2024-08-31T03:49:10.151 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T03:49:10.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T03:49:10.275 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} email: mchangir@redhat.com first_in_suite: false job_id: '7881260' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 global: ms die on skipped message: false mds: mds oft prefetch dirfrags: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5413 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 347/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBACEOXe4Br2Zadx0cKLXHqPU0eo+1PhkS1NgK8LST6mSrG41BL5da1YKo73ZtzJbKOESyga9GOPrpwNluEeGjLk= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6dnahY9oUwqZrhdK0miNsKJEr0lBY1mIMaIzlstjgXAB6kY2PZJLiUZZ9ggFWIqgVMVZpqS1YN4RuSSdX1Qsk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - quiescer: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_08:30:37 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-31T03:49:10.275 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-31T03:49:10.276 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-31T03:49:10.276 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T03:49:10.278 INFO:teuthology.task.internal:Checking packages... 2024-08-31T03:49:10.299 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-31T03:49:10.299 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T03:49:10.299 INFO:teuthology.packaging:ref: None 2024-08-31T03:49:10.299 INFO:teuthology.packaging:tag: None 2024-08-31T03:49:10.299 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T03:49:10.299 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T03:49:10.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T03:49:10.442 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560-gd19e6118-1jammy 2024-08-31T03:49:10.444 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T03:49:10.452 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T03:49:10.452 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T03:49:10.526 INFO:teuthology.task.internal:Saving configuration 2024-08-31T03:49:10.544 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T03:49:10.574 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T03:49:10.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 03:43:45.274837', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMFDpgT/u2ihhM4/zobX9K4eFRmDMpKoxq49BI6Vg9f4'} 2024-08-31T03:49:10.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 03:43:45.276389', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDupiGA/ryCw4RbcV7vIcHoaqaOxsmOHTK2EzqzQxYiX'} 2024-08-31T03:49:10.621 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T03:49:10.635 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-08-31T03:49:10.635 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-08-31T03:49:10.635 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T03:49:10.869 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd7f134bac0>, signals=[15]) 2024-08-31T03:49:10.869 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T03:49:10.875 INFO:teuthology.task.internal:Opening connections... 2024-08-31T03:49:10.875 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T03:49:10.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T03:49:10.958 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T03:49:10.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T03:49:11.039 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T03:49:11.051 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-08-31T03:49:11.056 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-08-31T03:49:11.056 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-08-31T03:49:11.101 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="22.04" 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=jammy 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-31T03:49:11.102 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-31T03:49:11.103 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=jammy 2024-08-31T03:49:11.103 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-08-31T03:49:11.120 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-08-31T03:49:11.124 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-08-31T03:49:11.124 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-08-31T03:49:11.172 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-31T03:49:11.172 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="22.04" 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=jammy 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-31T03:49:11.173 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=jammy 2024-08-31T03:49:11.174 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-08-31T03:49:11.203 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T03:49:11.217 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T03:49:11.293 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T03:49:11.293 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-08-31T03:49:11.296 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-08-31T03:49:11.301 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T03:49:11.338 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T03:49:11.338 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-08-31T03:49:11.343 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-08-31T03:49:11.356 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T03:49:11.403 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T03:49:11.423 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-31T03:49:11.423 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-08-31T03:49:11.424 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-08-31T03:49:11.424 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T03:49:11.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T03:49:11.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-08-31T03:49:11.619 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-31T03:49:11.619 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8ad8b8b160987a14eb199bb67cc00e23a08d43f6"... 2024-08-31T03:49:11.619 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-08-31T03:49:11.625 INFO:teuthology.orchestra.run.smithi089.stdout:5.15.0-56-generic 2024-08-31T03:49:11.625 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-31T03:49:11.626 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-31T03:49:11.626 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-08-31T03:49:11.626 DEBUG:teuthology.orchestra.run.smithi089:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-08-31T03:49:11.692 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-08-31T03:49:11.828 INFO:teuthology.orchestra.run.smithi089.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-31T03:49:11.828 INFO:teuthology.orchestra.run.smithi089.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-08-31T03:49:11.828 INFO:teuthology.orchestra.run.smithi089.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-08-31T03:49:11.828 INFO:teuthology.orchestra.run.smithi089.stderr:hint: 2024-08-31T03:49:11.828 INFO:teuthology.orchestra.run.smithi089.stderr:hint: git config --global init.defaultBranch 2024-08-31T03:49:11.828 INFO:teuthology.orchestra.run.smithi089.stderr:hint: 2024-08-31T03:49:11.829 INFO:teuthology.orchestra.run.smithi089.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-31T03:49:11.829 INFO:teuthology.orchestra.run.smithi089.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-08-31T03:49:11.829 INFO:teuthology.orchestra.run.smithi089.stderr:hint: 2024-08-31T03:49:11.829 INFO:teuthology.orchestra.run.smithi089.stderr:hint: git branch -m 2024-08-31T03:49:11.829 INFO:teuthology.orchestra.run.smithi089.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-08-31T03:49:11.832 DEBUG:teuthology.orchestra.run.smithi089:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-08-31T03:49:11.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-08-31T03:49:11.950 DEBUG:teuthology.orchestra.run.smithi089:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-08-31T03:49:33.077 INFO:teuthology.orchestra.run.smithi089.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-08-31T03:49:33.077 INFO:teuthology.orchestra.run.smithi089.stderr: * [new branch] main -> origin/main 2024-08-31T03:49:33.114 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190312 -> 20190312 2024-08-31T03:49:33.114 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190416 -> 20190416 2024-08-31T03:49:33.114 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190514 -> 20190514 2024-08-31T03:49:33.115 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190618 -> 20190618 2024-08-31T03:49:33.115 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190717 -> 20190717 2024-08-31T03:49:33.115 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190815 -> 20190815 2024-08-31T03:49:33.116 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190923 -> 20190923 2024-08-31T03:49:33.116 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20191022 -> 20191022 2024-08-31T03:49:33.116 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20191215 -> 20191215 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200122 -> 20200122 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200316 -> 20200316 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200421 -> 20200421 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200519 -> 20200519 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200619 -> 20200619 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200721 -> 20200721 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200817 -> 20200817 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200918 -> 20200918 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20201022 -> 20201022 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20201118 -> 20201118 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20201218 -> 20201218 2024-08-31T03:49:33.117 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210208 -> 20210208 2024-08-31T03:49:33.119 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210315 -> 20210315 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210511 -> 20210511 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210716 -> 20210716 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210818 -> 20210818 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210919 -> 20210919 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20211027 -> 20211027 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20211216 -> 20211216 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220209 -> 20220209 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220310 -> 20220310 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220411 -> 20220411 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220509 -> 20220509 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220610 -> 20220610 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220708 -> 20220708 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220815 -> 20220815 2024-08-31T03:49:33.120 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220913 -> 20220913 2024-08-31T03:49:33.121 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20221012 -> 20221012 2024-08-31T03:49:33.121 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20221109 -> 20221109 2024-08-31T03:49:33.121 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20221214 -> 20221214 2024-08-31T03:49:33.121 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230117 -> 20230117 2024-08-31T03:49:33.121 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230210 -> 20230210 2024-08-31T03:49:33.121 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230310 -> 20230310 2024-08-31T03:49:33.121 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230404 -> 20230404 2024-08-31T03:49:33.121 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230515 -> 20230515 2024-08-31T03:49:33.122 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230625 -> 20230625 2024-08-31T03:49:33.122 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230804 -> 20230804 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230919 -> 20230919 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20231030 -> 20231030 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20231111 -> 20231111 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20231211 -> 20231211 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20240115 -> 20240115 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20240220 -> 20240220 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20240312 -> 20240312 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20240410 -> 20240410 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20240513 -> 20240513 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20240610 -> 20240610 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20240709 -> 20240709 2024-08-31T03:49:33.123 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20240811 -> 20240811 2024-08-31T03:49:37.620 INFO:teuthology.orchestra.run.smithi089.stderr:Updating files: 44% (1558/3491) Updating files: 45% (1571/3491) Updating files: 46% (1606/3491) Updating files: 47% (1641/3491) Updating files: 48% (1676/3491) Updating files: 49% (1711/3491) Updating files: 50% (1746/3491) Updating files: 51% (1781/3491) Updating files: 52% (1816/3491) Updating files: 53% (1851/3491) Updating files: 54% (1886/3491) Updating files: 55% (1921/3491) Updating files: 56% (1955/3491) Updating files: 57% (1990/3491) Updating files: 58% (2025/3491) Updating files: 59% (2060/3491) Updating files: 59% (2065/3491) Updating files: 60% (2095/3491) Updating files: 61% (2130/3491) Updating files: 62% (2165/3491) Updating files: 63% (2200/3491) Updating files: 64% (2235/3491) Updating files: 65% (2270/3491) Updating files: 66% (2305/3491) Updating files: 67% (2339/3491) Updating files: 68% (2374/3491) Updating files: 69% (2409/3491) Updating files: 69% (2421/3491) Updating files: 70% (2444/3491) Updating files: 71% (2479/3491) Updating files: 72% (2514/3491) Updating files: 73% (2549/3491) Updating files: 74% (2584/3491) Updating files: 75% (2619/3491) Updating files: 76% (2654/3491) Updating files: 77% (2689/3491) Updating files: 78% (2723/3491) Updating files: 79% (2758/3491) Updating files: 80% (2793/3491) Updating files: 81% (2828/3491) Updating files: 82% (2863/3491) Updating files: 82% (2884/3491) Updating files: 83% (2898/3491) Updating files: 84% (2933/3491) Updating files: 85% (2968/3491) Updating files: 86% (3003/3491) Updating files: 87% (3038/3491) Updating files: 88% (3073/3491) Updating files: 89% (3107/3491) Updating files: 90% (3142/3491) Updating files: 91% (3177/3491) Updating files: 92% (3212/3491) Updating files: 93% (3247/3491) Updating files: 94% (3282/3491) Updating files: 95% (3317/3491) Updating files: 96% (3352/3491) Updating files: 97% (3387/3491) Updating files: 98% (3422/3491) Updating files: 99% (3457/3491) Updating files: 100% (3491/3491) Updating files: 100% (3491/3491), done. 2024-08-31T03:49:37.625 INFO:teuthology.orchestra.run.smithi089.stdout:HEAD is now at f4c18f9f Merge branch 'amd-staging' into 'main' 2024-08-31T03:49:37.648 INFO:teuthology.task.kernel:Downloading kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-08-31T03:49:37.648 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-31T03:49:37.807 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g8ad8b8b16098/ 2024-08-31T03:49:37.807 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g8ad8b8b16098_6.11.0-rc5-g8ad8b8b16098-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g8ad8b8b16098/ --input-file=- 2024-08-31T03:49:37.810 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi089.front.sepia.ceph.com to complete... 2024-08-31T03:49:38.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31 03:49:39 URL:https://2.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g8ad8b8b16098/linux-image-6.11.0-rc5-g8ad8b8b16098_6.11.0-rc5-g8ad8b8b16098-1_amd64.deb [45334904/45334904] -> "/tmp/linux-image.deb" [1] 2024-08-31T03:49:38.831 INFO:teuthology.orchestra.run.smithi089.stderr:FINISHED --2024-08-31 03:49:39-- 2024-08-31T03:49:38.831 INFO:teuthology.orchestra.run.smithi089.stderr:Total wall clock time: 1.0s 2024-08-31T03:49:38.831 INFO:teuthology.orchestra.run.smithi089.stderr:Downloaded: 1 files, 43M in 0.9s (49.4 MB/s) 2024-08-31T03:49:38.835 INFO:teuthology.task.kernel:Installing kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-08-31T03:49:38.835 DEBUG:teuthology.orchestra.run.smithi089:> sudo dpkg -i /tmp/linux-image.deb 2024-08-31T03:49:39.139 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g8ad8b8b16098. 2024-08-31T03:49:41.091 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-08-31T03:49:41.095 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-08-31T03:49:41.185 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-6.11.0-rc5-g8ad8b8b16098 (6.11.0-rc5-g8ad8b8b16098-1) ... 2024-08-31T03:49:44.998 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-6.11.0-rc5-g8ad8b8b16098 (6.11.0-rc5-g8ad8b8b16098-1) ... 2024-08-31T03:49:45.106 INFO:teuthology.orchestra.run.smithi089.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2024-08-31T03:50:07.421 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T03:50:07.440 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-08-31T03:50:07.755 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:07.769 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T03:50:08.079 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T03:50:08.138 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T03:50:08.143 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T03:50:08.284 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T03:50:08.284 INFO:teuthology.orchestra.run.smithi089.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T03:50:08.285 INFO:teuthology.orchestra.run.smithi089.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T03:50:08.333 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-08-31T03:50:08.515 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-deb -c /tmp/linux-image.deb 2024-08-31T03:50:08.522 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./ 2024-08-31T03:50:08.522 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./boot/ 2024-08-31T03:50:08.522 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7098725 2024-08-27 12:59 ./boot/System.map-6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:08.540 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 174121 2024-08-27 12:59 ./boot/config-6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:08.540 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13292544 2024-08-27 12:59 ./boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:08.565 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/ 2024-08-31T03:50:08.565 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/ 2024-08-31T03:50:08.565 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/postinst.d/ 2024-08-31T03:50:08.565 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/postrm.d/ 2024-08-31T03:50:08.565 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/preinst.d/ 2024-08-31T03:50:08.565 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./etc/kernel/prerm.d/ 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/ 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/ 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/ 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/ 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/ 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/ 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/ 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 189809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/aesni-intel.ko 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-31T03:50:08.566 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 109985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 155337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-31T03:50:08.567 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/ 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/ 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce/ 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpuid.ko 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/msr.ko 2024-08-31T03:50:08.568 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/ 2024-08-31T03:50:08.569 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 505169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-31T03:50:08.569 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1060585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-31T03:50:08.569 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2858865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm.ko 2024-08-31T03:50:08.589 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ 2024-08-31T03:50:08.589 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/af_alg.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/algif_hash.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/algif_skcipher.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ansi_cprng.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/anubis.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/arc4.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/asymmetric_keys/ 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/ 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_memcpy.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_pq.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-31T03:50:08.590 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_tx.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_xor.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/raid6test.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authenc.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authencesn.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blake2b_generic.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_common.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_generic.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/camellia_generic.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast5_generic.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast6_generic.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast_common.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ccm.ko 2024-08-31T03:50:08.591 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cmac.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crc32_generic.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cryptd.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_engine.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_simd.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_user.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cts.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/des_generic.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/dh_generic.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/echainiv.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/essiv.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/fcrypt.ko 2024-08-31T03:50:08.592 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/khazad.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lrw.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4hc.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/md4.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/michael_mic.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcbc.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcrypt.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/rmd160.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/seed.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/serpent_generic.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 169521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tcrypt.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tea.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_common.ko 2024-08-31T03:50:08.593 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_generic.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/vmac.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/wp512.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xcbc.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xor.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xts.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xxhash_generic.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/ 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_extlog.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_pad.ko 2024-08-31T03:50:08.594 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/apei/ 2024-08-31T03:50:08.595 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/apei/einj.ko 2024-08-31T03:50:08.595 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/ec_sys.ko 2024-08-31T03:50:08.595 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/platform_profile.ko 2024-08-31T03:50:08.595 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbs.ko 2024-08-31T03:50:08.595 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbshc.ko 2024-08-31T03:50:08.595 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 120321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/video.ko 2024-08-31T03:50:08.595 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/acard-ahci.ko 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ahci.ko 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ahci_platform.ko 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 105105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/libahci.ko 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/libahci_platform.ko 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_acpi.ko 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ali.ko 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_amd.ko 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_artop.ko 2024-08-31T03:50:08.596 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atiixp.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atp867x.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd640.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd64x.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cypress.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_efar.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt366.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt37x.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it8213.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it821x.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_jmicron.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_legacy.ko 2024-08-31T03:50:08.597 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_marvell.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_mpiix.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_netcell.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ninja32.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87410.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87415.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_oldpiix.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_opti.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_optidma.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pcmcia.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_piccolo.ko 2024-08-31T03:50:08.598 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_radisys.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_rdc.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_rz1000.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sch.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_serverworks.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sil680.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sl82c105.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_triflex.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_via.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pdc_adma.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_inic162x.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_mv.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_nv.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_promise.ko 2024-08-31T03:50:08.599 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_qstor.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil24.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sis.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_svw.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sx4.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_uli.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_via.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_vsc.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay/ 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay/ks0108.ko 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma/ 2024-08-31T03:50:08.600 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 161225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma/bcma.ko 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/ 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe/ 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 141025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe/aoe.ko 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd/ 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1240825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd/drbd.ko 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 203657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/floppy.ko 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx/ 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 115057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 143337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/nbd.ko 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk/ 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 133345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk/null_blk.ko 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/pktcdvd.ko 2024-08-31T03:50:08.601 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 312817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/rbd.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback/ 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 117753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram/ 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram/zram.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/applicom.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hangcheck-timer.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/ 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/via-rng.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-31T03:50:08.602 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 183745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 179465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/lp.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave/ 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 103521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave/mwave.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/nvram.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ppdev.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tlclk.ko 2024-08-31T03:50:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/ 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/xillybus/ 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/xillybus/xillybus_class.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/xillybus/xillybus_core.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/ 2024-08-31T03:50:08.604 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/clk-palmas.ko 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/clk-si5351.ko 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/clk-twl6040.ko 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/clk/clk-wm831x.ko 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/ 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 334505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp.ko 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/ 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/ 2024-08-31T03:50:08.605 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common/ 2024-08-31T03:50:08.606 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 833113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-31T03:50:08.658 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-aes.ko 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-sha.ko 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio/ 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca/ 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca/dca.ko 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw/ 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-31T03:50:08.659 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat/ 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 147345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/ 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/amd64_edac.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/e752x_edac.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/edac_mce_amd.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3000_edac.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3200_edac.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5100_edac.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5400_edac.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7300_edac.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7core_edac.ko 2024-08-31T03:50:08.660 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i82975x_edac.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/ie31200_edac.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/sb_edac.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/x38_edac.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/ 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-gpio.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-max14577.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-max77693.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-max8997.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-palmas.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-rt8973a.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/extcon/extcon-sm5502.ko 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/ 2024-08-31T03:50:08.661 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/dmi-sysfs.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/efi/ 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/efi/efi-pstore.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/ 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-adp5520.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-amd8111.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-arizona.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-da9052.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-da9055.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-dln2.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-f7188x.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-generic.ko 2024-08-31T03:50:08.662 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-ich.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-kempld.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-lp3943.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-max7300.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-max730x.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-max732x.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-pca953x.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-pcf857x.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-rdc321x.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-sch.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-sch311x.ko 2024-08-31T03:50:08.663 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-tps65912.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-twl4030.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-twl6040.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-vx855.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-wm831x.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-wm8350.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-wm8994.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/ 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-a4tech.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-apple.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-appleir.ko 2024-08-31T03:50:08.664 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-aureal.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-axff.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-belkin.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-cherry.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-chicony.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-cp2112.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-cypress.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-dr.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elecom.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elo.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-emsff.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ezkey.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gaff.ko 2024-08-31T03:50:08.665 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-generic.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gt683r.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gyration.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtekff.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-hyperv.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-icade.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-kensington.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-keytouch.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-kye.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lcpower.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-led.ko 2024-08-31T03:50:08.666 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lenovo.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lg-g15.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 98177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-magicmouse.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-microsoft.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-monterey.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-multitouch.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ntrig.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ortek.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-penmount.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-petalynx.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-picolcd.ko 2024-08-31T03:50:08.667 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-pl.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-plantronics.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-primax.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-rmi.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-common.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-31T03:50:08.668 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-saitek.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-samsung.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sjoy.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sony.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-speedlink.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-steelseries.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sunplus.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tivo.ko 2024-08-31T03:50:08.669 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tmff.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-topseed.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-twinhan.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-uclogic.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-waltop.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 184865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-wiimote.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-xinmo.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zpff.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zydacron.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 462849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/uhid.ko 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/usbhid/ 2024-08-31T03:50:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 153953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/usbhid/usbhid.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/usbhid/usbkbd.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/usbhid/usbmouse.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 261241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/wacom.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/ 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_balloon.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 96073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_utils.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 378337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_vmbus.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru3.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7414.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7418.ko 2024-08-31T03:50:08.671 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adc128d818.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1025.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 115201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1026.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1029.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1031.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm9240.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ads7828.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7410.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7411.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7462.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7470.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7475.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7x10.ko 2024-08-31T03:50:08.672 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/amc6821.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/applesmc.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asb100.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asc7621.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/atxp1.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/coretemp.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/da9052-hwmon.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/da9055-hwmon.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dme1737.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds1621.ko 2024-08-31T03:50:08.673 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds620.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc1403.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc2103.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc6w201.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71805f.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 109049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71882fg.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f75375s.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fam15h_power.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fschmd.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g760a.ko 2024-08-31T03:50:08.674 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g762.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl518sm.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl520sm.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/hih6130.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5500_temp.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5k_amb.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmaem.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmpex.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina209.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina2xx.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 150681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/it87.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/jc42.ko 2024-08-31T03:50:08.675 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k10temp.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k8temp.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lineage-pem.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm63.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm73.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm75.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm77.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm78.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm80.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm83.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm85.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm87.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm90.ko 2024-08-31T03:50:08.676 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm92.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 131585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm93.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95234.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95241.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95245.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc2945.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4151.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4215.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4222.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4245.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4260.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4261.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max16065.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1619.ko 2024-08-31T03:50:08.677 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1668.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max197.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6639.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6650.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6697.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/mc13783-adc.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/mcp3021.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6683.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 140657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775-core.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct7802.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87360.ko 2024-08-31T03:50:08.678 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87427.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pcf8591.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 98961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-31T03:50:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/powr1220.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5627.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5636.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht15.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht21.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/shtc1.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sis5595.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47b397.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m1.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m192.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/thmc50.ko 2024-08-31T03:50:08.680 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp102.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp103.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp401.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp421.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via-cputemp.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via686a.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt1211.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt8231.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627ehf.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 96665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627hf.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83781d.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83791d.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83792d.ko 2024-08-31T03:50:08.681 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 116873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83793.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 134513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83795.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l785ts.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l786ng.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/ 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/ 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/ 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-08-31T03:50:08.682 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-08-31T03:50:08.683 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-08-31T03:50:08.684 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-mux.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-smbus.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-stub.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/muxes/ 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-08-31T03:50:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 328633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1107329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_core.ko 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 84409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 404889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 120105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 343753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/ 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4/ 2024-08-31T03:50:08.686 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 591177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4/ 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 515585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5/ 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 919921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca/ 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 375761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/ocrdma/ 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 203241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/usnic/ 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 212353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib/ 2024-08-31T03:50:08.687 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 334665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-31T03:50:08.688 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser/ 2024-08-31T03:50:08.688 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 120785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-31T03:50:08.688 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert/ 2024-08-31T03:50:08.688 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 132457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-31T03:50:08.688 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp/ 2024-08-31T03:50:08.688 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 158257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-31T03:50:08.688 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt/ 2024-08-31T03:50:08.688 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 157209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-31T03:50:08.688 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/ 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/evbug.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/ff-memless.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/ 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/gameport.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/joydev.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/ 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-08-31T03:50:08.689 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/lkkbd.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/lm8323.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/lm8333.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/newtonkbd.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/qt1070.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/qt2160.ko 2024-08-31T03:50:08.690 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/stowaway.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/sunkbd.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/xtkbd.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/matrix-keymap.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/ 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/appletouch.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/bcm5974.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 160569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/cyapatp.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 114801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/gpio_mouse.ko 2024-08-31T03:50:08.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 430033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/psmouse.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/sermouse.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4/ 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 139497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/ 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/altera_ps2.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/arc_ps2.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/ct82c710.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/parkbd.ko 2024-08-31T03:50:08.692 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/pcips2.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/ps2mult.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/serio_raw.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/serport.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/sparse-keymap.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/ 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-88pm860x.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-adp5520.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-bd2802.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-blinkm.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-da903x.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-da9052.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-gpio.ko 2024-08-31T03:50:08.693 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3530.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3533.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm355x.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3642.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lp3944.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lp8788.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-max8997.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-mc13783.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-menf21bmc.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-pca9532.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-pca955x.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-pca963x.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-ss4200.ko 2024-08-31T03:50:08.694 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-tca6507.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-wm831x-status.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-wm8350.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/ 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache/ 2024-08-31T03:50:08.695 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 776777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache/bcache.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-bio-prison.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-bufio.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache-smq.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 197121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 137841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-crypt.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-delay.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-era.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-flakey.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-log-userspace.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-log.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-mirror.ko 2024-08-31T03:50:08.696 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 96937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-multipath.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-queue-length.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-raid.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-region-hash.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-round-robin.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-service-time.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 139257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-snapshot.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-switch.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 234353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-thin-pool.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-verity.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-zero.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data/ 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 257025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid0.ko 2024-08-31T03:50:08.697 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid1.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 157401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid10.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 443385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid456.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/ 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/ 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 211273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptbase.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptctl.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptfc.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptlan.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 150977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptsas.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptscsih.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptspi.ko 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/ 2024-08-31T03:50:08.698 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/88pm800.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/88pm805.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/88pm80x.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/arizona-i2c.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 146569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/arizona.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/bcm590xx.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/cros_ec_dev.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/dln2.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/janz-cmodio.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/kempld-core.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lm3533-core.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lp3943.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_ich.ko 2024-08-31T03:50:08.699 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_sch.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/max8907.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/mc13xxx-core.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/menf21bmc.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/pcf50633-adc.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/pcf50633-gpio.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/pcf50633.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/retu-mfd.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 95625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/si476x-core.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/sm501.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/tps65010.ko 2024-08-31T03:50:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/tps6507x.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/viperboard.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/vx855.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/wl1273-core.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/wm8994.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ad525x_dpot.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl/ 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds9802als.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds990x.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/bh1770glc.ko 2024-08-31T03:50:08.701 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/c2port/ 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/c2port/core.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710/ 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710/cb710.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ds1682.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/dummy-irq.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/echo/ 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/echo/echo.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/ 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/at24.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/max6875.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/enclosure.ko 2024-08-31T03:50:08.702 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/genwqe/ 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 191761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/hmc6352.ko 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/hpilo.ko 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ibmasm/ 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 92489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ics932s401.ko 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29003.ko 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29020.ko 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/ 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/ 2024-08-31T03:50:08.703 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 153777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-me.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-txe.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 381905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/phantom.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ti-st/ 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/ti-st/st_drv.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_7xx1.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_core.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tsl2550.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_balloon.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci/ 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 232257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ 2024-08-31T03:50:08.704 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding/ 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 623361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding/bonding.ko 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/ 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53/ 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 133161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx/ 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 592833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dummy.ko 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/eql.ko 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/ 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-31T03:50:08.705 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 158537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/ 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 109673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec/ 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere/ 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 84433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon/ 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-31T03:50:08.706 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera/ 2024-08-31T03:50:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-31T03:50:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/ 2024-08-31T03:50:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-31T03:50:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-31T03:50:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 116105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-31T03:50:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/ 2024-08-31T03:50:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx/ 2024-08-31T03:50:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-31T03:50:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 128625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 110505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/ 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/ 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 229409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1734265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 166913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-31T03:50:08.708 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet/ 2024-08-31T03:50:08.709 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 164665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-31T03:50:08.709 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 439633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-31T03:50:08.709 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/ 2024-08-31T03:50:08.709 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna/ 2024-08-31T03:50:08.709 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 432417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-31T03:50:08.744 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/ 2024-08-31T03:50:08.744 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-08-31T03:50:08.744 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 257433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-31T03:50:08.744 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-08-31T03:50:08.744 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 444721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-31T03:50:08.744 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-08-31T03:50:08.744 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1309441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-31T03:50:08.744 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 207073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/ 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic/ 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 269777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/ 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/ 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 169313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-31T03:50:08.745 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/ 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dnet.ko 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ec_bhf.ko 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/ 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet/ 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 356153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ethoc.ko 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fealnx.ko 2024-08-31T03:50:08.746 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fujitsu/ 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 115697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000/ 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 366465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e/ 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 755425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k/ 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 324721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e/ 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1193705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf/ 2024-08-31T03:50:08.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 356609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb/ 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 672177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf/ 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 121609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 966193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 193889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth/ 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie/ 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 5969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-31T03:50:08.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 109353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/jme.ko 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/ 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 127057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 151049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/ 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 888945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 346977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1408481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ 2024-08-31T03:50:08.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 117585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/ 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 131601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/ 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion/ 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 181409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia/ 2024-08-31T03:50:08.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 171649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/ 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/ 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 301017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 105857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 885465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc/ 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/ 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-31T03:50:08.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 264393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/samsung/ 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 142481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc/ 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1346017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan/ 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/ 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/ 2024-08-31T03:50:08.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/ 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 644913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/ 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 129089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 208177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-31T03:50:08.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 82033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti/ 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti/ 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 110881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/ 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 98993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/ 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom/ 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-31T03:50:08.754 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/fddi/ 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/fddi/defxx.ko 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/fddi/skfp/ 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 275889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/fddi/skfp/skfp.ko 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/geneve.ko 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv/ 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 290697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154/ 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ifb.ko 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan/ 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 107849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvlan.ko 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvtap.ko 2024-08-31T03:50:08.755 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/ 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-gpio.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mii.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/netconsole.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/nlmon.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/ 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/ 2024-08-31T03:50:08.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/amd.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm87xx.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/broadcom.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/cicada.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/davicom.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/et1011c.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/icplus.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/lxt.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/marvell.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/micrel.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/national.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 118505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/phylink.ko 2024-08-31T03:50:08.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/qsemi.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/realtek.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/smsc.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/ste10Xp.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/vitesse.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/plip/ 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/plip/plip.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_async.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-31T03:50:08.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppoe.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppox.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pptp.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/ 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slip.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/sungem_phy.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tap.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/ 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 136729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_random.ko 2024-08-31T03:50:08.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/veth.ko 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3/ 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 179329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan/ 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 384193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan/vxlan.ko 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback/ 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 175857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb/ 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb/ntb.ko 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/ 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/ 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 337697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme-core.ko 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 128353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme.ko 2024-08-31T03:50:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/ 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 164153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_cs.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 103657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_pc.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_serial.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/ 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/ 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pci-stub.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/xen-pcifront.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/ 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/i82092.ko 2024-08-31T03:50:08.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 177817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pcmcia.ko 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pcmcia_core.ko 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pd6729.ko 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 133969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/ 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/broadcom/ 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/samsung/ 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/ 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel/ 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-31T03:50:08.762 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/ 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/ 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/ 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 88017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acerhdf.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-31T03:50:08.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 172313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/hdaps.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/ibm_rtl.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/ 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-08-31T03:50:08.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel_ips.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi.ko 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/ 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ 2024-08-31T03:50:08.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/88pm860x_battery.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/88pm860x_charger.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/bq2415x_charger.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/bq24190_charger.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/bq24735-charger.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/cros_charge-control.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/da9030_battery.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/da9052-battery.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ds2760_battery.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ds2780_battery.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ds2781_battery.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/ds2782_battery.ko 2024-08-31T03:50:08.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/gpio-charger.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/isp1704_charger.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/lp8727_charger.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/max14577_charger.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/max17042_battery.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/max8903_charger.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/max8925_power.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/pcf50633-charger.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/sbs-battery.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/test_power.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/tps65090-charger.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/wm831x_backup.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/wm831x_power.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/power/supply/wm8350_power.ko 2024-08-31T03:50:08.767 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/ 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 98737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/ 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/ 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps_parport.ko 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/pps_core.ko 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp.ko 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp_kvm.ko 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/ 2024-08-31T03:50:08.768 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/ 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl/ 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/fmpm.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/ 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-88pm80x.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-88pm860x.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-da9052.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-da9055.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-da9063.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 82585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-31T03:50:08.769 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-em3027.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-lp8788.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-31T03:50:08.770 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t86.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max6900.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max8907.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max8925.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max8997.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max8998.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-palmas.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf50633.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-31T03:50:08.771 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rc5t583.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-s35390a.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-tps6586x.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-tps65910.ko 2024-08-31T03:50:08.772 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-wm831x.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-wm8350.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-x1205.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-9xxx.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-sas.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-xxxx.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 164753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/BusLogic.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/a100u2w.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid/ 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 341105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 120833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/advansys.ko 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/ 2024-08-31T03:50:08.773 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 468305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 380857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic94xx/ 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 244049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/am53c974.ko 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr/ 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 135801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/atp870u.ko 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi/ 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 305161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa/ 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1526289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa/bfa.ko 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc/ 2024-08-31T03:50:08.774 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 298321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i/ 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 144553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ch.ko 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor/ 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 390817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/ 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 117561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 168361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dc395x.ko 2024-08-31T03:50:08.775 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dmx3191d.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r/ 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 267737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esp_scsi.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/ 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 95553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 191041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fdomain.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic/ 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 366737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic/fnic.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 251641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hpsa.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hptiop.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hv_storvsc.ko 2024-08-31T03:50:08.776 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/imm.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/initio.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 327841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ipr.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 129881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ips.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci/ 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 398505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci/isci.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc/ 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 380649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc/libfc.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 172833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas/ 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 274913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas/libsas.ko 2024-08-31T03:50:08.777 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc/ 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2737441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/ 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 88625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 388737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 105177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid.ko 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas/ 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 833969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas/ 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 158857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 96697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvumi.ko 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/ 2024-08-31T03:50:08.778 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001/ 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 444273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 152097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pmcraid.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ppa.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla1280.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/ 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2323537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 103793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx/ 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 697393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-31T03:50:08.779 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qlogicfas408.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/raid_class.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 331577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_debug.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 219497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 349593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 121777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 92385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ses.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 138265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/st.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/stex.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2/ 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 205137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-31T03:50:08.780 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/virtio_scsi.ko 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/wd719x.ko 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/xen-scsifront.ko 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb/ 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 172697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb/ssb.ko 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/ 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi/ 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 915121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback/ 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_file.ko 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_iblock.ko 2024-08-31T03:50:08.781 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1161521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_mod.ko 2024-08-31T03:50:08.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_pscsi.ko 2024-08-31T03:50:08.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 149801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_user.ko 2024-08-31T03:50:08.817 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc/ 2024-08-31T03:50:08.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-31T03:50:08.817 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/ 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/ 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/ 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-31T03:50:08.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless/ 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 99417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/moxa.ko 2024-08-31T03:50:08.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/mxser.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 134633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_gsm.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_hdlc.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/nozomi.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/ 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/ 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/altera_uart.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/arc_uart.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-08-31T03:50:08.820 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm/ 2024-08-31T03:50:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 121249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-31T03:50:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/rp2.ko 2024-08-31T03:50:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/sc16is7xx.ko 2024-08-31T03:50:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-08-31T03:50:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/ 2024-08-31T03:50:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core/ 2024-08-31T03:50:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 689289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-31T03:50:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ 2024-08-31T03:50:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/ 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_aec.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_cif.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_dmem_genirq.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_mf624.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_netx.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_pci_generic.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-08-31T03:50:08.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_sercos3.ko 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/ 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/c67x00/ 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/c67x00/c67x00.ko 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 187689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/ 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-acm.ko 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-31T03:50:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usblp.ko 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 107633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usbtmc.ko 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/common/ 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/common/ulpi.ko 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc2/ 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc3/ 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 576329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/dwc3/dwc3.ko 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/ 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/ 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/u_ether.ko 2024-08-31T03:50:08.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/u_serial.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 132897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 142801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 99913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-08-31T03:50:08.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/ 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-08-31T03:50:08.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 200137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/libcomposite.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/ 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/bdc/ 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 182665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/net2272.ko 2024-08-31T03:50:08.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/net2280.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 191281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/ 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/bcma-hcd.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/isp116x-hcd.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 104817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/sl811_cs.ko 2024-08-31T03:50:08.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/ssb-hcd.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/ 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/mdc800.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/microtek.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/adutux.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/appledisplay.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/cytherm.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ehset.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi26.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi62.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ezusb.ko 2024-08-31T03:50:08.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/idmouse.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/iowarrior.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ldusb.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/legousbtower.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/lvstest.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga/ 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usb3503.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usblcd.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 84369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usbtest.ko 2024-08-31T03:50:08.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/uss720.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/yurex.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/mon/ 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/mon/usbmon.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/musb/ 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 391209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/musb/musb_hdrc.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/ 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-generic.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-isp1301.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-tahvo.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/aircable.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ark3116.ko 2024-08-31T03:50:08.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ch341.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cp210x.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cyberjack.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/empeg.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/f81232.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 188729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 152409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 142937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_ti.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipaq.ko 2024-08-31T03:50:08.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipw.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ir-usb.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mct_u232.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/metro-usb.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7720.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7840.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mxuport.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/navman.ko 2024-08-31T03:50:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/omninet.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/opticon.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 201257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/option.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/oti6858.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/pl2303.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcaux.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcserial.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/quatech2.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/safe_serial.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/sierra.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ssu100.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/symbolserial.ko 2024-08-31T03:50:08.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_debug.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 148729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usbserial.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/visor.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/whiteheat.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/wishbone-serial.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/uas.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-31T03:50:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-karma.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22681 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 201057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/usb-storage.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/ 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-31T03:50:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-31T03:50:08.840 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/ 2024-08-31T03:50:08.840 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/ 2024-08-31T03:50:08.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 196977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-31T03:50:08.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33737 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-31T03:50:08.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 134401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio.ko 2024-08-31T03:50:08.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 93481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-31T03:50:08.840 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/ 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 135241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost.ko 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_net.ko 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 110185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_scsi.ko 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/ 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/ 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/aat2870_bl.ko 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/adp5520_bl.ko 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/adp8860_bl.ko 2024-08-31T03:50:08.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/adp8870_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/apple_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/as3711_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/bd6107.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/da903x_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/da9052_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/gpio_backlight.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/kb3886_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lcd.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lm3533_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lm3639_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lv5207lp.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/max8925_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/pandora_bl.ko 2024-08-31T03:50:08.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/wm831x_bl.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/ 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2482.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2490.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/matrox_w1.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/w1-gpio.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/ 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-31T03:50:08.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 127601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/wire.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/acquirewdt.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/advantechwdt.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-31T03:50:08.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/cpu5wdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/da9052_wdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/da9055_wdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/da9063_wdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/dw_wdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/eurotechwdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/hpwdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/i6300esb.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ib700wdt.ko 2024-08-31T03:50:08.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ibmasr.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it87_wdt.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/kempld_wdt.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/machzwd.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/mena21_wdt.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/nv_tco.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pc87413_wdt.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-31T03:50:08.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/retu_wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sc1200wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/softdog.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/twl4030_wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/via_wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-31T03:50:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wafer5823wdt.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wdt_pci.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wm831x_wdt.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wm8350_wdt.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/xen_wdt.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/ 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-evtchn.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntalloc.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntdev.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback/ 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 214065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-privcmd.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-scsiback.ko 2024-08-31T03:50:08.848 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs/ 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p/ 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 195161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p/9p.ko 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/adfs/ 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/adfs/adfs.ko 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs/ 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 197849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs/affs.ko 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/afs/ 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1259073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/afs/kafs.ko 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/autofs/ 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 127665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/autofs/autofs4.ko 2024-08-31T03:50:08.849 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs/ 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs/befs.ko 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/bfs/ 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/bfs/bfs.ko 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/binfmt_misc.ko 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs/ 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 4575041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs/btrfs.ko 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles/ 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 384329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles/cachefiles.ko 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph/ 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1591857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph/ceph.ko 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda/ 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 130593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda/coda.ko 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/configfs/ 2024-08-31T03:50:08.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 137313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/configfs/configfs.ko 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs/ 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs/cramfs.ko 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm/ 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 841817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm/dlm.ko 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/efs/ 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/efs/efs.ko 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs/ 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1901633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs/f2fs.ko 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/ 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/msdos.ko 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/freevxfs/ 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/freevxfs/freevxfs.ko 2024-08-31T03:50:08.851 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/ 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/cuse.ko 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2/ 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1488329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2/gfs2.ko 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs/ 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 183553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs/hfs.ko 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus/ 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 282177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus/hfsplus.ko 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hpfs/ 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 248625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hpfs/hpfs.ko 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs/ 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 93513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs/isofs.ko 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs/ 2024-08-31T03:50:08.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 529833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs/jfs.ko 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd/ 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 359969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd/lockd.ko 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix/ 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix/minix.ko 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs/ 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 646793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs/netfs.ko 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/ 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout/ 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 111585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout/ 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout/ 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 147553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-31T03:50:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1291361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfs.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv2.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 152537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv3.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2526953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv4.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/ 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/grace.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/nfs_acl.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd/ 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2119673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd/nfsd.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2/ 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 734385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2/nilfs2.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/ 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-celtic.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-centeuro.ko 2024-08-31T03:50:08.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-croatian.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-cyrillic.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-gaelic.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-greek.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-iceland.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-inuit.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-roman.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-romanian.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-turkish.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_ascii.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1250.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1251.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1255.ko 2024-08-31T03:50:08.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp737.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp775.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp850.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp852.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp855.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp857.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp860.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp861.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp862.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp863.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp864.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp865.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp866.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp869.ko 2024-08-31T03:50:08.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp874.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 95761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp932.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 144409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp936.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 167273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp949.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp950.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_euc-jp.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-1.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-13.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-14.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13313 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-15.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-2.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-3.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-4.ko 2024-08-31T03:50:08.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-5.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-6.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-7.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-9.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-r.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-ru.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-u.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_utf8.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ntfs3/ 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 632217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ntfs3/ntfs3.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster/ 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 299761 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-31T03:50:08.858 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm/ 2024-08-31T03:50:08.859 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 547233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-31T03:50:08.859 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs/ 2024-08-31T03:50:08.859 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-31T03:50:08.859 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 3255305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2.ko 2024-08-31T03:50:08.897 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/omfs/ 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/omfs/omfs.ko 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs/ 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 468161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs/overlay.ko 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore/ 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore/ramoops.ko 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/qnx4/ 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/qnx4/qnx4.ko 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/qnx6/ 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/qnx6/qnx6.ko 2024-08-31T03:50:08.898 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/quota/ 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/quota/quota_tree.ko 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/quota/quota_v1.ko 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/quota/quota_v2.ko 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs/ 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 684489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs/reiserfs.ko 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs/ 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs/romfs.ko 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/ 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client/ 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 3333977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client/cifs.ko 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/ 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_arc4.ko 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_md4.ko 2024-08-31T03:50:08.899 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs/ 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 163081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs/squashfs.ko 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv/ 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 116065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv/sysv.ko 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf/ 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 309513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf/udf.ko 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs/ 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 198129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs/ufs.ko 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs/ 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 5454809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs/xfs.ko 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/ 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/locking/ 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/locking/locktorture.ko 2024-08-31T03:50:08.900 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/time/ 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/time/test_udelay.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/torture.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc-itu-t.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc7.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc8.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/ 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libarc4.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libdes.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/interval_tree_test.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/libcrc32c.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lru_cache.ko 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/ 2024-08-31T03:50:08.901 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4_compress.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4hc_compress.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math/ 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math/cordic.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/memory-notifier-error-inject.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/notifier-error-inject.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/percpu_test.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/pm-notifier-error-inject.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6/ 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 151073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6/raid6_pq.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/rbtree_test.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon/ 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20897 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/test-kstrtox.ko 2024-08-31T03:50:08.902 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 4912673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/test_bpf.ko 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/test_firmware.ko 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/test_module.ko 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_bm.ko 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_fsm.ko 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_kmp.ko 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/xz/ 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/xz/xz_dec_test.ko 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm/ 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm/hwpoison-inject.ko 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/ 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/6lowpan.ko 2024-08-31T03:50:08.903 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_dest.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_fragment.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_hop.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_mobility.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_routing.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_udp.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/ 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/garp.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/mrp.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/p8022.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/psnap.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/stp.ko 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q/ 2024-08-31T03:50:08.904 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106841 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q/8021q.ko 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/ 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 234745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet.ko 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_fd.ko 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_rdma.ko 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_virtio.ko 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv/ 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 875441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv/batman-adv.ko 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/ 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 88073 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/br_netfilter.ko 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1026825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/bridge.ko 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-31T03:50:08.905 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11233 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9657 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-31T03:50:08.906 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtables.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph/ 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1229873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph/libceph.ko 2024-08-31T03:50:08.907 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/ 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 154121 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/pktgen.ko 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/ 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 239393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp.ko 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10353 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_diag.ko 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv4.ko 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv6.ko 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/ 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 498249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/dsa_core.ko 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_brcm.ko 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_dsa.ko 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_none.ko 2024-08-31T03:50:08.908 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_trailer.ko 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/hsr/ 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 137945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/hsr/hsr.ko 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan/ 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 356385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154.ko 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29169 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ah4.ko 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/esp4.ko 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/fou.ko 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/gre.ko 2024-08-31T03:50:08.909 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/inet_diag.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_gre.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_tunnel.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_vti.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipcomp.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipip.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ip_tables.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16441 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-31T03:50:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-31T03:50:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_bic.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_dctcp.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_diag.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_highspeed.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_htcp.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_hybla.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_illinois.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11825 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_lp.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_scalable.ko 2024-08-31T03:50:08.912 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_vegas.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_veno.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_westwood.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_yeah.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tunnel4.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_diag.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53401 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_tunnel.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ah6.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/esp6.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17201 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/fou6.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_gre.ko 2024-08-31T03:50:08.913 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 117649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_tunnel.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_vti.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ipcomp6.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/mip6.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-31T03:50:08.914 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17537 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10617 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-31T03:50:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11185 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/sit.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/tunnel6.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key/ 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106217 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key/af_key.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/ 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 155593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_core.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_eth.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip.ko 2024-08-31T03:50:08.916 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip6.ko 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_netlink.ko 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ppp.ko 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/lapb/ 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/lapb/lapb.ko 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/ 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/llc.ko 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 333641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/llc2.ko 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154/ 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 388577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154/mac802154.ko 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls/ 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls/mpls_gso.ko 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ 2024-08-31T03:50:08.917 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 144881 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124137 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 126777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 126577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 137937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 133785 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 139177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 138369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-31T03:50:08.918 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 136281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 140001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 532393 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-31T03:50:08.919 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conncount.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 485769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37729 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 134177 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 140921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-31T03:50:08.920 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19025 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10993 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46193 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_log_syslog.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 115817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13433 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_irc.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_sip.ko 2024-08-31T03:50:08.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 813705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_tables.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36049 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_log.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26129 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_chain_nat.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_compat.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_ct.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fib.ko 2024-08-31T03:50:08.922 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17329 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_hash.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25385 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_limit.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18017 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_log.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_masq.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_nat.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_numgen.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_osf.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_queue.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_redir.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject_inet.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15145 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_socket.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25081 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_synproxy.ko 2024-08-31T03:50:08.923 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17721 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_tproxy.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 104257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/x_tables.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14281 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_AUDIT.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CT.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_DSCP.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HL.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HMARK.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45305 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16033 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LED.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LOG.ko 2024-08-31T03:50:08.924 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NETMAP.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10937 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFLOG.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22809 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_RATEEST.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12633 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16777 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_SECMARK.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11849 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TEE.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TPROXY.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TRACE.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15377 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_addrtype.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16665 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_bpf.ko 2024-08-31T03:50:08.925 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cgroup.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12953 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cluster.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_comment.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12041 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connbytes.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13113 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlabel.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10705 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlimit.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connmark.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_conntrack.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cpu.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12585 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dccp.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_devgroup.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10345 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dscp.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ecn.ko 2024-08-31T03:50:08.926 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_esp.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hashlimit.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_helper.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hl.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipcomp.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_iprange.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13497 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipvs.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_l2tp.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9225 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_length.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11609 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_limit.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mac.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mark.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_multiport.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16249 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nat.ko 2024-08-31T03:50:08.927 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nfacct.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_osf.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11649 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_owner.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_physdev.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_pkttype.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13641 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_policy.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_quota.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_rateest.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9361 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_realm.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43569 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_recent.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_sctp.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_set.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_socket.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10833 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_state.ko 2024-08-31T03:50:08.928 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10945 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_statistic.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10105 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_string.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9673 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_tcpmss.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_tcpudp.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_time.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_u32.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink/ 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17321 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink/netlink_diag.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh/ 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh/nsh.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/ 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 485961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/openvswitch.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-geneve.ko 2024-08-31T03:50:08.929 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10961 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-gre.ko 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-vxlan.ko 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet/ 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet/af_packet_diag.ko 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/phonet/ 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 141545 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/phonet/phonet.ko 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/phonet/pn_pep.ko 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/ 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 314473 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds.ko 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 202161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_rdma.ko 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85265 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_tcp.ko 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rxrpc/ 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1024009 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rxrpc/rxrpc.ko 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/ 2024-08-31T03:50:08.930 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39097 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_csum.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28817 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_gact.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45505 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_mirred.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_nat.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_pedit.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38801 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_police.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24057 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_simple.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43513 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_skbedit.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45769 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_vlan.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32289 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_basic.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41561 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_bpf.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_cgroup.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37409 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_flow.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39697 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_fw.ko 2024-08-31T03:50:08.931 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49417 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_route.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79257 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_u32.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8793 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_cmp.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15481 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_ipset.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_meta.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_nbyte.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13465 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_text.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_u32.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25921 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_choke.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25209 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_codel.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43577 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_drr.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43865 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_fq.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_fq_codel.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_gred.ko 2024-08-31T03:50:08.932 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60913 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hfsc.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hhf.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81065 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_htb.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33745 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_ingress.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36713 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11905 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio_lib.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33153 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_multiq.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_netem.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32425 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_pie.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13593 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_plug.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31889 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_prio.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60337 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_qfq.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40977 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_red.ko 2024-08-31T03:50:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33521 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfb.ko 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38457 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfq.ko 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35857 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_tbf.ko 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_teql.ko 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/ 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1184689 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp.ko 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24001 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp_diag.ko 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/ 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/ 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 426969 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1895553 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/sunrpc.ko 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma/ 2024-08-31T03:50:08.934 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 925089 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/ 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1122601 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc.ko 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12241 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc_diag.ko 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix/ 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18273 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix/unix_diag.ko 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/ 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101161 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90369 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 120625 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock.ko 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12985 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20489 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/x25/ 2024-08-31T03:50:08.935 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 165529 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/x25/x25.ko 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/ 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25449 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_algo.ko 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22929 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 135873 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_user.ko 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 649700 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 633853 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias.bin 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7850 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23959 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.alias.bin 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10056 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.bin 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74053 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.modinfo 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 147543 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 233297 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep.bin 2024-08-31T03:50:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 210 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.devname 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72756 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.order 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 879 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.softdep 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 261535 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 316586 2024-08-27 12:59 ./lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols.bin 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./usr/ 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./usr/share/ 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./usr/share/doc/ 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2024-08-27 12:59 ./usr/share/doc/linux-image-6.11.0-rc5-g8ad8b8b16098/ 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 174 2024-08-27 12:59 ./usr/share/doc/linux-image-6.11.0-rc5-g8ad8b8b16098/changelog.Debian.gz 2024-08-31T03:50:08.937 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 691 2024-08-27 12:59 ./usr/share/doc/linux-image-6.11.0-rc5-g8ad8b8b16098/copyright 2024-08-31T03:50:08.942 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:08.943 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:08.943 DEBUG:teuthology.orchestra.run.smithi089:> egrep '(submenu|menuentry.*6.11.0-rc5-g8ad8b8b16098).*{' /boot/grub/grub.cfg 2024-08-31T03:50:08.949 INFO:teuthology.orchestra.run.smithi089.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-31T03:50:08.949 INFO:teuthology.orchestra.run.smithi089.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g8ad8b8b16098' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g8ad8b8b16098-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-31T03:50:08.949 INFO:teuthology.orchestra.run.smithi089.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g8ad8b8b16098 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g8ad8b8b16098-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-31T03:50:08.950 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-08-31T03:50:08.950 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:08.950 DEBUG:teuthology.orchestra.run.smithi089:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-08-31T03:50:08.994 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi089.front.sepia.ceph.com to complete... 2024-08-31T03:50:09.375 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2024-08-31T03:50:09.377 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T03:50:09.412 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-08-31T03:50:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:09.592 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:50:09.796 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T03:50:09.802 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T03:50:09.841 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T03:50:09.848 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T03:50:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T03:50:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T03:50:09.982 INFO:teuthology.orchestra.run.smithi089.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T03:50:10.000 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-08-31T03:50:11.133 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-08-31T03:50:41.134 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-31T03:50:41.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-31T03:50:41.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T03:50:59.649 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-08-31T03:51:08.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-31T03:51:08.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T03:51:11.709 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-08-31T03:51:23.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-31T03:51:23.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T03:51:55.424 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-08-31T03:51:56.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-31T03:51:56.127 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g8ad8b8b16098"... 2024-08-31T03:51:56.127 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-08-31T03:51:56.175 INFO:teuthology.orchestra.run.smithi089.stdout:6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:51:56.176 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g8ad8b8b16098 vs 6.11.0-rc5-g8ad8b8b16098 2024-08-31T03:51:56.176 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-31T03:51:56.176 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-31T03:51:57.177 DEBUG:teuthology.parallel:result is None 2024-08-31T03:51:57.178 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T03:51:57.185 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T03:51:57.186 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T03:51:57.189 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T03:51:57.195 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T03:51:57.281 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T03:51:57.350 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T03:51:57.350 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T03:51:57.353 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T03:51:57.454 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T03:51:57.460 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T03:51:57.461 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T03:51:57.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T03:51:57.466 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T03:51:57.469 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T03:51:57.533 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T03:51:57.542 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T03:51:57.548 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T03:51:57.564 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T03:51:57.567 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T03:51:57.573 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T03:51:57.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T03:51:57.577 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T03:51:57.606 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T03:51:57.644 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T03:51:57.645 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T03:51:57.648 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T03:51:57.654 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T03:51:57.704 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T03:51:57.756 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T03:51:57.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T03:51:57.830 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T03:51:57.836 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T03:51:57.887 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T03:51:57.887 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T03:51:57.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-08-31T03:51:57.956 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-08-31T03:51:58.057 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T03:51:58.319 INFO:teuthology.task.internal:Starting timer... 2024-08-31T03:51:58.319 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T03:51:58.403 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T03:51:58.486 DEBUG:teuthology.task.selinux:Excluding smithi089: OS 'ubuntu' does not support SELinux 2024-08-31T03:51:58.487 DEBUG:teuthology.task.selinux:Excluding smithi170: OS 'ubuntu' does not support SELinux 2024-08-31T03:51:58.487 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T03:51:58.487 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-31T03:51:58.487 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T03:51:58.487 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T03:51:58.522 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-31T03:51:58.526 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-31T03:51:58.640 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T03:51:58.650 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T03:51:58.652 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T03:59:58.317 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-08-31T03:59:58.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-31T03:59:58.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T03:59:58.405 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-08-31T03:59:58.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-08-31T03:59:58.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-08-31T03:59:58.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T03:59:58.590 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-08-31T03:59:58.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-08-31T03:59:58.705 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T03:59:58.715 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T03:59:58.716 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T03:59:58.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T03:59:58.720 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T03:59:58.720 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T03:59:58.754 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-31T03:59:58.755 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: Command line: ntpd -gq 2024-08-31T03:59:58.755 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: ---------------------------------------------------- 2024-08-31T03:59:58.755 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: ntp-4 is maintained by Network Time Foundation, 2024-08-31T03:59:58.755 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-31T03:59:58.755 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: corporation. Support and training for ntp-4 are 2024-08-31T03:59:58.755 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: available at https://www.nwtime.org/support 2024-08-31T03:59:58.755 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: ---------------------------------------------------- 2024-08-31T03:59:58.756 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: proto: precision = 0.042 usec (-24) 2024-08-31T03:59:58.756 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: basedate set to 2022-02-04 2024-08-31T03:59:58.756 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: gps base set to 2022-02-06 (week 2196) 2024-08-31T03:59:58.756 INFO:teuthology.orchestra.run.smithi089.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T03:59:58.757 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T03:59:58.757 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: restrict ::: KOD does nothing without LIMITED. 2024-08-31T03:59:58.757 INFO:teuthology.orchestra.run.smithi089.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-31T03:59:58.758 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: Listen and drop on 0 v6wildcard [::]:123 2024-08-31T03:59:58.758 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-31T03:59:58.758 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: Listen normally on 2 lo 127.0.0.1:123 2024-08-31T03:59:58.758 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: Listen normally on 3 enp3s0f1 172.21.15.89:123 2024-08-31T03:59:58.758 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: Listen normally on 4 lo [::1]:123 2024-08-31T03:59:58.758 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d501%5]:123 2024-08-31T03:59:58.759 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 03:59:58 ntpd[18392]: Listening on routing socket on fd #22 for interface updates 2024-08-31T03:59:58.773 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-31T03:59:58.773 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: Command line: ntpd -gq 2024-08-31T03:59:58.773 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: ---------------------------------------------------- 2024-08-31T03:59:58.773 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: ntp-4 is maintained by Network Time Foundation, 2024-08-31T03:59:58.774 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-31T03:59:58.774 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: corporation. Support and training for ntp-4 are 2024-08-31T03:59:58.774 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: available at https://www.nwtime.org/support 2024-08-31T03:59:58.774 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: ---------------------------------------------------- 2024-08-31T03:59:58.774 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: proto: precision = 0.044 usec (-24) 2024-08-31T03:59:58.774 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: basedate set to 2022-02-04 2024-08-31T03:59:58.774 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: gps base set to 2022-02-06 (week 2196) 2024-08-31T03:59:58.775 INFO:teuthology.orchestra.run.smithi170.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T03:59:58.775 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T03:59:58.775 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: restrict ::: KOD does nothing without LIMITED. 2024-08-31T03:59:58.775 INFO:teuthology.orchestra.run.smithi170.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-31T03:59:58.776 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: Listen and drop on 0 v6wildcard [::]:123 2024-08-31T03:59:58.776 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-31T03:59:58.776 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: Listen normally on 2 lo 127.0.0.1:123 2024-08-31T03:59:58.776 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: Listen normally on 3 enp3s0f1 172.21.15.170:123 2024-08-31T03:59:58.776 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: Listen normally on 4 lo [::1]:123 2024-08-31T03:59:58.776 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7255%5]:123 2024-08-31T03:59:58.777 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 03:59:58 ntpd[18877]: Listening on routing socket on fd #22 for interface updates 2024-08-31T03:59:59.755 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 03:59:59 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T03:59:59.755 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 03:59:59 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T03:59:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 03:59:59 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T03:59:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 03:59:59 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T03:59:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 03:59:59 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T03:59:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 03:59:59 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T03:59:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 03:59:59 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T03:59:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 03:59:59 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T03:59:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 03:59:59 ntpd[18877]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T03:59:59.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 03:59:59 ntpd[18877]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:01.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:01.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:01.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:01.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:01.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:01.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:01.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:01.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:01.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:01 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:01.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:01 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:01.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:01 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:01.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:01 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:01.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:01 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:01.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:01 ntpd[18877]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:01.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:01 ntpd[18877]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:02.777 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:02 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:02.777 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:02 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:02.777 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:02 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:02.777 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:02 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:02.777 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:02 ntpd[18877]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:02.777 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:02 ntpd[18877]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:03.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:03 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:03 ntpd[18877]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:04.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:04 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:04.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:04 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:04.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:04 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:04.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:04 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:04.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:04 ntpd[18877]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:04.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:04 ntpd[18877]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:05.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:05.758 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:05 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:05.774 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:05.775 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:05.776 INFO:teuthology.orchestra.run.smithi170.stdout:31 Aug 04:00:05 ntpd[18877]: ntpd: time slew -0.002940 s 2024-08-31T04:00:05.776 INFO:teuthology.orchestra.run.smithi170.stdout:ntpd: time slew -0.002940s 2024-08-31T04:00:05.776 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-31T04:00:05.776 INFO:teuthology.orchestra.run.smithi170.stderr:31 Aug 04:00:05 ntpd[18877]: can't open /var/log/ntpstats/loopstats.20240831: Permission denied 2024-08-31T04:00:05.854 INFO:teuthology.orchestra.run.smithi170.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T04:00:05.855 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================== 2024-08-31T04:00:05.855 INFO:teuthology.orchestra.run.smithi170.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T04:00:05.855 INFO:teuthology.orchestra.run.smithi170.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T04:00:05.855 INFO:teuthology.orchestra.run.smithi170.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T04:00:05.855 INFO:teuthology.orchestra.run.smithi170.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T04:00:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T04:00:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T04:00:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T04:00:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T04:00:07.757 INFO:teuthology.orchestra.run.smithi089.stdout:31 Aug 04:00:07 ntpd[18392]: ntpd: time slew -0.000575 s 2024-08-31T04:00:07.757 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd: time slew -0.000575s 2024-08-31T04:00:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-31T04:00:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:31 Aug 04:00:07 ntpd[18392]: can't open /var/log/ntpstats/loopstats.20240831: Permission denied 2024-08-31T04:00:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T04:00:07.866 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2024-08-31T04:00:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T04:00:07.866 INFO:teuthology.orchestra.run.smithi089.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T04:00:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T04:00:07.867 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T04:00:07.868 INFO:teuthology.run_tasks:Running task install... 2024-08-31T04:00:07.879 DEBUG:teuthology.task.install:project ceph 2024-08-31T04:00:07.879 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-31T04:00:07.879 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T04:00:07.879 INFO:teuthology.task.install:Using flavor: default 2024-08-31T04:00:07.885 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T04:00:07.885 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-31T04:00:07.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-key list | grep Ceph 2024-08-31T04:00:07.886 DEBUG:teuthology.orchestra.run.smithi170:> sudo apt-key list | grep Ceph 2024-08-31T04:00:07.949 INFO:teuthology.orchestra.run.smithi170.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-31T04:00:07.997 INFO:teuthology.orchestra.run.smithi170.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-31T04:00:07.997 INFO:teuthology.orchestra.run.smithi170.stdout:uid [ unknown] Ceph.com (release key) 2024-08-31T04:00:07.998 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-31T04:00:07.998 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-08-31T04:00:07.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:00:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-31T04:00:08.061 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-31T04:00:08.061 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph.com (release key) 2024-08-31T04:00:08.062 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-31T04:00:08.062 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-08-31T04:00:08.063 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:00:08.142 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default/ 2024-08-31T04:00:08.142 INFO:teuthology.task.install.deb:Package version is 19.3.0-4560-gd19e6118-1jammy 2024-08-31T04:00:08.211 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default/ 2024-08-31T04:00:08.212 INFO:teuthology.task.install.deb:Package version is 19.3.0-4560-gd19e6118-1jammy 2024-08-31T04:00:08.259 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:00:08.259 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-31T04:00:08.274 DEBUG:teuthology.orchestra.run.smithi170:> sudo apt-get update 2024-08-31T04:00:08.330 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:00:08.330 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-31T04:00:08.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2024-08-31T04:00:08.494 INFO:teuthology.orchestra.run.smithi170.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy InRelease 2024-08-31T04:00:08.516 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-08-31T04:00:08.540 INFO:teuthology.orchestra.run.smithi170.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-31T04:00:08.562 INFO:teuthology.orchestra.run.smithi170.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-08-31T04:00:08.582 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy InRelease 2024-08-31T04:00:08.594 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-08-31T04:00:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-08-31T04:00:08.625 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-31T04:00:08.647 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-08-31T04:00:08.679 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-08-31T04:00:12.722 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T04:00:12.730 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T04:00:12.747 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T04:00:13.075 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T04:00:13.144 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T04:00:13.225 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T04:00:14.110 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T04:00:14.264 INFO:teuthology.orchestra.run.smithi170.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T04:00:14.341 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 29.2 kB in 6s (5,068 B/s) 2024-08-31T04:00:14.437 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 29.2 kB in 6s (4,894 B/s) 2024-08-31T04:00:15.366 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-08-31T04:00:15.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4560-gd19e6118-1jammy cephadm=19.3.0-4560-gd19e6118-1jammy ceph-mds=19.3.0-4560-gd19e6118-1jammy ceph-mgr=19.3.0-4560-gd19e6118-1jammy ceph-common=19.3.0-4560-gd19e6118-1jammy ceph-fuse=19.3.0-4560-gd19e6118-1jammy ceph-test=19.3.0-4560-gd19e6118-1jammy ceph-volume=19.3.0-4560-gd19e6118-1jammy radosgw=19.3.0-4560-gd19e6118-1jammy python3-rados=19.3.0-4560-gd19e6118-1jammy python3-rgw=19.3.0-4560-gd19e6118-1jammy python3-cephfs=19.3.0-4560-gd19e6118-1jammy python3-rbd=19.3.0-4560-gd19e6118-1jammy libcephfs2=19.3.0-4560-gd19e6118-1jammy libcephfs-dev=19.3.0-4560-gd19e6118-1jammy librados2=19.3.0-4560-gd19e6118-1jammy librbd1=19.3.0-4560-gd19e6118-1jammy rbd-fuse=19.3.0-4560-gd19e6118-1jammy python3-cephfs=19.3.0-4560-gd19e6118-1jammy cephfs-shell=19.3.0-4560-gd19e6118-1jammy cephfs-top=19.3.0-4560-gd19e6118-1jammy cephfs-mirror=19.3.0-4560-gd19e6118-1jammy 2024-08-31T04:00:15.457 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-08-31T04:00:15.463 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2024-08-31T04:00:15.480 DEBUG:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4560-gd19e6118-1jammy cephadm=19.3.0-4560-gd19e6118-1jammy ceph-mds=19.3.0-4560-gd19e6118-1jammy ceph-mgr=19.3.0-4560-gd19e6118-1jammy ceph-common=19.3.0-4560-gd19e6118-1jammy ceph-fuse=19.3.0-4560-gd19e6118-1jammy ceph-test=19.3.0-4560-gd19e6118-1jammy ceph-volume=19.3.0-4560-gd19e6118-1jammy radosgw=19.3.0-4560-gd19e6118-1jammy python3-rados=19.3.0-4560-gd19e6118-1jammy python3-rgw=19.3.0-4560-gd19e6118-1jammy python3-cephfs=19.3.0-4560-gd19e6118-1jammy python3-rbd=19.3.0-4560-gd19e6118-1jammy libcephfs2=19.3.0-4560-gd19e6118-1jammy libcephfs-dev=19.3.0-4560-gd19e6118-1jammy librados2=19.3.0-4560-gd19e6118-1jammy librbd1=19.3.0-4560-gd19e6118-1jammy rbd-fuse=19.3.0-4560-gd19e6118-1jammy python3-cephfs=19.3.0-4560-gd19e6118-1jammy cephfs-shell=19.3.0-4560-gd19e6118-1jammy cephfs-top=19.3.0-4560-gd19e6118-1jammy cephfs-mirror=19.3.0-4560-gd19e6118-1jammy 2024-08-31T04:00:15.533 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2024-08-31T04:00:15.641 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-08-31T04:00:15.642 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-08-31T04:00:15.718 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2024-08-31T04:00:15.719 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2024-08-31T04:00:15.825 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T04:00:15.825 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T04:00:15.825 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T04:00:15.825 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T04:00:15.826 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T04:00:15.826 INFO:teuthology.orchestra.run.smithi089.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T04:00:15.826 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T04:00:15.827 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2024-08-31T04:00:15.827 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-31T04:00:15.827 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-31T04:00:15.827 INFO:teuthology.orchestra.run.smithi089.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T04:00:15.827 INFO:teuthology.orchestra.run.smithi089.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-31T04:00:15.828 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-08-31T04:00:15.829 INFO:teuthology.orchestra.run.smithi089.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-08-31T04:00:15.830 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-08-31T04:00:15.830 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-08-31T04:00:15.830 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-08-31T04:00:15.830 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-08-31T04:00:15.830 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-08-31T04:00:15.830 INFO:teuthology.orchestra.run.smithi089.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-08-31T04:00:15.830 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-08-31T04:00:15.830 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-08-31T04:00:15.830 INFO:teuthology.orchestra.run.smithi089.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2024-08-31T04:00:15.831 INFO:teuthology.orchestra.run.smithi089.stdout: btrfs-tools 2024-08-31T04:00:15.905 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T04:00:15.906 INFO:teuthology.orchestra.run.smithi170.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T04:00:15.906 INFO:teuthology.orchestra.run.smithi170.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T04:00:15.906 INFO:teuthology.orchestra.run.smithi170.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T04:00:15.906 INFO:teuthology.orchestra.run.smithi170.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-31T04:00:15.906 INFO:teuthology.orchestra.run.smithi170.stdout: python2.7-minimal 2024-08-31T04:00:15.907 INFO:teuthology.orchestra.run.smithi170.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T04:00:15.907 INFO:teuthology.orchestra.run.smithi170.stdout:The following additional packages will be installed: 2024-08-31T04:00:15.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-31T04:00:15.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-31T04:00:15.908 INFO:teuthology.orchestra.run.smithi170.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T04:00:15.908 INFO:teuthology.orchestra.run.smithi170.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-08-31T04:00:15.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-08-31T04:00:15.910 INFO:teuthology.orchestra.run.smithi170.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout:Suggested packages: 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout:Recommended packages: 2024-08-31T04:00:15.911 INFO:teuthology.orchestra.run.smithi170.stdout: btrfs-tools 2024-08-31T04:00:15.982 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2024-08-31T04:00:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-31T04:00:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-31T04:00:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-31T04:00:15.982 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-08-31T04:00:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T04:00:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-08-31T04:00:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-08-31T04:00:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-08-31T04:00:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-08-31T04:00:15.984 INFO:teuthology.orchestra.run.smithi089.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-31T04:00:15.985 INFO:teuthology.orchestra.run.smithi089.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-31T04:00:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-31T04:00:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-08-31T04:00:15.986 INFO:teuthology.orchestra.run.smithi089.stdout: socat unzip xmlstarlet zip 2024-08-31T04:00:16.018 INFO:teuthology.orchestra.run.smithi170.stdout:The following NEW packages will be installed: 2024-08-31T04:00:16.018 INFO:teuthology.orchestra.run.smithi170.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-31T04:00:16.018 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-31T04:00:16.018 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-31T04:00:16.020 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-08-31T04:00:16.020 INFO:teuthology.orchestra.run.smithi170.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T04:00:16.020 INFO:teuthology.orchestra.run.smithi170.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-08-31T04:00:16.020 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-08-31T04:00:16.020 INFO:teuthology.orchestra.run.smithi170.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-08-31T04:00:16.020 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-08-31T04:00:16.020 INFO:teuthology.orchestra.run.smithi170.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-08-31T04:00:16.020 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-31T04:00:16.021 INFO:teuthology.orchestra.run.smithi170.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-31T04:00:16.022 INFO:teuthology.orchestra.run.smithi170.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-31T04:00:16.022 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-31T04:00:16.022 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-08-31T04:00:16.022 INFO:teuthology.orchestra.run.smithi170.stdout: socat unzip xmlstarlet zip 2024-08-31T04:00:16.134 INFO:teuthology.orchestra.run.smithi089.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-08-31T04:00:16.134 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 247 MB of archives. 2024-08-31T04:00:16.134 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 1,021 MB of additional disk space will be used. 2024-08-31T04:00:16.134 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4560-gd19e6118-1jammy [3,589 kB] 2024-08-31T04:00:16.163 INFO:teuthology.orchestra.run.smithi170.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-08-31T04:00:16.163 INFO:teuthology.orchestra.run.smithi170.stdout:Need to get 247 MB of archives. 2024-08-31T04:00:16.163 INFO:teuthology.orchestra.run.smithi170.stdout:After this operation, 1,021 MB of additional disk space will be used. 2024-08-31T04:00:16.163 INFO:teuthology.orchestra.run.smithi170.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4560-gd19e6118-1jammy [3,589 kB] 2024-08-31T04:00:16.321 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4560-gd19e6118-1jammy [3,356 kB] 2024-08-31T04:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4560-gd19e6118-1jammy [734 kB] 2024-08-31T04:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4560-gd19e6118-1jammy [356 kB] 2024-08-31T04:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4560-gd19e6118-1jammy [32.8 kB] 2024-08-31T04:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4560-gd19e6118-1jammy [180 kB] 2024-08-31T04:00:16.413 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4560-gd19e6118-1jammy [3,356 kB] 2024-08-31T04:00:16.420 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4560-gd19e6118-1jammy [70.2 kB] 2024-08-31T04:00:16.428 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4560-gd19e6118-1jammy [338 kB] 2024-08-31T04:00:16.435 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4560-gd19e6118-1jammy [8,856 kB] 2024-08-31T04:00:16.555 INFO:teuthology.orchestra.run.smithi170.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4560-gd19e6118-1jammy [734 kB] 2024-08-31T04:00:16.596 INFO:teuthology.orchestra.run.smithi170.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4560-gd19e6118-1jammy [356 kB] 2024-08-31T04:00:16.603 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4560-gd19e6118-1jammy [32.8 kB] 2024-08-31T04:00:16.604 INFO:teuthology.orchestra.run.smithi170.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4560-gd19e6118-1jammy [180 kB] 2024-08-31T04:00:16.608 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4560-gd19e6118-1jammy [70.2 kB] 2024-08-31T04:00:16.610 INFO:teuthology.orchestra.run.smithi170.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4560-gd19e6118-1jammy [338 kB] 2024-08-31T04:00:16.618 INFO:teuthology.orchestra.run.smithi170.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4560-gd19e6118-1jammy [8,856 kB] 2024-08-31T04:00:16.674 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4560-gd19e6118-1jammy [112 kB] 2024-08-31T04:00:16.675 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4560-gd19e6118-1jammy [477 kB] 2024-08-31T04:00:16.681 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4560-gd19e6118-1jammy [29.1 MB] 2024-08-31T04:00:17.058 INFO:teuthology.orchestra.run.smithi170.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4560-gd19e6118-1jammy [112 kB] 2024-08-31T04:00:17.060 INFO:teuthology.orchestra.run.smithi170.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4560-gd19e6118-1jammy [477 kB] 2024-08-31T04:00:17.070 INFO:teuthology.orchestra.run.smithi170.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4560-gd19e6118-1jammy [29.1 MB] 2024-08-31T04:00:17.530 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4560-gd19e6118-1jammy [5,011 kB] 2024-08-31T04:00:17.691 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4560-gd19e6118-1jammy [251 kB] 2024-08-31T04:00:17.693 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4560-gd19e6118-1jammy [126 kB] 2024-08-31T04:00:17.695 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4560-gd19e6118-1jammy [1,551 kB] 2024-08-31T04:00:17.765 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4560-gd19e6118-1jammy [6,139 kB] 2024-08-31T04:00:18.009 INFO:teuthology.orchestra.run.smithi170.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-08-31T04:00:18.040 INFO:teuthology.orchestra.run.smithi170.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4560-gd19e6118-1jammy [5,011 kB] 2024-08-31T04:00:18.041 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4560-gd19e6118-1jammy [22.8 MB] 2024-08-31T04:00:18.114 INFO:teuthology.orchestra.run.smithi170.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4560-gd19e6118-1jammy [251 kB] 2024-08-31T04:00:18.117 INFO:teuthology.orchestra.run.smithi170.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4560-gd19e6118-1jammy [126 kB] 2024-08-31T04:00:18.120 INFO:teuthology.orchestra.run.smithi170.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-31T04:00:18.121 INFO:teuthology.orchestra.run.smithi170.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4560-gd19e6118-1jammy [1,551 kB] 2024-08-31T04:00:18.167 INFO:teuthology.orchestra.run.smithi170.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-08-31T04:00:18.169 INFO:teuthology.orchestra.run.smithi170.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4560-gd19e6118-1jammy [6,139 kB] 2024-08-31T04:00:18.324 INFO:teuthology.orchestra.run.smithi170.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4560-gd19e6118-1jammy [22.8 MB] 2024-08-31T04:00:18.362 INFO:teuthology.orchestra.run.smithi170.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-31T04:00:18.455 INFO:teuthology.orchestra.run.smithi170.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-31T04:00:18.467 INFO:teuthology.orchestra.run.smithi170.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-31T04:00:18.517 INFO:teuthology.orchestra.run.smithi170.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-31T04:00:18.690 INFO:teuthology.orchestra.run.smithi170.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-31T04:00:18.698 INFO:teuthology.orchestra.run.smithi170.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-31T04:00:18.726 INFO:teuthology.orchestra.run.smithi170.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-31T04:00:18.734 INFO:teuthology.orchestra.run.smithi170.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-31T04:00:18.735 INFO:teuthology.orchestra.run.smithi170.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-31T04:00:18.754 INFO:teuthology.orchestra.run.smithi170.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-31T04:00:18.758 INFO:teuthology.orchestra.run.smithi170.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-31T04:00:18.762 INFO:teuthology.orchestra.run.smithi170.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-31T04:00:18.765 INFO:teuthology.orchestra.run.smithi170.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-31T04:00:18.773 INFO:teuthology.orchestra.run.smithi170.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-31T04:00:18.848 INFO:teuthology.orchestra.run.smithi170.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-31T04:00:18.852 INFO:teuthology.orchestra.run.smithi170.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-31T04:00:18.856 INFO:teuthology.orchestra.run.smithi170.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-31T04:00:18.864 INFO:teuthology.orchestra.run.smithi170.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-31T04:00:18.864 INFO:teuthology.orchestra.run.smithi170.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-31T04:00:18.864 INFO:teuthology.orchestra.run.smithi170.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-31T04:00:18.864 INFO:teuthology.orchestra.run.smithi170.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-31T04:00:18.864 INFO:teuthology.orchestra.run.smithi170.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-31T04:00:18.864 INFO:teuthology.orchestra.run.smithi170.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-31T04:00:18.936 INFO:teuthology.orchestra.run.smithi170.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-31T04:00:18.980 INFO:teuthology.orchestra.run.smithi170.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-31T04:00:18.981 INFO:teuthology.orchestra.run.smithi170.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-31T04:00:18.982 INFO:teuthology.orchestra.run.smithi170.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4560-gd19e6118-1jammy [14.0 kB] 2024-08-31T04:00:18.983 INFO:teuthology.orchestra.run.smithi170.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4560-gd19e6118-1jammy [865 kB] 2024-08-31T04:00:18.986 INFO:teuthology.orchestra.run.smithi170.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-31T04:00:18.987 INFO:teuthology.orchestra.run.smithi170.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-31T04:00:19.014 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4560-gd19e6118-1jammy [14.0 kB] 2024-08-31T04:00:19.014 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4560-gd19e6118-1jammy [865 kB] 2024-08-31T04:00:19.029 INFO:teuthology.orchestra.run.smithi170.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4560-gd19e6118-1jammy [2,381 kB] 2024-08-31T04:00:19.029 INFO:teuthology.orchestra.run.smithi170.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-31T04:00:19.029 INFO:teuthology.orchestra.run.smithi170.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-31T04:00:19.031 INFO:teuthology.orchestra.run.smithi170.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-31T04:00:19.031 INFO:teuthology.orchestra.run.smithi170.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-31T04:00:19.032 INFO:teuthology.orchestra.run.smithi170.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-31T04:00:19.034 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4560-gd19e6118-1jammy [2,381 kB] 2024-08-31T04:00:19.068 INFO:teuthology.orchestra.run.smithi170.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4560-gd19e6118-1jammy [810 kB] 2024-08-31T04:00:19.079 INFO:teuthology.orchestra.run.smithi170.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4560-gd19e6118-1jammy [159 kB] 2024-08-31T04:00:19.082 INFO:teuthology.orchestra.run.smithi170.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4560-gd19e6118-1jammy [61.3 MB] 2024-08-31T04:00:19.099 INFO:teuthology.orchestra.run.smithi170.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-31T04:00:19.101 INFO:teuthology.orchestra.run.smithi170.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-31T04:00:19.102 INFO:teuthology.orchestra.run.smithi170.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-31T04:00:19.104 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4560-gd19e6118-1jammy [810 kB] 2024-08-31T04:00:19.134 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4560-gd19e6118-1jammy [159 kB] 2024-08-31T04:00:19.150 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4560-gd19e6118-1jammy [61.3 MB] 2024-08-31T04:00:19.181 INFO:teuthology.orchestra.run.smithi170.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-31T04:00:19.182 INFO:teuthology.orchestra.run.smithi170.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-31T04:00:19.183 INFO:teuthology.orchestra.run.smithi170.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-31T04:00:19.184 INFO:teuthology.orchestra.run.smithi170.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-31T04:00:19.187 INFO:teuthology.orchestra.run.smithi170.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-31T04:00:19.191 INFO:teuthology.orchestra.run.smithi170.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-31T04:00:19.193 INFO:teuthology.orchestra.run.smithi170.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-31T04:00:19.221 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-08-31T04:00:19.239 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-31T04:00:19.249 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-08-31T04:00:19.262 INFO:teuthology.orchestra.run.smithi170.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-31T04:00:19.264 INFO:teuthology.orchestra.run.smithi170.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-31T04:00:19.269 INFO:teuthology.orchestra.run.smithi170.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-31T04:00:19.290 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-31T04:00:19.311 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-31T04:00:19.313 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-31T04:00:19.325 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-31T04:00:19.344 INFO:teuthology.orchestra.run.smithi170.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-31T04:00:19.345 INFO:teuthology.orchestra.run.smithi170.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-31T04:00:19.351 INFO:teuthology.orchestra.run.smithi170.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-31T04:00:19.363 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-31T04:00:19.365 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-31T04:00:19.372 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-31T04:00:19.375 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-31T04:00:19.376 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-31T04:00:19.382 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-31T04:00:19.384 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-31T04:00:19.385 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-31T04:00:19.387 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-31T04:00:19.387 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-31T04:00:19.400 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-31T04:00:19.402 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-31T04:00:19.403 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-31T04:00:19.404 INFO:teuthology.orchestra.run.smithi089.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-31T04:00:19.417 INFO:teuthology.orchestra.run.smithi089.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-31T04:00:19.419 INFO:teuthology.orchestra.run.smithi089.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-31T04:00:19.419 INFO:teuthology.orchestra.run.smithi089.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-31T04:00:19.419 INFO:teuthology.orchestra.run.smithi089.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-31T04:00:19.420 INFO:teuthology.orchestra.run.smithi089.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-31T04:00:19.420 INFO:teuthology.orchestra.run.smithi089.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-31T04:00:19.435 INFO:teuthology.orchestra.run.smithi089.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-31T04:00:19.435 INFO:teuthology.orchestra.run.smithi089.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-31T04:00:19.438 INFO:teuthology.orchestra.run.smithi089.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-31T04:00:19.438 INFO:teuthology.orchestra.run.smithi089.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-31T04:00:19.452 INFO:teuthology.orchestra.run.smithi089.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-31T04:00:19.453 INFO:teuthology.orchestra.run.smithi089.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-31T04:00:19.453 INFO:teuthology.orchestra.run.smithi089.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-31T04:00:19.454 INFO:teuthology.orchestra.run.smithi089.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-31T04:00:19.454 INFO:teuthology.orchestra.run.smithi089.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-31T04:00:19.455 INFO:teuthology.orchestra.run.smithi089.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-31T04:00:19.470 INFO:teuthology.orchestra.run.smithi089.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-31T04:00:19.470 INFO:teuthology.orchestra.run.smithi089.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-31T04:00:19.475 INFO:teuthology.orchestra.run.smithi089.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-31T04:00:19.476 INFO:teuthology.orchestra.run.smithi089.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-31T04:00:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-31T04:00:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-31T04:00:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-31T04:00:19.491 INFO:teuthology.orchestra.run.smithi089.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-31T04:00:19.491 INFO:teuthology.orchestra.run.smithi089.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-31T04:00:19.493 INFO:teuthology.orchestra.run.smithi089.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-31T04:00:19.504 INFO:teuthology.orchestra.run.smithi089.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-31T04:00:19.506 INFO:teuthology.orchestra.run.smithi089.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-31T04:00:19.507 INFO:teuthology.orchestra.run.smithi089.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-31T04:00:19.507 INFO:teuthology.orchestra.run.smithi089.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-31T04:00:19.518 INFO:teuthology.orchestra.run.smithi170.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-31T04:00:19.520 INFO:teuthology.orchestra.run.smithi170.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-31T04:00:19.522 INFO:teuthology.orchestra.run.smithi089.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-31T04:00:19.523 INFO:teuthology.orchestra.run.smithi170.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-31T04:00:19.524 INFO:teuthology.orchestra.run.smithi170.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-31T04:00:19.526 INFO:teuthology.orchestra.run.smithi170.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-31T04:00:19.562 INFO:teuthology.orchestra.run.smithi170.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-31T04:00:19.567 INFO:teuthology.orchestra.run.smithi089.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-31T04:00:19.568 INFO:teuthology.orchestra.run.smithi089.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-31T04:00:19.570 INFO:teuthology.orchestra.run.smithi089.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-31T04:00:19.570 INFO:teuthology.orchestra.run.smithi089.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-31T04:00:19.571 INFO:teuthology.orchestra.run.smithi089.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-31T04:00:19.589 INFO:teuthology.orchestra.run.smithi089.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-31T04:00:19.590 INFO:teuthology.orchestra.run.smithi170.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-31T04:00:19.591 INFO:teuthology.orchestra.run.smithi170.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-31T04:00:19.592 INFO:teuthology.orchestra.run.smithi089.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-31T04:00:19.592 INFO:teuthology.orchestra.run.smithi089.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-31T04:00:19.610 INFO:teuthology.orchestra.run.smithi089.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-31T04:00:19.610 INFO:teuthology.orchestra.run.smithi089.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-31T04:00:19.611 INFO:teuthology.orchestra.run.smithi089.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-31T04:00:19.612 INFO:teuthology.orchestra.run.smithi089.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-31T04:00:19.612 INFO:teuthology.orchestra.run.smithi089.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-31T04:00:19.613 INFO:teuthology.orchestra.run.smithi089.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-31T04:00:19.621 INFO:teuthology.orchestra.run.smithi089.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-31T04:00:19.622 INFO:teuthology.orchestra.run.smithi089.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-31T04:00:19.625 INFO:teuthology.orchestra.run.smithi170.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-31T04:00:19.625 INFO:teuthology.orchestra.run.smithi170.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-31T04:00:19.626 INFO:teuthology.orchestra.run.smithi089.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-31T04:00:19.639 INFO:teuthology.orchestra.run.smithi089.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-31T04:00:19.640 INFO:teuthology.orchestra.run.smithi089.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-31T04:00:19.641 INFO:teuthology.orchestra.run.smithi089.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-31T04:00:19.645 INFO:teuthology.orchestra.run.smithi089.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-31T04:00:19.647 INFO:teuthology.orchestra.run.smithi089.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-08-31T04:00:19.648 INFO:teuthology.orchestra.run.smithi089.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-31T04:00:19.649 INFO:teuthology.orchestra.run.smithi089.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-31T04:00:19.656 INFO:teuthology.orchestra.run.smithi089.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-31T04:00:19.660 INFO:teuthology.orchestra.run.smithi089.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-31T04:00:19.661 INFO:teuthology.orchestra.run.smithi089.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-31T04:00:19.673 INFO:teuthology.orchestra.run.smithi089.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-31T04:00:19.673 INFO:teuthology.orchestra.run.smithi089.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-31T04:00:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-31T04:00:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-31T04:00:19.676 INFO:teuthology.orchestra.run.smithi089.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-31T04:00:19.677 INFO:teuthology.orchestra.run.smithi089.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-31T04:00:19.684 INFO:teuthology.orchestra.run.smithi089.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-31T04:00:19.685 INFO:teuthology.orchestra.run.smithi170.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-31T04:00:19.687 INFO:teuthology.orchestra.run.smithi170.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-31T04:00:19.687 INFO:teuthology.orchestra.run.smithi170.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-31T04:00:19.689 INFO:teuthology.orchestra.run.smithi170.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-31T04:00:19.690 INFO:teuthology.orchestra.run.smithi170.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-31T04:00:19.690 INFO:teuthology.orchestra.run.smithi089.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-31T04:00:19.691 INFO:teuthology.orchestra.run.smithi089.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-31T04:00:19.691 INFO:teuthology.orchestra.run.smithi170.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-31T04:00:19.693 INFO:teuthology.orchestra.run.smithi089.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-31T04:00:19.698 INFO:teuthology.orchestra.run.smithi170.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-31T04:00:19.707 INFO:teuthology.orchestra.run.smithi089.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-31T04:00:19.767 INFO:teuthology.orchestra.run.smithi170.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-31T04:00:19.770 INFO:teuthology.orchestra.run.smithi170.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-31T04:00:19.771 INFO:teuthology.orchestra.run.smithi170.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-31T04:00:19.848 INFO:teuthology.orchestra.run.smithi170.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-31T04:00:19.854 INFO:teuthology.orchestra.run.smithi170.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-08-31T04:00:19.854 INFO:teuthology.orchestra.run.smithi170.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-31T04:00:19.856 INFO:teuthology.orchestra.run.smithi170.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-31T04:00:19.857 INFO:teuthology.orchestra.run.smithi170.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-31T04:00:19.866 INFO:teuthology.orchestra.run.smithi170.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-31T04:00:19.868 INFO:teuthology.orchestra.run.smithi170.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-31T04:00:19.930 INFO:teuthology.orchestra.run.smithi170.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-31T04:00:19.930 INFO:teuthology.orchestra.run.smithi170.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-31T04:00:19.932 INFO:teuthology.orchestra.run.smithi170.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-31T04:00:20.011 INFO:teuthology.orchestra.run.smithi170.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-31T04:00:20.015 INFO:teuthology.orchestra.run.smithi170.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-31T04:00:20.016 INFO:teuthology.orchestra.run.smithi170.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-31T04:00:20.031 INFO:teuthology.orchestra.run.smithi170.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-31T04:00:20.032 INFO:teuthology.orchestra.run.smithi170.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-31T04:00:20.033 INFO:teuthology.orchestra.run.smithi170.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-31T04:00:20.038 INFO:teuthology.orchestra.run.smithi170.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-31T04:00:20.093 INFO:teuthology.orchestra.run.smithi170.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-31T04:00:20.809 INFO:teuthology.orchestra.run.smithi170.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4560-gd19e6118-1jammy [8,625 kB] 2024-08-31T04:00:20.976 INFO:teuthology.orchestra.run.smithi170.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4560-gd19e6118-1jammy [14.2 kB] 2024-08-31T04:00:20.976 INFO:teuthology.orchestra.run.smithi170.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4560-gd19e6118-1jammy [48.9 MB] 2024-08-31T04:00:21.834 INFO:teuthology.orchestra.run.smithi089.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4560-gd19e6118-1jammy [8,625 kB] 2024-08-31T04:00:22.239 INFO:teuthology.orchestra.run.smithi089.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4560-gd19e6118-1jammy [14.2 kB] 2024-08-31T04:00:22.239 INFO:teuthology.orchestra.run.smithi089.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4560-gd19e6118-1jammy [48.9 MB] 2024-08-31T04:00:22.370 INFO:teuthology.orchestra.run.smithi170.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4560-gd19e6118-1jammy [130 kB] 2024-08-31T04:00:22.373 INFO:teuthology.orchestra.run.smithi170.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4560-gd19e6118-1jammy [237 kB] 2024-08-31T04:00:22.377 INFO:teuthology.orchestra.run.smithi170.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4560-gd19e6118-1jammy [33.9 kB] 2024-08-31T04:00:22.379 INFO:teuthology.orchestra.run.smithi170.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4560-gd19e6118-1jammy [23.4 kB] 2024-08-31T04:00:22.379 INFO:teuthology.orchestra.run.smithi170.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4560-gd19e6118-1jammy [39.0 kB] 2024-08-31T04:00:22.380 INFO:teuthology.orchestra.run.smithi170.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4560-gd19e6118-1jammy [17.6 MB] 2024-08-31T04:00:22.820 INFO:teuthology.orchestra.run.smithi170.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4560-gd19e6118-1jammy [92.9 kB] 2024-08-31T04:00:23.297 INFO:teuthology.orchestra.run.smithi089.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4560-gd19e6118-1jammy [130 kB] 2024-08-31T04:00:23.298 INFO:teuthology.orchestra.run.smithi089.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4560-gd19e6118-1jammy [237 kB] 2024-08-31T04:00:23.300 INFO:teuthology.orchestra.run.smithi089.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4560-gd19e6118-1jammy [33.9 kB] 2024-08-31T04:00:23.301 INFO:teuthology.orchestra.run.smithi089.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4560-gd19e6118-1jammy [23.4 kB] 2024-08-31T04:00:23.301 INFO:teuthology.orchestra.run.smithi089.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4560-gd19e6118-1jammy [39.0 kB] 2024-08-31T04:00:23.301 INFO:teuthology.orchestra.run.smithi089.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4560-gd19e6118-1jammy [17.6 MB] 2024-08-31T04:00:23.443 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 247 MB in 7s (36.4 MB/s) 2024-08-31T04:00:23.581 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-31T04:00:23.585 INFO:teuthology.orchestra.run.smithi089.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4560-gd19e6118-1jammy [92.9 kB] 2024-08-31T04:00:23.653 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-08-31T04:00:23.657 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-08-31T04:00:23.705 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-08-31T04:00:24.049 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-31T04:00:24.070 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-31T04:00:24.116 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T04:00:24.238 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 247 MB in 8s (32.6 MB/s) 2024-08-31T04:00:24.407 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-31T04:00:24.427 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cmd2. 2024-08-31T04:00:24.439 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-08-31T04:00:24.469 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-08-31T04:00:24.472 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-08-31T04:00:24.475 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-08-31T04:00:24.514 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-08-31T04:00:24.739 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-31T04:00:24.759 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-31T04:00:24.783 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-31T04:00:24.797 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-31T04:00:24.822 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T04:00:24.842 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T04:00:25.195 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cmd2. 2024-08-31T04:00:25.208 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-08-31T04:00:25.253 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-08-31T04:00:25.267 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-31T04:00:25.288 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-31T04:00:25.334 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T04:00:25.664 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-31T04:00:25.678 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-31T04:00:25.704 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-31T04:00:25.725 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-31T04:00:25.762 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T04:00:25.781 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T04:00:26.184 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-31T04:00:26.198 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-31T04:00:26.243 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T04:00:26.441 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-31T04:00:26.462 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T04:00:26.507 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:00:26.679 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-31T04:00:26.694 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-31T04:00:26.746 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T04:00:26.952 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-31T04:00:26.972 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T04:00:27.019 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:00:27.372 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-31T04:00:27.392 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T04:00:27.430 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:00:27.491 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-31T04:00:27.506 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T04:00:27.566 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:00:27.825 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-31T04:00:27.845 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-31T04:00:27.891 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T04:00:28.036 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-31T04:00:28.051 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T04:00:28.094 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:00:28.269 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librados2. 2024-08-31T04:00:28.290 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../010-librados2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:28.327 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librados2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:28.514 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-31T04:00:28.529 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T04:00:28.581 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:00:28.822 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librbd1. 2024-08-31T04:00:28.842 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../011-librbd1_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:28.880 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librbd1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:28.992 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-31T04:00:29.007 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-31T04:00:29.059 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T04:00:29.308 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libcephfs2. 2024-08-31T04:00:29.328 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../012-libcephfs2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:29.357 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libcephfs2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:29.420 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librados2. 2024-08-31T04:00:29.435 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../010-librados2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:29.495 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librados2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:29.618 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rados. 2024-08-31T04:00:29.630 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../013-python3-rados_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:29.677 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rados (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:29.996 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-31T04:00:30.014 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librbd1. 2024-08-31T04:00:30.017 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:00:30.028 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../011-librbd1_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:30.054 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-ceph-argparse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:30.081 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librbd1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:30.307 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cephfs. 2024-08-31T04:00:30.327 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../015-python3-cephfs_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:30.365 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cephfs (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:30.609 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs2. 2024-08-31T04:00:30.622 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../012-libcephfs2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:30.634 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-31T04:00:30.655 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../016-python3-ceph-common_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:00:30.675 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:30.684 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:30.979 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-prettytable. 2024-08-31T04:00:30.986 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rados. 2024-08-31T04:00:31.000 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-08-31T04:00:31.000 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../013-python3-rados_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:31.045 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rados (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:31.046 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-31T04:00:31.298 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rbd. 2024-08-31T04:00:31.310 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../018-python3-rbd_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:31.322 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-31T04:00:31.336 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:00:31.340 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rbd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:31.380 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-argparse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:31.633 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cephfs. 2024-08-31T04:00:31.646 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../015-python3-cephfs_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:31.724 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cephfs (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:31.785 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-31T04:00:31.805 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-31T04:00:31.834 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T04:00:32.019 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-31T04:00:32.033 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../016-python3-ceph-common_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:00:32.078 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:32.104 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-31T04:00:32.116 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-31T04:00:32.154 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T04:00:32.414 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-prettytable. 2024-08-31T04:00:32.427 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-08-31T04:00:32.473 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-31T04:00:32.485 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-31T04:00:32.523 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T04:00:32.614 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-31T04:00:32.844 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package lua5.1. 2024-08-31T04:00:32.864 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-31T04:00:32.900 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rbd. 2024-08-31T04:00:32.901 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-31T04:00:32.914 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../018-python3-rbd_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:32.950 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rbd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:33.223 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package lua-any. 2024-08-31T04:00:33.244 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-08-31T04:00:33.278 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-31T04:00:33.281 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-31T04:00:33.292 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-31T04:00:33.361 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T04:00:33.509 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package zip. 2024-08-31T04:00:33.529 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-08-31T04:00:33.567 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking zip (3.0-12build2) ... 2024-08-31T04:00:33.630 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-31T04:00:33.645 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-31T04:00:33.688 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T04:00:33.871 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package unzip. 2024-08-31T04:00:33.891 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-31T04:00:33.929 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-31T04:00:34.008 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-31T04:00:34.023 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-31T04:00:34.066 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T04:00:34.333 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package luarocks. 2024-08-31T04:00:34.353 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-31T04:00:34.388 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua5.1. 2024-08-31T04:00:34.391 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-31T04:00:34.402 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-31T04:00:34.480 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-31T04:00:34.766 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package librgw2. 2024-08-31T04:00:34.786 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../027-librgw2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:34.791 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua-any. 2024-08-31T04:00:34.806 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-08-31T04:00:34.824 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking librgw2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:34.849 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-31T04:00:35.135 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package zip. 2024-08-31T04:00:35.150 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-08-31T04:00:35.185 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking zip (3.0-12build2) ... 2024-08-31T04:00:35.472 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package unzip. 2024-08-31T04:00:35.487 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-31T04:00:35.534 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rgw. 2024-08-31T04:00:35.546 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../028-python3-rgw_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:35.563 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-31T04:00:35.576 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:35.921 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-31T04:00:35.941 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-31T04:00:35.959 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package luarocks. 2024-08-31T04:00:35.973 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-31T04:00:35.979 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T04:00:36.042 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-31T04:00:36.299 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libradosstriper1. 2024-08-31T04:00:36.320 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../030-libradosstriper1_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:36.357 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libradosstriper1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:36.441 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librgw2. 2024-08-31T04:00:36.455 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../027-librgw2_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:36.500 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librgw2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:36.928 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-common. 2024-08-31T04:00:36.948 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../031-ceph-common_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:36.986 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:37.086 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rgw. 2024-08-31T04:00:37.100 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../028-python3-rgw_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:37.144 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:37.497 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-31T04:00:37.512 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-31T04:00:37.555 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T04:00:38.017 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libradosstriper1. 2024-08-31T04:00:38.031 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../030-libradosstriper1_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:38.075 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libradosstriper1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:38.436 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-common. 2024-08-31T04:00:38.451 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../031-ceph-common_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:38.494 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:38.725 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-base. 2024-08-31T04:00:38.745 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../032-ceph-base_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:38.792 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-base (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:39.395 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-31T04:00:39.416 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-31T04:00:39.453 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-31T04:00:39.765 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cheroot. 2024-08-31T04:00:39.785 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-31T04:00:39.823 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T04:00:39.908 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-base. 2024-08-31T04:00:39.923 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../032-ceph-base_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:39.976 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-base (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:40.185 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-31T04:00:40.196 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-31T04:00:40.235 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-31T04:00:40.513 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-31T04:00:40.533 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-31T04:00:40.571 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-31T04:00:40.579 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-31T04:00:40.593 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-31T04:00:40.637 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-31T04:00:40.874 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-31T04:00:40.894 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-31T04:00:40.932 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-31T04:00:40.932 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cheroot. 2024-08-31T04:00:40.946 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-31T04:00:40.982 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T04:00:41.220 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-tempora. 2024-08-31T04:00:41.239 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-08-31T04:00:41.276 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-31T04:00:41.302 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-31T04:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-31T04:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-31T04:00:41.546 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-portend. 2024-08-31T04:00:41.567 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-08-31T04:00:41.604 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-31T04:00:41.646 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-31T04:00:41.660 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-31T04:00:41.705 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-31T04:00:42.016 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-31T04:00:42.030 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-31T04:00:42.074 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-31T04:00:42.116 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-31T04:00:42.136 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-31T04:00:42.174 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-31T04:00:42.402 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempora. 2024-08-31T04:00:42.416 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-08-31T04:00:42.452 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-31T04:00:42.477 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-31T04:00:42.497 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-31T04:00:42.535 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-31T04:00:42.754 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-portend. 2024-08-31T04:00:42.769 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-08-31T04:00:42.813 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-31T04:00:42.856 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-natsort. 2024-08-31T04:00:42.876 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-08-31T04:00:42.914 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-31T04:00:43.116 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-31T04:00:43.130 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-31T04:00:43.166 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-31T04:00:43.225 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-logutils. 2024-08-31T04:00:43.246 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-08-31T04:00:43.283 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-31T04:00:43.443 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-31T04:00:43.457 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-31T04:00:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-31T04:00:43.586 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-31T04:00:43.607 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-31T04:00:43.644 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-31T04:00:43.847 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-natsort. 2024-08-31T04:00:43.861 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-08-31T04:00:43.905 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-31T04:00:43.914 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-mako. 2024-08-31T04:00:43.935 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-31T04:00:43.972 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T04:00:44.209 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-logutils. 2024-08-31T04:00:44.223 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-08-31T04:00:44.258 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-31T04:00:44.292 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-31T04:00:44.313 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-31T04:00:44.350 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-31T04:00:44.569 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-31T04:00:44.584 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-31T04:00:44.644 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-31T04:00:44.653 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-31T04:00:44.674 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-31T04:00:44.712 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-31T04:00:44.948 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-mako. 2024-08-31T04:00:44.963 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-31T04:00:45.006 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T04:00:45.040 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-webob. 2024-08-31T04:00:45.061 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-31T04:00:45.098 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-31T04:00:45.342 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-31T04:00:45.357 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-31T04:00:45.400 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-31T04:00:45.460 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-waitress. 2024-08-31T04:00:45.480 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-31T04:00:45.512 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T04:00:45.695 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-31T04:00:45.711 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-31T04:00:45.753 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-31T04:00:45.796 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-tempita. 2024-08-31T04:00:45.817 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-31T04:00:45.854 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T04:00:46.056 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webob. 2024-08-31T04:00:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-31T04:00:46.114 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-31T04:00:46.166 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-paste. 2024-08-31T04:00:46.186 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-31T04:00:46.223 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T04:00:46.467 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-waitress. 2024-08-31T04:00:46.482 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-31T04:00:46.528 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T04:00:46.535 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-31T04:00:46.556 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-31T04:00:46.593 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T04:00:46.854 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempita. 2024-08-31T04:00:46.869 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-31T04:00:46.888 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-31T04:00:46.909 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-31T04:00:46.911 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T04:00:46.946 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-31T04:00:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-paste. 2024-08-31T04:00:47.180 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-31T04:00:47.215 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T04:00:47.425 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-webtest. 2024-08-31T04:00:47.446 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-08-31T04:00:47.483 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-31T04:00:47.551 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-31T04:00:47.566 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-31T04:00:47.609 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T04:00:47.778 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pecan. 2024-08-31T04:00:47.798 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-31T04:00:47.836 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T04:00:47.887 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-31T04:00:47.902 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-31T04:00:47.962 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-31T04:00:48.199 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-certifi. 2024-08-31T04:00:48.220 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-08-31T04:00:48.249 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-31T04:00:48.491 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webtest. 2024-08-31T04:00:48.505 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-08-31T04:00:48.549 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-31T04:00:49.102 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-idna. 2024-08-31T04:00:49.124 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-31T04:00:49.519 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T04:00:49.652 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pecan. 2024-08-31T04:00:49.667 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-31T04:00:49.702 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T04:00:49.848 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-urllib3. 2024-08-31T04:00:49.868 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-31T04:00:49.906 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T04:00:50.073 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-certifi. 2024-08-31T04:00:50.088 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-08-31T04:00:50.123 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-31T04:00:50.234 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-requests. 2024-08-31T04:00:50.255 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-31T04:00:50.292 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T04:00:50.451 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-idna. 2024-08-31T04:00:50.466 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-31T04:00:50.509 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T04:00:50.578 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-31T04:00:50.590 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-31T04:00:50.628 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T04:00:50.821 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-urllib3. 2024-08-31T04:00:50.836 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-31T04:00:50.879 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T04:00:50.923 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-31T04:00:50.935 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:00:50.973 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:51.224 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests. 2024-08-31T04:00:51.239 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-31T04:00:51.282 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T04:00:51.328 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-31T04:00:51.349 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:51.378 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:51.593 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-31T04:00:51.609 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-31T04:00:51.651 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T04:00:51.723 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-31T04:00:51.744 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-31T04:00:51.781 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-31T04:00:51.921 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-31T04:00:51.936 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:00:51.971 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:52.084 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-openssl. 2024-08-31T04:00:52.105 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-08-31T04:00:52.142 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-31T04:00:52.384 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-31T04:00:52.399 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:52.443 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:52.678 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr. 2024-08-31T04:00:52.699 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../065-ceph-mgr_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:52.736 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:52.796 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-31T04:00:52.812 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-31T04:00:52.854 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-31T04:00:53.132 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mon. 2024-08-31T04:00:53.133 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-openssl. 2024-08-31T04:00:53.147 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-08-31T04:00:53.153 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../066-ceph-mon_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:53.190 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mon (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:53.203 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-31T04:00:53.526 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr. 2024-08-31T04:00:53.542 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../065-ceph-mgr_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:53.584 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:53.785 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-osd. 2024-08-31T04:00:53.806 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../067-ceph-osd_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:53.843 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-osd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:53.996 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mon. 2024-08-31T04:00:54.011 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../066-ceph-mon_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:54.054 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mon (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:54.633 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-osd. 2024-08-31T04:00:54.647 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../067-ceph-osd_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:54.683 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-osd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:55.047 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph. 2024-08-31T04:00:55.067 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../068-ceph_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:55.105 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:55.408 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-fuse. 2024-08-31T04:00:55.429 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../069-ceph-fuse_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:55.466 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:55.511 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph. 2024-08-31T04:00:55.525 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../068-ceph_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:55.569 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:55.828 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mds. 2024-08-31T04:00:55.848 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../070-ceph-mds_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:55.871 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-fuse. 2024-08-31T04:00:55.885 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mds (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:55.886 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../069-ceph-fuse_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:55.955 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:56.266 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mds. 2024-08-31T04:00:56.281 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../070-ceph-mds_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:56.314 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package cephadm. 2024-08-31T04:00:56.324 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mds (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:56.335 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../071-cephadm_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:56.380 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:56.700 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-31T04:00:56.721 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-31T04:00:56.744 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephadm. 2024-08-31T04:00:56.758 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-31T04:00:56.759 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../071-cephadm_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:00:56.802 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:57.078 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-31T04:00:57.099 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T04:00:57.136 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T04:00:57.138 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-31T04:00:57.153 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-31T04:00:57.196 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-31T04:00:57.508 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-31T04:00:57.522 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T04:00:57.585 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T04:00:58.125 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-babel. 2024-08-31T04:00:58.137 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T04:00:58.174 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T04:00:58.511 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-jinja2. 2024-08-31T04:00:58.533 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-31T04:00:58.546 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-babel. 2024-08-31T04:00:58.560 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T04:00:58.577 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T04:00:58.796 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T04:00:58.914 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-31T04:00:58.936 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:00:58.981 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:59.107 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jinja2. 2024-08-31T04:00:59.121 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-31T04:00:59.166 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T04:00:59.318 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-31T04:00:59.339 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-08-31T04:00:59.384 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-31T04:00:59.519 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-31T04:00:59.532 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:00:59.577 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:00:59.687 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-routes. 2024-08-31T04:00:59.708 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-31T04:00:59.745 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T04:00:59.913 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-31T04:00:59.927 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-08-31T04:00:59.972 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-31T04:01:00.099 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-31T04:01:00.115 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:00.157 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:00.275 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-routes. 2024-08-31T04:01:00.288 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-31T04:01:00.333 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T04:01:00.686 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-31T04:01:00.699 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:00.744 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:03.058 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-31T04:01:03.073 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-31T04:01:03.116 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T04:01:03.129 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-31T04:01:03.143 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-31T04:01:03.287 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T04:01:03.686 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-joblib. 2024-08-31T04:01:03.700 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-31T04:01:03.744 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T04:01:03.808 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-joblib. 2024-08-31T04:01:03.821 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-31T04:01:03.858 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T04:01:04.140 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-31T04:01:04.154 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-31T04:01:04.187 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-31T04:01:04.208 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-31T04:01:04.275 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-31T04:01:04.338 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-31T04:01:04.594 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn. 2024-08-31T04:01:04.608 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-31T04:01:04.642 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-sklearn. 2024-08-31T04:01:04.653 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T04:01:04.663 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-31T04:01:04.708 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T04:01:05.295 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-31T04:01:05.310 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:05.353 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:05.409 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-31T04:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:05.475 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:06.350 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cachetools. 2024-08-31T04:01:06.366 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-08-31T04:01:06.415 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-31T04:01:06.437 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-cachetools. 2024-08-31T04:01:06.459 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-08-31T04:01:06.503 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-31T04:01:06.718 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-31T04:01:06.734 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-31T04:01:06.776 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-31T04:01:06.856 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-31T04:01:06.878 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-31T04:01:06.931 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-31T04:01:07.138 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-31T04:01:07.153 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-31T04:01:07.196 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T04:01:07.302 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-31T04:01:07.323 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-31T04:01:07.368 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T04:01:07.541 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rsa. 2024-08-31T04:01:07.556 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-08-31T04:01:07.599 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-31T04:01:07.679 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-rsa. 2024-08-31T04:01:07.700 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-08-31T04:01:07.745 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-31T04:01:07.886 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-google-auth. 2024-08-31T04:01:07.901 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-08-31T04:01:07.936 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-31T04:01:08.075 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-google-auth. 2024-08-31T04:01:08.096 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-08-31T04:01:08.141 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-31T04:01:08.289 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-31T04:01:08.305 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-31T04:01:08.347 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T04:01:08.452 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-31T04:01:08.474 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-31T04:01:08.519 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T04:01:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-websocket. 2024-08-31T04:01:08.700 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-08-31T04:01:08.742 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-31T04:01:08.855 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-websocket. 2024-08-31T04:01:08.877 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-08-31T04:01:08.930 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-31T04:01:09.301 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-31T04:01:09.322 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-31T04:01:09.337 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-31T04:01:09.353 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-31T04:01:09.375 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T04:01:09.395 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T04:01:10.051 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-31T04:01:10.066 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:10.106 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-31T04:01:10.112 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:10.119 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:10.164 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:10.429 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-31T04:01:10.443 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-31T04:01:10.479 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T04:01:10.484 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-31T04:01:10.506 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-31T04:01:10.550 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T04:01:10.849 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-31T04:01:10.863 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T04:01:10.870 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-31T04:01:10.893 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T04:01:10.907 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T04:01:10.928 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T04:01:11.159 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package jq. 2024-08-31T04:01:11.173 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T04:01:11.190 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package jq. 2024-08-31T04:01:11.212 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T04:01:11.217 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-31T04:01:11.256 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-31T04:01:11.495 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package socat. 2024-08-31T04:01:11.509 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package socat. 2024-08-31T04:01:11.509 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-31T04:01:11.531 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-31T04:01:11.553 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-31T04:01:11.575 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-31T04:01:11.848 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package xmlstarlet. 2024-08-31T04:01:11.863 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-31T04:01:11.907 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-31T04:01:11.912 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package xmlstarlet. 2024-08-31T04:01:11.925 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-31T04:01:11.962 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-31T04:01:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-test. 2024-08-31T04:01:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../099-ceph-test_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:12.319 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-test (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:12.360 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-test. 2024-08-31T04:01:12.373 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../099-ceph-test_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:12.410 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-test (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:14.509 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-volume. 2024-08-31T04:01:14.525 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../100-ceph-volume_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:14.567 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-volume (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:14.938 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-31T04:01:14.953 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../101-cephfs-mirror_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:14.988 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-mirror (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:15.048 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ceph-volume. 2024-08-31T04:01:15.070 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../100-ceph-volume_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:15.114 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ceph-volume (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:15.290 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-colorama. 2024-08-31T04:01:15.306 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-08-31T04:01:15.374 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-08-31T04:01:15.485 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-31T04:01:15.507 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../101-cephfs-mirror_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:15.552 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking cephfs-mirror (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:15.635 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-shell. 2024-08-31T04:01:15.652 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../103-cephfs-shell_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:15.693 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-shell (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:15.847 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-colorama. 2024-08-31T04:01:15.869 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-08-31T04:01:15.913 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-08-31T04:01:15.979 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-top. 2024-08-31T04:01:15.994 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../104-cephfs-top_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:16.037 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-top (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:16.199 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package cephfs-shell. 2024-08-31T04:01:16.221 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../103-cephfs-shell_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:16.273 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-31T04:01:16.274 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking cephfs-shell (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:16.288 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../105-libcephfs-dev_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:16.323 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs-dev (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:16.585 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package cephfs-top. 2024-08-31T04:01:16.607 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../104-cephfs-top_19.3.0-4560-gd19e6118-1jammy_all.deb ... 2024-08-31T04:01:16.667 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-31T04:01:16.677 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking cephfs-top (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:16.682 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-31T04:01:16.725 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T04:01:16.938 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-31T04:01:16.960 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../105-libcephfs-dev_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:17.004 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libcephfs-dev (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:17.097 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-31T04:01:17.112 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-08-31T04:01:17.155 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-31T04:01:17.316 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-31T04:01:17.338 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-31T04:01:17.382 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T04:01:17.526 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package nvme-cli. 2024-08-31T04:01:17.542 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-31T04:01:17.584 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T04:01:17.729 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-31T04:01:17.751 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-08-31T04:01:17.787 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-31T04:01:18.006 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package pkg-config. 2024-08-31T04:01:18.021 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-31T04:01:18.072 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T04:01:18.141 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package nvme-cli. 2024-08-31T04:01:18.163 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-31T04:01:18.207 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T04:01:18.367 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-31T04:01:18.379 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-31T04:01:18.417 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-31T04:01:18.655 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package pkg-config. 2024-08-31T04:01:18.677 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-31T04:01:18.713 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T04:01:18.870 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-31T04:01:18.883 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-31T04:01:18.920 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-31T04:01:18.957 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-31T04:01:18.970 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-31T04:01:19.007 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-31T04:01:19.419 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-31T04:01:19.442 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-31T04:01:19.485 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-31T04:01:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastescript. 2024-08-31T04:01:19.501 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-08-31T04:01:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-31T04:01:19.788 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pastescript. 2024-08-31T04:01:19.811 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-08-31T04:01:19.826 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pluggy. 2024-08-31T04:01:19.841 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-31T04:01:19.855 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-31T04:01:19.901 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-31T04:01:20.168 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pluggy. 2024-08-31T04:01:20.189 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-31T04:01:20.195 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-psutil. 2024-08-31T04:01:20.207 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-31T04:01:20.233 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-31T04:01:20.245 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-31T04:01:20.545 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-psutil. 2024-08-31T04:01:20.567 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-31T04:01:20.581 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-py. 2024-08-31T04:01:20.593 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-08-31T04:01:20.611 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-31T04:01:20.631 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-31T04:01:20.956 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-py. 2024-08-31T04:01:20.968 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pygments. 2024-08-31T04:01:20.979 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-08-31T04:01:20.980 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-31T04:01:21.018 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T04:01:21.022 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-31T04:01:21.351 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pygments. 2024-08-31T04:01:21.373 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-31T04:01:21.417 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T04:01:21.446 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-31T04:01:21.459 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-31T04:01:21.530 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-31T04:01:21.841 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-toml. 2024-08-31T04:01:21.853 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-08-31T04:01:21.891 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-31T04:01:21.905 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-31T04:01:21.928 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-31T04:01:21.971 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-31T04:01:22.221 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pytest. 2024-08-31T04:01:22.231 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-31T04:01:22.268 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T04:01:22.291 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-toml. 2024-08-31T04:01:22.313 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-08-31T04:01:22.357 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-31T04:01:22.630 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplejson. 2024-08-31T04:01:22.642 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-31T04:01:22.669 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-pytest. 2024-08-31T04:01:22.680 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-31T04:01:22.691 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-31T04:01:22.735 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T04:01:22.950 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-31T04:01:22.964 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-31T04:01:23.008 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-31T04:01:23.089 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package python3-simplejson. 2024-08-31T04:01:23.111 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-31T04:01:23.155 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-31T04:01:23.425 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-31T04:01:23.448 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-31T04:01:23.492 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-31T04:01:23.695 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package radosgw. 2024-08-31T04:01:23.708 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../122-radosgw_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:23.770 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking radosgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:24.346 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package radosgw. 2024-08-31T04:01:24.369 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../122-radosgw_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:24.421 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking radosgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:24.682 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package rbd-fuse. 2024-08-31T04:01:24.696 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../123-rbd-fuse_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:24.739 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking rbd-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:25.066 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-31T04:01:25.337 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T04:01:25.462 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T04:01:25.599 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package rbd-fuse. 2024-08-31T04:01:25.612 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../123-rbd-fuse_19.3.0-4560-gd19e6118-1jammy_amd64.deb ... 2024-08-31T04:01:25.649 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking rbd-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:25.700 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-31T04:01:25.961 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-31T04:01:26.101 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-31T04:01:26.222 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T04:01:26.347 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T04:01:26.609 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-31T04:01:26.693 INFO:teuthology.orchestra.run.smithi089.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-31T04:01:26.733 INFO:teuthology.orchestra.run.smithi089.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-08-31T04:01:26.839 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:26.966 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-31T04:01:27.375 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user cephadm....done 2024-08-31T04:01:27.472 INFO:teuthology.orchestra.run.smithi170.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-31T04:01:27.529 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T04:01:27.574 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:27.797 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-31T04:01:28.057 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-31T04:01:28.141 INFO:teuthology.orchestra.run.smithi170.stdout:Adding system user cephadm....done 2024-08-31T04:01:28.216 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-31T04:01:28.313 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T04:01:28.475 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-31T04:01:28.590 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-31T04:01:28.756 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T04:01:28.841 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-31T04:01:28.886 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-31T04:01:28.951 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-31T04:01:29.188 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T04:01:29.210 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-31T04:01:29.478 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T04:01:29.573 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-31T04:01:29.604 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-31T04:01:29.841 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-08-31T04:01:29.906 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T04:01:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-31T04:01:30.266 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-31T04:01:30.410 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-31T04:01:30.559 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-08-31T04:01:30.670 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-31T04:01:30.820 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-31T04:01:30.962 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-31T04:01:31.087 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-31T04:01:31.255 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-31T04:01:31.355 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-31T04:01:31.523 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-argparse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:31.623 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-31T04:01:31.815 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T04:01:31.916 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T04:01:31.941 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-31T04:01:32.026 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-08-31T04:01:32.200 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-ceph-argparse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:32.319 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T04:01:32.445 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-31T04:01:32.459 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T04:01:32.585 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T04:01:32.712 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-08-31T04:01:32.712 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-31T04:01:32.962 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T04:01:33.089 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-31T04:01:33.110 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-31T04:01:33.143 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-31T04:01:33.224 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T04:01:33.325 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-31T04:01:33.340 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-31T04:01:33.676 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T04:01:33.740 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-31T04:01:33.771 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-31T04:01:33.828 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-31T04:01:33.835 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T04:01:33.961 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-31T04:01:34.104 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T04:01:34.320 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T04:01:34.380 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-31T04:01:34.447 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-31T04:01:34.715 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T04:01:34.715 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up zip (3.0-12build2) ... 2024-08-31T04:01:34.857 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T04:01:34.990 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-31T04:01:35.292 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up zip (3.0-12build2) ... 2024-08-31T04:01:35.418 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T04:01:35.534 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T04:01:35.810 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T04:01:35.961 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-31T04:01:36.087 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T04:01:36.095 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T04:01:36.346 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T04:01:36.405 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-31T04:01:36.472 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-31T04:01:36.598 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T04:01:36.831 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-31T04:01:36.900 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-31T04:01:37.091 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T04:01:37.268 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-31T04:01:37.467 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T04:01:37.519 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T04:01:37.760 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-08-31T04:01:37.878 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T04:01:38.078 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T04:01:38.163 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-08-31T04:01:38.463 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-31T04:01:38.506 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T04:01:38.747 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-31T04:01:38.849 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-31T04:01:38.873 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:39.100 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-31T04:01:39.166 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T04:01:39.226 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:39.528 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T04:01:39.543 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T04:01:39.837 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T04:01:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T04:01:40.992 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:01:41.043 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T04:01:41.126 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-31T04:01:41.337 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:01:41.394 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T04:01:41.471 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-31T04:01:41.545 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-31T04:01:41.671 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T04:01:41.756 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T04:01:41.882 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-31T04:01:41.972 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-31T04:01:42.009 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T04:01:42.257 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-31T04:01:42.318 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-31T04:01:42.491 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:01:42.569 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-31T04:01:42.634 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-31T04:01:42.812 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:01:42.938 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-31T04:01:42.952 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-31T04:01:43.212 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-31T04:01:43.231 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-31T04:01:43.487 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-31T04:01:43.490 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-31T04:01:43.750 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-31T04:01:43.756 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-31T04:01:44.001 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-31T04:01:44.015 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-31T04:01:44.252 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-31T04:01:44.291 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T04:01:44.392 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-31T04:01:44.520 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T04:01:44.646 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-31T04:01:44.685 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T04:01:44.836 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T04:01:44.931 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T04:01:45.057 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T04:01:45.129 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-31T04:01:45.358 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-31T04:01:45.446 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-31T04:01:45.659 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-31T04:01:45.714 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T04:01:45.857 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-31T04:01:45.902 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T04:01:45.958 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T04:01:46.011 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-31T04:01:46.029 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-31T04:01:46.129 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T04:01:46.218 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-31T04:01:46.277 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T04:01:46.427 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T04:01:46.811 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T04:01:46.821 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-31T04:01:46.990 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T04:01:47.105 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-31T04:01:47.231 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-31T04:01:47.367 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-31T04:01:47.521 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:01:47.633 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T04:01:47.634 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-31T04:01:47.761 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-31T04:01:47.942 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T04:01:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T04:01:48.121 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T04:01:48.252 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T04:01:48.472 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T04:01:48.537 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-31T04:01:48.773 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-31T04:01:48.782 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T04:01:49.049 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-31T04:01:49.050 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-31T04:01:49.269 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-31T04:01:49.309 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T04:01:49.545 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-31T04:01:49.577 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-31T04:01:49.821 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T04:01:50.073 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-31T04:01:50.095 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-31T04:01:50.397 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T04:01:50.458 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-31T04:01:50.726 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T04:01:50.749 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T04:01:50.875 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librados2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:51.010 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:51.062 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T04:01:51.136 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-31T04:01:51.188 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librados2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:51.314 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-31T04:01:51.497 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:51.623 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libradosstriper1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:51.740 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-31T04:01:51.785 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libcephfs2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:51.911 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libradosstriper1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:52.037 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-31T04:01:52.042 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librbd1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:52.168 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-modules-core (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:52.294 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:52.313 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librbd1 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:52.441 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-modules-core (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:52.507 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T04:01:52.507 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T04:01:52.566 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:52.788 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T04:01:52.788 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T04:01:53.145 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs-dev (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:53.271 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rados (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:53.325 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libcephfs-dev (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:53.398 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librgw2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:53.452 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rados (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:53.524 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-top (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:53.586 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up librgw2 (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:53.683 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T04:01:53.695 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up cephfs-top (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:53.821 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T04:01:54.954 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rbd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.067 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rbd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.079 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up rbd-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.193 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up rbd-fuse (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.214 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.319 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-rgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.356 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cephfs (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.445 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up python3-cephfs (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.482 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-shell (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.571 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up cephfs-shell (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.601 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:55.697 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-common (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:56.153 INFO:teuthology.orchestra.run.smithi089.stdout:Adding group ceph....done 2024-08-31T04:01:56.198 INFO:teuthology.orchestra.run.smithi170.stdout:Adding group ceph....done 2024-08-31T04:01:56.571 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user ceph....done 2024-08-31T04:01:56.574 INFO:teuthology.orchestra.run.smithi170.stdout:Adding system user ceph....done 2024-08-31T04:01:56.736 INFO:teuthology.orchestra.run.smithi170.stdout:Setting system user ceph properties....done 2024-08-31T04:01:56.748 INFO:teuthology.orchestra.run.smithi170.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-31T04:01:56.749 INFO:teuthology.orchestra.run.smithi089.stdout:Setting system user ceph properties....done 2024-08-31T04:01:56.768 INFO:teuthology.orchestra.run.smithi089.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-31T04:01:56.895 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-31T04:01:56.907 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-31T04:01:57.257 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-31T04:01:57.309 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-31T04:01:57.807 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up cephfs-mirror (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:58.010 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:01:58.010 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:01:58.027 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-mirror (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:58.237 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:01:58.237 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:01:58.509 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-test (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:58.618 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up radosgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:58.845 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-test (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:58.971 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up radosgw (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:59.102 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:01:59.103 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:01:59.501 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:01:59.502 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:01:59.587 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-base (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:01:59.948 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-31T04:02:00.123 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-base (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:00.464 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mds (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:00.521 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-31T04:02:00.694 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T04:02:00.694 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T04:02:01.241 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:01.243 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mds (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:01.452 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T04:02:01.452 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T04:02:01.458 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T04:02:01.458 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T04:02:01.984 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-osd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:02.086 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:02.301 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T04:02:02.301 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T04:02:02.305 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T04:02:02.305 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T04:02:02.812 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:02.913 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-osd (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:02.938 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:03.089 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mon (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:03.249 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T04:02:03.249 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T04:02:03.304 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T04:02:03.304 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T04:02:03.798 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:03.889 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:03.933 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:03.999 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:04.059 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-mgr-dashboard (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:04.142 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mon (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:04.210 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ceph-volume (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:04.350 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T04:02:04.350 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T04:02:04.564 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T04:02:04.664 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T04:02:04.817 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T04:02:05.001 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-cephadm (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:05.144 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:05.295 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-dashboard (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:05.505 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-volume (19.3.0-4560-gd19e6118-1jammy) ... 2024-08-31T04:02:05.875 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T04:02:05.953 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T04:02:05.976 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T04:02:06.127 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T04:02:06.635 INFO:teuthology.orchestra.run.smithi170.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T04:02:06.638 DEBUG:teuthology.orchestra.run.smithi170:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-08-31T04:02:06.740 INFO:teuthology.orchestra.run.smithi170.stdout:Reading package lists... 2024-08-31T04:02:06.951 INFO:teuthology.orchestra.run.smithi170.stdout:Building dependency tree... 2024-08-31T04:02:06.951 INFO:teuthology.orchestra.run.smithi170.stdout:Reading state information... 2024-08-31T04:02:07.141 INFO:teuthology.orchestra.run.smithi170.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-08-31T04:02:07.142 INFO:teuthology.orchestra.run.smithi170.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-08-31T04:02:07.142 INFO:teuthology.orchestra.run.smithi170.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-08-31T04:02:07.142 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T04:02:07.142 INFO:teuthology.orchestra.run.smithi170.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T04:02:07.142 INFO:teuthology.orchestra.run.smithi170.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T04:02:07.143 INFO:teuthology.orchestra.run.smithi170.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T04:02:07.143 INFO:teuthology.orchestra.run.smithi170.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-31T04:02:07.143 INFO:teuthology.orchestra.run.smithi170.stdout: python2.7-minimal 2024-08-31T04:02:07.144 INFO:teuthology.orchestra.run.smithi170.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T04:02:07.144 INFO:teuthology.orchestra.run.smithi170.stdout:The following additional packages will be installed: 2024-08-31T04:02:07.144 INFO:teuthology.orchestra.run.smithi170.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-08-31T04:02:07.144 INFO:teuthology.orchestra.run.smithi170.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-08-31T04:02:07.145 INFO:teuthology.orchestra.run.smithi170.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-08-31T04:02:07.145 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-08-31T04:02:07.145 INFO:teuthology.orchestra.run.smithi170.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-31T04:02:07.145 INFO:teuthology.orchestra.run.smithi170.stdout:Suggested packages: 2024-08-31T04:02:07.146 INFO:teuthology.orchestra.run.smithi170.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-08-31T04:02:07.146 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-08-31T04:02:07.146 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-31T04:02:07.189 INFO:teuthology.orchestra.run.smithi170.stdout:The following NEW packages will be installed: 2024-08-31T04:02:07.189 INFO:teuthology.orchestra.run.smithi170.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-08-31T04:02:07.189 INFO:teuthology.orchestra.run.smithi170.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-08-31T04:02:07.189 INFO:teuthology.orchestra.run.smithi170.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-08-31T04:02:07.189 INFO:teuthology.orchestra.run.smithi170.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-08-31T04:02:07.190 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-08-31T04:02:07.190 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-08-31T04:02:07.190 INFO:teuthology.orchestra.run.smithi170.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-31T04:02:07.191 INFO:teuthology.orchestra.run.smithi170.stdout:The following packages will be upgraded: 2024-08-31T04:02:07.191 INFO:teuthology.orchestra.run.smithi170.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-08-31T04:02:07.212 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T04:02:07.372 INFO:teuthology.orchestra.run.smithi170.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-08-31T04:02:07.372 INFO:teuthology.orchestra.run.smithi170.stdout:Need to get 55.8 MB of archives. 2024-08-31T04:02:07.372 INFO:teuthology.orchestra.run.smithi170.stdout:After this operation, 203 MB of additional disk space will be used. 2024-08-31T04:02:07.372 INFO:teuthology.orchestra.run.smithi170.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-08-31T04:02:07.907 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T04:02:07.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-08-31T04:02:07.988 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-08-31T04:02:07.990 INFO:teuthology.orchestra.run.smithi170.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-08-31T04:02:08.007 INFO:teuthology.orchestra.run.smithi170.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.17 [1,905 kB] 2024-08-31T04:02:08.131 INFO:teuthology.orchestra.run.smithi170.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-08-31T04:02:08.132 INFO:teuthology.orchestra.run.smithi170.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-08-31T04:02:08.133 INFO:teuthology.orchestra.run.smithi170.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-08-31T04:02:08.161 INFO:teuthology.orchestra.run.smithi170.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-08-31T04:02:08.163 INFO:teuthology.orchestra.run.smithi170.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-08-31T04:02:08.166 INFO:teuthology.orchestra.run.smithi170.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-08-31T04:02:08.169 INFO:teuthology.orchestra.run.smithi170.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-08-31T04:02:08.170 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-08-31T04:02:08.170 INFO:teuthology.orchestra.run.smithi170.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-08-31T04:02:08.170 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-08-31T04:02:08.172 INFO:teuthology.orchestra.run.smithi170.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-08-31T04:02:08.235 INFO:teuthology.orchestra.run.smithi170.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-08-31T04:02:08.235 INFO:teuthology.orchestra.run.smithi170.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-08-31T04:02:08.235 INFO:teuthology.orchestra.run.smithi170.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-08-31T04:02:08.316 INFO:teuthology.orchestra.run.smithi170.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-08-31T04:02:08.354 INFO:teuthology.orchestra.run.smithi089.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-08-31T04:02:08.355 INFO:teuthology.orchestra.run.smithi089.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-08-31T04:02:08.355 INFO:teuthology.orchestra.run.smithi089.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-08-31T04:02:08.355 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T04:02:08.355 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T04:02:08.355 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T04:02:08.355 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T04:02:08.356 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T04:02:08.356 INFO:teuthology.orchestra.run.smithi089.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T04:02:08.356 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T04:02:08.356 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2024-08-31T04:02:08.356 INFO:teuthology.orchestra.run.smithi089.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-08-31T04:02:08.357 INFO:teuthology.orchestra.run.smithi089.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-08-31T04:02:08.357 INFO:teuthology.orchestra.run.smithi089.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-08-31T04:02:08.357 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-08-31T04:02:08.357 INFO:teuthology.orchestra.run.smithi089.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-31T04:02:08.358 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2024-08-31T04:02:08.358 INFO:teuthology.orchestra.run.smithi089.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-08-31T04:02:08.359 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-08-31T04:02:08.359 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-31T04:02:08.415 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2024-08-31T04:02:08.416 INFO:teuthology.orchestra.run.smithi089.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-08-31T04:02:08.416 INFO:teuthology.orchestra.run.smithi089.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-08-31T04:02:08.416 INFO:teuthology.orchestra.run.smithi089.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-08-31T04:02:08.416 INFO:teuthology.orchestra.run.smithi089.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-08-31T04:02:08.416 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-08-31T04:02:08.417 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-08-31T04:02:08.417 INFO:teuthology.orchestra.run.smithi089.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-31T04:02:08.418 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2024-08-31T04:02:08.418 INFO:teuthology.orchestra.run.smithi089.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-08-31T04:02:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-08-31T04:02:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 55.8 MB of archives. 2024-08-31T04:02:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 203 MB of additional disk space will be used. 2024-08-31T04:02:08.603 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-08-31T04:02:09.110 INFO:teuthology.orchestra.run.smithi170.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-08-31T04:02:09.114 INFO:teuthology.orchestra.run.smithi170.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-08-31T04:02:09.114 INFO:teuthology.orchestra.run.smithi170.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-08-31T04:02:09.119 INFO:teuthology.orchestra.run.smithi170.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-08-31T04:02:09.120 INFO:teuthology.orchestra.run.smithi170.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-08-31T04:02:09.130 INFO:teuthology.orchestra.run.smithi170.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-08-31T04:02:09.133 INFO:teuthology.orchestra.run.smithi170.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-08-31T04:02:09.148 INFO:teuthology.orchestra.run.smithi170.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-08-31T04:02:09.148 INFO:teuthology.orchestra.run.smithi170.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.17 [2,375 kB] 2024-08-31T04:02:09.215 INFO:teuthology.orchestra.run.smithi170.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-08-31T04:02:09.222 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-08-31T04:02:09.233 INFO:teuthology.orchestra.run.smithi170.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-08-31T04:02:09.237 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.17 [1,905 kB] 2024-08-31T04:02:09.255 INFO:teuthology.orchestra.run.smithi170.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-08-31T04:02:09.323 INFO:teuthology.orchestra.run.smithi170.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-08-31T04:02:09.328 INFO:teuthology.orchestra.run.smithi170.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-08-31T04:02:09.330 INFO:teuthology.orchestra.run.smithi170.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-08-31T04:02:09.330 INFO:teuthology.orchestra.run.smithi170.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-08-31T04:02:09.331 INFO:teuthology.orchestra.run.smithi170.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-08-31T04:02:09.359 INFO:teuthology.orchestra.run.smithi170.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-08-31T04:02:09.361 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-08-31T04:02:09.362 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-08-31T04:02:09.363 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-08-31T04:02:09.375 INFO:teuthology.orchestra.run.smithi170.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-08-31T04:02:09.392 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-08-31T04:02:09.393 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-08-31T04:02:09.396 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-08-31T04:02:09.399 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-08-31T04:02:09.399 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-08-31T04:02:09.401 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-08-31T04:02:09.466 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-08-31T04:02:09.466 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-08-31T04:02:09.466 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-08-31T04:02:09.547 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-08-31T04:02:09.913 INFO:teuthology.orchestra.run.smithi170.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-08-31T04:02:09.913 INFO:teuthology.orchestra.run.smithi170.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-08-31T04:02:09.913 INFO:teuthology.orchestra.run.smithi170.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-08-31T04:02:09.914 INFO:teuthology.orchestra.run.smithi170.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-08-31T04:02:09.914 INFO:teuthology.orchestra.run.smithi170.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-08-31T04:02:09.914 INFO:teuthology.orchestra.run.smithi170.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-08-31T04:02:09.938 INFO:teuthology.orchestra.run.smithi170.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-08-31T04:02:09.938 INFO:teuthology.orchestra.run.smithi170.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-08-31T04:02:10.227 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-08-31T04:02:10.229 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-08-31T04:02:10.229 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-08-31T04:02:10.232 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-08-31T04:02:10.232 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-08-31T04:02:10.237 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-08-31T04:02:10.238 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-08-31T04:02:10.286 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-08-31T04:02:10.286 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.17 [2,375 kB] 2024-08-31T04:02:10.322 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-08-31T04:02:10.341 INFO:teuthology.orchestra.run.smithi170.stdout:Preconfiguring packages ... 2024-08-31T04:02:10.368 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-08-31T04:02:10.379 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-08-31T04:02:10.455 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-08-31T04:02:10.458 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-08-31T04:02:10.459 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-08-31T04:02:10.460 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-08-31T04:02:10.460 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-08-31T04:02:10.478 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-08-31T04:02:10.480 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-08-31T04:02:10.488 INFO:teuthology.orchestra.run.smithi170.stdout:Fetched 55.8 MB in 3s (20.3 MB/s) 2024-08-31T04:02:10.802 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140857 files and directories currently installed.) 2024-08-31T04:02:10.807 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T04:02:10.951 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T04:02:10.961 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-08-31T04:02:10.961 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-08-31T04:02:10.961 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-08-31T04:02:10.962 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-08-31T04:02:10.962 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-08-31T04:02:10.962 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-08-31T04:02:11.024 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-08-31T04:02:11.024 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-08-31T04:02:11.403 INFO:teuthology.orchestra.run.smithi089.stdout:Preconfiguring packages ... 2024-08-31T04:02:11.565 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 55.8 MB in 3s (21.5 MB/s) 2024-08-31T04:02:11.620 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-08-31T04:02:11.874 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143281 files and directories currently installed.) 2024-08-31T04:02:11.878 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T04:02:12.021 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T04:02:12.602 INFO:teuthology.orchestra.run.smithi170.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-08-31T04:02:12.672 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-08-31T04:02:12.915 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package flex. 2024-08-31T04:02:12.998 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140857 files and directories currently installed.) 2024-08-31T04:02:13.002 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-08-31T04:02:13.039 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking flex (2.6.4-8build2) ... 2024-08-31T04:02:13.567 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-31T04:02:13.736 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.17) over (3.0.2-0ubuntu1.7) ... 2024-08-31T04:02:13.804 INFO:teuthology.orchestra.run.smithi089.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-08-31T04:02:14.077 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package flex. 2024-08-31T04:02:14.147 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143281 files and directories currently installed.) 2024-08-31T04:02:14.151 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-08-31T04:02:14.169 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T04:02:14.183 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking flex (2.6.4-8build2) ... 2024-08-31T04:02:14.636 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140930 files and directories currently installed.) 2024-08-31T04:02:14.640 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T04:02:14.720 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-31T04:02:14.768 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T04:02:14.915 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.17) over (3.0.2-0ubuntu1.7) ... 2024-08-31T04:02:15.206 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T04:02:15.313 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T04:02:15.341 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T04:02:15.658 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-31T04:02:15.911 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143354 files and directories currently installed.) 2024-08-31T04:02:15.914 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T04:02:15.984 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package bison. 2024-08-31T04:02:16.039 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T04:02:16.071 INFO:teuthology.orchestra.run.smithi170.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140930 files and directories currently installed.) 2024-08-31T04:02:16.076 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-08-31T04:02:16.111 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-08-31T04:02:16.419 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-31T04:02:16.470 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-31T04:02:16.493 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-08-31T04:02:16.537 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-08-31T04:02:16.546 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-31T04:02:16.873 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package dump. 2024-08-31T04:02:16.895 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-31T04:02:16.895 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-08-31T04:02:16.940 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking dump (0.4b47-3) ... 2024-08-31T04:02:17.235 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package indent. 2024-08-31T04:02:17.257 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:17.272 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package bison. 2024-08-31T04:02:17.310 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-31T04:02:17.346 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143354 files and directories currently installed.) 2024-08-31T04:02:17.350 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-08-31T04:02:17.399 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-08-31T04:02:17.571 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-31T04:02:17.584 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-08-31T04:02:17.621 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-31T04:02:17.823 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-31T04:02:17.838 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-08-31T04:02:17.883 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-08-31T04:02:18.203 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package dump. 2024-08-31T04:02:18.219 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-08-31T04:02:18.261 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking dump (0.4b47-3) ... 2024-08-31T04:02:18.548 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package indent. 2024-08-31T04:02:18.564 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:18.592 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-31T04:02:18.607 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-31T04:02:18.614 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-08-31T04:02:18.659 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-31T04:02:18.851 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-31T04:02:18.867 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-08-31T04:02:18.920 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-31T04:02:18.928 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-31T04:02:18.933 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-08-31T04:02:18.970 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-08-31T04:02:19.247 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-31T04:02:19.264 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-08-31T04:02:19.305 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-31T04:02:19.307 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libfl2:amd64. 2024-08-31T04:02:19.329 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-08-31T04:02:19.373 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-08-31T04:02:19.582 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-31T04:02:19.593 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-08-31T04:02:19.598 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-08-31T04:02:19.615 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-08-31T04:02:19.632 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-08-31T04:02:19.651 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-31T04:02:19.904 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libjson-perl. 2024-08-31T04:02:19.917 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-08-31T04:02:19.954 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-08-31T04:02:19.969 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libfl2:amd64. 2024-08-31T04:02:19.985 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-08-31T04:02:20.052 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-08-31T04:02:20.274 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libllvm14:amd64. 2024-08-31T04:02:20.296 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-08-31T04:02:20.313 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-08-31T04:02:20.329 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-08-31T04:02:20.340 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-31T04:02:20.372 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-31T04:02:20.649 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjson-perl. 2024-08-31T04:02:20.666 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-08-31T04:02:20.708 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-08-31T04:02:21.562 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libllvm14:amd64. 2024-08-31T04:02:21.579 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-08-31T04:02:21.620 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-31T04:02:22.035 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-31T04:02:22.057 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-31T04:02:22.101 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T04:02:22.363 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-31T04:02:22.385 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-31T04:02:22.429 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T04:02:22.748 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-31T04:02:22.771 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-31T04:02:22.815 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T04:02:22.982 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-31T04:02:22.998 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-31T04:02:23.040 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T04:02:23.185 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-31T04:02:23.207 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-08-31T04:02:23.251 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-31T04:02:23.326 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-31T04:02:23.342 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-31T04:02:23.376 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T04:02:23.647 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-31T04:02:23.662 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-31T04:02:23.669 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-08-31T04:02:23.678 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-31T04:02:23.713 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-31T04:02:23.720 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T04:02:24.057 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-31T04:02:24.066 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libpq5:amd64. 2024-08-31T04:02:24.073 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-08-31T04:02:24.089 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:24.107 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-31T04:02:24.133 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:24.442 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-31T04:02:24.459 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-08-31T04:02:24.477 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-31T04:02:24.500 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:24.501 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-31T04:02:24.536 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T04:02:24.863 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libpq5:amd64. 2024-08-31T04:02:24.863 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-31T04:02:24.879 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:24.886 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:24.921 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:24.930 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T04:02:25.174 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-31T04:02:25.187 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-31T04:02:25.224 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T04:02:25.257 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-31T04:02:25.272 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:25.315 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T04:02:25.635 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-31T04:02:25.651 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:25.693 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T04:02:25.770 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-31T04:02:25.792 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-08-31T04:02:25.836 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-08-31T04:02:25.912 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-31T04:02:25.929 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-31T04:02:26.004 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T04:02:26.189 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package modemmanager. 2024-08-31T04:02:26.211 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-31T04:02:26.256 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T04:02:26.634 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-31T04:02:26.650 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-08-31T04:02:26.684 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-08-31T04:02:26.904 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package network-manager. 2024-08-31T04:02:26.927 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-08-31T04:02:26.970 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-08-31T04:02:26.996 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package modemmanager. 2024-08-31T04:02:27.011 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-31T04:02:27.054 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T04:02:27.579 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package ppp. 2024-08-31T04:02:27.601 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-08-31T04:02:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package network-manager. 2024-08-31T04:02:27.677 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-08-31T04:02:27.743 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-08-31T04:02:27.915 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-08-31T04:02:28.225 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package pptp-linux. 2024-08-31T04:02:28.248 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-08-31T04:02:28.291 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-08-31T04:02:28.351 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ppp. 2024-08-31T04:02:28.368 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-08-31T04:02:28.717 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-08-31T04:02:28.924 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-31T04:02:28.949 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-08-31T04:02:29.040 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package pptp-linux. 2024-08-31T04:02:29.054 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-08-31T04:02:29.062 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-08-31T04:02:29.092 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-08-31T04:02:29.307 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-client-common. 2024-08-31T04:02:29.326 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-31T04:02:29.330 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-08-31T04:02:29.341 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-08-31T04:02:29.365 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-client-common (238) ... 2024-08-31T04:02:29.401 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-08-31T04:02:29.677 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-client-14. 2024-08-31T04:02:29.700 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:29.712 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-client-common. 2024-08-31T04:02:29.727 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-08-31T04:02:29.744 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:29.771 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-client-common (238) ... 2024-08-31T04:02:30.074 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-client-14. 2024-08-31T04:02:30.090 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:30.124 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:30.324 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-common. 2024-08-31T04:02:30.346 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-08-31T04:02:30.409 INFO:teuthology.orchestra.run.smithi170.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-08-31T04:02:30.438 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-common (238) ... 2024-08-31T04:02:30.687 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-common. 2024-08-31T04:02:30.702 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-08-31T04:02:30.763 INFO:teuthology.orchestra.run.smithi089.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-08-31T04:02:30.786 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-common (238) ... 2024-08-31T04:02:30.898 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-14. 2024-08-31T04:02:30.920 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:30.967 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:31.278 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-14. 2024-08-31T04:02:31.293 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-08-31T04:02:31.340 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:32.250 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql. 2024-08-31T04:02:32.264 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-08-31T04:02:32.309 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql (14+238) ... 2024-08-31T04:02:32.415 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql. 2024-08-31T04:02:32.430 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-08-31T04:02:32.490 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql (14+238) ... 2024-08-31T04:02:32.553 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-client. 2024-08-31T04:02:32.575 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-08-31T04:02:32.611 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-client (14+238) ... 2024-08-31T04:02:32.772 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-client. 2024-08-31T04:02:32.784 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-08-31T04:02:32.833 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-client (14+238) ... 2024-08-31T04:02:32.838 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package postgresql-contrib. 2024-08-31T04:02:32.851 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-08-31T04:02:32.888 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking postgresql-contrib (14+238) ... 2024-08-31T04:02:33.077 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-contrib. 2024-08-31T04:02:33.093 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-08-31T04:02:33.136 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-contrib (14+238) ... 2024-08-31T04:02:33.191 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package tcl8.6. 2024-08-31T04:02:33.214 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-08-31T04:02:33.257 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-31T04:02:33.455 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package tcl8.6. 2024-08-31T04:02:33.471 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-08-31T04:02:33.505 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-31T04:02:33.526 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package tcl. 2024-08-31T04:02:33.549 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-08-31T04:02:33.597 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-08-31T04:02:33.782 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package tcl. 2024-08-31T04:02:33.799 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-08-31T04:02:33.845 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-08-31T04:02:33.896 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package wpasupplicant. 2024-08-31T04:02:33.909 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-08-31T04:02:33.946 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-31T04:02:34.210 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package wpasupplicant. 2024-08-31T04:02:34.226 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-08-31T04:02:34.268 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-31T04:02:34.342 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-31T04:02:34.364 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-08-31T04:02:34.408 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-08-31T04:02:34.614 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-31T04:02:34.630 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-08-31T04:02:34.664 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-08-31T04:02:34.787 INFO:teuthology.orchestra.run.smithi170.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-31T04:02:34.809 INFO:teuthology.orchestra.run.smithi170.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-08-31T04:02:34.861 INFO:teuthology.orchestra.run.smithi170.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-31T04:02:35.042 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-31T04:02:35.058 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-08-31T04:02:35.108 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-31T04:02:35.147 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-client-common (238) ... 2024-08-31T04:02:35.359 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up flex (2.6.4-8build2) ... 2024-08-31T04:02:35.385 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-client-common (238) ... 2024-08-31T04:02:35.485 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-31T04:02:35.608 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up flex (2.6.4-8build2) ... 2024-08-31T04:02:35.611 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:35.733 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-31T04:02:35.754 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-08-31T04:02:35.834 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:35.905 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-31T04:02:35.943 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-08-31T04:02:36.056 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:36.069 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-31T04:02:36.237 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:36.595 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-08-31T04:02:36.686 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-31T04:02:37.051 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-31T04:02:37.051 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-31T04:02:37.198 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-08-31T04:02:37.310 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-31T04:02:37.564 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-31T04:02:37.687 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-31T04:02:37.687 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-31T04:02:37.693 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-08-31T04:02:37.816 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T04:02:37.942 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-08-31T04:02:38.068 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-08-31T04:02:38.210 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-08-31T04:02:38.345 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-31T04:02:38.405 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-31T04:02:38.471 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-08-31T04:02:38.514 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-08-31T04:02:38.623 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-31T04:02:38.749 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-08-31T04:02:38.901 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-08-31T04:02:39.034 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-08-31T04:02:39.093 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-31T04:02:39.160 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-31T04:02:39.286 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-08-31T04:02:39.494 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up dump (0.4b47-3) ... 2024-08-31T04:02:39.863 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-31T04:02:39.921 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T04:02:39.959 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-31T04:02:40.022 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-31T04:02:40.109 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up dump (0.4b47-3) ... 2024-08-31T04:02:40.149 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up tcl (8.6.11+1build2) ... 2024-08-31T04:02:40.204 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-31T04:02:40.269 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T04:02:40.274 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libjson-perl (4.04000-1) ... 2024-08-31T04:02:40.395 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-31T04:02:40.400 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-08-31T04:02:40.491 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-08-31T04:02:40.530 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up tcl (8.6.11+1build2) ... 2024-08-31T04:02:40.560 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-31T04:02:40.664 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjson-perl (4.04000-1) ... 2024-08-31T04:02:40.686 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-31T04:02:40.765 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-08-31T04:02:40.855 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-08-31T04:02:40.863 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-31T04:02:40.917 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-31T04:02:40.980 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T04:02:41.043 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-31T04:02:41.090 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-08-31T04:02:41.244 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-31T04:02:41.257 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-client (14+238) ... 2024-08-31T04:02:41.373 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T04:02:41.383 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-08-31T04:02:41.513 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-08-31T04:02:41.706 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-client (14+238) ... 2024-08-31T04:02:41.932 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:02:41.932 INFO:teuthology.orchestra.run.smithi170.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-31T04:02:41.932 INFO:teuthology.orchestra.run.smithi170.stdout:which means they are currently configured by ifupdown: 2024-08-31T04:02:41.932 INFO:teuthology.orchestra.run.smithi170.stdout:- enp3s0f1 2024-08-31T04:02:41.932 INFO:teuthology.orchestra.run.smithi170.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-31T04:02:41.932 INFO:teuthology.orchestra.run.smithi170.stdout:remove their configuration from /etc/network/interfaces. 2024-08-31T04:02:41.932 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:02:42.048 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-31T04:02:42.176 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-08-31T04:02:42.416 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-31T04:02:42.769 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-31T04:02:42.816 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:02:42.816 INFO:teuthology.orchestra.run.smithi089.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-31T04:02:42.816 INFO:teuthology.orchestra.run.smithi089.stdout:which means they are currently configured by ifupdown: 2024-08-31T04:02:42.816 INFO:teuthology.orchestra.run.smithi089.stdout:- enp3s0f1 2024-08-31T04:02:42.816 INFO:teuthology.orchestra.run.smithi089.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-31T04:02:42.817 INFO:teuthology.orchestra.run.smithi089.stdout:remove their configuration from /etc/network/interfaces. 2024-08-31T04:02:42.817 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:02:42.948 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-31T04:02:43.302 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T04:02:43.370 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-31T04:02:43.429 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-31T04:02:43.555 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-08-31T04:02:43.681 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-common (238) ... 2024-08-31T04:02:43.786 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-31T04:02:44.509 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-31T04:02:44.653 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-31T04:02:44.718 INFO:teuthology.orchestra.run.smithi170.stdout:Adding user postgres to group ssl-cert 2024-08-31T04:02:44.779 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-08-31T04:02:44.913 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-common (238) ... 2024-08-31T04:02:44.972 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:02:44.972 INFO:teuthology.orchestra.run.smithi170.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-08-31T04:02:45.178 INFO:teuthology.orchestra.run.smithi170.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-08-31T04:02:45.178 INFO:teuthology.orchestra.run.smithi170.stdout:Removing obsolete dictionary files: 2024-08-31T04:02:45.761 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-08-31T04:02:45.901 INFO:teuthology.orchestra.run.smithi089.stdout:Adding user postgres to group ssl-cert 2024-08-31T04:02:46.167 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:46.169 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:02:46.169 INFO:teuthology.orchestra.run.smithi089.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-08-31T04:02:46.427 INFO:teuthology.orchestra.run.smithi089.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-08-31T04:02:46.427 INFO:teuthology.orchestra.run.smithi089.stdout:Removing obsolete dictionary files: 2024-08-31T04:02:46.490 INFO:teuthology.orchestra.run.smithi170.stdout:Creating new PostgreSQL cluster 14/main ... 2024-08-31T04:02:46.511 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-08-31T04:02:46.558 INFO:teuthology.orchestra.run.smithi170.stdout:The files belonging to this database system will be owned by user "postgres". 2024-08-31T04:02:46.558 INFO:teuthology.orchestra.run.smithi170.stdout:This user must also own the server process. 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout:The database cluster will be initialized with locale "en_US". 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout:The default text search configuration will be set to "english". 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout:Data page checksums are disabled. 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout:creating subdirectories ... ok 2024-08-31T04:02:46.559 INFO:teuthology.orchestra.run.smithi170.stdout:selecting dynamic shared memory implementation ... posix 2024-08-31T04:02:46.571 INFO:teuthology.orchestra.run.smithi170.stdout:selecting default max_connections ... 100 2024-08-31T04:02:46.587 INFO:teuthology.orchestra.run.smithi170.stdout:selecting default shared_buffers ... 128MB 2024-08-31T04:02:46.597 INFO:teuthology.orchestra.run.smithi170.stdout:selecting default time zone ... Etc/UTC 2024-08-31T04:02:46.597 INFO:teuthology.orchestra.run.smithi170.stdout:creating configuration files ... ok 2024-08-31T04:02:46.700 INFO:teuthology.orchestra.run.smithi170.stdout:running bootstrap script ... ok 2024-08-31T04:02:47.145 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-08-31T04:02:47.398 INFO:teuthology.orchestra.run.smithi170.stdout:performing post-bootstrap initialization ... ok 2024-08-31T04:02:47.614 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-08-31T04:02:47.984 INFO:teuthology.orchestra.run.smithi089.stdout:Creating new PostgreSQL cluster 14/main ... 2024-08-31T04:02:48.002 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-08-31T04:02:48.053 INFO:teuthology.orchestra.run.smithi089.stdout:The files belonging to this database system will be owned by user "postgres". 2024-08-31T04:02:48.053 INFO:teuthology.orchestra.run.smithi089.stdout:This user must also own the server process. 2024-08-31T04:02:48.054 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:02:48.054 INFO:teuthology.orchestra.run.smithi089.stdout:The database cluster will be initialized with locale "en_US". 2024-08-31T04:02:48.054 INFO:teuthology.orchestra.run.smithi089.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-08-31T04:02:48.054 INFO:teuthology.orchestra.run.smithi089.stdout:The default text search configuration will be set to "english". 2024-08-31T04:02:48.054 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:02:48.054 INFO:teuthology.orchestra.run.smithi089.stdout:Data page checksums are disabled. 2024-08-31T04:02:48.054 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:02:48.054 INFO:teuthology.orchestra.run.smithi089.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-08-31T04:02:48.055 INFO:teuthology.orchestra.run.smithi089.stdout:creating subdirectories ... ok 2024-08-31T04:02:48.055 INFO:teuthology.orchestra.run.smithi089.stdout:selecting dynamic shared memory implementation ... posix 2024-08-31T04:02:48.078 INFO:teuthology.orchestra.run.smithi089.stdout:selecting default max_connections ... 100 2024-08-31T04:02:48.111 INFO:teuthology.orchestra.run.smithi089.stdout:selecting default shared_buffers ... 128MB 2024-08-31T04:02:48.124 INFO:teuthology.orchestra.run.smithi089.stdout:selecting default time zone ... Etc/UTC 2024-08-31T04:02:48.125 INFO:teuthology.orchestra.run.smithi089.stdout:creating configuration files ... ok 2024-08-31T04:02:48.262 INFO:teuthology.orchestra.run.smithi170.stdout:syncing data to disk ... ok 2024-08-31T04:02:48.285 INFO:teuthology.orchestra.run.smithi089.stdout:running bootstrap script ... ok 2024-08-31T04:02:48.683 INFO:teuthology.orchestra.run.smithi170.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-08-31T04:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout:performing post-bootstrap initialization ... ok 2024-08-31T04:02:49.474 INFO:teuthology.orchestra.run.smithi089.stdout:syncing data to disk ... ok 2024-08-31T04:02:49.976 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-08-31T04:02:51.509 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T04:02:51.635 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql-contrib (14+238) ... 2024-08-31T04:02:51.761 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up postgresql (14+238) ... 2024-08-31T04:02:51.887 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T04:02:52.013 INFO:teuthology.orchestra.run.smithi170.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T04:02:52.269 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-31T04:02:52.269 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-31T04:02:52.890 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T04:02:52.955 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T04:02:52.983 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-31T04:02:53.081 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-contrib (14+238) ... 2024-08-31T04:02:53.245 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql (14+238) ... 2024-08-31T04:02:53.319 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T04:02:53.367 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-31T04:02:53.462 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T04:02:53.493 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-31T04:02:53.752 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-31T04:02:53.752 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-31T04:02:54.520 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T04:02:54.615 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-31T04:02:54.797 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-08-31T04:02:54.983 INFO:teuthology.orchestra.run.smithi170.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T04:02:55.083 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T04:02:55.252 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T04:02:55.497 INFO:teuthology.orchestra.run.smithi170.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T04:02:55.504 DEBUG:teuthology.parallel:result is None 2024-08-31T04:02:56.647 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-08-31T04:02:56.756 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T04:02:57.302 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T04:02:57.310 DEBUG:teuthology.parallel:result is None 2024-08-31T04:02:57.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:02:57.480 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-query -W -f '${Version}' ceph 2024-08-31T04:02:57.503 INFO:teuthology.orchestra.run.smithi089.stdout:19.3.0-4560-gd19e6118-1jammy 2024-08-31T04:02:57.503 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560-gd19e6118-1jammy 2024-08-31T04:02:57.503 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560-gd19e6118-1jammy is installed. 2024-08-31T04:02:57.505 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:02:57.651 DEBUG:teuthology.orchestra.run.smithi170:> dpkg-query -W -f '${Version}' ceph 2024-08-31T04:02:57.670 INFO:teuthology.orchestra.run.smithi170.stdout:19.3.0-4560-gd19e6118-1jammy 2024-08-31T04:02:57.671 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560-gd19e6118-1jammy 2024-08-31T04:02:57.671 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560-gd19e6118-1jammy is installed. 2024-08-31T04:02:57.673 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T04:02:57.673 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:02:57.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T04:02:57.693 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:02:57.694 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T04:02:57.726 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T04:02:57.726 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:02:57.726 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T04:02:57.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T04:02:57.824 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:02:57.824 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T04:02:57.836 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T04:02:57.893 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T04:02:57.893 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:02:57.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T04:02:57.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T04:02:57.976 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:02:57.976 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T04:02:57.989 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T04:02:58.044 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T04:02:58.045 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:02:58.045 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T04:02:58.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T04:02:58.124 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:02:58.124 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T04:02:58.136 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T04:02:58.193 INFO:teuthology.run_tasks:Running task ceph... 2024-08-31T04:02:58.277 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-31T04:02:58.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2024-08-31T04:02:58.281 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2024-08-31T04:02:58.297 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-31T04:02:58.297 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-31T04:02:58.341 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-31T04:02:58.356 INFO:tasks.ceph:Creating extra log directories... 2024-08-31T04:02:58.356 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-31T04:02:58.405 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-31T04:02:58.426 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-31T04:02:58.426 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-31T04:02:58.427 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-31T04:02:58.427 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:02:58.427 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-31T04:02:58.470 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-31T04:02:58.558 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:02:58.558 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-31T04:02:58.564 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-31T04:02:58.643 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-31T04:02:58.643 INFO:tasks.ceph:config {'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-31T04:02:58.643 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260', 'branch': 'wip-mchangir-testing-20240828.085847-main-debug', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7881260', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing-20240828.085847-main-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing-20240828.085847-main-debug', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5413, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'sleep_before_teardown': 0, 'subset': '347/512', 'suite': 'fs', 'suite_branch': 'wip-mchangir-testing-20240828.085847-main-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBACEOXe4Br2Zadx0cKLXHqPU0eo+1PhkS1NgK8LST6mSrG41BL5da1YKo73ZtzJbKOESyga9GOPrpwNluEeGjLk=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6dnahY9oUwqZrhdK0miNsKJEr0lBY1mIMaIzlstjgXAB6kY2PZJLiUZZ9ggFWIqgVMVZpqS1YN4RuSSdX1Qsk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'global': {'ms die on skipped message': False}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'cluster': 'ceph'}}, {'kclient': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-08-30_08:30:37', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-31T04:02:58.644 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-31T04:02:58.647 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-31T04:02:58.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2024-08-31T04:02:58.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2024-08-31T04:02:58.741 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:02:58.741 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T04:02:58.771 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T04:02:58.771 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-08-31T04:02:58.834 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T04:02:58.834 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:02:58.835 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 893 Links: 1 2024-08-31T04:02:58.835 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:02:58.835 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-08-31 03:56:14.791045390 +0000 2024-08-31T04:02:58.835 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-31 03:56:14.507047927 +0000 2024-08-31T04:02:58.835 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-31 03:56:14.507047927 +0000 2024-08-31T04:02:58.836 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-08-31 03:56:14.507047927 +0000 2024-08-31T04:02:58.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T04:02:58.896 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-08-31T04:02:58.896 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-08-31T04:02:58.897 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000344282 s, 1.5 MB/s 2024-08-31T04:02:58.898 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T04:02:58.954 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-08-31T04:02:59.008 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T04:02:59.008 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:02:59.008 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 912 Links: 1 2024-08-31T04:02:59.008 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:02:59.008 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-08-31 03:56:15.375040174 +0000 2024-08-31T04:02:59.008 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-31 03:56:15.099042640 +0000 2024-08-31T04:02:59.009 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-31 03:56:15.099042640 +0000 2024-08-31T04:02:59.009 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-08-31 03:56:15.099042640 +0000 2024-08-31T04:02:59.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T04:02:59.067 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-08-31T04:02:59.067 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-08-31T04:02:59.067 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000642008 s, 797 kB/s 2024-08-31T04:02:59.069 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T04:02:59.123 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-08-31T04:02:59.174 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T04:02:59.174 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:02:59.174 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 929 Links: 1 2024-08-31T04:02:59.174 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:02:59.174 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-08-31 03:56:15.979034778 +0000 2024-08-31T04:02:59.174 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-31 03:56:15.715037137 +0000 2024-08-31T04:02:59.175 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-31 03:56:15.715037137 +0000 2024-08-31T04:02:59.175 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-08-31 03:56:15.715037137 +0000 2024-08-31T04:02:59.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T04:02:59.235 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-08-31T04:02:59.235 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-08-31T04:02:59.235 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000373035 s, 1.4 MB/s 2024-08-31T04:02:59.237 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T04:02:59.292 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-08-31T04:02:59.342 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T04:02:59.342 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:02:59.342 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 945 Links: 1 2024-08-31T04:02:59.342 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:02:59.342 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-08-31 03:56:16.539029777 +0000 2024-08-31T04:02:59.342 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-31 03:56:16.299031921 +0000 2024-08-31T04:02:59.342 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-31 03:56:16.299031921 +0000 2024-08-31T04:02:59.342 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-08-31 03:56:16.299031921 +0000 2024-08-31T04:02:59.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T04:02:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-08-31T04:02:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-08-31T04:02:59.407 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000369186 s, 1.4 MB/s 2024-08-31T04:02:59.409 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T04:02:59.459 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T04:02:59.459 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:02:59.459 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T04:02:59.465 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T04:02:59.465 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-08-31T04:02:59.513 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T04:02:59.513 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:02:59.513 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-08-31T04:02:59.513 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:02:59.513 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-08-31 03:55:58.785253939 +0000 2024-08-31T04:02:59.513 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-08-31 03:55:58.521263425 +0000 2024-08-31T04:02:59.513 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-08-31 03:55:58.521263425 +0000 2024-08-31T04:02:59.514 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2024-08-31T04:02:59.514 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T04:02:59.567 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-08-31T04:02:59.567 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-08-31T04:02:59.568 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000351487 s, 1.5 MB/s 2024-08-31T04:02:59.569 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T04:02:59.618 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-08-31T04:02:59.665 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T04:02:59.665 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:02:59.665 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-08-31T04:02:59.665 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:02:59.665 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-08-31 03:55:59.249237761 +0000 2024-08-31T04:02:59.666 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-08-31 03:55:59.001246175 +0000 2024-08-31T04:02:59.666 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-08-31 03:55:59.001246175 +0000 2024-08-31T04:02:59.666 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2024-08-31T04:02:59.666 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T04:02:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-08-31T04:02:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-08-31T04:02:59.719 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000343588 s, 1.5 MB/s 2024-08-31T04:02:59.720 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T04:02:59.770 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-08-31T04:02:59.821 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T04:02:59.821 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:02:59.821 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-08-31T04:02:59.821 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:02:59.821 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-08-31 03:55:59.717221881 +0000 2024-08-31T04:02:59.821 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-08-31 03:55:59.457230702 +0000 2024-08-31T04:02:59.821 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-08-31 03:55:59.457230702 +0000 2024-08-31T04:02:59.821 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2024-08-31T04:02:59.821 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T04:02:59.875 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-08-31T04:02:59.875 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-08-31T04:02:59.875 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000301148 s, 1.7 MB/s 2024-08-31T04:02:59.876 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T04:02:59.926 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-08-31T04:02:59.973 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T04:02:59.973 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:02:59.973 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-08-31T04:02:59.973 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:02:59.973 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-08-31 03:55:59.929214687 +0000 2024-08-31T04:02:59.973 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-08-31 03:55:59.925214822 +0000 2024-08-31T04:02:59.973 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-08-31 03:55:59.925214822 +0000 2024-08-31T04:02:59.973 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: - 2024-08-31T04:02:59.973 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T04:03:00.027 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-08-31T04:03:00.027 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-08-31T04:03:00.028 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000356814 s, 1.4 MB/s 2024-08-31T04:03:00.029 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T04:03:00.082 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T04:03:00.082 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-31T04:03:00.082 INFO:tasks.ceph:Generating config... 2024-08-31T04:03:00.083 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-08-31T04:03:00.083 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-31T04:03:00.083 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-31T04:03:00.084 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-08-31T04:03:00.085 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-08-31T04:03:00.086 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-08-31T04:03:00.086 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-08-31T04:03:00.086 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-31T04:03:00.086 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-08-31T04:03:00.086 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-31T04:03:00.086 INFO:tasks.ceph:Setting up mon.a... 2024-08-31T04:03:00.086 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-31T04:03:00.139 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.keyring 2024-08-31T04:03:00.158 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-31T04:03:00.214 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-31T04:03:00.233 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.89'), ('mon.b', '172.21.15.170'), ('mon.c', '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]')] 2024-08-31T04:03:00.234 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.89,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client_shutdown_timeout': 120}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500}} 2024-08-31T04:03:00.234 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:00.235 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-31T04:03:00.285 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.89 --add b 172.21.15.170 --addv c '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:00.382 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:00.382 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: generated fsid 4a16b848-e6b2-47d6-97cd-edff59841cb1 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = quincy 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 0 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:fsid 4a16b848-e6b2-47d6-97cd-edff59841cb1 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:last_changed 2024-08-31T04:03:00.385277+0000 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-08-31T04:03:00.385277+0000 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:min_mon_release 17 (quincy) 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:election_strategy: 1 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:2: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-08-31T04:03:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-31T04:03:00.386 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-31T04:03:00.394 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4a16b848-e6b2-47d6-97cd-edff59841cb1... 2024-08-31T04:03:00.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-31T04:03:00.440 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-31T04:03:00.471 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-08-31T04:03:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-08-31T04:03:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-31T04:03:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-08-31T04:03:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-08-31T04:03:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-31T04:03:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-08-31T04:03:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.89,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on skipped message = False 2024-08-31T04:03:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 4a16b848-e6b2-47d6-97cd-edff59841cb1 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-08-31T04:03:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 20 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 20 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 10 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: mon client directed command retry = 5 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-08-31T04:03:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject delay max = 1 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject delay probability = 0.005 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject delay type = client mds 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject socket failures = 2500 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: osd blocked scrub grace period = 3600 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: osd max markdown count = 1000 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-08-31T04:03:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-08-31T04:03:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-08-31T04:03:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: mon down mkfs grace = 300 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: client_shutdown_timeout = 120 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-08-31T04:03:00.481 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.e] 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.f] 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: mds oft prefetch dirfrags = True 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: mds_sleep_rank_change = 5000000.0 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: mon client directed command retry = 5 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject delay max = 1 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject delay probability = 0.005 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject delay type = client mds osd 2024-08-31T04:03:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject socket failures = 2500 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.483 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2024-08-31T04:03:00.484 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.485 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.89,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on skipped message = False 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 4a16b848-e6b2-47d6-97cd-edff59841cb1 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2024-08-31T04:03:00.486 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2024-08-31T04:03:00.487 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 20 2024-08-31T04:03:00.488 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 20 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 10 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: mon client directed command retry = 5 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: ms inject delay max = 1 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: ms inject delay probability = 0.005 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: ms inject delay type = client mds 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: ms inject socket failures = 2500 2024-08-31T04:03:00.489 INFO:teuthology.orchestra.run.smithi089.stdout: osd blocked scrub grace period = 3600 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd max markdown count = 1000 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-08-31T04:03:00.490 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-31T04:03:00.491 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: mon down mkfs grace = 300 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:00.492 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout: client_shutdown_timeout = 120 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.e] 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2024-08-31T04:03:00.493 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.f] 2024-08-31T04:03:00.494 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2024-08-31T04:03:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: mds oft prefetch dirfrags = True 2024-08-31T04:03:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: mds_sleep_rank_change = 5000000.0 2024-08-31T04:03:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: mon client directed command retry = 5 2024-08-31T04:03:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: ms inject delay max = 1 2024-08-31T04:03:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: ms inject delay probability = 0.005 2024-08-31T04:03:00.494 INFO:teuthology.orchestra.run.smithi089.stdout: ms inject delay type = client mds osd 2024-08-31T04:03:00.495 INFO:teuthology.orchestra.run.smithi089.stdout: ms inject socket failures = 2500 2024-08-31T04:03:00.496 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-31T04:03:00.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-31T04:03:00.610 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-31T04:03:00.610 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:00.610 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-31T04:03:00.618 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:00.618 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-31T04:03:00.669 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:03:00.670 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:00.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-31T04:03:00.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-31T04:03:00.744 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:00.745 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:00.794 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:03:00.794 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:00.794 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-31T04:03:00.794 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-31T04:03:00.817 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:00.817 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:00.865 INFO:tasks.ceph:Setting up mon nodes... 2024-08-31T04:03:00.866 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-31T04:03:00.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-31T04:03:00.928 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-31T04:03:00.934 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-31T04:03:01.009 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-31T04:03:01.023 INFO:tasks.ceph:Setting up mds nodes... 2024-08-31T04:03:01.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-31T04:03:01.086 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-31T04:03:01.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-31T04:03:01.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-31T04:03:01.216 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-31T04:03:01.221 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-31T04:03:01.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-08-31T04:03:01.344 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-08-31T04:03:01.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-08-31T04:03:01.368 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-31T04:03:01.443 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-31T04:03:01.449 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-31T04:03:01.460 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-31T04:03:01.567 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-31T04:03:01.574 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-31T04:03:01.585 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-08-31T04:03:01.689 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-08-31T04:03:01.695 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-08-31T04:03:01.705 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-31T04:03:01.705 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-31T04:03:01.757 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-31T04:03:01.774 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-31T04:03:01.774 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-31T04:03:01.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-31T04:03:01.793 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T04:03:01.793 INFO:tasks.ceph:role: osd.0 2024-08-31T04:03:01.793 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:03:01.793 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-31T04:03:01.859 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T04:03:01.860 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T04:03:01.860 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T04:03:01.860 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T04:03:01.860 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T04:03:01.860 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-08-31T04:03:01.860 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T04:03:01.860 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T04:03:01.860 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T04:03:01.860 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T04:03:02.271 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-08-31T04:03:02.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-08-31T04:03:02.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-31T04:03:02.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-31T04:03:02.429 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T04:03:02.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:03:02.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-31T04:03:02.493 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T04:03:02.493 INFO:tasks.ceph:role: osd.1 2024-08-31T04:03:02.493 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:03:02.493 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-31T04:03:02.560 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T04:03:02.560 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T04:03:02.561 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T04:03:02.561 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T04:03:02.561 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T04:03:02.561 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-08-31T04:03:02.561 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T04:03:02.562 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T04:03:02.562 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T04:03:02.562 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T04:03:02.923 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-08-31T04:03:02.926 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-08-31T04:03:02.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-31T04:03:03.000 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-31T04:03:03.057 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T04:03:03.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:03:03.058 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-31T04:03:03.121 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T04:03:03.121 INFO:tasks.ceph:role: osd.2 2024-08-31T04:03:03.121 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:03:03.121 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-31T04:03:03.188 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T04:03:03.188 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T04:03:03.188 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T04:03:03.188 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T04:03:03.189 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T04:03:03.189 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-08-31T04:03:03.189 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T04:03:03.189 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T04:03:03.189 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T04:03:03.189 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T04:03:03.580 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-08-31T04:03:03.582 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-08-31T04:03:03.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-31T04:03:03.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-31T04:03:03.706 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T04:03:03.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:03:03.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-31T04:03:03.770 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-31T04:03:03.770 INFO:tasks.ceph:role: osd.3 2024-08-31T04:03:03.770 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:03:03.770 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-31T04:03:03.846 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T04:03:03.846 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T04:03:03.846 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T04:03:03.846 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T04:03:03.846 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T04:03:03.846 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-08-31T04:03:03.846 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T04:03:03.846 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T04:03:03.847 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T04:03:03.847 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T04:03:04.237 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-08-31T04:03:04.240 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-08-31T04:03:04.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-31T04:03:04.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-31T04:03:04.395 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T04:03:04.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:03:04.396 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:04.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:04.540+0000 7f237463d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-31T04:03:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:04.544+0000 7f237463d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-31T04:03:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:04.544+0000 7f237463d7c0 -1 bdev(0x562f967c2a00 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-08-31T04:03:04.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:04.544+0000 7f237463d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-31T04:03:07.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-31T04:03:07.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:07.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:07.916+0000 7fa297be87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-31T04:03:07.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:07.916+0000 7fa297be87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-31T04:03:07.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:07.916+0000 7fa297be87c0 -1 bdev(0x555a249f4a00 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-08-31T04:03:07.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:07.916+0000 7fa297be87c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-31T04:03:11.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-31T04:03:11.158 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:11.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:11.264+0000 7f81e72397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-31T04:03:11.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:11.268+0000 7f81e72397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-31T04:03:11.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:11.268+0000 7f81e72397c0 -1 bdev(0x55784ce8ca00 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-08-31T04:03:11.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:11.268+0000 7f81e72397c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-31T04:03:14.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-31T04:03:14.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:14.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:14.668+0000 7fd6c502b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-31T04:03:14.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:14.672+0000 7fd6c502b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-31T04:03:14.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:14.672+0000 7fd6c502b7c0 -1 bdev(0x5613bbe32a00 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-08-31T04:03:14.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:14.672+0000 7fd6c502b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-31T04:03:17.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-31T04:03:17.920 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-31T04:03:17.934 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T04:03:17.934 INFO:tasks.ceph:role: osd.4 2024-08-31T04:03:17.934 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:03:17.935 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-31T04:03:17.988 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T04:03:17.988 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T04:03:17.988 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T04:03:17.988 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T04:03:17.989 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T04:03:17.989 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-08-31T04:03:17.989 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T04:03:17.989 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T04:03:17.989 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T04:03:17.989 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T04:03:18.012 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-08-31T04:03:18.014 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-08-31T04:03:18.014 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-31T04:03:18.070 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-31T04:03:18.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:03:18.121 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T04:03:18.122 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-31T04:03:18.174 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T04:03:18.174 INFO:tasks.ceph:role: osd.5 2024-08-31T04:03:18.174 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:03:18.174 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-31T04:03:18.228 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T04:03:18.229 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T04:03:18.229 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T04:03:18.229 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T04:03:18.229 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T04:03:18.229 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-08-31T04:03:18.229 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T04:03:18.229 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T04:03:18.229 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T04:03:18.229 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T04:03:18.253 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-08-31T04:03:18.255 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-08-31T04:03:18.255 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-31T04:03:18.312 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-31T04:03:18.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:03:18.366 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T04:03:18.366 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-31T04:03:18.420 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T04:03:18.420 INFO:tasks.ceph:role: osd.6 2024-08-31T04:03:18.420 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:03:18.420 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-31T04:03:18.475 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T04:03:18.475 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T04:03:18.476 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T04:03:18.476 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T04:03:18.476 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T04:03:18.476 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-08-31T04:03:18.476 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T04:03:18.476 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T04:03:18.476 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T04:03:18.476 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T04:03:18.500 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-08-31T04:03:18.502 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-08-31T04:03:18.502 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-31T04:03:18.559 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-31T04:03:18.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:03:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T04:03:18.609 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-31T04:03:18.661 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-31T04:03:18.662 INFO:tasks.ceph:role: osd.7 2024-08-31T04:03:18.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:03:18.662 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-31T04:03:18.715 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-31T04:03:18.715 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-31T04:03:18.715 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-31T04:03:18.715 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-31T04:03:18.716 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-31T04:03:18.716 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-08-31T04:03:18.716 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-31T04:03:18.716 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-31T04:03:18.716 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-31T04:03:18.716 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-31T04:03:18.739 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-08-31T04:03:18.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-08-31T04:03:18.742 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-31T04:03:18.799 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-31T04:03:18.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:03:18.850 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: /sbin/restorecon: command not found 2024-08-31T04:03:18.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:18.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:18.992+0000 7fdb3ec1f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-31T04:03:18.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:18.992+0000 7fdb3ec1f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-31T04:03:18.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:18.992+0000 7fdb3ec1f7c0 -1 bdev(0x55bb0385ea00 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-08-31T04:03:18.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:18.992+0000 7fdb3ec1f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-31T04:03:22.116 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-31T04:03:22.130 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:22.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:22.240+0000 7f2ba83137c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-31T04:03:22.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:22.240+0000 7f2ba83137c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-31T04:03:22.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:22.240+0000 7f2ba83137c0 -1 bdev(0x55e3ec94ca00 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-08-31T04:03:22.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:22.240+0000 7f2ba83137c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-31T04:03:25.381 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-31T04:03:25.393 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:25.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:25.504+0000 7feca16357c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-31T04:03:25.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:25.504+0000 7feca16357c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-31T04:03:25.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:25.504+0000 7feca16357c0 -1 bdev(0x56070fa98a00 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-08-31T04:03:25.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:25.504+0000 7feca16357c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-31T04:03:28.639 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-31T04:03:28.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:03:28.649 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:03:28.652 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:28.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:28.763+0000 7fee0312c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-31T04:03:28.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:28.763+0000 7fee0312c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-31T04:03:28.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:28.763+0000 7fee0312c7c0 -1 bdev(0x558c5f75ea00 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-08-31T04:03:28.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:28.763+0000 7fee0312c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-31T04:03:31.888 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-31T04:03:31.944 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-31T04:03:31.944 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:31.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-31T04:03:31.966 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:31.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-31T04:03:32.031 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:32.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-31T04:03:32.094 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:32.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-08-31T04:03:32.159 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:32.159 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-31T04:03:32.226 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:32.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-31T04:03:32.294 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:32.294 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-31T04:03:32.359 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:32.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-31T04:03:32.422 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:32.423 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-31T04:03:32.437 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:32.437 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-31T04:03:32.492 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:32.493 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-31T04:03:32.547 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:32.548 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-08-31T04:03:32.599 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:32.599 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-31T04:03:32.651 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:32.651 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-31T04:03:32.704 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:32.704 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-31T04:03:32.761 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:32.761 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-31T04:03:32.816 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:32.816 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-31T04:03:32.825 INFO:tasks.ceph:Adding keys to all mons... 2024-08-31T04:03:32.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-31T04:03:32.869 DEBUG:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD0ldJmulSDNxAAGTHil+rpNGFMHb79jF57+A== 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD1ldJmP8pUBRAA7dSVp72nMlAZMjtcL0NgIA== 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD1ldJm0wMVDRAATl+/DbIdvClxoPKhB6/BTw== 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.e] 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD1ldJmsLevFBAAwW7OOwU2uU/FeQztewj7mg== 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD4ldJmmRRVIBAA2dcPGEgKRmN0x0m5oSyErw== 2024-08-31T04:03:32.880 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD7ldJmXRG2NhAA3xpQXyQWnBJ1p7XOKAKVsQ== 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD/ldJmF/sHEBAAuwIQdGo+aSD1eFSySUbdZA== 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQACltJmr3cgKBAAADge+6YO7QTDQ+T3Ewhjcw== 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD1ldJmndWoABAAEngpXjtiFnhkg4Ewhq8ltw== 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD1ldJmTiyIGhAAqgJDYxlOIBoBw4ocpTVOEw== 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD1ldJmpwTtIRAARqm0vTpdztC6huqRlioOdQ== 2024-08-31T04:03:32.881 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.f] 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD1ldJmKgEzKRAAKltETTGwJhXbVulZK55Mxw== 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.4] 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAGltJm9aRVOxAA9fJ7MnQE7Z8/0qgxKdKalA== 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.5] 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAKltJmPmKeDhAAPOcG/+dipZQgywrWJWwRlw== 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.6] 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQANltJmlhY+HhAAuJ59YvKoa7eRnhpWY+/nKw== 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.7] 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAQltJmNqTGLRAAIYvaLdXjcxtun77gvf+DIA== 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-08-31T04:03:32.882 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD1ldJm1qFPLRAAJW2lbXx529RTT7GkXix6oQ== 2024-08-31T04:03:32.885 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2024-08-31T04:03:32.885 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD0ldJmulSDNxAAGTHil+rpNGFMHb79jF57+A== 2024-08-31T04:03:32.885 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2024-08-31T04:03:32.885 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD1ldJmP8pUBRAA7dSVp72nMlAZMjtcL0NgIA== 2024-08-31T04:03:32.885 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2024-08-31T04:03:32.885 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD1ldJm0wMVDRAATl+/DbIdvClxoPKhB6/BTw== 2024-08-31T04:03:32.885 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.e] 2024-08-31T04:03:32.885 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD1ldJmsLevFBAAwW7OOwU2uU/FeQztewj7mg== 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD4ldJmmRRVIBAA2dcPGEgKRmN0x0m5oSyErw== 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD7ldJmXRG2NhAA3xpQXyQWnBJ1p7XOKAKVsQ== 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD/ldJmF/sHEBAAuwIQdGo+aSD1eFSySUbdZA== 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQACltJmr3cgKBAAADge+6YO7QTDQ+T3Ewhjcw== 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD1ldJmndWoABAAEngpXjtiFnhkg4Ewhq8ltw== 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2024-08-31T04:03:32.886 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD1ldJmTiyIGhAAqgJDYxlOIBoBw4ocpTVOEw== 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD1ldJmpwTtIRAARqm0vTpdztC6huqRlioOdQ== 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.f] 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD1ldJmKgEzKRAAKltETTGwJhXbVulZK55Mxw== 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAGltJm9aRVOxAA9fJ7MnQE7Z8/0qgxKdKalA== 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAKltJmPmKeDhAAPOcG/+dipZQgywrWJWwRlw== 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQANltJmlhY+HhAAuJ59YvKoa7eRnhpWY+/nKw== 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAQltJmNqTGLRAAIYvaLdXjcxtun77gvf+DIA== 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-08-31T04:03:32.887 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD1ldJm1qFPLRAAJW2lbXx529RTT7GkXix6oQ== 2024-08-31T04:03:32.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-31T04:03:32.933 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-31T04:03:33.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.017 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.095 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.171 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.248 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.321 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.394 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.464 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-31T04:03:33.541 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-31T04:03:33.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.616 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.691 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.695 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.764 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-31T04:03:33.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.834 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.902 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.974 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:33.978 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:34.042 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:34.045 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-31T04:03:34.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-31T04:03:34.112 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-31T04:03:34.181 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-31T04:03:34.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-31T04:03:34.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-31T04:03:34.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-31T04:03:34.339 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-31T04:03:34.353 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-31T04:03:34.477 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-31T04:03:34.489 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-31T04:03:34.542 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-31T04:03:34.665 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-31T04:03:34.674 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:34.677 DEBUG:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-31T04:03:34.720 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-31T04:03:34.721 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-31T04:03:34.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-31T04:03:34.725 INFO:tasks.ceph.mon.a:Started 2024-08-31T04:03:34.725 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-31T04:03:34.725 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-31T04:03:34.766 INFO:tasks.ceph.mon.b:Started 2024-08-31T04:03:34.766 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-31T04:03:34.766 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-31T04:03:34.768 INFO:tasks.ceph.mon.c:Started 2024-08-31T04:03:34.768 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-31T04:03:34.768 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-31T04:03:34.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-31T04:03:34.772 INFO:tasks.ceph.mgr.y:Started 2024-08-31T04:03:34.772 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-31T04:03:34.772 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-31T04:03:34.774 INFO:tasks.ceph.mgr.x:Started 2024-08-31T04:03:34.774 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-08-31T04:03:34.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-08-31T04:03:34.777 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-08-31T04:03:34.777 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set client debug_client 20 2024-08-31T04:03:34.821 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-08-31T04:03:34.821 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set client debug_ms 1 2024-08-31T04:03:34.865 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-08-31T04:03:34.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-08-31T04:03:34.910 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-08-31T04:03:34.910 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-08-31T04:03:34.958 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-08-31T04:03:34.958 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-08-31T04:03:35.009 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-08-31T04:03:35.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-08-31T04:03:35.057 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-08-31T04:03:35.057 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-08-31T04:03:35.102 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-31T04:03:35.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2024-08-31T04:03:35.153 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2024-08-31T04:03:35.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-08-31T04:03:35.205 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2024-08-31T04:03:35.206 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2024-08-31T04:03:35.257 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2024-08-31T04:03:35.257 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2024-08-31T04:03:35.317 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-08-31T04:03:35.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-08-31T04:03:35.370 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-08-31T04:03:35.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-08-31T04:03:35.430 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-08-31T04:03:35.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-08-31T04:03:35.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.427+0000 7efd45600640 1 -- 172.21.15.89:0/1873696705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd401fc5a0 msgr2=0x7efd401fc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.427+0000 7efd45600640 1 --2- 172.21.15.89:0/1873696705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd401fc5a0 0x7efd401fc9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efd4006ecf0 tx=0x7efd3800dd10 comp rx=0 tx=0).stop 2024-08-31T04:03:35.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.427+0000 7efd45600640 1 -- 172.21.15.89:0/1873696705 shutdown_connections 2024-08-31T04:03:35.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.427+0000 7efd45600640 1 --2- 172.21.15.89:0/1873696705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd401fc5a0 0x7efd401fc9b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.427+0000 7efd45600640 1 --2- 172.21.15.89:0/1873696705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd4014fb00 0x7efd4015a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.427+0000 7efd45600640 1 --2- 172.21.15.89:0/1873696705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd24003a60 0x7efd400c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.427+0000 7efd45600640 1 -- 172.21.15.89:0/1873696705 >> 172.21.15.89:0/1873696705 conn(0x7efd4006e3d0 msgr2=0x7efd400b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.427+0000 7efd45600640 1 -- 172.21.15.89:0/1873696705 shutdown_connections 2024-08-31T04:03:35.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.435+0000 7efd45600640 1 -- 172.21.15.89:0/1873696705 wait complete. 2024-08-31T04:03:35.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.439+0000 7f9d19200640 1 -- 172.21.15.89:0/3833368333 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f9ce8005300 con 0x7f9d14157fe0 2024-08-31T04:03:35.443 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-08-31T04:03:35.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-08-31T04:03:35.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.443+0000 7f886a000640 1 -- 172.21.15.89:0/697413048 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f886c018020 con 0x7f8874158840 2024-08-31T04:03:35.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.443+0000 7f886a000640 1 -- 172.21.15.89:0/697413048 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f886c01a410 con 0x7f8874158840 2024-08-31T04:03:35.448 INFO:tasks.ceph:setting config [mds] mds_dir_prefetch = True 2024-08-31T04:03:35.449 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds mds_dir_prefetch True 2024-08-31T04:03:35.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.451+0000 7f3860c00640 1 -- 172.21.15.89:0/73103768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f385c1f90c0 msgr2=0x7f385c152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.451+0000 7f3860c00640 1 --2- 172.21.15.89:0/73103768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f385c1f90c0 0x7f385c152c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f384800e6e0 tx=0x7f384800eba0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.455+0000 7f886a000640 1 -- 172.21.15.89:0/697413048 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f886c010440 con 0x7f8874158840 2024-08-31T04:03:35.459 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-08-31T04:03:35.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-08-31T04:03:35.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.455+0000 7f3860c00640 1 -- 172.21.15.89:0/73103768 shutdown_connections 2024-08-31T04:03:35.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.455+0000 7f3860c00640 1 --2- 172.21.15.89:0/73103768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f385c1f90c0 0x7f385c152c00 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f384800e6e0 tx=0x7f384800eba0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.455+0000 7f3860c00640 1 --2- 172.21.15.89:0/73103768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f385c1f2dd0 0x7f385c1f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.455+0000 7f3860c00640 1 --2- 172.21.15.89:0/73103768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3840004e50 0x7f385c153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.455+0000 7f3860c00640 1 -- 172.21.15.89:0/73103768 >> 172.21.15.89:0/73103768 conn(0x7f385c071a70 msgr2=0x7f385c14fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.463+0000 7f3860c00640 1 -- 172.21.15.89:0/73103768 shutdown_connections 2024-08-31T04:03:35.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.463+0000 7f3860c00640 1 -- 172.21.15.89:0/73103768 wait complete. 2024-08-31T04:03:35.467 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-08-31T04:03:35.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-08-31T04:03:35.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.467+0000 7f9d0b400640 1 -- 172.21.15.89:0/3833368333 <== mon.2 v2:172.21.15.170:3301/0 11 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v6)=0 v6) ==== 108+0+0 (secure 0 0 0) 0x7f9d000ad870 con 0x7f9d14157fe0 2024-08-31T04:03:35.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.475+0000 7f9d19200640 1 -- 172.21.15.89:0/3833368333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d14157fe0 msgr2=0x7f9d141616f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.479+0000 7f9d19200640 1 --2- 172.21.15.89:0/3833368333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d14157fe0 0x7f9d141616f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d0001c670 tx=0x7f9d000195e0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.482 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-08-31T04:03:35.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-08-31T04:03:35.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.483+0000 7efe4be00640 1 -- 172.21.15.89:0/4211935233 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7efe20005320 con 0x7efe4c158250 2024-08-31T04:03:35.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.487+0000 7f9d19200640 1 -- 172.21.15.89:0/3833368333 shutdown_connections 2024-08-31T04:03:35.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.487+0000 7f9d19200640 1 --2- 172.21.15.89:0/3833368333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d140c9df0 0x7f9d141592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.487+0000 7f9d19200640 1 --2- 172.21.15.89:0/3833368333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d14157fe0 0x7f9d141616f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.487+0000 7f9d19200640 1 --2- 172.21.15.89:0/3833368333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d140c86f0 0x7f9d14156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.487+0000 7f9d19200640 1 -- 172.21.15.89:0/3833368333 >> 172.21.15.89:0/3833368333 conn(0x7f9d140cd1e0 msgr2=0x7f9d1406cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.491+0000 7efe42a00640 1 -- 172.21.15.89:0/4211935233 <== mon.0 v2:172.21.15.89:3300/0 11 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v7)=0 v7) ==== 123+0+0 (secure 0 0 0) 0x7efe380195c0 con 0x7efe4c158250 2024-08-31T04:03:35.494 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-08-31T04:03:35.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-08-31T04:03:35.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.491+0000 7f84b4c00640 1 -- 172.21.15.89:0/1687702095 <== mon.2 v2:172.21.15.170:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84a80159a0 con 0x7f84b80c3a60 2024-08-31T04:03:35.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.495+0000 7efe42a00640 1 -- 172.21.15.89:0/4211935233 <== mon.0 v2:172.21.15.89:3300/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe38019820 con 0x7efe4c158250 2024-08-31T04:03:35.500 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-31T04:03:35.500 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-08-31T04:03:35.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.507+0000 7f886a000640 1 -- 172.21.15.89:0/697413048 <== mon.0 v2:172.21.15.89:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f886c010620 con 0x7f8874158840 2024-08-31T04:03:35.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.507+0000 7efe4be00640 1 -- 172.21.15.89:0/4211935233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe4c158250 msgr2=0x7efe4c1f08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.507+0000 7efe4be00640 1 --2- 172.21.15.89:0/4211935233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe4c158250 0x7efe4c1f08d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe380066b0 tx=0x7efe380039d0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.510 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-08-31T04:03:35.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-08-31T04:03:35.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.511+0000 7efe4be00640 1 -- 172.21.15.89:0/4211935233 shutdown_connections 2024-08-31T04:03:35.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.511+0000 7efe4be00640 1 --2- 172.21.15.89:0/4211935233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe4c158250 0x7efe4c1f08d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.511+0000 7efe4be00640 1 --2- 172.21.15.89:0/4211935233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe4c1f0e10 0x7efe4c15c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.511+0000 7efe4be00640 1 --2- 172.21.15.89:0/4211935233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe4c158740 0x7efe4c15b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.511+0000 7efe4be00640 1 -- 172.21.15.89:0/4211935233 >> 172.21.15.89:0/4211935233 conn(0x7efe4c072750 msgr2=0x7efe4c1e22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.511+0000 7f9d19200640 1 -- 172.21.15.89:0/3833368333 shutdown_connections 2024-08-31T04:03:35.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.511+0000 7f9d19200640 1 -- 172.21.15.89:0/3833368333 wait complete. 2024-08-31T04:03:35.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.511+0000 7f84bf400640 1 -- 172.21.15.89:0/1687702095 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f848c005300 con 0x7f84b80c3a60 2024-08-31T04:03:35.520 DEBUG:tasks.ceph:set 23 configs 2024-08-31T04:03:35.521 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi089') 2024-08-31T04:03:35.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.519+0000 7efe4be00640 1 -- 172.21.15.89:0/4211935233 shutdown_connections 2024-08-31T04:03:35.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.519+0000 7efe4be00640 1 -- 172.21.15.89:0/4211935233 wait complete. 2024-08-31T04:03:35.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.527+0000 7f84b4c00640 1 -- 172.21.15.89:0/1687702095 <== mon.2 v2:172.21.15.170:3301/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f84a8015c30 con 0x7f84b80c3a60 2024-08-31T04:03:35.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.531+0000 7f84bf400640 1 -- 172.21.15.89:0/1687702095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84b80c3a60 msgr2=0x7f84b8155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.531+0000 7f84bf400640 1 --2- 172.21.15.89:0/1687702095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84b80c3a60 0x7f84b8155850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f84a800e830 tx=0x7f84a800ecf0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.535+0000 7f84bf400640 1 -- 172.21.15.89:0/1687702095 shutdown_connections 2024-08-31T04:03:35.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.535+0000 7f84bf400640 1 --2- 172.21.15.89:0/1687702095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84b80c89a0 0x7f84b80b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.535+0000 7f84bf400640 1 --2- 172.21.15.89:0/1687702095 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84b80c3a60 0x7f84b8155850 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.535+0000 7f84bf400640 1 --2- 172.21.15.89:0/1687702095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84b8070c60 0x7f84b8152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.535+0000 7f84bf400640 1 -- 172.21.15.89:0/1687702095 >> 172.21.15.89:0/1687702095 conn(0x7f84b80cd1b0 msgr2=0x7f84b80c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.543+0000 7f84bf400640 1 -- 172.21.15.89:0/1687702095 shutdown_connections 2024-08-31T04:03:35.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.543+0000 7f84bf400640 1 -- 172.21.15.89:0/1687702095 wait complete. 2024-08-31T04:03:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.567+0000 7fe14b000640 1 -- 172.21.15.89:0/4250008009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe12c003a60 msgr2=0x7fe12c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.567+0000 7fe14b000640 1 --2- 172.21.15.89:0/4250008009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe12c003a60 0x7fe12c003ed0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe13000c310 tx=0x7fe13001cf20 comp rx=0 tx=0).stop 2024-08-31T04:03:35.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.583+0000 7fe14b000640 1 -- 172.21.15.89:0/4250008009 shutdown_connections 2024-08-31T04:03:35.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.583+0000 7fe14b000640 1 --2- 172.21.15.89:0/4250008009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe12c003a60 0x7fe12c003ed0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.583+0000 7fe14b000640 1 -- 172.21.15.89:0/4250008009 >> 172.21.15.89:0/4250008009 conn(0x7fe1440cd1e0 msgr2=0x7fe1440c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.583+0000 7fe14b000640 1 -- 172.21.15.89:0/4250008009 shutdown_connections 2024-08-31T04:03:35.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.595+0000 7fe14b000640 1 -- 172.21.15.89:0/4250008009 wait complete. 2024-08-31T04:03:35.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe14b000640 1 Processor -- start 2024-08-31T04:03:35.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe14b000640 1 -- start start 2024-08-31T04:03:35.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe14b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe12c003a60 0x7fe14414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe14b000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe144153380 0x7fe144150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe14b000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe144150ec0 0x7fe1441479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe14b000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe1440c2b80 con 0x7fe144153380 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe14b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe1440c28a0 con 0x7fe12c003a60 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe14b000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe1440c7d90 con 0x7fe144150ec0 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe149200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe144153380 0x7fe144150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe149c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe12c003a60 0x7fe14414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe149200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe144153380 0x7fe144150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55580/0 (socket says 172.21.15.89:55580) 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe149200640 1 -- 172.21.15.89:0/298412662 learned_addr learned my addr 172.21.15.89:0/298412662 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:35.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.611+0000 7fe14a600640 1 --2- 172.21.15.89:0/298412662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe144150ec0 0x7fe1441479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe149200640 1 -- 172.21.15.89:0/298412662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe144150ec0 msgr2=0x7fe1441479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe149200640 1 --2- 172.21.15.89:0/298412662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe144150ec0 0x7fe1441479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe149200640 1 -- 172.21.15.89:0/298412662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe12c003a60 msgr2=0x7fe14414f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe149200640 1 --2- 172.21.15.89:0/298412662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe12c003a60 0x7fe14414f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe149200640 1 -- 172.21.15.89:0/298412662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1441ed460 con 0x7fe144153380 2024-08-31T04:03:35.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe14a600640 1 --2- 172.21.15.89:0/298412662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe144150ec0 0x7fe1441479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:03:35.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe149200640 1 --2- 172.21.15.89:0/298412662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe144153380 0x7fe144150330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe13800ca60 tx=0x7fe13800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:35.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe141600640 1 -- 172.21.15.89:0/298412662 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1380064e0 con 0x7fe144153380 2024-08-31T04:03:35.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe141600640 1 -- 172.21.15.89:0/298412662 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe138003600 con 0x7fe144153380 2024-08-31T04:03:35.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.615+0000 7fe141600640 1 -- 172.21.15.89:0/298412662 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138003a10 con 0x7fe144153380 2024-08-31T04:03:35.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.627+0000 7fe14b000640 1 -- 172.21.15.89:0/298412662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1441487e0 con 0x7fe144153380 2024-08-31T04:03:35.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.627+0000 7fe14b000640 1 -- 172.21.15.89:0/298412662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14414eb50 con 0x7fe144153380 2024-08-31T04:03:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.627+0000 7fe14b000640 1 -- 172.21.15.89:0/298412662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1440ca3f0 con 0x7fe144153380 2024-08-31T04:03:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.631+0000 7fe141600640 1 -- 172.21.15.89:0/298412662 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe138022020 con 0x7fe144153380 2024-08-31T04:03:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.631+0000 7fe141600640 1 -- 172.21.15.89:0/298412662 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe13801b740 con 0x7fe144153380 2024-08-31T04:03:35.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.631+0000 7fe141600640 1 -- 172.21.15.89:0/298412662 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe138029070 con 0x7fe144153380 2024-08-31T04:03:35.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi089') 2024-08-31T04:03:35.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi089') 2024-08-31T04:03:35.654 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi089') 2024-08-31T04:03:35.654 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi089') 2024-08-31T04:03:35.654 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi089') 2024-08-31T04:03:35.654 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi089') 2024-08-31T04:03:35.656 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi089') 2024-08-31T04:03:35.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.763+0000 7f2bb7200640 1 -- 172.21.15.89:0/1870516076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bb8155ac0 msgr2=0x7f2bb8070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.763+0000 7f2bb7200640 1 --2- 172.21.15.89:0/1870516076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bb8155ac0 0x7f2bb8070c60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80c2a20 tx=0x7f2ba801c7e0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.763+0000 7f2bb7200640 1 -- 172.21.15.89:0/1870516076 shutdown_connections 2024-08-31T04:03:35.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.763+0000 7f2bb7200640 1 --2- 172.21.15.89:0/1870516076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bb8155ac0 0x7f2bb8070c60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.763+0000 7f2bb7200640 1 --2- 172.21.15.89:0/1870516076 >> v2:172.21.15.89:3300/0 conn(0x7f2bb80c6740 0x7f2bb80c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.763+0000 7f2bb7200640 1 -- 172.21.15.89:0/1870516076 >> 172.21.15.89:0/1870516076 conn(0x7f2bb80cd1e0 msgr2=0x7f2bb80c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.763+0000 7f0f1a400640 1 -- 172.21.15.89:0/3228087453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f140c90e0 msgr2=0x7f0f140747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.763+0000 7f0f1a400640 1 --2- 172.21.15.89:0/3228087453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f140c90e0 0x7f0f140747b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009840 tx=0x7f0f0401c7b0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.771+0000 7f2bb7200640 1 -- 172.21.15.89:0/1870516076 shutdown_connections 2024-08-31T04:03:35.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.775+0000 7f2bb7200640 1 -- 172.21.15.89:0/1870516076 wait complete. 2024-08-31T04:03:35.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.775+0000 7f0f1a400640 1 -- 172.21.15.89:0/3228087453 shutdown_connections 2024-08-31T04:03:35.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.775+0000 7f0f1a400640 1 --2- 172.21.15.89:0/3228087453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f140c90e0 0x7f0f140747b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.775+0000 7f0f1a400640 1 --2- 172.21.15.89:0/3228087453 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f140b2d20 0x7f0f140c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.775+0000 7f0f1a400640 1 -- 172.21.15.89:0/3228087453 >> 172.21.15.89:0/3228087453 conn(0x7f0f140c99b0 msgr2=0x7f0f140c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.779+0000 7f0f1a400640 1 -- 172.21.15.89:0/3228087453 shutdown_connections 2024-08-31T04:03:35.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.787+0000 7f2bb7200640 1 Processor -- start 2024-08-31T04:03:35.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.783+0000 7f0f1a400640 1 -- 172.21.15.89:0/3228087453 wait complete. 2024-08-31T04:03:35.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.787+0000 7f2bb7200640 1 -- start start 2024-08-31T04:03:35.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.787+0000 7f0f1a400640 1 Processor -- start 2024-08-31T04:03:35.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f1a400640 1 -- start start 2024-08-31T04:03:35.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f2bb7200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb80711a0 0x7f2bb814b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f2bb7200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bb80c6740 0x7f2bb8205490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb7200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bb8155ac0 0x7f2bb8167a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb7200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80ca3f0 con 0x7f2bb80711a0 2024-08-31T04:03:35.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb7200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80c3010 con 0x7f2bb8155ac0 2024-08-31T04:03:35.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb7200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb80ca570 con 0x7f2bb80c6740 2024-08-31T04:03:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f1a400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f140b2860 0x7f0f14146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f1a400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140b2d20 0x7f0f141571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb6800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bb8155ac0 0x7f2bb8167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb80711a0 0x7f2bb814b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bb80c6740 0x7f2bb8205490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bb80c6740 0x7f2bb8205490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53362/0 (socket says 172.21.15.89:53362) 2024-08-31T04:03:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb6800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bb8155ac0 0x7f2bb8167a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:54486/0 (socket says 172.21.15.89:54486) 2024-08-31T04:03:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5400640 1 -- 172.21.15.89:0/2185921023 learned_addr learned my addr 172.21.15.89:0/2185921023 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f1a400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f140c90e0 0x7f0f14157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f1a400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0f14165770 con 0x7f0f140b2860 2024-08-31T04:03:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f1a400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f141658f0 con 0x7f0f140b2d20 2024-08-31T04:03:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f1a400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f14165a70 con 0x7f0f140c90e0 2024-08-31T04:03:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f12a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140b2d20 0x7f0f141571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f12a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140b2d20 0x7f0f141571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:54472/0 (socket says 172.21.15.89:54472) 2024-08-31T04:03:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f12a00640 1 -- 172.21.15.89:0/1425347921 learned_addr learned my addr 172.21.15.89:0/1425347921 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.791+0000 7f0f13400640 1 --2- 172.21.15.89:0/1425347921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f140b2860 0x7f0f14146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f12a00640 1 -- 172.21.15.89:0/1425347921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f140c90e0 msgr2=0x7f0f14157700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T04:03:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f12a00640 1 --2- 172.21.15.89:0/1425347921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f140c90e0 0x7f0f14157700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f12a00640 1 -- 172.21.15.89:0/1425347921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f140b2860 msgr2=0x7f0f14146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f12a00640 1 --2- 172.21.15.89:0/1425347921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f140b2860 0x7f0f14146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f12a00640 1 -- 172.21.15.89:0/1425347921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1414f7f0 con 0x7f0f140b2d20 2024-08-31T04:03:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f13400640 1 --2- 172.21.15.89:0/1425347921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f140b2860 0x7f0f14146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:35.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f12a00640 1 --2- 172.21.15.89:0/1425347921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140b2d20 0x7f0f141571c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00bd70 tx=0x7f0f0c00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5400640 1 -- 172.21.15.89:0/2185921023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bb8155ac0 msgr2=0x7f2bb8167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5400640 1 --2- 172.21.15.89:0/2185921023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bb8155ac0 0x7f2bb8167a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5400640 1 -- 172.21.15.89:0/2185921023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb80711a0 msgr2=0x7f2bb814b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5400640 1 --2- 172.21.15.89:0/2185921023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb80711a0 0x7f2bb814b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5400640 1 -- 172.21.15.89:0/2185921023 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb814bdb0 con 0x7f2bb80c6740 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5e00640 1 --2- 172.21.15.89:0/2185921023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb80711a0 0x7f2bb814b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb5400640 1 --2- 172.21.15.89:0/2185921023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bb80c6740 0x7f2bb8205490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8000c10 tx=0x7f2ba80a5690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bae000640 1 -- 172.21.15.89:0/2185921023 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80ba030 con 0x7f2bb80c6740 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bae000640 1 -- 172.21.15.89:0/2185921023 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ba8005370 con 0x7f2bb80c6740 2024-08-31T04:03:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bae000640 1 -- 172.21.15.89:0/2185921023 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80b2040 con 0x7f2bb80c6740 2024-08-31T04:03:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb7200640 1 -- 172.21.15.89:0/2185921023 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb814bba0 con 0x7f2bb80c6740 2024-08-31T04:03:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f2bb7200640 1 -- 172.21.15.89:0/2185921023 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb8157a30 con 0x7f2bb80c6740 2024-08-31T04:03:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f0b400640 1 -- 172.21.15.89:0/1425347921 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c019070 con 0x7f0f140b2d20 2024-08-31T04:03:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f0b400640 1 -- 172.21.15.89:0/1425347921 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f0c014440 con 0x7f0f140b2d20 2024-08-31T04:03:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.795+0000 7f0f0b400640 1 -- 172.21.15.89:0/1425347921 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c014870 con 0x7f0f140b2d20 2024-08-31T04:03:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.799+0000 7f2bb7200640 1 -- 172.21.15.89:0/2185921023 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb8074e80 con 0x7f2bb80c6740 2024-08-31T04:03:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.803+0000 7f0f1a400640 1 -- 172.21.15.89:0/1425347921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f141f8de0 con 0x7f0f140b2d20 2024-08-31T04:03:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.803+0000 7f0f1a400640 1 -- 172.21.15.89:0/1425347921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f14153040 con 0x7f0f140b2d20 2024-08-31T04:03:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.803+0000 7f0f1a400640 1 -- 172.21.15.89:0/1425347921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f140c1ed0 con 0x7f0f140b2d20 2024-08-31T04:03:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.807+0000 7f2bae000640 1 -- 172.21.15.89:0/2185921023 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ba80bd070 con 0x7f2bb80c6740 2024-08-31T04:03:35.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.807+0000 7f2bae000640 1 -- 172.21.15.89:0/2185921023 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2ba80a5c80 con 0x7f2bb80c6740 2024-08-31T04:03:35.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.807+0000 7f0f0b400640 1 -- 172.21.15.89:0/1425347921 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0f0c014a10 con 0x7f0f140b2d20 2024-08-31T04:03:35.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.807+0000 7f0f0b400640 1 -- 172.21.15.89:0/1425347921 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0f0c0044d0 con 0x7f0f140b2d20 2024-08-31T04:03:35.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.807+0000 7f2bae000640 1 -- 172.21.15.89:0/2185921023 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2ba80c4020 con 0x7f2bb80c6740 2024-08-31T04:03:35.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.823+0000 7f0f0b400640 1 -- 172.21.15.89:0/1425347921 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0f0c022020 con 0x7f0f140b2d20 2024-08-31T04:03:35.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.831+0000 7fd8dca00640 1 -- 172.21.15.89:0/1146044579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d00452a0 msgr2=0x7fd8d00071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.831+0000 7fd8dca00640 1 --2- 172.21.15.89:0/1146044579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d00452a0 0x7fd8d00071d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd8d802e9d0 tx=0x7fd8d809c800 comp rx=0 tx=0).stop 2024-08-31T04:03:35.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.835+0000 7fd8dca00640 1 -- 172.21.15.89:0/1146044579 shutdown_connections 2024-08-31T04:03:35.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.835+0000 7fd8dca00640 1 --2- 172.21.15.89:0/1146044579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d00452a0 0x7fd8d00071d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.835+0000 7fd8dca00640 1 -- 172.21.15.89:0/1146044579 >> 172.21.15.89:0/1146044579 conn(0x7fd8d0050010 msgr2=0x7fd8d0050420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.839+0000 7fd8dca00640 1 -- 172.21.15.89:0/1146044579 shutdown_connections 2024-08-31T04:03:35.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.843+0000 7fd8dca00640 1 -- 172.21.15.89:0/1146044579 wait complete. 2024-08-31T04:03:35.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.851+0000 7fd8dca00640 1 Processor -- start 2024-08-31T04:03:35.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.851+0000 7fd8dca00640 1 -- start start 2024-08-31T04:03:35.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.851+0000 7fd8dca00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8d00452a0 0x7fd8d00df280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.851+0000 7fd8dca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d0047f00 0x7fd8d00d6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.851+0000 7fd8dca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00e2af0 0x7fd8d00cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:35.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.851+0000 7fd8d5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8d00452a0 0x7fd8d00df280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.851+0000 7fd8d5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8d00452a0 0x7fd8d00df280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55610/0 (socket says 172.21.15.89:55610) 2024-08-31T04:03:35.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.855+0000 7fd8d5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d0047f00 0x7fd8d00d6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:35.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.855+0000 7fd8d5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d0047f00 0x7fd8d00d6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:54500/0 (socket says 172.21.15.89:54500) 2024-08-31T04:03:35.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7f885f400640 1 -- 172.21.15.89:0/697413048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f8848005190 con 0x7f8874158840 2024-08-31T04:03:35.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8d5e00640 1 -- 172.21.15.89:0/3885040566 learned_addr learned my addr 172.21.15.89:0/3885040566 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:35.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d00d91e0 con 0x7fd8d00452a0 2024-08-31T04:03:35.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d0006d40 con 0x7fd8d0047f00 2024-08-31T04:03:35.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d00d9360 con 0x7fd8d00e2af0 2024-08-31T04:03:35.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8d5400640 1 -- 172.21.15.89:0/3885040566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00e2af0 msgr2=0x7fd8d00cde80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:03:35.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8d5400640 1 --2- 172.21.15.89:0/3885040566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00e2af0 0x7fd8d00cde80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8d5400640 1 -- 172.21.15.89:0/3885040566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8d00452a0 msgr2=0x7fd8d00df280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8d5400640 1 --2- 172.21.15.89:0/3885040566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8d00452a0 0x7fd8d00df280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8d5400640 1 -- 172.21.15.89:0/3885040566 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d00d72b0 con 0x7fd8d0047f00 2024-08-31T04:03:35.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8d5400640 1 --2- 172.21.15.89:0/3885040566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d0047f00 0x7fd8d00d6d70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400b440 tx=0x7fd8c400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:35.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8ce000640 1 -- 172.21.15.89:0/3885040566 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4011830 con 0x7fd8d0047f00 2024-08-31T04:03:35.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8ce000640 1 -- 172.21.15.89:0/3885040566 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8c4016070 con 0x7fd8d0047f00 2024-08-31T04:03:35.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.859+0000 7fd8ce000640 1 -- 172.21.15.89:0/3885040566 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4011d60 con 0x7fd8d0047f00 2024-08-31T04:03:35.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.863+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d00d5cd0 con 0x7fd8d0047f00 2024-08-31T04:03:35.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.863+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d00d8700 con 0x7fd8d0047f00 2024-08-31T04:03:35.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.867+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d0047bb0 con 0x7fd8d0047f00 2024-08-31T04:03:35.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.863+0000 7fd8ce000640 1 -- 172.21.15.89:0/3885040566 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd8c4004020 con 0x7fd8d0047f00 2024-08-31T04:03:35.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.867+0000 7fd8ce000640 1 -- 172.21.15.89:0/3885040566 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd8c401b580 con 0x7fd8d0047f00 2024-08-31T04:03:35.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.879+0000 7fd8ce000640 1 -- 172.21.15.89:0/3885040566 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd8c4020020 con 0x7fd8d0047f00 2024-08-31T04:03:35.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.883+0000 7f886a000640 1 -- 172.21.15.89:0/697413048 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f886c0107d0 con 0x7f8874158840 2024-08-31T04:03:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.887+0000 7f885f400640 1 -- 172.21.15.89:0/697413048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8874158840 msgr2=0x7f887414dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.887+0000 7f885f400640 1 --2- 172.21.15.89:0/697413048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8874158840 0x7f887414dbe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f886c00cfb0 tx=0x7f886c001580 comp rx=0 tx=0).stop 2024-08-31T04:03:35.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.891+0000 7f885f400640 1 -- 172.21.15.89:0/697413048 shutdown_connections 2024-08-31T04:03:35.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.891+0000 7f885f400640 1 --2- 172.21.15.89:0/697413048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8874158840 0x7f887414dbe0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.891+0000 7f885f400640 1 --2- 172.21.15.89:0/697413048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8874158430 0x7f887414d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.895+0000 7f885f400640 1 --2- 172.21.15.89:0/697413048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88740c75e0 0x7f887415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.895+0000 7f885f400640 1 -- 172.21.15.89:0/697413048 >> 172.21.15.89:0/697413048 conn(0x7f88740cd1e0 msgr2=0x7f88740c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.895+0000 7f885f400640 1 -- 172.21.15.89:0/697413048 shutdown_connections 2024-08-31T04:03:35.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.895+0000 7f885f400640 1 -- 172.21.15.89:0/697413048 wait complete. 2024-08-31T04:03:35.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.943+0000 7fe14b000640 1 -- 172.21.15.89:0/298412662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fe1440c7860 con 0x7fe144153380 2024-08-31T04:03:35.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.955+0000 7fe141600640 1 -- 172.21.15.89:0/298412662 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v10)=0 v10) ==== 127+0+0 (secure 0 0 0) 0x7fe13801cb20 con 0x7fe144153380 2024-08-31T04:03:35.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.971+0000 7fe14b000640 1 -- 172.21.15.89:0/298412662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe144153380 msgr2=0x7fe144150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:35.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.971+0000 7fe14b000640 1 --2- 172.21.15.89:0/298412662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe144153380 0x7fe144150330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe13800ca60 tx=0x7fe13800ca90 comp rx=0 tx=0).stop 2024-08-31T04:03:35.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.971+0000 7fe14b000640 1 -- 172.21.15.89:0/298412662 shutdown_connections 2024-08-31T04:03:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.971+0000 7fe14b000640 1 --2- 172.21.15.89:0/298412662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe144153380 0x7fe144150330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.971+0000 7fe14b000640 1 --2- 172.21.15.89:0/298412662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe144150ec0 0x7fe1441479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.971+0000 7fe14b000640 1 --2- 172.21.15.89:0/298412662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe12c003a60 0x7fe14414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.971+0000 7fe14b000640 1 -- 172.21.15.89:0/298412662 >> 172.21.15.89:0/298412662 conn(0x7fe1440cd1e0 msgr2=0x7fe1440b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.971+0000 7fe14b000640 1 -- 172.21.15.89:0/298412662 shutdown_connections 2024-08-31T04:03:35.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:35.971+0000 7fe14b000640 1 -- 172.21.15.89:0/298412662 wait complete. 2024-08-31T04:03:35.975 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.007+0000 7f1153e00640 1 -- 172.21.15.89:0/2737714344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11540c6740 msgr2=0x7f11540c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.007+0000 7f1153e00640 1 --2- 172.21.15.89:0/2737714344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11540c6740 0x7f11540c9070 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f11540706d0 tx=0x7f114401c630 comp rx=0 tx=0).stop 2024-08-31T04:03:36.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.007+0000 7f9323000640 1 -- 172.21.15.89:0/2466885134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9304004810 msgr2=0x7f9304004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.007+0000 7f9323000640 1 --2- 172.21.15.89:0/2466885134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9304004810 0x7f9304004c20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f931c0c80e0 tx=0x7f930801cf40 comp rx=0 tx=0).stop 2024-08-31T04:03:36.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.011+0000 7fb24d800640 1 -- 172.21.15.89:0/1246396776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb22c004850 msgr2=0x7fb22c00d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.011+0000 7fb24d800640 1 --2- 172.21.15.89:0/1246396776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb22c004850 0x7fb22c00d420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb24806a170 tx=0x7fb24001c990 comp rx=0 tx=0).stop 2024-08-31T04:03:36.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.011+0000 7fb24d800640 1 -- 172.21.15.89:0/1246396776 shutdown_connections 2024-08-31T04:03:36.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.011+0000 7fb24d800640 1 --2- 172.21.15.89:0/1246396776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb22c004850 0x7fb22c00d420 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.011+0000 7fb24d800640 1 -- 172.21.15.89:0/1246396776 >> 172.21.15.89:0/1246396776 conn(0x7fb2480c99b0 msgr2=0x7fb2480c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.011+0000 7fb24d800640 1 -- 172.21.15.89:0/1246396776 shutdown_connections 2024-08-31T04:03:36.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f9323000640 1 -- 172.21.15.89:0/2466885134 shutdown_connections 2024-08-31T04:03:36.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f9323000640 1 --2- 172.21.15.89:0/2466885134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9304004810 0x7f9304004c20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f9323000640 1 -- 172.21.15.89:0/2466885134 >> 172.21.15.89:0/2466885134 conn(0x7f931c0cd1e0 msgr2=0x7f931c0c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f9323000640 1 -- 172.21.15.89:0/2466885134 shutdown_connections 2024-08-31T04:03:36.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f9323000640 1 -- 172.21.15.89:0/2466885134 wait complete. 2024-08-31T04:03:36.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.011+0000 7fb24d800640 1 -- 172.21.15.89:0/1246396776 wait complete. 2024-08-31T04:03:36.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f1153e00640 1 -- 172.21.15.89:0/2737714344 shutdown_connections 2024-08-31T04:03:36.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f1153e00640 1 --2- 172.21.15.89:0/2737714344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11540c6740 0x7f11540c9070 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f1153e00640 1 -- 172.21.15.89:0/2737714344 >> 172.21.15.89:0/2737714344 conn(0x7f11540cd1e0 msgr2=0x7f11540c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f1153e00640 1 -- 172.21.15.89:0/2737714344 shutdown_connections 2024-08-31T04:03:36.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f5a51c00640 1 -- 172.21.15.89:0/3889310615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a4c0c75e0 msgr2=0x7f5a4c0c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f5a51c00640 1 --2- 172.21.15.89:0/3889310615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a4c0c75e0 0x7f5a4c0c86d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c06dc60 tx=0x7f5a4401cac0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.015+0000 7f1153e00640 1 -- 172.21.15.89:0/2737714344 wait complete. 2024-08-31T04:03:36.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.019+0000 7f5a51c00640 1 -- 172.21.15.89:0/3889310615 shutdown_connections 2024-08-31T04:03:36.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.019+0000 7f5a51c00640 1 --2- 172.21.15.89:0/3889310615 >> v2:172.21.15.89:3300/0 conn(0x7f5a4c0c8c10 0x7f5a4c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.019+0000 7f5a51c00640 1 --2- 172.21.15.89:0/3889310615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a4c0c75e0 0x7f5a4c0c86d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.019+0000 7f5a51c00640 1 --2- 172.21.15.89:0/3889310615 >> v2:172.21.15.170:3300/0 conn(0x7f5a4c15f8f0 0x7f5a4c070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.019+0000 7f5a51c00640 1 -- 172.21.15.89:0/3889310615 >> 172.21.15.89:0/3889310615 conn(0x7f5a4c0cd1e0 msgr2=0x7f5a4c0c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7f9323000640 1 Processor -- start 2024-08-31T04:03:36.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7f9323000640 1 -- start start 2024-08-31T04:03:36.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7f9323000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9304004810 0x7f931c1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7f1153e00640 1 Processor -- start 2024-08-31T04:03:36.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7f5a51c00640 1 -- 172.21.15.89:0/3889310615 shutdown_connections 2024-08-31T04:03:36.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7f5a51c00640 1 -- 172.21.15.89:0/3889310615 wait complete. 2024-08-31T04:03:36.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7f1153e00640 1 -- start start 2024-08-31T04:03:36.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1153e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1154074600 0x7f11540c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1153e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11540c6740 0x7f1154152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1153e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1154155ac0 0x7f1154152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1153e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f11540c6c70 con 0x7f1154155ac0 2024-08-31T04:03:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1153e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f11540c2b80 con 0x7f11540c6740 2024-08-31T04:03:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1153e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f11540c7d90 con 0x7f1154074600 2024-08-31T04:03:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1152a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1154074600 0x7f11540c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1152a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1154074600 0x7f11540c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53418/0 (socket says 172.21.15.89:53418) 2024-08-31T04:03:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1152a00640 1 -- 172.21.15.89:0/853859954 learned_addr learned my addr 172.21.15.89:0/853859954 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.019+0000 7fb24d800640 1 Processor -- start 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.019+0000 7fb24d800640 1 -- start start 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb24d800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb22c004850 0x7fb2481fe470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb24d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2481f4090 0x7fb248150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb24d800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb248150e90 0x7fb248201770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb24d800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480c2070 con 0x7fb248150e90 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb24d800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb248158360 con 0x7fb2481f4090 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb24d800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb2480c2350 con 0x7fb22c004850 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb246a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb22c004850 0x7fb2481fe470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb246a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb22c004850 0x7fb2481fe470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53404/0 (socket says 172.21.15.89:53404) 2024-08-31T04:03:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb246a00640 1 -- 172.21.15.89:0/2149888871 learned_addr learned my addr 172.21.15.89:0/2149888871 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb247400640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb248150e90 0x7fb248201770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb246000640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2481f4090 0x7fb248150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb246a00640 1 -- 172.21.15.89:0/2149888871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2481f4090 msgr2=0x7fb248150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb246a00640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2481f4090 0x7fb248150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb246a00640 1 -- 172.21.15.89:0/2149888871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb248150e90 msgr2=0x7fb248201770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb246a00640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb248150e90 0x7fb248201770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb246a00640 1 -- 172.21.15.89:0/2149888871 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2481fe9b0 con 0x7fb22c004850 2024-08-31T04:03:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.023+0000 7fb247400640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb248150e90 0x7fb248201770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7fb246a00640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb22c004850 0x7fb2481fe470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb23400b440 tx=0x7fb23400b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1153400640 1 --2- 172.21.15.89:0/853859954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1154155ac0 0x7f1154152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1152a00640 1 -- 172.21.15.89:0/853859954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11540c6740 msgr2=0x7f1154152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1152a00640 1 --2- 172.21.15.89:0/853859954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11540c6740 0x7f1154152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1152a00640 1 -- 172.21.15.89:0/853859954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1154155ac0 msgr2=0x7f1154152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1152a00640 1 --2- 172.21.15.89:0/853859954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1154155ac0 0x7f1154152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1152a00640 1 -- 172.21.15.89:0/853859954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1154202480 con 0x7f1154074600 2024-08-31T04:03:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1153400640 1 --2- 172.21.15.89:0/853859954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1154155ac0 0x7f1154152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:03:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f1152a00640 1 --2- 172.21.15.89:0/853859954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1154074600 0x7f11540c8ba0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1144000c10 tx=0x7f1144004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.027+0000 7f114aa00640 1 -- 172.21.15.89:0/853859954 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144005440 con 0x7f1154074600 2024-08-31T04:03:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f114aa00640 1 -- 172.21.15.89:0/853859954 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11440bc070 con 0x7f1154074600 2024-08-31T04:03:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f114aa00640 1 -- 172.21.15.89:0/853859954 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144004930 con 0x7f1154074600 2024-08-31T04:03:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9323000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f931c157a70 0x7f931c0c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9323000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f931c157e80 0x7f931c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9323000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f931c0b30e0 con 0x7f9304004810 2024-08-31T04:03:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9323000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f931c0c3cb0 con 0x7f931c157e80 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9323000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f931c0b3260 con 0x7f931c157a70 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9321200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f931c157a70 0x7f931c0c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9321200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f931c157a70 0x7f931c0c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53428/0 (socket says 172.21.15.89:53428) 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9321200640 1 -- 172.21.15.89:0/2648099317 learned_addr learned my addr 172.21.15.89:0/2648099317 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9322600640 1 --2- 172.21.15.89:0/2648099317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f931c157e80 0x7f931c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9321200640 1 -- 172.21.15.89:0/2648099317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f931c157e80 msgr2=0x7f931c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9321200640 1 --2- 172.21.15.89:0/2648099317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f931c157e80 0x7f931c0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9321200640 1 -- 172.21.15.89:0/2648099317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9304004810 msgr2=0x7f931c1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9321200640 1 --2- 172.21.15.89:0/2648099317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9304004810 0x7f931c1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9321200640 1 -- 172.21.15.89:0/2648099317 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c0c22d0 con 0x7f931c157a70 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9321200640 1 --2- 172.21.15.89:0/2648099317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f931c157a70 0x7f931c0c61b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9308098ad0 tx=0x7f93080aea40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9319600640 1 -- 172.21.15.89:0/2648099317 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308006c80 con 0x7f931c157a70 2024-08-31T04:03:36.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9323000640 1 -- 172.21.15.89:0/2648099317 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c1f6b40 con 0x7f931c157a70 2024-08-31T04:03:36.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9323000640 1 -- 172.21.15.89:0/2648099317 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c1f6de0 con 0x7f931c157a70 2024-08-31T04:03:36.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f1153e00640 1 -- 172.21.15.89:0/853859954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11541e15f0 con 0x7f1154074600 2024-08-31T04:03:36.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f1153e00640 1 -- 172.21.15.89:0/853859954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1154202700 con 0x7f1154074600 2024-08-31T04:03:36.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9319600640 1 -- 172.21.15.89:0/2648099317 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9308006170 con 0x7f931c157a70 2024-08-31T04:03:36.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7f9319600640 1 -- 172.21.15.89:0/2648099317 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308001d00 con 0x7f931c157a70 2024-08-31T04:03:36.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f9319600640 1 -- 172.21.15.89:0/2648099317 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f93080014e0 con 0x7f931c157a70 2024-08-31T04:03:36.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f9319600640 1 -- 172.21.15.89:0/2648099317 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f93080c14e0 con 0x7f931c157a70 2024-08-31T04:03:36.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a51c00640 1 Processor -- start 2024-08-31T04:03:36.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a51c00640 1 -- start start 2024-08-31T04:03:36.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f9323000640 1 -- 172.21.15.89:0/2648099317 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c0ca540 con 0x7f931c157a70 2024-08-31T04:03:36.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a51c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0c75e0 0x7f5a4c14cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a51c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a4c0c8c10 0x7f5a4c15e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a51c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4c15f8f0 0x7f5a4c153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a51c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c0b3260 con 0x7f5a4c0c75e0 2024-08-31T04:03:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a51c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c0b30e0 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a51c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4c071370 con 0x7f5a4c0c8c10 2024-08-31T04:03:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a4be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0c75e0 0x7f5a4c14cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7fb23ea00640 1 -- 172.21.15.89:0/2149888871 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234036070 con 0x7fb22c004850 2024-08-31T04:03:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7fb23ea00640 1 -- 172.21.15.89:0/2149888871 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2340328f0 con 0x7fb22c004850 2024-08-31T04:03:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.031+0000 7fb23ea00640 1 -- 172.21.15.89:0/2149888871 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234032d40 con 0x7fb22c004850 2024-08-31T04:03:36.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f114aa00640 1 -- 172.21.15.89:0/853859954 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1144004ad0 con 0x7f1154074600 2024-08-31T04:03:36.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f114aa00640 1 -- 172.21.15.89:0/853859954 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1144003d80 con 0x7f1154074600 2024-08-31T04:03:36.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f113fe00640 1 -- 172.21.15.89:0/853859954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11540ca3f0 con 0x7f1154074600 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a4be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0c75e0 0x7f5a4c14cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55688/0 (socket says 172.21.15.89:55688) 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.035+0000 7f5a4be00640 1 -- 172.21.15.89:0/2280636697 learned_addr learned my addr 172.21.15.89:0/2280636697 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a51200640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4c15f8f0 0x7f5a4c153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a4b400640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a4c0c8c10 0x7f5a4c15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a51200640 1 -- 172.21.15.89:0/2280636697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a4c0c8c10 msgr2=0x7f5a4c15e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a51200640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a4c0c8c10 0x7f5a4c15e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a51200640 1 -- 172.21.15.89:0/2280636697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0c75e0 msgr2=0x7f5a4c14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a51200640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0c75e0 0x7f5a4c14cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a51200640 1 -- 172.21.15.89:0/2280636697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c14d040 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a4be00640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0c75e0 0x7f5a4c14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:36.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a51200640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4c15f8f0 0x7f5a4c153d40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00e670 tx=0x7f5a3c00eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a43e00640 1 -- 172.21.15.89:0/2280636697 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c004220 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a43e00640 1 -- 172.21.15.89:0/2280636697 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a3c00c8b0 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.039+0000 7f5a43e00640 1 -- 172.21.15.89:0/2280636697 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00cd00 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.043+0000 7f0f1a400640 1 -- 172.21.15.89:0/1425347921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f0f140749e0 con 0x7f0f140b2d20 2024-08-31T04:03:36.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.043+0000 7f5a51c00640 1 -- 172.21.15.89:0/2280636697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c1f9f10 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.043+0000 7fb24d800640 1 -- 172.21.15.89:0/2149888871 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2481efed0 con 0x7fb22c004850 2024-08-31T04:03:36.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.043+0000 7fb24d800640 1 -- 172.21.15.89:0/2149888871 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2480cc810 con 0x7fb22c004850 2024-08-31T04:03:36.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.047+0000 7fb24d800640 1 -- 172.21.15.89:0/2149888871 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2480cc320 con 0x7fb22c004850 2024-08-31T04:03:36.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.043+0000 7f9319600640 1 -- 172.21.15.89:0/2648099317 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9308016cf0 con 0x7f931c157a70 2024-08-31T04:03:36.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.047+0000 7f5a51c00640 1 -- 172.21.15.89:0/2280636697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c14e1b0 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.047+0000 7f114aa00640 1 -- 172.21.15.89:0/853859954 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1154202480 con 0x7f1154074600 2024-08-31T04:03:36.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.051+0000 7f5a51c00640 1 -- 172.21.15.89:0/2280636697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4c0ca510 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.053 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.055+0000 7f5a43e00640 1 -- 172.21.15.89:0/2280636697 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5a3c0053b0 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.055+0000 7f5a43e00640 1 -- 172.21.15.89:0/2280636697 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5a3c003b50 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.051+0000 7fb23ea00640 1 -- 172.21.15.89:0/2149888871 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb234039070 con 0x7fb22c004850 2024-08-31T04:03:36.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.051+0000 7fb23ea00640 1 -- 172.21.15.89:0/2149888871 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb23403b8c0 con 0x7fb22c004850 2024-08-31T04:03:36.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.055+0000 7fb23ea00640 1 -- 172.21.15.89:0/2149888871 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb234045480 con 0x7fb22c004850 2024-08-31T04:03:36.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.059+0000 7f5a43e00640 1 -- 172.21.15.89:0/2280636697 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5a3c0047b0 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.063+0000 7f0f0b400640 1 -- 172.21.15.89:0/1425347921 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v11)=0 v11) ==== 116+0+0 (secure 0 0 0) 0x7f0f0c014d00 con 0x7f0f140b2d20 2024-08-31T04:03:36.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.063+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fd8d0032bf0 con 0x7fd8d0047f00 2024-08-31T04:03:36.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.067+0000 7f0f1a400640 1 -- 172.21.15.89:0/1425347921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140b2d20 msgr2=0x7f0f141571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.067+0000 7f0f1a400640 1 --2- 172.21.15.89:0/1425347921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140b2d20 0x7f0f141571c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00bd70 tx=0x7f0f0c00be60 comp rx=0 tx=0).stop 2024-08-31T04:03:36.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.067+0000 7f0f1a400640 1 -- 172.21.15.89:0/1425347921 shutdown_connections 2024-08-31T04:03:36.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.067+0000 7f0f1a400640 1 --2- 172.21.15.89:0/1425347921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f140c90e0 0x7f0f14157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.067+0000 7f0f1a400640 1 --2- 172.21.15.89:0/1425347921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140b2d20 0x7f0f141571c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.067+0000 7f0f1a400640 1 --2- 172.21.15.89:0/1425347921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f140b2860 0x7f0f14146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.067+0000 7f0f1a400640 1 -- 172.21.15.89:0/1425347921 >> 172.21.15.89:0/1425347921 conn(0x7f0f140c99b0 msgr2=0x7f0f14151b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.067+0000 7f0f1a400640 1 -- 172.21.15.89:0/1425347921 shutdown_connections 2024-08-31T04:03:36.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7f0f1a400640 1 -- 172.21.15.89:0/1425347921 wait complete. 2024-08-31T04:03:36.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8ce000640 1 -- 172.21.15.89:0/3885040566 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v12)=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7fd8c4004310 con 0x7fd8d0047f00 2024-08-31T04:03:36.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d0047f00 msgr2=0x7fd8d00d6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8dca00640 1 --2- 172.21.15.89:0/3885040566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d0047f00 0x7fd8d00d6d70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400b440 tx=0x7fd8c400b900 comp rx=0 tx=0).stop 2024-08-31T04:03:36.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 shutdown_connections 2024-08-31T04:03:36.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8dca00640 1 --2- 172.21.15.89:0/3885040566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00e2af0 0x7fd8d00cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8dca00640 1 --2- 172.21.15.89:0/3885040566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d0047f00 0x7fd8d00d6d70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8dca00640 1 --2- 172.21.15.89:0/3885040566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8d00452a0 0x7fd8d00df280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 >> 172.21.15.89:0/3885040566 conn(0x7fd8d0050010 msgr2=0x7fd8d00d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 shutdown_connections 2024-08-31T04:03:36.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7fd8dca00640 1 -- 172.21.15.89:0/3885040566 wait complete. 2024-08-31T04:03:36.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7f56e7200640 1 -- 172.21.15.89:0/3293215650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e00c75e0 msgr2=0x7f56e00c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.079+0000 7f56e7200640 1 --2- 172.21.15.89:0/3293215650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e00c75e0 0x7f56e00c8060 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f56e0159380 tx=0x7f56d001f030 comp rx=0 tx=0).stop 2024-08-31T04:03:36.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.091+0000 7f56e7200640 1 -- 172.21.15.89:0/3293215650 shutdown_connections 2024-08-31T04:03:36.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.091+0000 7f56e7200640 1 --2- 172.21.15.89:0/3293215650 >> v2:172.21.15.170:3300/0 conn(0x7f56e00c85a0 0x7f56e0155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.091+0000 7f56e7200640 1 --2- 172.21.15.89:0/3293215650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e00c75e0 0x7f56e00c8060 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.091+0000 7f56e7200640 1 -- 172.21.15.89:0/3293215650 >> 172.21.15.89:0/3293215650 conn(0x7f56e00cd1e0 msgr2=0x7f56e00c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.087+0000 7f2bb7200640 1 -- 172.21.15.89:0/2185921023 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f2bb80c7860 con 0x7f2bb80c6740 2024-08-31T04:03:36.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.095+0000 7f56e7200640 1 -- 172.21.15.89:0/3293215650 shutdown_connections 2024-08-31T04:03:36.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.095+0000 7f2bae000640 1 -- 172.21.15.89:0/2185921023 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v13)=0 v13) ==== 116+0+0 (secure 0 0 0) 0x7f2ba80163d0 con 0x7f2bb80c6740 2024-08-31T04:03:36.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.095+0000 7f2bb7200640 1 -- 172.21.15.89:0/2185921023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bb80c6740 msgr2=0x7f2bb8205490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.095+0000 7f2bb7200640 1 --2- 172.21.15.89:0/2185921023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bb80c6740 0x7f2bb8205490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8000c10 tx=0x7f2ba80a5690 comp rx=0 tx=0).stop 2024-08-31T04:03:36.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.095+0000 7f56e7200640 1 -- 172.21.15.89:0/3293215650 wait complete. 2024-08-31T04:03:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.099+0000 7f2bb7200640 1 -- 172.21.15.89:0/2185921023 shutdown_connections 2024-08-31T04:03:36.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.099+0000 7f2bb7200640 1 --2- 172.21.15.89:0/2185921023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bb8155ac0 0x7f2bb8167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.099+0000 7f2bb7200640 1 --2- 172.21.15.89:0/2185921023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bb80c6740 0x7f2bb8205490 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.099+0000 7f2bb7200640 1 --2- 172.21.15.89:0/2185921023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb80711a0 0x7f2bb814b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.099+0000 7f2bb7200640 1 -- 172.21.15.89:0/2185921023 >> 172.21.15.89:0/2185921023 conn(0x7f2bb80cd1e0 msgr2=0x7f2bb8074530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.103+0000 7f2bb7200640 1 -- 172.21.15.89:0/2185921023 shutdown_connections 2024-08-31T04:03:36.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.103+0000 7f2bb7200640 1 -- 172.21.15.89:0/2185921023 wait complete. 2024-08-31T04:03:36.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.107+0000 7f56e7200640 1 Processor -- start 2024-08-31T04:03:36.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.111+0000 7f56e7200640 1 -- start start 2024-08-31T04:03:36.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.115+0000 7f265a800640 1 -- 172.21.15.89:0/2319808770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2638003ab0 msgr2=0x7f2638003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.115+0000 7f265a800640 1 --2- 172.21.15.89:0/2319808770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2638003ab0 0x7f2638003ee0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2644003ff0 tx=0x7f264401d820 comp rx=0 tx=0).stop 2024-08-31T04:03:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7f265a800640 1 -- 172.21.15.89:0/2319808770 shutdown_connections 2024-08-31T04:03:36.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7f265a800640 1 --2- 172.21.15.89:0/2319808770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2638003ab0 0x7f2638003ee0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7f265a800640 1 -- 172.21.15.89:0/2319808770 >> 172.21.15.89:0/2319808770 conn(0x7f26540c99b0 msgr2=0x7f26540c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7fd957200640 1 -- 172.21.15.89:0/3248440840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9480df890 msgr2=0x7fd948049880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7fd957200640 1 --2- 172.21.15.89:0/3248440840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9480df890 0x7fd948049880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009900 tx=0x7fd93c01c900 comp rx=0 tx=0).stop 2024-08-31T04:03:36.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7f265a800640 1 -- 172.21.15.89:0/2319808770 shutdown_connections 2024-08-31T04:03:36.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7f265a800640 1 -- 172.21.15.89:0/2319808770 wait complete. 2024-08-31T04:03:36.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7fd957200640 1 -- 172.21.15.89:0/3248440840 shutdown_connections 2024-08-31T04:03:36.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7fd957200640 1 --2- 172.21.15.89:0/3248440840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9480df890 0x7fd948049880 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7fd957200640 1 --2- 172.21.15.89:0/3248440840 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd948046be0 0x7fd9480d5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.119+0000 7fd957200640 1 -- 172.21.15.89:0/3248440840 >> 172.21.15.89:0/3248440840 conn(0x7fd948050010 msgr2=0x7fd948050420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7fd957200640 1 -- 172.21.15.89:0/3248440840 shutdown_connections 2024-08-31T04:03:36.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7fd957200640 1 -- 172.21.15.89:0/3248440840 wait complete. 2024-08-31T04:03:36.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e7200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e00c75e0 0x7f56e0158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e7200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e00c85a0 0x7f56e01571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e7200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e00ca260 0x7f56e015e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e7200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f56e015c230 con 0x7f56e00c75e0 2024-08-31T04:03:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e7200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f56e00c89b0 con 0x7f56e00ca260 2024-08-31T04:03:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e7200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56e00b2fe0 con 0x7f56e00c85a0 2024-08-31T04:03:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e00c85a0 0x7f56e01571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e00c85a0 0x7f56e01571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53476/0 (socket says 172.21.15.89:53476) 2024-08-31T04:03:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5400640 1 -- 172.21.15.89:0/3645356219 learned_addr learned my addr 172.21.15.89:0/3645356219 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e6800640 1 --2- 172.21.15.89:0/3645356219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e00ca260 0x7f56e015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5e00640 1 --2- 172.21.15.89:0/3645356219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e00c75e0 0x7f56e0158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5400640 1 -- 172.21.15.89:0/3645356219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e00ca260 msgr2=0x7f56e015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5400640 1 --2- 172.21.15.89:0/3645356219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e00ca260 0x7f56e015e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5400640 1 -- 172.21.15.89:0/3645356219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e00c75e0 msgr2=0x7f56e0158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5400640 1 --2- 172.21.15.89:0/3645356219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e00c75e0 0x7f56e0158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5400640 1 -- 172.21.15.89:0/3645356219 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e0157730 con 0x7f56e00c85a0 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.123+0000 7f56e5400640 1 --2- 172.21.15.89:0/3645356219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e00c85a0 0x7f56e01571f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f56d001bc40 tx=0x7f56d00a8d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.127+0000 7f56da000640 1 -- 172.21.15.89:0/3645356219 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d00b5040 con 0x7f56e00c85a0 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.127+0000 7f56da000640 1 -- 172.21.15.89:0/3645356219 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56d00be070 con 0x7f56e00c85a0 2024-08-31T04:03:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.127+0000 7f56da000640 1 -- 172.21.15.89:0/3645356219 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0005490 con 0x7f56e00c85a0 2024-08-31T04:03:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.131+0000 7f265a800640 1 Processor -- start 2024-08-31T04:03:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.131+0000 7f265a800640 1 -- start start 2024-08-31T04:03:36.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.131+0000 7f56e7200640 1 -- 172.21.15.89:0/3645356219 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e015f670 con 0x7f56e00c85a0 2024-08-31T04:03:36.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.131+0000 7f56e7200640 1 -- 172.21.15.89:0/3645356219 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e015c950 con 0x7f56e00c85a0 2024-08-31T04:03:36.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7fd957200640 1 Processor -- start 2024-08-31T04:03:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f265a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2638003ab0 0x7f26541f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f265a800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f265415a5b0 0x7f26540c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f56da000640 1 -- 172.21.15.89:0/3645356219 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56d00b1700 con 0x7f56e00c85a0 2024-08-31T04:03:36.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f56da000640 1 -- 172.21.15.89:0/3645356219 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f56d0004990 con 0x7f56e00c85a0 2024-08-31T04:03:36.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f265a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f265415a9c0 0x7f26540c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f56e7200640 1 -- 172.21.15.89:0/3645356219 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e00c8060 con 0x7f56e00c85a0 2024-08-31T04:03:36.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f2652a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f265415a5b0 0x7f26540c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f2652a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f265415a5b0 0x7f26540c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53490/0 (socket says 172.21.15.89:53490) 2024-08-31T04:03:36.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f2653400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2638003ab0 0x7f26541f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f2653400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2638003ab0 0x7f26541f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:54632/0 (socket says 172.21.15.89:54632) 2024-08-31T04:03:36.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7fd957200640 1 -- start start 2024-08-31T04:03:36.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7fd957200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd948046be0 0x7fd9480cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f2653e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f265415a9c0 0x7f26540c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f2653e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f265415a9c0 0x7f26540c5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55722/0 (socket says 172.21.15.89:55722) 2024-08-31T04:03:36.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f2652a00640 1 -- 172.21.15.89:0/3811901997 learned_addr learned my addr 172.21.15.89:0/3811901997 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f3eada00640 1 -- 172.21.15.89:0/2563879060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c75e0 msgr2=0x7f3ea8155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7f3eada00640 1 --2- 172.21.15.89:0/2563879060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c75e0 0x7f3ea8155a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009900 tx=0x7f3e9801c850 comp rx=0 tx=0).stop 2024-08-31T04:03:36.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.135+0000 7fd957200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd948049210 0x7fd9480d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f265415bd20 con 0x7f265415a9c0 2024-08-31T04:03:36.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd955c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd948046be0 0x7fd9480cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd955c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd948046be0 0x7fd9480cd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53502/0 (socket says 172.21.15.89:53502) 2024-08-31T04:03:36.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2654070820 con 0x7f2638003ab0 2024-08-31T04:03:36.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f265415c000 con 0x7f265415a5b0 2024-08-31T04:03:36.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd955c00640 1 -- 172.21.15.89:0/2160524130 learned_addr learned my addr 172.21.15.89:0/2160524130 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd957200640 1 --2- 172.21.15.89:0/2160524130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9480df890 0x7fd9480d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f3eada00640 1 -- 172.21.15.89:0/2563879060 shutdown_connections 2024-08-31T04:03:36.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f3eada00640 1 --2- 172.21.15.89:0/2563879060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ea80c8dd0 0x7f3ea8071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f3eada00640 1 --2- 172.21.15.89:0/2563879060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c75e0 0x7f3ea8155a30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f3eada00640 1 -- 172.21.15.89:0/2563879060 >> 172.21.15.89:0/2563879060 conn(0x7f3ea80cd1e0 msgr2=0x7f3ea80c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd94f400640 1 --2- 172.21.15.89:0/2160524130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd948049210 0x7fd9480d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.147 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f3eada00640 1 -- 172.21.15.89:0/2563879060 shutdown_connections 2024-08-31T04:03:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd957200640 1 -- 172.21.15.89:0/2160524130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd94804a1d0 con 0x7fd9480df890 2024-08-31T04:03:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd957200640 1 -- 172.21.15.89:0/2160524130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd9480e8370 con 0x7fd948049210 2024-08-31T04:03:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd957200640 1 -- 172.21.15.89:0/2160524130 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd94804a350 con 0x7fd948046be0 2024-08-31T04:03:36.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f3eada00640 1 -- 172.21.15.89:0/2563879060 wait complete. 2024-08-31T04:03:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f2653e00640 1 -- 172.21.15.89:0/3811901997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f265415a5b0 msgr2=0x7f26540c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f2653e00640 1 --2- 172.21.15.89:0/3811901997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f265415a5b0 0x7f26540c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f2653e00640 1 -- 172.21.15.89:0/3811901997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2638003ab0 msgr2=0x7f26541f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f2653e00640 1 --2- 172.21.15.89:0/3811901997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2638003ab0 0x7f26541f6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f2653e00640 1 -- 172.21.15.89:0/3811901997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26541f6950 con 0x7f265415a9c0 2024-08-31T04:03:36.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7f2653e00640 1 --2- 172.21.15.89:0/3811901997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f265415a9c0 0x7f26540c5e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f26540c30b0 tx=0x7f264000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd94f400640 1 -- 172.21.15.89:0/2160524130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd948046be0 msgr2=0x7fd9480cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd94f400640 1 --2- 172.21.15.89:0/2160524130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd948046be0 0x7fd9480cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd94f400640 1 -- 172.21.15.89:0/2160524130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9480df890 msgr2=0x7fd9480d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd94f400640 1 --2- 172.21.15.89:0/2160524130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9480df890 0x7fd9480d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd94f400640 1 -- 172.21.15.89:0/2160524130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9480d0df0 con 0x7fd948049210 2024-08-31T04:03:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd94f400640 1 --2- 172.21.15.89:0/2160524130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd948049210 0x7fd9480d08b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd950066680 tx=0x7fd9500769a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd943e00640 1 -- 172.21.15.89:0/2160524130 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950077020 con 0x7fd948049210 2024-08-31T04:03:36.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd943e00640 1 -- 172.21.15.89:0/2160524130 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd95006a060 con 0x7fd948049210 2024-08-31T04:03:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.139+0000 7fd943e00640 1 -- 172.21.15.89:0/2160524130 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950095680 con 0x7fd948049210 2024-08-31T04:03:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7f264b400640 1 -- 172.21.15.89:0/3811901997 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26400052d0 con 0x7f265415a9c0 2024-08-31T04:03:36.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7fd957200640 1 -- 172.21.15.89:0/2160524130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9480d12f0 con 0x7fd948049210 2024-08-31T04:03:36.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7f264b400640 1 -- 172.21.15.89:0/3811901997 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2640005490 con 0x7f265415a9c0 2024-08-31T04:03:36.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7f264b400640 1 -- 172.21.15.89:0/3811901997 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640007260 con 0x7f265415a9c0 2024-08-31T04:03:36.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7fd957200640 1 -- 172.21.15.89:0/2160524130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd948032fc0 con 0x7fd948049210 2024-08-31T04:03:36.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26540c6840 con 0x7f265415a9c0 2024-08-31T04:03:36.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26540c6e00 con 0x7f265415a9c0 2024-08-31T04:03:36.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7fd943e00640 1 -- 172.21.15.89:0/2160524130 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd950095bb0 con 0x7fd948049210 2024-08-31T04:03:36.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7fd943e00640 1 -- 172.21.15.89:0/2160524130 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd95009e3a0 con 0x7fd948049210 2024-08-31T04:03:36.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.143+0000 7f56da000640 1 -- 172.21.15.89:0/3645356219 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f56d00c7020 con 0x7f56e00c85a0 2024-08-31T04:03:36.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.147+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26540c65d0 con 0x7f265415a9c0 2024-08-31T04:03:36.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.147+0000 7f264b400640 1 -- 172.21.15.89:0/3811901997 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f26400067e0 con 0x7f265415a9c0 2024-08-31T04:03:36.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.147+0000 7f3eada00640 1 Processor -- start 2024-08-31T04:03:36.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.147+0000 7f264b400640 1 -- 172.21.15.89:0/3811901997 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f26400096e0 con 0x7f265415a9c0 2024-08-31T04:03:36.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.147+0000 7f3eada00640 1 -- start start 2024-08-31T04:03:36.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.147+0000 7fd941600640 1 -- 172.21.15.89:0/2160524130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9480de8f0 con 0x7fd948049210 2024-08-31T04:03:36.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.147+0000 7f3eada00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ea8070c60 0x7f3ea814a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.147+0000 7f3eada00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c75e0 0x7f3ea80c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3eada00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea80c8dd0 0x7f3ea80c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3eada00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea81560f0 con 0x7f3ea80c75e0 2024-08-31T04:03:36.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3eada00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea8155f70 con 0x7f3ea80c8dd0 2024-08-31T04:03:36.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ea7e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ea8070c60 0x7f3ea814a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3eada00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea80b3070 con 0x7f3ea8070c60 2024-08-31T04:03:36.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ea7e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ea8070c60 0x7f3ea814a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53520/0 (socket says 172.21.15.89:53520) 2024-08-31T04:03:36.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ea7e00640 1 -- 172.21.15.89:0/237756021 learned_addr learned my addr 172.21.15.89:0/237756021 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ead000640 1 --2- 172.21.15.89:0/237756021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea80c8dd0 0x7f3ea80c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ea7e00640 1 -- 172.21.15.89:0/237756021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea80c8dd0 msgr2=0x7f3ea80c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ea7e00640 1 --2- 172.21.15.89:0/237756021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea80c8dd0 0x7f3ea80c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ea7e00640 1 -- 172.21.15.89:0/237756021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c75e0 msgr2=0x7f3ea80c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ea7e00640 1 --2- 172.21.15.89:0/237756021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c75e0 0x7f3ea80c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ea7e00640 1 -- 172.21.15.89:0/237756021 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea81484e0 con 0x7f3ea8070c60 2024-08-31T04:03:36.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.151+0000 7f3ea7e00640 1 --2- 172.21.15.89:0/237756021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ea8070c60 0x7f3ea814a150 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3e98019460 tx=0x7f3e98005790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.155+0000 7fd943e00640 1 -- 172.21.15.89:0/2160524130 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd9500a4080 con 0x7fd948049210 2024-08-31T04:03:36.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.155+0000 7f3e9fe00640 1 -- 172.21.15.89:0/237756021 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e980bb070 con 0x7f3ea8070c60 2024-08-31T04:03:36.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.155+0000 7f3e9fe00640 1 -- 172.21.15.89:0/237756021 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e980043e0 con 0x7f3ea8070c60 2024-08-31T04:03:36.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.155+0000 7f3e9fe00640 1 -- 172.21.15.89:0/237756021 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e980b2040 con 0x7f3ea8070c60 2024-08-31T04:03:36.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.155+0000 7f3eada00640 1 -- 172.21.15.89:0/237756021 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea81487c0 con 0x7f3ea8070c60 2024-08-31T04:03:36.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.155+0000 7f3eada00640 1 -- 172.21.15.89:0/237756021 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea8148d80 con 0x7f3ea8070c60 2024-08-31T04:03:36.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.159+0000 7f3e9fe00640 1 -- 172.21.15.89:0/237756021 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3e98003860 con 0x7f3ea8070c60 2024-08-31T04:03:36.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.159+0000 7f3e9fe00640 1 -- 172.21.15.89:0/237756021 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3e980ad7e0 con 0x7f3ea8070c60 2024-08-31T04:03:36.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.159+0000 7f264b400640 1 -- 172.21.15.89:0/3811901997 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2640020020 con 0x7f265415a9c0 2024-08-31T04:03:36.162 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.163 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.163 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.159+0000 7f1aa5600640 1 -- 172.21.15.89:0/3594691634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a84005160 msgr2=0x7f1a8400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.159+0000 7f1aa5600640 1 --2- 172.21.15.89:0/3594691634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a84005160 0x7f1a8400b9d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1aa015dc20 tx=0x7f1a9801d5f0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f1aa5600640 1 -- 172.21.15.89:0/3594691634 shutdown_connections 2024-08-31T04:03:36.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f85f8600640 1 -- 172.21.15.89:0/2987478721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 msgr2=0x7f85f0151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f85f8600640 1 --2- 172.21.15.89:0/2987478721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 0x7f85f0151720 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009bf0 tx=0x7f85e801f3d0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f1aa5600640 1 --2- 172.21.15.89:0/3594691634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a84005160 0x7f1a8400b9d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f1aa5600640 1 -- 172.21.15.89:0/3594691634 >> 172.21.15.89:0/3594691634 conn(0x7f1aa00cd1e0 msgr2=0x7f1aa00c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f85f8600640 1 -- 172.21.15.89:0/2987478721 shutdown_connections 2024-08-31T04:03:36.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f85f8600640 1 --2- 172.21.15.89:0/2987478721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 0x7f85f0151720 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f85f8600640 1 -- 172.21.15.89:0/2987478721 >> 172.21.15.89:0/2987478721 conn(0x7f85f00cd1b0 msgr2=0x7f85f00cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f3eada00640 1 -- 172.21.15.89:0/237756021 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea80ca480 con 0x7f3ea8070c60 2024-08-31T04:03:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.167+0000 7f1aa5600640 1 -- 172.21.15.89:0/3594691634 shutdown_connections 2024-08-31T04:03:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f85f8600640 1 -- 172.21.15.89:0/2987478721 shutdown_connections 2024-08-31T04:03:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.163+0000 7f85f8600640 1 -- 172.21.15.89:0/2987478721 wait complete. 2024-08-31T04:03:36.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.167+0000 7f85f8600640 1 Processor -- start 2024-08-31T04:03:36.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.167+0000 7f85f8600640 1 -- start start 2024-08-31T04:03:36.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.167+0000 7f3e9fe00640 1 -- 172.21.15.89:0/237756021 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3e980c4020 con 0x7f3ea8070c60 2024-08-31T04:03:36.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.167+0000 7f1aa5600640 1 -- 172.21.15.89:0/3594691634 wait complete. 2024-08-31T04:03:36.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f8600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85f006d200 0x7f85f0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f8600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 0x7f85f00c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f8600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85f0074e60 0x7f85f015e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85f006d200 0x7f85f0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85f006d200 0x7f85f0156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:54674/0 (socket says 172.21.15.89:54674) 2024-08-31T04:03:36.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 0x7f85f00c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 0x7f85f00c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53526/0 (socket says 172.21.15.89:53526) 2024-08-31T04:03:36.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f85f00744d0 con 0x7f85f0074e60 2024-08-31T04:03:36.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5c00640 1 -- 172.21.15.89:0/612977718 learned_addr learned my addr 172.21.15.89:0/612977718 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f85f00c7940 con 0x7f85f006d200 2024-08-31T04:03:36.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f85f015ee60 con 0x7f85f006d610 2024-08-31T04:03:36.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5c00640 1 -- 172.21.15.89:0/612977718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 msgr2=0x7f85f00c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5c00640 1 --2- 172.21.15.89:0/612977718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 0x7f85f00c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5c00640 1 -- 172.21.15.89:0/612977718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85f0074e60 msgr2=0x7f85f015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5c00640 1 --2- 172.21.15.89:0/612977718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85f0074e60 0x7f85f015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5c00640 1 -- 172.21.15.89:0/612977718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f0157040 con 0x7f85f006d200 2024-08-31T04:03:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5200640 1 --2- 172.21.15.89:0/612977718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 0x7f85f00c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:03:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.171+0000 7f85f5c00640 1 --2- 172.21.15.89:0/612977718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85f006d200 0x7f85f0156b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c430 tx=0x7f85e400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1aa5600640 1 Processor -- start 2024-08-31T04:03:36.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1aa5600640 1 -- start start 2024-08-31T04:03:36.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1aa5600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a84005160 0x7f1aa0143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1aa5600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa0149190 0x7f1aa00cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1aa5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa00cc080 0x7f1aa00ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1aa5600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa00c75e0 con 0x7f1aa00cc080 2024-08-31T04:03:36.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1aa5600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa00ca540 con 0x7f1aa0149190 2024-08-31T04:03:36.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1aa5600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa00c7760 con 0x7f1a84005160 2024-08-31T04:03:36.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1a9f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa0149190 0x7f1aa00cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1a9fe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a84005160 0x7f1aa0143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1a9f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa0149190 0x7f1aa00cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:54676/0 (socket says 172.21.15.89:54676) 2024-08-31T04:03:36.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.175+0000 7f1a9f400640 1 -- 172.21.15.89:0/23886898 learned_addr learned my addr 172.21.15.89:0/23886898 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f1a9fe00640 1 -- 172.21.15.89:0/23886898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa0149190 msgr2=0x7f1aa00cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f1a9fe00640 1 --2- 172.21.15.89:0/23886898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa0149190 0x7f1aa00cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f1a9fe00640 1 -- 172.21.15.89:0/23886898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa00cc080 msgr2=0x7f1aa00ca9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T04:03:36.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f1a9fe00640 1 --2- 172.21.15.89:0/23886898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa00cc080 0x7f1aa00ca9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f1a9fe00640 1 -- 172.21.15.89:0/23886898 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa014b5f0 con 0x7f1a84005160 2024-08-31T04:03:36.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f1a9fe00640 1 --2- 172.21.15.89:0/23886898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a84005160 0x7f1aa0143f40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00c7bd0 tx=0x7f1a9000f6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f1a97e00640 1 -- 172.21.15.89:0/23886898 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9001a070 con 0x7f1a84005160 2024-08-31T04:03:36.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f1a97e00640 1 -- 172.21.15.89:0/23886898 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a900084e0 con 0x7f1a84005160 2024-08-31T04:03:36.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f1a97e00640 1 -- 172.21.15.89:0/23886898 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90006980 con 0x7f1a84005160 2024-08-31T04:03:36.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f85ed600640 1 -- 172.21.15.89:0/612977718 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4011790 con 0x7f85f006d200 2024-08-31T04:03:36.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f85ed600640 1 -- 172.21.15.89:0/612977718 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85e4017070 con 0x7f85f006d200 2024-08-31T04:03:36.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f85ed600640 1 -- 172.21.15.89:0/612977718 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4011ce0 con 0x7f85f006d200 2024-08-31T04:03:36.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f00c5d30 con 0x7f85f006d200 2024-08-31T04:03:36.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f00c5fd0 con 0x7f85f006d200 2024-08-31T04:03:36.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f00740b0 con 0x7f85f006d200 2024-08-31T04:03:36.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f85ed600640 1 -- 172.21.15.89:0/612977718 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f85e401c460 con 0x7f85f006d200 2024-08-31T04:03:36.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.179+0000 7f85ed600640 1 -- 172.21.15.89:0/612977718 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f85e4026800 con 0x7f85f006d200 2024-08-31T04:03:36.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.187+0000 7f1aa5600640 1 -- 172.21.15.89:0/23886898 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa014b8d0 con 0x7f1a84005160 2024-08-31T04:03:36.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.187+0000 7f1aa5600640 1 -- 172.21.15.89:0/23886898 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa006d930 con 0x7f1a84005160 2024-08-31T04:03:36.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.187+0000 7f85ed600640 1 -- 172.21.15.89:0/612977718 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f85e4026a50 con 0x7f85f006d200 2024-08-31T04:03:36.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.191+0000 7f1a97e00640 1 -- 172.21.15.89:0/23886898 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1a9001d070 con 0x7f1a84005160 2024-08-31T04:03:36.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.191+0000 7f1a97e00640 1 -- 172.21.15.89:0/23886898 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1a90015740 con 0x7f1a84005160 2024-08-31T04:03:36.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.191+0000 7f1aa5600640 1 -- 172.21.15.89:0/23886898 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa01596d0 con 0x7f1a84005160 2024-08-31T04:03:36.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.195+0000 7f1a97e00640 1 -- 172.21.15.89:0/23886898 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1a90024020 con 0x7f1a84005160 2024-08-31T04:03:36.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.215+0000 7f7442a00640 1 -- 172.21.15.89:0/713345656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 msgr2=0x7f743c0711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.215+0000 7f7442a00640 1 --2- 172.21.15.89:0/713345656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 0x7f743c0711a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f74280074e0 tx=0x7f742801d300 comp rx=0 tx=0).stop 2024-08-31T04:03:36.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.215+0000 7f7442a00640 1 -- 172.21.15.89:0/713345656 shutdown_connections 2024-08-31T04:03:36.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.215+0000 7f7442a00640 1 --2- 172.21.15.89:0/713345656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 0x7f743c0711a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.215+0000 7f7442a00640 1 --2- 172.21.15.89:0/713345656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f743c15b860 0x7f743c070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.215+0000 7f7442a00640 1 -- 172.21.15.89:0/713345656 >> 172.21.15.89:0/713345656 conn(0x7f743c0cd1e0 msgr2=0x7f743c0c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.215+0000 7f7442a00640 1 -- 172.21.15.89:0/713345656 shutdown_connections 2024-08-31T04:03:36.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.219+0000 7f7442a00640 1 -- 172.21.15.89:0/713345656 wait complete. 2024-08-31T04:03:36.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7442a00640 1 Processor -- start 2024-08-31T04:03:36.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7442a00640 1 -- start start 2024-08-31T04:03:36.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7442a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 0x7f743c2023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7442a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f743c074d80 0x7f743c157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7442a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f743c15b860 0x7f743c160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7442a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f743c164d90 con 0x7f743c074d80 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7442a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f743c164c10 con 0x7f743c074130 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7441600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 0x7f743c2023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7441600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 0x7f743c2023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:54694/0 (socket says 172.21.15.89:54694) 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7441600640 1 -- 172.21.15.89:0/3660762558 learned_addr learned my addr 172.21.15.89:0/3660762558 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7440c00640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f743c074d80 0x7f743c157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.227+0000 7f7442000640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f743c15b860 0x7f743c160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f743c164f10 con 0x7f743c15b860 2024-08-31T04:03:36.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7441600640 1 -- 172.21.15.89:0/3660762558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f743c15b860 msgr2=0x7f743c160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7441600640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f743c15b860 0x7f743c160c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7441600640 1 -- 172.21.15.89:0/3660762558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f743c074d80 msgr2=0x7f743c157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7441600640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f743c074d80 0x7f743c157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7441600640 1 -- 172.21.15.89:0/3660762558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c2028f0 con 0x7f743c074130 2024-08-31T04:03:36.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7442000640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f743c15b860 0x7f743c160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:03:36.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7441600640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 0x7f743c2023b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f743400eb00 tx=0x7f743400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7439600640 1 -- 172.21.15.89:0/3660762558 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7434004b30 con 0x7f743c074130 2024-08-31T04:03:36.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7439600640 1 -- 172.21.15.89:0/3660762558 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7434004cf0 con 0x7f743c074130 2024-08-31T04:03:36.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7439600640 1 -- 172.21.15.89:0/3660762558 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7434005280 con 0x7f743c074130 2024-08-31T04:03:36.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743c15dd20 con 0x7f743c074130 2024-08-31T04:03:36.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743c15e2e0 con 0x7f743c074130 2024-08-31T04:03:36.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7439600640 1 -- 172.21.15.89:0/3660762558 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f74340057b0 con 0x7f743c074130 2024-08-31T04:03:36.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.231+0000 7f7439600640 1 -- 172.21.15.89:0/3660762558 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7434018770 con 0x7f743c074130 2024-08-31T04:03:36.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.235+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743c073a20 con 0x7f743c074130 2024-08-31T04:03:36.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.239+0000 7fb24d800640 1 -- 172.21.15.89:0/2149888871 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb2480c3f30 con 0x7fb22c004850 2024-08-31T04:03:36.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.239+0000 7f9323000640 1 -- 172.21.15.89:0/2648099317 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f931c1f6fe0 con 0x7f931c157a70 2024-08-31T04:03:36.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.239+0000 7f113fe00640 1 -- 172.21.15.89:0/853859954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f11540c7860 con 0x7f1154074600 2024-08-31T04:03:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.243+0000 7f7439600640 1 -- 172.21.15.89:0/3660762558 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7434021440 con 0x7f743c074130 2024-08-31T04:03:36.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.251+0000 7fb23ea00640 1 -- 172.21.15.89:0/2149888871 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7fb23403bb10 con 0x7fb22c004850 2024-08-31T04:03:36.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.251+0000 7fb24d800640 1 -- 172.21.15.89:0/2149888871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb22c004850 msgr2=0x7fb2481fe470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.251+0000 7fb24d800640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb22c004850 0x7fb2481fe470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb23400b440 tx=0x7fb23400b900 comp rx=0 tx=0).stop 2024-08-31T04:03:36.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.251+0000 7fb24d800640 1 -- 172.21.15.89:0/2149888871 shutdown_connections 2024-08-31T04:03:36.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.251+0000 7fb24d800640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb248150e90 0x7fb248201770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.251+0000 7fb24d800640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2481f4090 0x7fb248150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.251+0000 7fb24d800640 1 --2- 172.21.15.89:0/2149888871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb22c004850 0x7fb2481fe470 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.251+0000 7fb24d800640 1 -- 172.21.15.89:0/2149888871 >> 172.21.15.89:0/2149888871 conn(0x7fb2480c99b0 msgr2=0x7fb2480c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.259+0000 7fb24d800640 1 -- 172.21.15.89:0/2149888871 shutdown_connections 2024-08-31T04:03:36.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.259+0000 7fb24d800640 1 -- 172.21.15.89:0/2149888871 wait complete. 2024-08-31T04:03:36.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.267+0000 7f114aa00640 1 -- 172.21.15.89:0/853859954 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f11440162b0 con 0x7f1154074600 2024-08-31T04:03:36.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.271+0000 7f9319600640 1 -- 172.21.15.89:0/2648099317 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v16)=0 v16) ==== 115+0+0 (secure 0 0 0) 0x7f9308003620 con 0x7f931c157a70 2024-08-31T04:03:36.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f5a51c00640 1 -- 172.21.15.89:0/2280636697 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f5a4c14c7b0 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f9323000640 1 -- 172.21.15.89:0/2648099317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f931c157a70 msgr2=0x7f931c0c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f9323000640 1 --2- 172.21.15.89:0/2648099317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f931c157a70 0x7f931c0c61b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9308098ad0 tx=0x7f93080aea40 comp rx=0 tx=0).stop 2024-08-31T04:03:36.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f113fe00640 1 -- 172.21.15.89:0/853859954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1154074600 msgr2=0x7f11540c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f113fe00640 1 --2- 172.21.15.89:0/853859954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1154074600 0x7f11540c8ba0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1144000c10 tx=0x7f1144004340 comp rx=0 tx=0).stop 2024-08-31T04:03:36.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f9323000640 1 -- 172.21.15.89:0/2648099317 shutdown_connections 2024-08-31T04:03:36.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f9323000640 1 --2- 172.21.15.89:0/2648099317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f931c157e80 0x7f931c0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f9323000640 1 --2- 172.21.15.89:0/2648099317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f931c157a70 0x7f931c0c61b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f9323000640 1 --2- 172.21.15.89:0/2648099317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9304004810 0x7f931c1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f113fe00640 1 -- 172.21.15.89:0/853859954 shutdown_connections 2024-08-31T04:03:36.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f113fe00640 1 --2- 172.21.15.89:0/853859954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1154155ac0 0x7f1154152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f113fe00640 1 --2- 172.21.15.89:0/853859954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11540c6740 0x7f1154152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f113fe00640 1 --2- 172.21.15.89:0/853859954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1154074600 0x7f11540c8ba0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f113fe00640 1 -- 172.21.15.89:0/853859954 >> 172.21.15.89:0/853859954 conn(0x7f11540cd1e0 msgr2=0x7f11541e4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f9323000640 1 -- 172.21.15.89:0/2648099317 >> 172.21.15.89:0/2648099317 conn(0x7f931c0cd1e0 msgr2=0x7f931c0cacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f113fe00640 1 -- 172.21.15.89:0/853859954 shutdown_connections 2024-08-31T04:03:36.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f113fe00640 1 -- 172.21.15.89:0/853859954 wait complete. 2024-08-31T04:03:36.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f9323000640 1 -- 172.21.15.89:0/2648099317 shutdown_connections 2024-08-31T04:03:36.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.275+0000 7f9323000640 1 -- 172.21.15.89:0/2648099317 wait complete. 2024-08-31T04:03:36.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.287+0000 7f5a43e00640 1 -- 172.21.15.89:0/2280636697 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f5a3c004990 con 0x7f5a4c15f8f0 2024-08-31T04:03:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.299+0000 7f5a51c00640 1 -- 172.21.15.89:0/2280636697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4c15f8f0 msgr2=0x7f5a4c153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.299+0000 7f5a51c00640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4c15f8f0 0x7f5a4c153d40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00e670 tx=0x7f5a3c00eb30 comp rx=0 tx=0).stop 2024-08-31T04:03:36.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.303+0000 7fd941600640 1 -- 172.21.15.89:0/2160524130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fd9480d5d00 con 0x7fd948049210 2024-08-31T04:03:36.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.303+0000 7f5a51c00640 1 -- 172.21.15.89:0/2280636697 shutdown_connections 2024-08-31T04:03:36.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.303+0000 7f5a51c00640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4c15f8f0 0x7f5a4c153d40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.303+0000 7f5a51c00640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a4c0c8c10 0x7f5a4c15e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.303+0000 7f5a51c00640 1 --2- 172.21.15.89:0/2280636697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a4c0c75e0 0x7f5a4c14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.303+0000 7f5a51c00640 1 -- 172.21.15.89:0/2280636697 >> 172.21.15.89:0/2280636697 conn(0x7f5a4c0cd1e0 msgr2=0x7f5a4c150c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.307+0000 7f5a51c00640 1 -- 172.21.15.89:0/2280636697 shutdown_connections 2024-08-31T04:03:36.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.307+0000 7f5a51c00640 1 -- 172.21.15.89:0/2280636697 wait complete. 2024-08-31T04:03:36.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.307+0000 7f56e7200640 1 -- 172.21.15.89:0/3645356219 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=mds_dir_prefetch}] v 0) -- 0x7f56e0075150 con 0x7f56e00c85a0 2024-08-31T04:03:36.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.319+0000 7fd943e00640 1 -- 172.21.15.89:0/2160524130 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fd95009f3f0 con 0x7fd948049210 2024-08-31T04:03:36.327 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.323+0000 7fd941600640 1 -- 172.21.15.89:0/2160524130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd948049210 msgr2=0x7fd9480d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.323+0000 7fd941600640 1 --2- 172.21.15.89:0/2160524130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd948049210 0x7fd9480d08b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd950066680 tx=0x7fd9500769a0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.327+0000 7fd941600640 1 -- 172.21.15.89:0/2160524130 shutdown_connections 2024-08-31T04:03:36.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.327+0000 7fd941600640 1 --2- 172.21.15.89:0/2160524130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9480df890 0x7fd9480d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.327+0000 7fd941600640 1 --2- 172.21.15.89:0/2160524130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd948049210 0x7fd9480d08b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.327+0000 7fd941600640 1 --2- 172.21.15.89:0/2160524130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd948046be0 0x7fd9480cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.327+0000 7fd941600640 1 -- 172.21.15.89:0/2160524130 >> 172.21.15.89:0/2160524130 conn(0x7fd948050010 msgr2=0x7fd94804a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.327+0000 7fd941600640 1 -- 172.21.15.89:0/2160524130 shutdown_connections 2024-08-31T04:03:36.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.327+0000 7fd941600640 1 -- 172.21.15.89:0/2160524130 wait complete. 2024-08-31T04:03:36.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.331+0000 7f56da000640 1 -- 172.21.15.89:0/3645356219 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_prefetch}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f56d0018b90 con 0x7f56e00c85a0 2024-08-31T04:03:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.335+0000 7f56e7200640 1 -- 172.21.15.89:0/3645356219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e00c85a0 msgr2=0x7f56e01571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.335+0000 7f56e7200640 1 --2- 172.21.15.89:0/3645356219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e00c85a0 0x7f56e01571f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f56d001bc40 tx=0x7f56d00a8d30 comp rx=0 tx=0).stop 2024-08-31T04:03:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.335+0000 7f56e7200640 1 -- 172.21.15.89:0/3645356219 shutdown_connections 2024-08-31T04:03:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.335+0000 7f56e7200640 1 --2- 172.21.15.89:0/3645356219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56e00ca260 0x7f56e015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.335+0000 7f56e7200640 1 --2- 172.21.15.89:0/3645356219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56e00c85a0 0x7f56e01571f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.335+0000 7f56e7200640 1 --2- 172.21.15.89:0/3645356219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56e00c75e0 0x7f56e0158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.335+0000 7f56e7200640 1 -- 172.21.15.89:0/3645356219 >> 172.21.15.89:0/3645356219 conn(0x7f56e00cd1e0 msgr2=0x7f56e015b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.335+0000 7f56e7200640 1 -- 172.21.15.89:0/3645356219 shutdown_connections 2024-08-31T04:03:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.335+0000 7f56e7200640 1 -- 172.21.15.89:0/3645356219 wait complete. 2024-08-31T04:03:36.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.339+0000 7f3eada00640 1 -- 172.21.15.89:0/237756021 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f3ea8153770 con 0x7f3ea8070c60 2024-08-31T04:03:36.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.343+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f26540b2f00 con 0x7f265415a9c0 2024-08-31T04:03:36.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.343+0000 7f1aa5600640 1 -- 172.21.15.89:0/23886898 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f1aa0149680 con 0x7f1a84005160 2024-08-31T04:03:36.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.347+0000 7f3e9fe00640 1 -- 172.21.15.89:0/237756021 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f3e980164d0 con 0x7f3ea8070c60 2024-08-31T04:03:36.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f3eada00640 1 -- 172.21.15.89:0/237756021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ea8070c60 msgr2=0x7f3ea814a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f3eada00640 1 --2- 172.21.15.89:0/237756021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ea8070c60 0x7f3ea814a150 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3e98019460 tx=0x7f3e98005790 comp rx=0 tx=0).stop 2024-08-31T04:03:36.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f3eada00640 1 -- 172.21.15.89:0/237756021 shutdown_connections 2024-08-31T04:03:36.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f3eada00640 1 --2- 172.21.15.89:0/237756021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80c75e0 0x7f3ea80c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f3eada00640 1 --2- 172.21.15.89:0/237756021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea80c8dd0 0x7f3ea80c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f3eada00640 1 --2- 172.21.15.89:0/237756021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ea8070c60 0x7f3ea814a150 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f3eada00640 1 -- 172.21.15.89:0/237756021 >> 172.21.15.89:0/237756021 conn(0x7f3ea80cd1e0 msgr2=0x7f3ea80cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f3eada00640 1 -- 172.21.15.89:0/237756021 shutdown_connections 2024-08-31T04:03:36.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f3eada00640 1 -- 172.21.15.89:0/237756021 wait complete. 2024-08-31T04:03:36.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.351+0000 7f264b400640 1 -- 172.21.15.89:0/3811901997 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f2640009a40 con 0x7f265415a9c0 2024-08-31T04:03:36.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.355+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f265415a9c0 msgr2=0x7f26540c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.355+0000 7f265a800640 1 --2- 172.21.15.89:0/3811901997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f265415a9c0 0x7f26540c5e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f26540c30b0 tx=0x7f264000c820 comp rx=0 tx=0).stop 2024-08-31T04:03:36.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.355+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 shutdown_connections 2024-08-31T04:03:36.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.355+0000 7f265a800640 1 --2- 172.21.15.89:0/3811901997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f265415a9c0 0x7f26540c5e00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.355+0000 7f265a800640 1 --2- 172.21.15.89:0/3811901997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f265415a5b0 0x7f26540c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.355+0000 7f265a800640 1 --2- 172.21.15.89:0/3811901997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2638003ab0 0x7f26541f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.355+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 >> 172.21.15.89:0/3811901997 conn(0x7f26540c99b0 msgr2=0x7f26540c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.355+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 shutdown_connections 2024-08-31T04:03:36.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.355+0000 7f265a800640 1 -- 172.21.15.89:0/3811901997 wait complete. 2024-08-31T04:03:36.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.359+0000 7f1a97e00640 1 -- 172.21.15.89:0/23886898 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v22)=0 v22) ==== 119+0+0 (secure 0 0 0) 0x7f1a90024020 con 0x7f1a84005160 2024-08-31T04:03:36.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.363+0000 7f1aa5600640 1 -- 172.21.15.89:0/23886898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a84005160 msgr2=0x7f1aa0143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.363+0000 7f1aa5600640 1 --2- 172.21.15.89:0/23886898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a84005160 0x7f1aa0143f40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00c7bd0 tx=0x7f1a9000f6c0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.363+0000 7f1aa5600640 1 -- 172.21.15.89:0/23886898 shutdown_connections 2024-08-31T04:03:36.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.363+0000 7f1aa5600640 1 --2- 172.21.15.89:0/23886898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1aa00cc080 0x7f1aa00ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.363+0000 7f1aa5600640 1 --2- 172.21.15.89:0/23886898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa0149190 0x7f1aa00cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.363+0000 7f1aa5600640 1 --2- 172.21.15.89:0/23886898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a84005160 0x7f1aa0143f40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.363+0000 7f1aa5600640 1 -- 172.21.15.89:0/23886898 >> 172.21.15.89:0/23886898 conn(0x7f1aa00cd1e0 msgr2=0x7f1aa0157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.363+0000 7f1aa5600640 1 -- 172.21.15.89:0/23886898 shutdown_connections 2024-08-31T04:03:36.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.363+0000 7f1aa5600640 1 -- 172.21.15.89:0/23886898 wait complete. 2024-08-31T04:03:36.368 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.368 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.367+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f85f00c4f30 con 0x7f85f006d200 2024-08-31T04:03:36.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85ed600640 1 -- 172.21.15.89:0/612977718 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f85e4026a50 con 0x7f85f006d200 2024-08-31T04:03:36.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85f006d200 msgr2=0x7f85f0156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85f8600640 1 --2- 172.21.15.89:0/612977718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85f006d200 0x7f85f0156b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c430 tx=0x7f85e400c8f0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 shutdown_connections 2024-08-31T04:03:36.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85f8600640 1 --2- 172.21.15.89:0/612977718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85f0074e60 0x7f85f015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85f8600640 1 --2- 172.21.15.89:0/612977718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85f006d610 0x7f85f00c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85f8600640 1 --2- 172.21.15.89:0/612977718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85f006d200 0x7f85f0156b00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 >> 172.21.15.89:0/612977718 conn(0x7f85f00cd1b0 msgr2=0x7f85f00765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 shutdown_connections 2024-08-31T04:03:36.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.375+0000 7f85f8600640 1 -- 172.21.15.89:0/612977718 wait complete. 2024-08-31T04:03:36.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.387+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f743c074b60 con 0x7f743c074130 2024-08-31T04:03:36.392 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_dir_prefetch', 'True'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.392 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.392 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.395+0000 7f7439600640 1 -- 172.21.15.89:0/3660762558 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v24)=0 v24) ==== 125+0+0 (secure 0 0 0) 0x7f7434021440 con 0x7f743c074130 2024-08-31T04:03:36.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.395+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 msgr2=0x7f743c2023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.395+0000 7f7442a00640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 0x7f743c2023b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f743400eb00 tx=0x7f743400c2d0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.395+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 shutdown_connections 2024-08-31T04:03:36.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.395+0000 7f7442a00640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f743c074d80 0x7f743c157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.395+0000 7f7442a00640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f743c15b860 0x7f743c160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.395+0000 7f7442a00640 1 --2- 172.21.15.89:0/3660762558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f743c074130 0x7f743c2023b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.395+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 >> 172.21.15.89:0/3660762558 conn(0x7f743c0cd1e0 msgr2=0x7f743c0caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.395+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 shutdown_connections 2024-08-31T04:03:36.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.399+0000 7f7442a00640 1 -- 172.21.15.89:0/3660762558 wait complete. 2024-08-31T04:03:36.404 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.404 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.405 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.418 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi089') 2024-08-31T04:03:36.419 INFO:tasks.ceph:Setting crush tunables to default 2024-08-31T04:03:36.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd crush tunables default 2024-08-31T04:03:36.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.610+0000 7fd598400640 1 -- 172.21.15.89:0/1669216781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 msgr2=0x7fd590152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.610+0000 7fd598400640 1 --2- 172.21.15.89:0/1669216781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 0x7fd590152980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd5900c3ba0 tx=0x7fd58401cb60 comp rx=0 tx=0).stop 2024-08-31T04:03:36.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.610+0000 7fd598400640 1 -- 172.21.15.89:0/1669216781 shutdown_connections 2024-08-31T04:03:36.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.610+0000 7fd598400640 1 --2- 172.21.15.89:0/1669216781 >> v2:172.21.15.170:3300/0 conn(0x7fd5900c8dd0 0x7fd590158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.610+0000 7fd598400640 1 --2- 172.21.15.89:0/1669216781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 0x7fd590152980 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.610+0000 7fd598400640 1 -- 172.21.15.89:0/1669216781 >> 172.21.15.89:0/1669216781 conn(0x7fd5900ca9c0 msgr2=0x7fd5900cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.610+0000 7fd598400640 1 -- 172.21.15.89:0/1669216781 shutdown_connections 2024-08-31T04:03:36.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.610+0000 7fd598400640 1 -- 172.21.15.89:0/1669216781 wait complete. 2024-08-31T04:03:36.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 Processor -- start 2024-08-31T04:03:36.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 -- start start 2024-08-31T04:03:36.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5900c88c0 0x7fd59014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5900c8dd0 0x7fd590144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 0x7fd5901428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:36.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd5900725b0 con 0x7fd5900ca4b0 2024-08-31T04:03:36.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd590159160 con 0x7fd5900c8dd0 2024-08-31T04:03:36.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd590072730 con 0x7fd5900c88c0 2024-08-31T04:03:36.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd596400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 0x7fd5901428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd596400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 0x7fd5901428e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55776/0 (socket says 172.21.15.89:55776) 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd596400640 1 -- 172.21.15.89:0/91024769 learned_addr learned my addr 172.21.15.89:0/91024769 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd595a00640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5900c88c0 0x7fd59014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd595000640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5900c8dd0 0x7fd590144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd596400640 1 -- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5900c88c0 msgr2=0x7fd59014d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd596400640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5900c88c0 0x7fd59014d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd596400640 1 -- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5900c8dd0 msgr2=0x7fd590144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd596400640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5900c8dd0 0x7fd590144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd596400640 1 -- 172.21.15.89:0/91024769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd590148280 con 0x7fd5900ca4b0 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd595a00640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5900c88c0 0x7fd59014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd595000640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5900c8dd0 0x7fd590144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:36.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd596400640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 0x7fd5901428e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd58800e770 tx=0x7fd58800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:36.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd58d600640 1 -- 172.21.15.89:0/91024769 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588005220 con 0x7fd5900ca4b0 2024-08-31T04:03:36.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 -- 172.21.15.89:0/91024769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd590146f70 con 0x7fd5900ca4b0 2024-08-31T04:03:36.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd58d600640 1 -- 172.21.15.89:0/91024769 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5880053c0 con 0x7fd5900ca4b0 2024-08-31T04:03:36.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd58d600640 1 -- 172.21.15.89:0/91024769 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58800c850 con 0x7fd5900ca4b0 2024-08-31T04:03:36.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.614+0000 7fd598400640 1 -- 172.21.15.89:0/91024769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5900cd120 con 0x7fd5900ca4b0 2024-08-31T04:03:36.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.618+0000 7fd58d600640 1 -- 172.21.15.89:0/91024769 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd5880047b0 con 0x7fd5900ca4b0 2024-08-31T04:03:36.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.618+0000 7fd58d600640 1 -- 172.21.15.89:0/91024769 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd588018770 con 0x7fd5900ca4b0 2024-08-31T04:03:36.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.618+0000 7fd598400640 1 -- 172.21.15.89:0/91024769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd590146cd0 con 0x7fd5900ca4b0 2024-08-31T04:03:36.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.618+0000 7fd58d600640 1 -- 172.21.15.89:0/91024769 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd590146cd0 con 0x7fd5900ca4b0 2024-08-31T04:03:36.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.682+0000 7fd598400640 1 -- 172.21.15.89:0/91024769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd590158810 con 0x7fd5900ca4b0 2024-08-31T04:03:36.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd58d600640 1 -- 172.21.15.89:0/91024769 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fd588021cb0 con 0x7fd5900ca4b0 2024-08-31T04:03:36.688 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2024-08-31T04:03:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd598400640 1 -- 172.21.15.89:0/91024769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 msgr2=0x7fd5901428e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd598400640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 0x7fd5901428e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd58800e770 tx=0x7fd58800ec30 comp rx=0 tx=0).stop 2024-08-31T04:03:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd598400640 1 -- 172.21.15.89:0/91024769 shutdown_connections 2024-08-31T04:03:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd598400640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5900ca4b0 0x7fd5901428e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd598400640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5900c8dd0 0x7fd590144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd598400640 1 --2- 172.21.15.89:0/91024769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5900c88c0 0x7fd59014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd598400640 1 -- 172.21.15.89:0/91024769 >> 172.21.15.89:0/91024769 conn(0x7fd5900ca9c0 msgr2=0x7fd5900765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:36.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd598400640 1 -- 172.21.15.89:0/91024769 shutdown_connections 2024-08-31T04:03:36.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:36.686+0000 7fd598400640 1 -- 172.21.15.89:0/91024769 wait complete. 2024-08-31T04:03:36.709 INFO:tasks.ceph:check_enable_crimson: False 2024-08-31T04:03:36.709 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-31T04:03:36.709 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:36.709 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-31T04:03:36.728 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:36.728 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-31T04:03:36.789 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:36.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-31T04:03:36.851 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:03:36.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-31T04:03:36.913 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:36.914 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-31T04:03:36.926 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:36.926 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-31T04:03:36.979 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:36.979 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-31T04:03:37.032 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-08-31T04:03:37.032 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-31T04:03:37.088 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 83de31e6-3473-49e1-9021-523c19766651 0 2024-08-31T04:03:37.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 -- 172.21.15.170:0/473526902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb01415c2a0 msgr2=0x7fb01415c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 --2- 172.21.15.170:0/473526902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb01415c2a0 0x7fb01415c6b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb01415bcd0 tx=0x7fb00401f580 comp rx=0 tx=0).stop 2024-08-31T04:03:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 -- 172.21.15.170:0/473526902 shutdown_connections 2024-08-31T04:03:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 --2- 172.21.15.170:0/473526902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb01415c2a0 0x7fb01415c6b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 --2- 172.21.15.170:0/473526902 >> v2:172.21.15.89:3300/0 conn(0x7fb0140c2fc0 0x7fb014155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 -- 172.21.15.170:0/473526902 >> 172.21.15.170:0/473526902 conn(0x7fb0140caaa0 msgr2=0x7fb0140caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 -- 172.21.15.170:0/473526902 shutdown_connections 2024-08-31T04:03:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 -- 172.21.15.170:0/473526902 wait complete. 2024-08-31T04:03:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 Processor -- start 2024-08-31T04:03:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 -- start start 2024-08-31T04:03:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0140c2fc0 0x7fb0141f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0140c7bf0 0x7fb01415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb01415c2a0 0x7fb01414aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb0140c93a0 con 0x7fb0140c7bf0 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb0140c90c0 con 0x7fb0140c2fc0 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01bb1d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb014156120 con 0x7fb01415c2a0 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb0198b9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0140c2fc0 0x7fb0141f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.283+0000 7fb01a0ba640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb01415c2a0 0x7fb01414aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb0198b9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0140c2fc0 0x7fb0141f36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46526/0 (socket says 172.21.15.170:46526) 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb0198b9640 1 -- 172.21.15.170:0/4209372186 learned_addr learned my addr 172.21.15.170:0/4209372186 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb0190b8640 1 --2- 172.21.15.170:0/4209372186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0140c7bf0 0x7fb01415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb01a0ba640 1 -- 172.21.15.170:0/4209372186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0140c2fc0 msgr2=0x7fb0141f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb01a0ba640 1 --2- 172.21.15.170:0/4209372186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0140c2fc0 0x7fb0141f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb01a0ba640 1 -- 172.21.15.170:0/4209372186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0140c7bf0 msgr2=0x7fb01415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb01a0ba640 1 --2- 172.21.15.170:0/4209372186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0140c7bf0 0x7fb01415a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb01a0ba640 1 -- 172.21.15.170:0/4209372186 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01415ac90 con 0x7fb01415c2a0 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb01a0ba640 1 --2- 172.21.15.170:0/4209372186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb01415c2a0 0x7fb01414aba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb0140c5a30 tx=0x7fb004009350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb0127fc640 1 -- 172.21.15.170:0/4209372186 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004004c50 con 0x7fb01415c2a0 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb0127fc640 1 -- 172.21.15.170:0/4209372186 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0040be030 con 0x7fb01415c2a0 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb01bb1d640 1 -- 172.21.15.170:0/4209372186 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0141ef720 con 0x7fb01415c2a0 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb0127fc640 1 -- 172.21.15.170:0/4209372186 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0040afae0 con 0x7fb01415c2a0 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb01bb1d640 1 -- 172.21.15.170:0/4209372186 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0141effa0 con 0x7fb01415c2a0 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb0127fc640 1 -- 172.21.15.170:0/4209372186 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb004004350 con 0x7fb01415c2a0 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb0127fc640 1 -- 172.21.15.170:0/4209372186 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb004005310 con 0x7fb01415c2a0 2024-08-31T04:03:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb01bb1d640 1 -- 172.21.15.170:0/4209372186 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0141efa30 con 0x7fb01415c2a0 2024-08-31T04:03:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.287+0000 7fb0127fc640 1 -- 172.21.15.170:0/4209372186 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb0040190e0 con 0x7fb01415c2a0 2024-08-31T04:03:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.359+0000 7fb01bb1d640 1 -- 172.21.15.170:0/4209372186 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83de31e6-3473-49e1-9021-523c19766651", "id": 0} v 0) -- 0x7fb01415a420 con 0x7fb01415c2a0 2024-08-31T04:03:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb0127fc640 1 -- 172.21.15.170:0/4209372186 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83de31e6-3473-49e1-9021-523c19766651", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb0040046e0 con 0x7fb01415c2a0 2024-08-31T04:03:37.370 INFO:teuthology.orchestra.run.smithi170.stdout:0 2024-08-31T04:03:37.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb01bb1d640 1 -- 172.21.15.170:0/4209372186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb01415c2a0 msgr2=0x7fb01414aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb01bb1d640 1 --2- 172.21.15.170:0/4209372186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb01415c2a0 0x7fb01414aba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb0140c5a30 tx=0x7fb004009350 comp rx=0 tx=0).stop 2024-08-31T04:03:37.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb01bb1d640 1 -- 172.21.15.170:0/4209372186 shutdown_connections 2024-08-31T04:03:37.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb01bb1d640 1 --2- 172.21.15.170:0/4209372186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0140c7bf0 0x7fb01415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb01bb1d640 1 --2- 172.21.15.170:0/4209372186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb01415c2a0 0x7fb01414aba0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb01bb1d640 1 --2- 172.21.15.170:0/4209372186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0140c2fc0 0x7fb0141f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb01bb1d640 1 -- 172.21.15.170:0/4209372186 >> 172.21.15.170:0/4209372186 conn(0x7fb0140caaa0 msgr2=0x7fb01414cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:37.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb01bb1d640 1 -- 172.21.15.170:0/4209372186 shutdown_connections 2024-08-31T04:03:37.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.367+0000 7fb01bb1d640 1 -- 172.21.15.170:0/4209372186 wait complete. 2024-08-31T04:03:37.390 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new a6a088f0-9e59-4acc-af24-4288aefaf5d6 1 2024-08-31T04:03:37.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.531+0000 7fbfc2d30640 1 -- 172.21.15.170:0/779722386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0c9f30 msgr2=0x7fbfbc0ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.531+0000 7fbfc2d30640 1 --2- 172.21.15.170:0/779722386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0c9f30 0x7fbfbc0ca340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009840 tx=0x7fbfb001c820 comp rx=0 tx=0).stop 2024-08-31T04:03:37.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.531+0000 7fbfc2d30640 1 -- 172.21.15.170:0/779722386 shutdown_connections 2024-08-31T04:03:37.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.531+0000 7fbfc2d30640 1 --2- 172.21.15.170:0/779722386 >> v2:172.21.15.89:3300/0 conn(0x7fbfbc0b38a0 0x7fbfbc0b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.531+0000 7fbfc2d30640 1 --2- 172.21.15.170:0/779722386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0c9f30 0x7fbfbc0ca340 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.531+0000 7fbfc2d30640 1 -- 172.21.15.170:0/779722386 >> 172.21.15.170:0/779722386 conn(0x7fbfbc072210 msgr2=0x7fbfbc072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:37.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.531+0000 7fbfc2d30640 1 -- 172.21.15.170:0/779722386 shutdown_connections 2024-08-31T04:03:37.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.531+0000 7fbfc2d30640 1 -- 172.21.15.170:0/779722386 wait complete. 2024-08-31T04:03:37.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 Processor -- start 2024-08-31T04:03:37.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 -- start start 2024-08-31T04:03:37.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0b38a0 0x7fbfbc0c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:37.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfbc0c9f30 0x7fbfbc147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:37.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc155d30 0x7fbfbc0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:37.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc0c3030 con 0x7fbfbc155d30 2024-08-31T04:03:37.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc156140 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbfbc0c7920 con 0x7fbfbc0b38a0 2024-08-31T04:03:37.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfbc0c9f30 0x7fbfbc147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:37.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc0acc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0b38a0 0x7fbfbc0c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:37.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfbc0c9f30 0x7fbfbc147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46528/0 (socket says 172.21.15.170:46528) 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfbbfff640 1 -- 172.21.15.170:0/397283234 learned_addr learned my addr 172.21.15.170:0/397283234 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc0acc640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0b38a0 0x7fbfbc0c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:39628/0 (socket says 172.21.15.170:39628) 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc12cd640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc155d30 0x7fbfbc0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfbbfff640 1 -- 172.21.15.170:0/397283234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0b38a0 msgr2=0x7fbfbc0c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfbbfff640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0b38a0 0x7fbfbc0c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfbbfff640 1 -- 172.21.15.170:0/397283234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc155d30 msgr2=0x7fbfbc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfbbfff640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc155d30 0x7fbfbc0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfbbfff640 1 -- 172.21.15.170:0/397283234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc0ca680 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc0acc640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0b38a0 0x7fbfbc0c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfbbfff640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfbc0c9f30 0x7fbfbc147050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009790 tx=0x7fbfb00a6760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfb97fa640 1 -- 172.21.15.170:0/397283234 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0004140 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 -- 172.21.15.170:0/397283234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfbc0c7450 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfb97fa640 1 -- 172.21.15.170:0/397283234 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfb00043d0 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfb97fa640 1 -- 172.21.15.170:0/397283234 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0003860 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 -- 172.21.15.170:0/397283234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfbc162d30 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfb97fa640 1 -- 172.21.15.170:0/397283234 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbfb00bf020 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfb97fa640 1 -- 172.21.15.170:0/397283234 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fbfb00ae420 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.535+0000 7fbfc2d30640 1 -- 172.21.15.170:0/397283234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfbc162f00 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.539+0000 7fbfb97fa640 1 -- 172.21.15.170:0/397283234 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbfb00c6020 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.611+0000 7fbfc2d30640 1 -- 172.21.15.170:0/397283234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a6a088f0-9e59-4acc-af24-4288aefaf5d6", "id": 1} v 0) -- 0x7fbfbc0b4280 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.615+0000 7fbfb97fa640 1 -- 172.21.15.170:0/397283234 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6a088f0-9e59-4acc-af24-4288aefaf5d6", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fbfb0016410 con 0x7fbfbc0c9f30 2024-08-31T04:03:37.620 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-08-31T04:03:37.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.619+0000 7fbfc2d30640 1 -- 172.21.15.170:0/397283234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfbc0c9f30 msgr2=0x7fbfbc147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.619+0000 7fbfc2d30640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfbc0c9f30 0x7fbfbc147050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009790 tx=0x7fbfb00a6760 comp rx=0 tx=0).stop 2024-08-31T04:03:37.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.619+0000 7fbfc2d30640 1 -- 172.21.15.170:0/397283234 shutdown_connections 2024-08-31T04:03:37.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.619+0000 7fbfc2d30640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc155d30 0x7fbfbc0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.619+0000 7fbfc2d30640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfbc0c9f30 0x7fbfbc147050 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.619+0000 7fbfc2d30640 1 --2- 172.21.15.170:0/397283234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfbc0b38a0 0x7fbfbc0c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.619+0000 7fbfc2d30640 1 -- 172.21.15.170:0/397283234 >> 172.21.15.170:0/397283234 conn(0x7fbfbc072210 msgr2=0x7fbfbc0cdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:37.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.619+0000 7fbfc2d30640 1 -- 172.21.15.170:0/397283234 shutdown_connections 2024-08-31T04:03:37.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.619+0000 7fbfc2d30640 1 -- 172.21.15.170:0/397283234 wait complete. 2024-08-31T04:03:37.639 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 2273a43e-d9d4-4082-9bc3-726a8c1fd221 2 2024-08-31T04:03:37.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.783+0000 7f77030f2640 1 -- 172.21.15.170:0/3990101963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76fc151dc0 msgr2=0x7f76fc0749d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.783+0000 7f77030f2640 1 --2- 172.21.15.170:0/3990101963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76fc151dc0 0x7f76fc0749d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009840 tx=0x7f76f801f010 comp rx=0 tx=0).stop 2024-08-31T04:03:37.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.783+0000 7f77030f2640 1 -- 172.21.15.170:0/3990101963 shutdown_connections 2024-08-31T04:03:37.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.783+0000 7f77030f2640 1 --2- 172.21.15.170:0/3990101963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc1588b0 0x7f76fc070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.783+0000 7f77030f2640 1 --2- 172.21.15.170:0/3990101963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76fc151dc0 0x7f76fc0749d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.783+0000 7f77030f2640 1 -- 172.21.15.170:0/3990101963 >> 172.21.15.170:0/3990101963 conn(0x7f76fc0c99b0 msgr2=0x7f76fc0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.783+0000 7f77030f2640 1 -- 172.21.15.170:0/3990101963 shutdown_connections 2024-08-31T04:03:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.783+0000 7f77030f2640 1 -- 172.21.15.170:0/3990101963 wait complete. 2024-08-31T04:03:37.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.787+0000 7f77030f2640 1 Processor -- start 2024-08-31T04:03:37.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.787+0000 7f77030f2640 1 -- start start 2024-08-31T04:03:37.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f77030f2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc06fd80 0x7f76fc1efab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f77030f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc151dc0 0x7f76fc154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f77030f2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76fc1588b0 0x7f76fc14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f77030f2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc0c2770 con 0x7f76fc151dc0 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f77030f2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc0c2490 con 0x7f76fc1588b0 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f77030f2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f76fc1521d0 con 0x7f76fc06fd80 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f7700e8e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc06fd80 0x7f76fc1efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f7700e8e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc06fd80 0x7f76fc1efab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:39648/0 (socket says 172.21.15.170:39648) 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f7700e8e640 1 -- 172.21.15.170:0/689832436 learned_addr learned my addr 172.21.15.170:0/689832436 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f770168f640 1 --2- 172.21.15.170:0/689832436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76fc1588b0 0x7f76fc14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:37.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f76f3fff640 1 --2- 172.21.15.170:0/689832436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc151dc0 0x7f76fc154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:37.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f770168f640 1 -- 172.21.15.170:0/689832436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc06fd80 msgr2=0x7f76fc1efab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f770168f640 1 --2- 172.21.15.170:0/689832436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc06fd80 0x7f76fc1efab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f770168f640 1 -- 172.21.15.170:0/689832436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc151dc0 msgr2=0x7f76fc154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f770168f640 1 --2- 172.21.15.170:0/689832436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc151dc0 0x7f76fc154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f770168f640 1 -- 172.21.15.170:0/689832436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76fc0c4f90 con 0x7f76fc1588b0 2024-08-31T04:03:37.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f770168f640 1 --2- 172.21.15.170:0/689832436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76fc1588b0 0x7f76fc14cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0c9980 tx=0x7f76f40095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:37.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f76f17fa640 1 -- 172.21.15.170:0/689832436 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f401a070 con 0x7f76fc1588b0 2024-08-31T04:03:37.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f76f17fa640 1 -- 172.21.15.170:0/689832436 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76f4009e50 con 0x7f76fc1588b0 2024-08-31T04:03:37.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f76f17fa640 1 -- 172.21.15.170:0/689832436 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f4003bc0 con 0x7f76fc1588b0 2024-08-31T04:03:37.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f77030f2640 1 -- 172.21.15.170:0/689832436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76fc0c4890 con 0x7f76fc1588b0 2024-08-31T04:03:37.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.791+0000 7f77030f2640 1 -- 172.21.15.170:0/689832436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76fc1f0050 con 0x7f76fc1588b0 2024-08-31T04:03:37.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.795+0000 7f76f17fa640 1 -- 172.21.15.170:0/689832436 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f76f401d070 con 0x7f76fc1588b0 2024-08-31T04:03:37.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.795+0000 7f76f17fa640 1 -- 172.21.15.170:0/689832436 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f76f40158c0 con 0x7f76fc1588b0 2024-08-31T04:03:37.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.799+0000 7f77030f2640 1 -- 172.21.15.170:0/689832436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76dc0052a0 con 0x7f76fc1588b0 2024-08-31T04:03:37.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.803+0000 7f76f17fa640 1 -- 172.21.15.170:0/689832436 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f76f4024030 con 0x7f76fc1588b0 2024-08-31T04:03:37.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.903+0000 7f77030f2640 1 -- 172.21.15.170:0/689832436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2273a43e-d9d4-4082-9bc3-726a8c1fd221", "id": 2} v 0) -- 0x7f76dc005590 con 0x7f76fc1588b0 2024-08-31T04:03:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.907+0000 7f76f17fa640 1 -- 172.21.15.170:0/689832436 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2273a43e-d9d4-4082-9bc3-726a8c1fd221", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f76f40154a0 con 0x7f76fc1588b0 2024-08-31T04:03:37.912 INFO:teuthology.orchestra.run.smithi170.stdout:2 2024-08-31T04:03:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.911+0000 7f77030f2640 1 -- 172.21.15.170:0/689832436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76fc1588b0 msgr2=0x7f76fc14cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.911+0000 7f77030f2640 1 --2- 172.21.15.170:0/689832436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76fc1588b0 0x7f76fc14cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0c9980 tx=0x7f76f40095b0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.911+0000 7f77030f2640 1 -- 172.21.15.170:0/689832436 shutdown_connections 2024-08-31T04:03:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.911+0000 7f77030f2640 1 --2- 172.21.15.170:0/689832436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc151dc0 0x7f76fc154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.911+0000 7f77030f2640 1 --2- 172.21.15.170:0/689832436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76fc1588b0 0x7f76fc14cba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.911+0000 7f77030f2640 1 --2- 172.21.15.170:0/689832436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc06fd80 0x7f76fc1efab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.911+0000 7f77030f2640 1 -- 172.21.15.170:0/689832436 >> 172.21.15.170:0/689832436 conn(0x7f76fc0c99b0 msgr2=0x7f76fc1563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.911+0000 7f77030f2640 1 -- 172.21.15.170:0/689832436 shutdown_connections 2024-08-31T04:03:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:37.911+0000 7f77030f2640 1 -- 172.21.15.170:0/689832436 wait complete. 2024-08-31T04:03:37.929 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new ec64da71-436b-4bf8-9055-1a2fc9b67a1c 3 2024-08-31T04:03:38.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.067+0000 7fcd4af75640 1 -- 172.21.15.170:0/55609098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 msgr2=0x7fcd440715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.067+0000 7fcd4af75640 1 --2- 172.21.15.170:0/55609098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 0x7fcd440715c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd440c65b0 tx=0x7fcd3c01cd80 comp rx=0 tx=0).stop 2024-08-31T04:03:38.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.067+0000 7fcd4af75640 1 -- 172.21.15.170:0/55609098 shutdown_connections 2024-08-31T04:03:38.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.067+0000 7fcd4af75640 1 --2- 172.21.15.170:0/55609098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 0x7fcd440715c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.067+0000 7fcd4af75640 1 --2- 172.21.15.170:0/55609098 >> v2:172.21.15.170:3300/0 conn(0x7fcd440c72e0 0x7fcd44071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.067+0000 7fcd4af75640 1 --2- 172.21.15.170:0/55609098 >> v2:172.21.15.89:3300/0 conn(0x7fcd440b3f20 0x7fcd44156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.067+0000 7fcd4af75640 1 -- 172.21.15.170:0/55609098 >> 172.21.15.170:0/55609098 conn(0x7fcd44072210 msgr2=0x7fcd44072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:38.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.067+0000 7fcd4af75640 1 -- 172.21.15.170:0/55609098 shutdown_connections 2024-08-31T04:03:38.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.067+0000 7fcd4af75640 1 -- 172.21.15.170:0/55609098 wait complete. 2024-08-31T04:03:38.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 Processor -- start 2024-08-31T04:03:38.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 -- start start 2024-08-31T04:03:38.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd440b3f20 0x7fcd44149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd440c72e0 0x7fcd44155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 0x7fcd441487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44070aa0 con 0x7fcd440b3f20 2024-08-31T04:03:38.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcd440704c0 con 0x7fcd440c72e0 2024-08-31T04:03:38.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcd44070c20 con 0x7fcd440c76f0 2024-08-31T04:03:38.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd49512640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 0x7fcd441487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd49512640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 0x7fcd441487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:39664/0 (socket says 172.21.15.170:39664) 2024-08-31T04:03:38.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd49512640 1 -- 172.21.15.170:0/4080336055 learned_addr learned my addr 172.21.15.170:0/4080336055 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-08-31T04:03:38.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd43fff640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd440c72e0 0x7fcd44155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd48d11640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd440b3f20 0x7fcd44149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd49512640 1 -- 172.21.15.170:0/4080336055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd440c72e0 msgr2=0x7fcd44155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd49512640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd440c72e0 0x7fcd44155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd49512640 1 -- 172.21.15.170:0/4080336055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd440b3f20 msgr2=0x7fcd44149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd49512640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd440b3f20 0x7fcd44149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd49512640 1 -- 172.21.15.170:0/4080336055 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4414a110 con 0x7fcd440c76f0 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd48d11640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd440b3f20 0x7fcd44149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd43fff640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd440c72e0 0x7fcd44155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd49512640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 0x7fcd441487f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c01b430 tx=0x7fcd3c0092c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd417fa640 1 -- 172.21.15.170:0/4080336055 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0bb070 con 0x7fcd440c76f0 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd417fa640 1 -- 172.21.15.170:0/4080336055 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd3c004d40 con 0x7fcd440c76f0 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 -- 172.21.15.170:0/4080336055 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd440c9510 con 0x7fcd440c76f0 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd417fa640 1 -- 172.21.15.170:0/4080336055 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0b2040 con 0x7fcd440c76f0 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 -- 172.21.15.170:0/4080336055 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd441f7190 con 0x7fcd440c76f0 2024-08-31T04:03:38.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd417fa640 1 -- 172.21.15.170:0/4080336055 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd3c0be070 con 0x7fcd440c76f0 2024-08-31T04:03:38.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd417fa640 1 -- 172.21.15.170:0/4080336055 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fcd3c0054c0 con 0x7fcd440c76f0 2024-08-31T04:03:38.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.071+0000 7fcd4af75640 1 -- 172.21.15.170:0/4080336055 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd441f6cc0 con 0x7fcd440c76f0 2024-08-31T04:03:38.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.075+0000 7fcd417fa640 1 -- 172.21.15.170:0/4080336055 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcd3c016970 con 0x7fcd440c76f0 2024-08-31T04:03:38.085 INFO:tasks.ceph.mgr.x.smithi170.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-31T04:03:38.085 INFO:tasks.ceph.mgr.x.smithi170.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-31T04:03:38.085 INFO:tasks.ceph.mgr.x.smithi170.stderr: from numpy import show_config as show_numpy_config 2024-08-31T04:03:38.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.139+0000 7fcd4af75640 1 -- 172.21.15.170:0/4080336055 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ec64da71-436b-4bf8-9055-1a2fc9b67a1c", "id": 3} v 0) -- 0x7fcd44156e60 con 0x7fcd440c76f0 2024-08-31T04:03:38.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd417fa640 1 -- 172.21.15.170:0/4080336055 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec64da71-436b-4bf8-9055-1a2fc9b67a1c", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fcd3c005760 con 0x7fcd440c76f0 2024-08-31T04:03:38.151 INFO:teuthology.orchestra.run.smithi170.stdout:3 2024-08-31T04:03:38.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd4af75640 1 -- 172.21.15.170:0/4080336055 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 msgr2=0x7fcd441487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd4af75640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 0x7fcd441487f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c01b430 tx=0x7fcd3c0092c0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd4af75640 1 -- 172.21.15.170:0/4080336055 shutdown_connections 2024-08-31T04:03:38.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd4af75640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd440c76f0 0x7fcd441487f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd4af75640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd440c72e0 0x7fcd44155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd4af75640 1 --2- 172.21.15.170:0/4080336055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd440b3f20 0x7fcd44149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd4af75640 1 -- 172.21.15.170:0/4080336055 >> 172.21.15.170:0/4080336055 conn(0x7fcd44072210 msgr2=0x7fcd440c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:38.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd4af75640 1 -- 172.21.15.170:0/4080336055 shutdown_connections 2024-08-31T04:03:38.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.147+0000 7fcd4af75640 1 -- 172.21.15.170:0/4080336055 wait complete. 2024-08-31T04:03:38.169 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new e11caf26-99a3-4be9-87b1-451dcfd4fa98 4 2024-08-31T04:03:38.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.323+0000 7f9bd9558640 1 -- 172.21.15.170:0/1491313467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bd41528d0 msgr2=0x7f9bd415bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.323+0000 7f9bd9558640 1 --2- 172.21.15.170:0/1491313467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bd41528d0 0x7f9bd415bb10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009900 tx=0x7f9bbc01f0d0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.323+0000 7f9bd9558640 1 -- 172.21.15.170:0/1491313467 shutdown_connections 2024-08-31T04:03:38.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.323+0000 7f9bd9558640 1 --2- 172.21.15.170:0/1491313467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bd41528d0 0x7f9bd415bb10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.323+0000 7f9bd9558640 1 --2- 172.21.15.170:0/1491313467 >> v2:172.21.15.170:3300/0 conn(0x7f9bd40c5d10 0x7f9bd4152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.323+0000 7f9bd9558640 1 -- 172.21.15.170:0/1491313467 >> 172.21.15.170:0/1491313467 conn(0x7f9bd4071970 msgr2=0x7f9bd4071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:38.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.323+0000 7f9bd9558640 1 -- 172.21.15.170:0/1491313467 shutdown_connections 2024-08-31T04:03:38.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.323+0000 7f9bd9558640 1 -- 172.21.15.170:0/1491313467 wait complete. 2024-08-31T04:03:38.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.323+0000 7f9bd9558640 1 Processor -- start 2024-08-31T04:03:38.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 -- start start 2024-08-31T04:03:38.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd40c5d10 0x7f9bd40cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bd41528d0 0x7f9bd41e3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bd415c050 0x7f9bd4073e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4158df0 con 0x7f9bd40c5d10 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4158b10 con 0x7f9bd41528d0 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd40c4a80 con 0x7f9bd415c050 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bd41528d0 0x7f9bd41e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcbfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bd41528d0 0x7f9bd41e3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46578/0 (socket says 172.21.15.170:46578) 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd37fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bd415c050 0x7f9bd4073e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcbfff640 1 -- 172.21.15.170:0/365660271 learned_addr learned my addr 172.21.15.170:0/365660271 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd2ffd640 1 --2- 172.21.15.170:0/365660271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd40c5d10 0x7f9bd40cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcbfff640 1 -- 172.21.15.170:0/365660271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bd415c050 msgr2=0x7f9bd4073e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcbfff640 1 --2- 172.21.15.170:0/365660271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bd415c050 0x7f9bd4073e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcbfff640 1 -- 172.21.15.170:0/365660271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd40c5d10 msgr2=0x7f9bd40cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcbfff640 1 --2- 172.21.15.170:0/365660271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd40c5d10 0x7f9bd40cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcbfff640 1 -- 172.21.15.170:0/365660271 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd40cc160 con 0x7f9bd41528d0 2024-08-31T04:03:38.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd2ffd640 1 --2- 172.21.15.170:0/365660271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd40c5d10 0x7f9bd40cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:38.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcbfff640 1 --2- 172.21.15.170:0/365660271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bd41528d0 0x7f9bd41e3040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009850 tx=0x7f9bbc005790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:38.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcb7fe640 1 -- 172.21.15.170:0/365660271 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0b5040 con 0x7f9bd41528d0 2024-08-31T04:03:38.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcb7fe640 1 -- 172.21.15.170:0/365660271 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bbc0038f0 con 0x7f9bd41528d0 2024-08-31T04:03:38.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 -- 172.21.15.170:0/365660271 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd41efcd0 con 0x7f9bd41528d0 2024-08-31T04:03:38.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcb7fe640 1 -- 172.21.15.170:0/365660271 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc003ce0 con 0x7f9bd41528d0 2024-08-31T04:03:38.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 -- 172.21.15.170:0/365660271 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd40cd220 con 0x7f9bd41528d0 2024-08-31T04:03:38.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bd9558640 1 -- 172.21.15.170:0/365660271 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd4152390 con 0x7f9bd41528d0 2024-08-31T04:03:38.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcb7fe640 1 -- 172.21.15.170:0/365660271 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9bbc0c0060 con 0x7f9bd41528d0 2024-08-31T04:03:38.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.327+0000 7f9bcb7fe640 1 -- 172.21.15.170:0/365660271 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9bbc0b09a0 con 0x7f9bd41528d0 2024-08-31T04:03:38.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.331+0000 7f9bcb7fe640 1 -- 172.21.15.170:0/365660271 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9bbc018c30 con 0x7f9bd41528d0 2024-08-31T04:03:38.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.399+0000 7f9bd9558640 1 -- 172.21.15.170:0/365660271 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e11caf26-99a3-4be9-87b1-451dcfd4fa98", "id": 4} v 0) -- 0x7f9bd4151730 con 0x7f9bd41528d0 2024-08-31T04:03:38.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.403+0000 7f9bcb7fe640 1 -- 172.21.15.170:0/365660271 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e11caf26-99a3-4be9-87b1-451dcfd4fa98", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f9bbc0b0bf0 con 0x7f9bd41528d0 2024-08-31T04:03:38.408 INFO:teuthology.orchestra.run.smithi170.stdout:4 2024-08-31T04:03:38.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.407+0000 7f9bd9558640 1 -- 172.21.15.170:0/365660271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bd41528d0 msgr2=0x7f9bd41e3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.407+0000 7f9bd9558640 1 --2- 172.21.15.170:0/365660271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bd41528d0 0x7f9bd41e3040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009850 tx=0x7f9bbc005790 comp rx=0 tx=0).stop 2024-08-31T04:03:38.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.407+0000 7f9bd9558640 1 -- 172.21.15.170:0/365660271 shutdown_connections 2024-08-31T04:03:38.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.407+0000 7f9bd9558640 1 --2- 172.21.15.170:0/365660271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9bd415c050 0x7f9bd4073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.407+0000 7f9bd9558640 1 --2- 172.21.15.170:0/365660271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bd41528d0 0x7f9bd41e3040 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.407+0000 7f9bd9558640 1 --2- 172.21.15.170:0/365660271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd40c5d10 0x7f9bd40cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.407+0000 7f9bd9558640 1 -- 172.21.15.170:0/365660271 >> 172.21.15.170:0/365660271 conn(0x7f9bd4071970 msgr2=0x7f9bd40c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:38.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.407+0000 7f9bd9558640 1 -- 172.21.15.170:0/365660271 shutdown_connections 2024-08-31T04:03:38.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.407+0000 7f9bd9558640 1 -- 172.21.15.170:0/365660271 wait complete. 2024-08-31T04:03:38.426 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new e4b27fbc-5880-4587-aacc-235758f442ab 5 2024-08-31T04:03:38.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.567+0000 7f8d28c0a640 1 -- 172.21.15.170:0/2801275620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d24156e60 msgr2=0x7f8d24071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.567+0000 7f8d28c0a640 1 --2- 172.21.15.170:0/2801275620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d24156e60 0x7f8d24071080 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009840 tx=0x7f8d0c01c820 comp rx=0 tx=0).stop 2024-08-31T04:03:38.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.567+0000 7f8d28c0a640 1 -- 172.21.15.170:0/2801275620 shutdown_connections 2024-08-31T04:03:38.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.567+0000 7f8d28c0a640 1 --2- 172.21.15.170:0/2801275620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d240715c0 0x7f8d241640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.567+0000 7f8d28c0a640 1 --2- 172.21.15.170:0/2801275620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d24156e60 0x7f8d24071080 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.567+0000 7f8d28c0a640 1 -- 172.21.15.170:0/2801275620 >> 172.21.15.170:0/2801275620 conn(0x7f8d24072210 msgr2=0x7f8d24072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:38.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.567+0000 7f8d28c0a640 1 -- 172.21.15.170:0/2801275620 shutdown_connections 2024-08-31T04:03:38.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.567+0000 7f8d28c0a640 1 -- 172.21.15.170:0/2801275620 wait complete. 2024-08-31T04:03:38.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 Processor -- start 2024-08-31T04:03:38.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 -- start start 2024-08-31T04:03:38.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d240715c0 0x7f8d241f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d240b3f20 0x7f8d2414c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d24156e60 0x7f8d24140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2415cda0 con 0x7f8d240b3f20 2024-08-31T04:03:38.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d240c9b80 con 0x7f8d240715c0 2024-08-31T04:03:38.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8d240704c0 con 0x7f8d24156e60 2024-08-31T04:03:38.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d2259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d240715c0 0x7f8d241f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d2259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d240715c0 0x7f8d241f31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46598/0 (socket says 172.21.15.170:46598) 2024-08-31T04:03:38.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d2259c640 1 -- 172.21.15.170:0/1219965854 learned_addr learned my addr 172.21.15.170:0/1219965854 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-08-31T04:03:38.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d22d9d640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d24156e60 0x7f8d24140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d1bfff640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d240b3f20 0x7f8d2414c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d2259c640 1 -- 172.21.15.170:0/1219965854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d24156e60 msgr2=0x7f8d24140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d2259c640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d24156e60 0x7f8d24140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d2259c640 1 -- 172.21.15.170:0/1219965854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d240b3f20 msgr2=0x7f8d2414c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d2259c640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d240b3f20 0x7f8d2414c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d2259c640 1 -- 172.21.15.170:0/1219965854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d241f3720 con 0x7f8d240715c0 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d1bfff640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d240b3f20 0x7f8d2414c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d2259c640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d240715c0 0x7f8d241f31e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400b440 tx=0x7f8d1400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d1affd640 1 -- 172.21.15.170:0/1219965854 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14015020 con 0x7f8d240715c0 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d1affd640 1 -- 172.21.15.170:0/1219965854 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d14011980 con 0x7f8d240715c0 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 -- 172.21.15.170:0/1219965854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2414ab80 con 0x7f8d240715c0 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d1affd640 1 -- 172.21.15.170:0/1219965854 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14011dd0 con 0x7f8d240715c0 2024-08-31T04:03:38.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d28c0a640 1 -- 172.21.15.170:0/1219965854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d24145af0 con 0x7f8d240715c0 2024-08-31T04:03:38.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d1affd640 1 -- 172.21.15.170:0/1219965854 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d14018020 con 0x7f8d240715c0 2024-08-31T04:03:38.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.571+0000 7f8d1affd640 1 -- 172.21.15.170:0/1219965854 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8d140193b0 con 0x7f8d240715c0 2024-08-31T04:03:38.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.575+0000 7f8d28c0a640 1 -- 172.21.15.170:0/1219965854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d24070aa0 con 0x7f8d240715c0 2024-08-31T04:03:38.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.575+0000 7f8d1affd640 1 -- 172.21.15.170:0/1219965854 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8d1401f020 con 0x7f8d240715c0 2024-08-31T04:03:38.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.643+0000 7f8d28c0a640 1 -- 172.21.15.170:0/1219965854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e4b27fbc-5880-4587-aacc-235758f442ab", "id": 5} v 0) -- 0x7f8d240b3af0 con 0x7f8d240715c0 2024-08-31T04:03:38.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d1affd640 1 -- 172.21.15.170:0/1219965854 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4b27fbc-5880-4587-aacc-235758f442ab", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8d1400d040 con 0x7f8d240715c0 2024-08-31T04:03:38.654 INFO:teuthology.orchestra.run.smithi170.stdout:5 2024-08-31T04:03:38.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d28c0a640 1 -- 172.21.15.170:0/1219965854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d240715c0 msgr2=0x7f8d241f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d28c0a640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d240715c0 0x7f8d241f31e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400b440 tx=0x7f8d1400b900 comp rx=0 tx=0).stop 2024-08-31T04:03:38.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d28c0a640 1 -- 172.21.15.170:0/1219965854 shutdown_connections 2024-08-31T04:03:38.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d28c0a640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d240b3f20 0x7f8d2414c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d28c0a640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d24156e60 0x7f8d24140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d28c0a640 1 --2- 172.21.15.170:0/1219965854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d240715c0 0x7f8d241f31e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d28c0a640 1 -- 172.21.15.170:0/1219965854 >> 172.21.15.170:0/1219965854 conn(0x7f8d24072210 msgr2=0x7f8d24158230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:38.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d28c0a640 1 -- 172.21.15.170:0/1219965854 shutdown_connections 2024-08-31T04:03:38.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.651+0000 7f8d28c0a640 1 -- 172.21.15.170:0/1219965854 wait complete. 2024-08-31T04:03:38.679 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 8bba872c-eb21-4429-9c99-8a46290e3716 6 2024-08-31T04:03:38.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 -- 172.21.15.170:0/1579119020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 msgr2=0x7fd0600c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 --2- 172.21.15.170:0/1579119020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 0x7fd0600c8c70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd06006f140 tx=0x7fd05401f0b0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 -- 172.21.15.170:0/1579119020 shutdown_connections 2024-08-31T04:03:38.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 --2- 172.21.15.170:0/1579119020 >> v2:172.21.15.89:3300/0 conn(0x7fd0600c91b0 0x7fd0600749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 --2- 172.21.15.170:0/1579119020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 0x7fd0600c8c70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 -- 172.21.15.170:0/1579119020 >> 172.21.15.170:0/1579119020 conn(0x7fd060073e80 msgr2=0x7fd060074290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:38.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 -- 172.21.15.170:0/1579119020 shutdown_connections 2024-08-31T04:03:38.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 -- 172.21.15.170:0/1579119020 wait complete. 2024-08-31T04:03:38.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 Processor -- start 2024-08-31T04:03:38.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.819+0000 7fd066b3b640 1 -- start start 2024-08-31T04:03:38.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd066b3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd060068e00 0x7fd0601e06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd066b3b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0600c91b0 0x7fd0601f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd066b3b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 0x7fd06014a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:38.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd066b3b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600c8750 con 0x7fd060068e00 2024-08-31T04:03:38.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd066b3b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600c8470 con 0x7fd060150330 2024-08-31T04:03:38.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd066b3b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd060073750 con 0x7fd0600c91b0 2024-08-31T04:03:38.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd0650d8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 0x7fd06014a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0600c91b0 0x7fd0601f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd0650d8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 0x7fd06014a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46618/0 (socket says 172.21.15.170:46618) 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0600c91b0 0x7fd0601f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:39718/0 (socket says 172.21.15.170:39718) 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd0650d8640 1 -- 172.21.15.170:0/2819497013 learned_addr learned my addr 172.21.15.170:0/2819497013 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd0648d7640 1 --2- 172.21.15.170:0/2819497013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd060068e00 0x7fd0601e06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05ffff640 1 -- 172.21.15.170:0/2819497013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 msgr2=0x7fd06014a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05ffff640 1 --2- 172.21.15.170:0/2819497013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 0x7fd06014a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05ffff640 1 -- 172.21.15.170:0/2819497013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd060068e00 msgr2=0x7fd0601e06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05ffff640 1 --2- 172.21.15.170:0/2819497013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd060068e00 0x7fd0601e06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05ffff640 1 -- 172.21.15.170:0/2819497013 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0601f1010 con 0x7fd0600c91b0 2024-08-31T04:03:38.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd0650d8640 1 --2- 172.21.15.170:0/2819497013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 0x7fd06014a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:03:38.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05ffff640 1 --2- 172.21.15.170:0/2819497013 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0600c91b0 0x7fd0601f0ad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00d650 tx=0x7fd04c00db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:38.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05d7fa640 1 -- 172.21.15.170:0/2819497013 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c017070 con 0x7fd0600c91b0 2024-08-31T04:03:38.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05d7fa640 1 -- 172.21.15.170:0/2819497013 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd04c005310 con 0x7fd0600c91b0 2024-08-31T04:03:38.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05d7fa640 1 -- 172.21.15.170:0/2819497013 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0097c0 con 0x7fd0600c91b0 2024-08-31T04:03:38.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd066b3b640 1 -- 172.21.15.170:0/2819497013 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0601df910 con 0x7fd0600c91b0 2024-08-31T04:03:38.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd066b3b640 1 -- 172.21.15.170:0/2819497013 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0601dfed0 con 0x7fd0600c91b0 2024-08-31T04:03:38.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05d7fa640 1 -- 172.21.15.170:0/2819497013 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd04c009960 con 0x7fd0600c91b0 2024-08-31T04:03:38.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd05d7fa640 1 -- 172.21.15.170:0/2819497013 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd04c009c50 con 0x7fd0600c91b0 2024-08-31T04:03:38.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.823+0000 7fd066b3b640 1 -- 172.21.15.170:0/2819497013 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd060072450 con 0x7fd0600c91b0 2024-08-31T04:03:38.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.827+0000 7fd05d7fa640 1 -- 172.21.15.170:0/2819497013 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd0601f1010 con 0x7fd0600c91b0 2024-08-31T04:03:38.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.895+0000 7fd066b3b640 1 -- 172.21.15.170:0/2819497013 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8bba872c-eb21-4429-9c99-8a46290e3716", "id": 6} v 0) -- 0x7fd0600c46f0 con 0x7fd0600c91b0 2024-08-31T04:03:38.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd05d7fa640 1 -- 172.21.15.170:0/2819497013 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8bba872c-eb21-4429-9c99-8a46290e3716", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd04c0047b0 con 0x7fd0600c91b0 2024-08-31T04:03:38.902 INFO:teuthology.orchestra.run.smithi170.stdout:6 2024-08-31T04:03:38.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd066b3b640 1 -- 172.21.15.170:0/2819497013 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0600c91b0 msgr2=0x7fd0601f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:38.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd066b3b640 1 --2- 172.21.15.170:0/2819497013 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0600c91b0 0x7fd0601f0ad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00d650 tx=0x7fd04c00db10 comp rx=0 tx=0).stop 2024-08-31T04:03:38.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd066b3b640 1 -- 172.21.15.170:0/2819497013 shutdown_connections 2024-08-31T04:03:38.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd066b3b640 1 --2- 172.21.15.170:0/2819497013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd060150330 0x7fd06014a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd066b3b640 1 --2- 172.21.15.170:0/2819497013 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0600c91b0 0x7fd0601f0ad0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd066b3b640 1 --2- 172.21.15.170:0/2819497013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd060068e00 0x7fd0601e06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:38.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd066b3b640 1 -- 172.21.15.170:0/2819497013 >> 172.21.15.170:0/2819497013 conn(0x7fd060073e80 msgr2=0x7fd06014d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:38.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd066b3b640 1 -- 172.21.15.170:0/2819497013 shutdown_connections 2024-08-31T04:03:38.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:38.899+0000 7fd066b3b640 1 -- 172.21.15.170:0/2819497013 wait complete. 2024-08-31T04:03:38.921 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8 7 2024-08-31T04:03:38.941 INFO:tasks.ceph.mgr.y.smithi089.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-31T04:03:38.941 INFO:tasks.ceph.mgr.y.smithi089.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-31T04:03:38.941 INFO:tasks.ceph.mgr.y.smithi089.stderr: from numpy import show_config as show_numpy_config 2024-08-31T04:03:39.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.059+0000 7f75b8bc9640 1 -- 172.21.15.170:0/403519774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75a0003a60 msgr2=0x7f75a0003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:39.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.059+0000 7f75b8bc9640 1 --2- 172.21.15.170:0/403519774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75a0003a60 0x7f75a0003ed0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f75a40016f0 tx=0x7f75a401c750 comp rx=0 tx=0).stop 2024-08-31T04:03:39.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.059+0000 7f75b8bc9640 1 -- 172.21.15.170:0/403519774 shutdown_connections 2024-08-31T04:03:39.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.059+0000 7f75b8bc9640 1 --2- 172.21.15.170:0/403519774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75a0003a60 0x7f75a0003ed0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.059+0000 7f75b8bc9640 1 -- 172.21.15.170:0/403519774 >> 172.21.15.170:0/403519774 conn(0x7f75b4071970 msgr2=0x7f75b4071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:39.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.059+0000 7f75b8bc9640 1 -- 172.21.15.170:0/403519774 shutdown_connections 2024-08-31T04:03:39.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.059+0000 7f75b8bc9640 1 -- 172.21.15.170:0/403519774 wait complete. 2024-08-31T04:03:39.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 Processor -- start 2024-08-31T04:03:39.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 -- start start 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75a0003a60 0x7f75b41e2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75b4149270 0x7f75b41544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b4073e80 0x7f75b4074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f75b4158b10 con 0x7f75b4073e80 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f75b4158990 con 0x7f75b4149270 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f75b4158c90 con 0x7f75a0003a60 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b259c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75a0003a60 0x7f75b41e2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75abfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75b4149270 0x7f75b41544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b259c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75a0003a60 0x7f75b41e2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:39730/0 (socket says 172.21.15.170:39730) 2024-08-31T04:03:39.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b259c640 1 -- 172.21.15.170:0/717530869 learned_addr learned my addr 172.21.15.170:0/717530869 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b2d9d640 1 --2- 172.21.15.170:0/717530869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b4073e80 0x7f75b4074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b259c640 1 -- 172.21.15.170:0/717530869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75b4149270 msgr2=0x7f75b41544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b259c640 1 --2- 172.21.15.170:0/717530869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75b4149270 0x7f75b41544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b259c640 1 -- 172.21.15.170:0/717530869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b4073e80 msgr2=0x7f75b4074290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b259c640 1 --2- 172.21.15.170:0/717530869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b4073e80 0x7f75b4074290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b259c640 1 -- 172.21.15.170:0/717530869 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b41efd90 con 0x7f75a0003a60 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75abfff640 1 --2- 172.21.15.170:0/717530869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75b4149270 0x7f75b41544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b259c640 1 --2- 172.21.15.170:0/717530869 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75a0003a60 0x7f75b41e2520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f75a401ae50 tx=0x7f75a4001440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75aaffd640 1 -- 172.21.15.170:0/717530869 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40036c0 con 0x7f75a0003a60 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75aaffd640 1 -- 172.21.15.170:0/717530869 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75a4003950 con 0x7f75a0003a60 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 -- 172.21.15.170:0/717530869 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b41e2f70 con 0x7f75a0003a60 2024-08-31T04:03:39.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75aaffd640 1 -- 172.21.15.170:0/717530869 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4003d40 con 0x7f75a0003a60 2024-08-31T04:03:39.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.063+0000 7f75b8bc9640 1 -- 172.21.15.170:0/717530869 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b41f0330 con 0x7f75a0003a60 2024-08-31T04:03:39.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.067+0000 7f75aaffd640 1 -- 172.21.15.170:0/717530869 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f75a40a5940 con 0x7f75a0003a60 2024-08-31T04:03:39.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.067+0000 7f75aaffd640 1 -- 172.21.15.170:0/717530869 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f75a40aecf0 con 0x7f75a0003a60 2024-08-31T04:03:39.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.067+0000 7f75b8bc9640 1 -- 172.21.15.170:0/717530869 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b4152620 con 0x7f75a0003a60 2024-08-31T04:03:39.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.067+0000 7f75aaffd640 1 -- 172.21.15.170:0/717530869 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f75a40b3070 con 0x7f75a0003a60 2024-08-31T04:03:39.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.139+0000 7f75b8bc9640 1 -- 172.21.15.170:0/717530869 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8", "id": 7} v 0) -- 0x7f75b4155a70 con 0x7f75a0003a60 2024-08-31T04:03:39.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.143+0000 7f75aaffd640 1 -- 172.21.15.170:0/717530869 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f75a40164b0 con 0x7f75a0003a60 2024-08-31T04:03:39.148 INFO:teuthology.orchestra.run.smithi170.stdout:7 2024-08-31T04:03:39.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.147+0000 7f75b8bc9640 1 -- 172.21.15.170:0/717530869 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75a0003a60 msgr2=0x7f75b41e2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:39.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.147+0000 7f75b8bc9640 1 --2- 172.21.15.170:0/717530869 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75a0003a60 0x7f75b41e2520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f75a401ae50 tx=0x7f75a4001440 comp rx=0 tx=0).stop 2024-08-31T04:03:39.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.147+0000 7f75b8bc9640 1 -- 172.21.15.170:0/717530869 shutdown_connections 2024-08-31T04:03:39.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.147+0000 7f75b8bc9640 1 --2- 172.21.15.170:0/717530869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75b4073e80 0x7f75b4074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.147+0000 7f75b8bc9640 1 --2- 172.21.15.170:0/717530869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75b4149270 0x7f75b41544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.147+0000 7f75b8bc9640 1 --2- 172.21.15.170:0/717530869 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75a0003a60 0x7f75b41e2520 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.147+0000 7f75b8bc9640 1 -- 172.21.15.170:0/717530869 >> 172.21.15.170:0/717530869 conn(0x7f75b4071970 msgr2=0x7f75b4071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:39.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.147+0000 7f75b8bc9640 1 -- 172.21.15.170:0/717530869 shutdown_connections 2024-08-31T04:03:39.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-08-31T04:03:39.147+0000 7f75b8bc9640 1 -- 172.21.15.170:0/717530869 wait complete. 2024-08-31T04:03:39.168 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-31T04:03:39.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-31T04:03:39.172 INFO:tasks.ceph.osd.0:Started 2024-08-31T04:03:39.172 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-31T04:03:39.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-31T04:03:39.175 INFO:tasks.ceph.osd.1:Started 2024-08-31T04:03:39.175 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-31T04:03:39.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-31T04:03:39.178 INFO:tasks.ceph.osd.2:Started 2024-08-31T04:03:39.178 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-31T04:03:39.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-31T04:03:39.182 INFO:tasks.ceph.osd.3:Started 2024-08-31T04:03:39.183 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-31T04:03:39.183 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-31T04:03:39.185 INFO:tasks.ceph.osd.4:Started 2024-08-31T04:03:39.186 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-31T04:03:39.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-31T04:03:39.188 INFO:tasks.ceph.osd.5:Started 2024-08-31T04:03:39.189 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-31T04:03:39.189 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-31T04:03:39.194 INFO:tasks.ceph.osd.6:Started 2024-08-31T04:03:39.194 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-31T04:03:39.194 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-31T04:03:39.197 INFO:tasks.ceph.osd.7:Started 2024-08-31T04:03:39.198 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:03:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.390+0000 7f2858e00640 1 -- 172.21.15.89:0/3968611723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540cedf0 msgr2=0x7f28540cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.390+0000 7f2858e00640 1 --2- 172.21.15.89:0/3968611723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540cedf0 0x7f28540cf200 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f284c009bc0 tx=0x7f284c01cb30 comp rx=0 tx=0).stop 2024-08-31T04:03:39.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.390+0000 7f2858e00640 1 -- 172.21.15.89:0/3968611723 shutdown_connections 2024-08-31T04:03:39.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.390+0000 7f2858e00640 1 --2- 172.21.15.89:0/3968611723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540cedf0 0x7f28540cf200 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.390+0000 7f2858e00640 1 --2- 172.21.15.89:0/3968611723 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2854155e80 0x7f28540c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.390+0000 7f2858e00640 1 -- 172.21.15.89:0/3968611723 >> 172.21.15.89:0/3968611723 conn(0x7f2854071be0 msgr2=0x7f285406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:39.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.390+0000 7f2858e00640 1 -- 172.21.15.89:0/3968611723 shutdown_connections 2024-08-31T04:03:39.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.390+0000 7f2858e00640 1 -- 172.21.15.89:0/3968611723 wait complete. 2024-08-31T04:03:39.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 Processor -- start 2024-08-31T04:03:39.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 -- start start 2024-08-31T04:03:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540c97e0 0x7f2854153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28540cedf0 0x7f2854146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2854155e80 0x7f285414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f285406e8f0 con 0x7f28540c97e0 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f28540c5260 con 0x7f2854155e80 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f28540cce40 con 0x7f28540cedf0 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2851e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540c97e0 0x7f2854153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2851e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540c97e0 0x7f2854153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55820/0 (socket says 172.21.15.89:55820) 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2851e00640 1 -- 172.21.15.89:0/1148293443 learned_addr learned my addr 172.21.15.89:0/1148293443 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f284be00640 1 --2- 172.21.15.89:0/1148293443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28540cedf0 0x7f2854146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2852800640 1 --2- 172.21.15.89:0/1148293443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2854155e80 0x7f285414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2851e00640 1 -- 172.21.15.89:0/1148293443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28540cedf0 msgr2=0x7f2854146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2851e00640 1 --2- 172.21.15.89:0/1148293443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28540cedf0 0x7f2854146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2851e00640 1 -- 172.21.15.89:0/1148293443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2854155e80 msgr2=0x7f285414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2851e00640 1 --2- 172.21.15.89:0/1148293443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2854155e80 0x7f285414ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2851e00640 1 -- 172.21.15.89:0/1148293443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2854148230 con 0x7f28540c97e0 2024-08-31T04:03:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2851e00640 1 --2- 172.21.15.89:0/1148293443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540c97e0 0x7f2854153740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f284400e7f0 tx=0x7f284400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f284a000640 1 -- 172.21.15.89:0/1148293443 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284400ccc0 con 0x7f28540c97e0 2024-08-31T04:03:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f284a000640 1 -- 172.21.15.89:0/1148293443 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f284400ce80 con 0x7f28540c97e0 2024-08-31T04:03:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 -- 172.21.15.89:0/1148293443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28540c5d80 con 0x7f28540c97e0 2024-08-31T04:03:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f284a000640 1 -- 172.21.15.89:0/1148293443 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2844005280 con 0x7f28540c97e0 2024-08-31T04:03:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f2858e00640 1 -- 172.21.15.89:0/1148293443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285414d810 con 0x7f28540c97e0 2024-08-31T04:03:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f284a000640 1 -- 172.21.15.89:0/1148293443 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f28440047b0 con 0x7f28540c97e0 2024-08-31T04:03:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.394+0000 7f284a000640 1 -- 172.21.15.89:0/1148293443 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2844021440 con 0x7f28540c97e0 2024-08-31T04:03:39.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.398+0000 7f2858e00640 1 -- 172.21.15.89:0/1148293443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28540cf200 con 0x7f28540c97e0 2024-08-31T04:03:39.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.398+0000 7f284a000640 1 -- 172.21.15.89:0/1148293443 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2844021710 con 0x7f28540c97e0 2024-08-31T04:03:39.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 -- 172.21.15.89:0/1148293443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28540c9290 con 0x7f28540c97e0 2024-08-31T04:03:39.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f284a000640 1 -- 172.21.15.89:0/1148293443 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2844004aa0 con 0x7f28540c97e0 2024-08-31T04:03:39.462 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:39.462 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":10,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:03:39.145119+0000","last_up_change":"0.000000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:03:39.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 -- 172.21.15.89:0/1148293443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540c97e0 msgr2=0x7f2854153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:39.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 --2- 172.21.15.89:0/1148293443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540c97e0 0x7f2854153740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f284400e7f0 tx=0x7f284400ecb0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 -- 172.21.15.89:0/1148293443 shutdown_connections 2024-08-31T04:03:39.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 --2- 172.21.15.89:0/1148293443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2854155e80 0x7f285414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 --2- 172.21.15.89:0/1148293443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28540cedf0 0x7f2854146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 --2- 172.21.15.89:0/1148293443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28540c97e0 0x7f2854153740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:39.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 -- 172.21.15.89:0/1148293443 >> 172.21.15.89:0/1148293443 conn(0x7f2854071be0 msgr2=0x7f2854148670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:39.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 -- 172.21.15.89:0/1148293443 shutdown_connections 2024-08-31T04:03:39.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:39.458+0000 7f2858e00640 1 -- 172.21.15.89:0/1148293443 wait complete. 2024-08-31T04:03:39.483 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-31T04:03:39.483 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-31T04:03:40.289 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-31T04:03:40.435 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.430+0000 7fa989600640 1 -- 172.21.15.89:0/3176023134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9840cc180 msgr2=0x7fa984074870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:40.435 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.430+0000 7fa989600640 1 --2- 172.21.15.89:0/3176023134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9840cc180 0x7fa984074870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9840cdcf0 tx=0x7fa96c01f090 comp rx=0 tx=0).stop 2024-08-31T04:03:40.435 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.430+0000 7fa989600640 1 -- 172.21.15.89:0/3176023134 shutdown_connections 2024-08-31T04:03:40.435 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.430+0000 7fa989600640 1 --2- 172.21.15.89:0/3176023134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9841527f0 0x7fa984074db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:40.436 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.430+0000 7fa989600640 1 --2- 172.21.15.89:0/3176023134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9840cc180 0x7fa984074870 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:40.436 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.430+0000 7fa989600640 1 --2- 172.21.15.89:0/3176023134 >> v2:172.21.15.170:3300/0 conn(0x7fa9840c1b70 0x7fa9840cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:40.436 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.430+0000 7fa989600640 1 -- 172.21.15.89:0/3176023134 >> 172.21.15.89:0/3176023134 conn(0x7fa984070e40 msgr2=0x7fa984071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:40.436 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.430+0000 7fa989600640 1 -- 172.21.15.89:0/3176023134 shutdown_connections 2024-08-31T04:03:40.436 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.430+0000 7fa989600640 1 -- 172.21.15.89:0/3176023134 wait complete. 2024-08-31T04:03:40.437 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.434+0000 7fa989600640 1 Processor -- start 2024-08-31T04:03:40.437 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.434+0000 7fa989600640 1 -- start start 2024-08-31T04:03:40.439 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.434+0000 7fa989600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9840c1b70 0x7fa98415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:40.439 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.434+0000 7fa989600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9840cc180 0x7fa984154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.434+0000 7fa989600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9841527f0 0x7fa98415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.434+0000 7fa989600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa9840c2dc0 con 0x7fa9841527f0 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.434+0000 7fa989600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa9840c2ae0 con 0x7fa9840cc180 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.434+0000 7fa989600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa984158a30 con 0x7fa9840c1b70 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.434+0000 7fa983400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9841527f0 0x7fa98415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa983400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9841527f0 0x7fa98415a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55836/0 (socket says 172.21.15.89:55836) 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa983400640 1 -- 172.21.15.89:0/2476672807 learned_addr learned my addr 172.21.15.89:0/2476672807 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa97be00640 1 --2- 172.21.15.89:0/2476672807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9840cc180 0x7fa984154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa982a00640 1 --2- 172.21.15.89:0/2476672807 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9840c1b70 0x7fa98415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa983400640 1 -- 172.21.15.89:0/2476672807 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9840c1b70 msgr2=0x7fa98415b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa983400640 1 --2- 172.21.15.89:0/2476672807 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9840c1b70 0x7fa98415b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:40.440 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa983400640 1 -- 172.21.15.89:0/2476672807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9840cc180 msgr2=0x7fa984154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:40.441 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa983400640 1 --2- 172.21.15.89:0/2476672807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9840cc180 0x7fa984154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:40.441 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa983400640 1 -- 172.21.15.89:0/2476672807 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98415be00 con 0x7fa9841527f0 2024-08-31T04:03:40.441 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa983400640 1 --2- 172.21.15.89:0/2476672807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9841527f0 0x7fa98415a610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009fd0 tx=0x7fa97c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:40.442 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa97aa00640 1 -- 172.21.15.89:0/2476672807 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00ce20 con 0x7fa9841527f0 2024-08-31T04:03:40.442 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa97aa00640 1 -- 172.21.15.89:0/2476672807 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa97c004b30 con 0x7fa9841527f0 2024-08-31T04:03:40.442 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa989600640 1 -- 172.21.15.89:0/2476672807 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa984155d20 con 0x7fa9841527f0 2024-08-31T04:03:40.442 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa97aa00640 1 -- 172.21.15.89:0/2476672807 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c005020 con 0x7fa9841527f0 2024-08-31T04:03:40.442 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa989600640 1 -- 172.21.15.89:0/2476672807 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa984159d10 con 0x7fa9841527f0 2024-08-31T04:03:40.442 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa989600640 1 -- 172.21.15.89:0/2476672807 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9840cbc40 con 0x7fa9841527f0 2024-08-31T04:03:40.442 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa97aa00640 1 -- 172.21.15.89:0/2476672807 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 2) ==== 48010+0+0 (secure 0 0 0) 0x7fa97c0051c0 con 0x7fa9841527f0 2024-08-31T04:03:40.442 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.438+0000 7fa97aa00640 1 -- 172.21.15.89:0/2476672807 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa97c04efd0 con 0x7fa9841527f0 2024-08-31T04:03:40.444 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.442+0000 7fa97aa00640 1 -- 172.21.15.89:0/2476672807 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa97c00f3c0 con 0x7fa9841527f0 2024-08-31T04:03:40.503 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 -- 172.21.15.89:0/2476672807 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9841516e0 con 0x7fa9841527f0 2024-08-31T04:03:40.504 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa97aa00640 1 -- 172.21.15.89:0/2476672807 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa97c013dc0 con 0x7fa9841527f0 2024-08-31T04:03:40.504 INFO:teuthology.misc.health.smithi089.stdout: 2024-08-31T04:03:40.504 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":10,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:03:39.145119+0000","last_up_change":"0.000000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:03:40.505 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 -- 172.21.15.89:0/2476672807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9841527f0 msgr2=0x7fa98415a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:40.505 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 --2- 172.21.15.89:0/2476672807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9841527f0 0x7fa98415a610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009fd0 tx=0x7fa97c00ef10 comp rx=0 tx=0).stop 2024-08-31T04:03:40.505 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 -- 172.21.15.89:0/2476672807 shutdown_connections 2024-08-31T04:03:40.505 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 --2- 172.21.15.89:0/2476672807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9841527f0 0x7fa98415a610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:40.505 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 --2- 172.21.15.89:0/2476672807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9840cc180 0x7fa984154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:40.505 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 --2- 172.21.15.89:0/2476672807 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9840c1b70 0x7fa98415b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:40.505 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 -- 172.21.15.89:0/2476672807 >> 172.21.15.89:0/2476672807 conn(0x7fa984070e40 msgr2=0x7fa9840c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:40.505 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 -- 172.21.15.89:0/2476672807 shutdown_connections 2024-08-31T04:03:40.506 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:40.502+0000 7fa989600640 1 -- 172.21.15.89:0/2476672807 wait complete. 2024-08-31T04:03:40.522 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-31T04:03:40.847 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-08-31T04:03:40.843+0000 7f91a2f707c0 -1 Falling back to public interface 2024-08-31T04:03:40.854 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-08-31T04:03:40.851+0000 7f4f6bfeb7c0 -1 Falling back to public interface 2024-08-31T04:03:40.872 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-08-31T04:03:40.870+0000 7f83b01887c0 -1 Falling back to public interface 2024-08-31T04:03:40.876 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-08-31T04:03:40.874+0000 7fee3adbd7c0 -1 Falling back to public interface 2024-08-31T04:03:40.882 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-08-31T04:03:40.879+0000 7f2747fef7c0 -1 Falling back to public interface 2024-08-31T04:03:40.901 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-08-31T04:03:40.898+0000 7f565a5b27c0 -1 Falling back to public interface 2024-08-31T04:03:41.039 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-08-31T04:03:41.035+0000 7f24a1c097c0 -1 Falling back to public interface 2024-08-31T04:03:41.097 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-08-31T04:03:41.094+0000 7f06452d67c0 -1 Falling back to public interface 2024-08-31T04:03:41.124 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-08-31T04:03:41.119+0000 7f7675e88640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-31T04:03:41.128 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-08-31T04:03:41.123+0000 7f7675e88640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-31T04:03:44.803 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-08-31T04:03:44.799+0000 7f91a2f707c0 -1 osd.7 0 log_to_monitors true 2024-08-31T04:03:44.964 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-08-31T04:03:44.959+0000 7f24a1c097c0 -1 osd.4 0 log_to_monitors true 2024-08-31T04:03:45.046 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-08-31T04:03:45.042+0000 7f83b01887c0 -1 osd.0 0 log_to_monitors true 2024-08-31T04:03:45.091 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-08-31T04:03:45.086+0000 7fee3adbd7c0 -1 osd.1 0 log_to_monitors true 2024-08-31T04:03:45.226 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-08-31T04:03:45.222+0000 7f565a5b27c0 -1 osd.3 0 log_to_monitors true 2024-08-31T04:03:45.245 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-08-31T04:03:45.239+0000 7f4f6bfeb7c0 -1 osd.5 0 log_to_monitors true 2024-08-31T04:03:45.291 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-08-31T04:03:45.286+0000 7f06452d67c0 -1 osd.2 0 log_to_monitors true 2024-08-31T04:03:45.421 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-08-31T04:03:45.419+0000 7f2747fef7c0 -1 osd.6 0 log_to_monitors true 2024-08-31T04:03:46.591 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-08-31T04:03:46.587+0000 7f919f72b640 -1 osd.7 0 waiting for initial osdmap 2024-08-31T04:03:46.613 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-08-31T04:03:46.611+0000 7f9196d13640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:03:47.329 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-31T04:03:47.524 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.522+0000 7fb8c8600640 1 -- 172.21.15.89:0/976300763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8c00ca260 msgr2=0x7fb8c00b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:47.524 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.522+0000 7fb8c8600640 1 --2- 172.21.15.89:0/976300763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8c00ca260 0x7fb8c00b1b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009870 tx=0x7fb8b401c830 comp rx=0 tx=0).stop 2024-08-31T04:03:47.524 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.522+0000 7fb8c8600640 1 -- 172.21.15.89:0/976300763 shutdown_connections 2024-08-31T04:03:47.524 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.522+0000 7fb8c8600640 1 --2- 172.21.15.89:0/976300763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8c00ca260 0x7fb8c00b1b80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:47.524 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.522+0000 7fb8c8600640 1 -- 172.21.15.89:0/976300763 >> 172.21.15.89:0/976300763 conn(0x7fb8c006ce00 msgr2=0x7fb8c006d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:47.525 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.522+0000 7fb8c8600640 1 -- 172.21.15.89:0/976300763 shutdown_connections 2024-08-31T04:03:47.525 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.522+0000 7fb8c8600640 1 -- 172.21.15.89:0/976300763 wait complete. 2024-08-31T04:03:47.526 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.522+0000 7fb8c8600640 1 Processor -- start 2024-08-31T04:03:47.526 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.522+0000 7fb8c8600640 1 -- start start 2024-08-31T04:03:47.529 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c8600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8c00ca260 0x7fb8c00c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:47.529 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c8600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8c00caa90 0x7fb8c00ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:47.529 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c8600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c0142970 0x7fb8c0142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:47.529 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c8600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c00cf8c0 con 0x7fb8c0142970 2024-08-31T04:03:47.529 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c8600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0150600 con 0x7fb8c00caa90 2024-08-31T04:03:47.529 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c8600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c00cfa40 con 0x7fb8c00ca260 2024-08-31T04:03:47.529 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8c00caa90 0x7fb8c00ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:47.529 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c5c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8c00ca260 0x7fb8c00c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:47.529 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c6600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c0142970 0x7fb8c0142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:47.530 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c5c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8c00ca260 0x7fb8c00c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:36648/0 (socket says 172.21.15.89:36648) 2024-08-31T04:03:47.530 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c5c00640 1 -- 172.21.15.89:0/2736352081 learned_addr learned my addr 172.21.15.89:0/2736352081 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:47.530 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8c00caa90 0x7fb8c00ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:45332/0 (socket says 172.21.15.89:45332) 2024-08-31T04:03:47.530 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c6600640 1 -- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8c00ca260 msgr2=0x7fb8c00c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:47.530 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c6600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8c00ca260 0x7fb8c00c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:47.530 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c6600640 1 -- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8c00caa90 msgr2=0x7fb8c00ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:47.530 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c6600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8c00caa90 0x7fb8c00ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:47.530 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c6600640 1 -- 172.21.15.89:0/2736352081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c014bde0 con 0x7fb8c0142970 2024-08-31T04:03:47.530 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c6600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c0142970 0x7fb8c0142d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800c7b0 tx=0x7fb8b800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:47.531 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8bd600640 1 -- 172.21.15.89:0/2736352081 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8003b80 con 0x7fb8c0142970 2024-08-31T04:03:47.531 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8bd600640 1 -- 172.21.15.89:0/2736352081 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8b8003d40 con 0x7fb8c0142970 2024-08-31T04:03:47.531 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c014a4e0 con 0x7fb8c0142970 2024-08-31T04:03:47.531 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c00c6170 con 0x7fb8c0142970 2024-08-31T04:03:47.531 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8bd600640 1 -- 172.21.15.89:0/2736352081 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8005330 con 0x7fb8c0142970 2024-08-31T04:03:47.531 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.526+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb89c0052a0 con 0x7fb8c0142970 2024-08-31T04:03:47.532 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.530+0000 7fb8bd600640 1 -- 172.21.15.89:0/2736352081 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) ==== 95888+0+0 (secure 0 0 0) 0x7fb8b80054d0 con 0x7fb8c0142970 2024-08-31T04:03:47.533 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.530+0000 7fb8bd600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb8a0076440 0x7fb8a0078950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:47.533 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.530+0000 7fb8bd600640 1 -- 172.21.15.89:0/2736352081 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7fb8b80917e0 con 0x7fb8c0142970 2024-08-31T04:03:47.533 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.530+0000 7fb8c5c00640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb8a0076440 0x7fb8a0078950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:47.533 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.530+0000 7fb8c5c00640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb8a0076440 0x7fb8a0078950 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009870 tx=0x7fb8b401b070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:47.538 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.534+0000 7fb8bd600640 1 -- 172.21.15.89:0/2736352081 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb8b805d8f0 con 0x7fb8c0142970 2024-08-31T04:03:47.757 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.754+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb89c005590 con 0x7fb8c0142970 2024-08-31T04:03:47.758 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.754+0000 7fb8bd600640 1 -- 172.21.15.89:0/2736352081 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7fb8b80620b0 con 0x7fb8c0142970 2024-08-31T04:03:47.759 INFO:teuthology.misc.health.smithi089.stdout: 2024-08-31T04:03:47.759 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":13,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:03:46.868979+0000","last_up_change":"2024-08-31T04:03:46.868979+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:03:47.761 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb8a0076440 msgr2=0x7fb8a0078950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:47.761 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb8a0076440 0x7fb8a0078950 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009870 tx=0x7fb8b401b070 comp rx=0 tx=0).stop 2024-08-31T04:03:47.761 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c0142970 msgr2=0x7fb8c0142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:47.761 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c0142970 0x7fb8c0142d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800c7b0 tx=0x7fb8b800cc70 comp rx=0 tx=0).stop 2024-08-31T04:03:47.762 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 shutdown_connections 2024-08-31T04:03:47.762 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb8a0076440 0x7fb8a0078950 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:47.762 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c0142970 0x7fb8c0142d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:47.762 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8c00caa90 0x7fb8c00ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:47.762 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 --2- 172.21.15.89:0/2736352081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8c00ca260 0x7fb8c00c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:47.763 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 >> 172.21.15.89:0/2736352081 conn(0x7fb8c006ce00 msgr2=0x7fb8c00c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:47.763 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 shutdown_connections 2024-08-31T04:03:47.763 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:47.758+0000 7fb8c8600640 1 -- 172.21.15.89:0/2736352081 wait complete. 2024-08-31T04:03:47.780 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-08-31T04:03:48.156 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-08-31T04:03:48.150+0000 7f4f67f91640 -1 osd.5 0 waiting for initial osdmap 2024-08-31T04:03:48.164 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-08-31T04:03:48.158+0000 7f2743f95640 -1 osd.6 0 waiting for initial osdmap 2024-08-31T04:03:48.189 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-08-31T04:03:48.186+0000 7f4f5fd8e640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:03:48.193 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-08-31T04:03:48.190+0000 7f273bd92640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:03:48.267 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-08-31T04:03:48.262+0000 7f249e3c4640 -1 osd.4 0 waiting for initial osdmap 2024-08-31T04:03:48.297 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-08-31T04:03:48.294+0000 7f24959ac640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:03:49.252 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-08-31T04:03:49.250+0000 7f0640200640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T04:03:49.296 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-08-31T04:03:49.290+0000 7f83ab000640 -1 osd.0 0 waiting for initial osdmap 2024-08-31T04:03:49.296 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-08-31T04:03:49.294+0000 7fee35c00640 -1 osd.1 0 waiting for initial osdmap 2024-08-31T04:03:49.301 INFO:tasks.ceph.osd.2.smithi089.stderr:2024-08-31T04:03:49.298+0000 7f0636200640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:03:49.325 INFO:tasks.ceph.osd.0.smithi089.stderr:2024-08-31T04:03:49.322+0000 7f83a1000640 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:03:49.332 INFO:tasks.ceph.osd.1.smithi089.stderr:2024-08-31T04:03:49.330+0000 7fee2bc00640 -1 osd.1 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:03:49.350 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-08-31T04:03:49.346+0000 7f5655400640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T04:03:49.384 INFO:tasks.ceph.osd.3.smithi089.stderr:2024-08-31T04:03:49.382+0000 7f564b400640 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:03:54.587 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-31T04:03:54.742 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.737+0000 7f2c91e00640 1 -- 172.21.15.89:0/228878449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c156d80 msgr2=0x7f2c8c0cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:54.742 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.737+0000 7f2c91e00640 1 --2- 172.21.15.89:0/228878449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c156d80 0x7f2c8c0cb040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009c80 tx=0x7f2c7c01cc80 comp rx=0 tx=0).stop 2024-08-31T04:03:54.742 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.737+0000 7f2c91e00640 1 -- 172.21.15.89:0/228878449 shutdown_connections 2024-08-31T04:03:54.742 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.737+0000 7f2c91e00640 1 --2- 172.21.15.89:0/228878449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c0c5e70 0x7f2c8c164170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.742 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.737+0000 7f2c91e00640 1 --2- 172.21.15.89:0/228878449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c156d80 0x7f2c8c0cb040 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.742 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.737+0000 7f2c91e00640 1 -- 172.21.15.89:0/228878449 >> 172.21.15.89:0/228878449 conn(0x7f2c8c070e40 msgr2=0x7f2c8c071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:54.742 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.737+0000 7f2c91e00640 1 -- 172.21.15.89:0/228878449 shutdown_connections 2024-08-31T04:03:54.742 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.737+0000 7f2c91e00640 1 -- 172.21.15.89:0/228878449 wait complete. 2024-08-31T04:03:54.743 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 Processor -- start 2024-08-31T04:03:54.744 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 -- start start 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c0c5e70 0x7f2c8c1f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c0cb580 0x7f2c8c14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c156d80 0x7f2c8c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c073330 con 0x7f2c8c0cb580 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0c4190 con 0x7f2c8c156d80 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8c0cda70 con 0x7f2c8c0c5e70 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c82000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c0cb580 0x7f2c8c14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c82000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c0cb580 0x7f2c8c14b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37908/0 (socket says 172.21.15.89:37908) 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c82000640 1 -- 172.21.15.89:0/906491228 learned_addr learned my addr 172.21.15.89:0/906491228 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:54.747 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c8aa00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c0c5e70 0x7f2c8c1f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c8b400640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c156d80 0x7f2c8c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c82000640 1 -- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c0c5e70 msgr2=0x7f2c8c1f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c82000640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c0c5e70 0x7f2c8c1f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c82000640 1 -- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c156d80 msgr2=0x7f2c8c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c82000640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c156d80 0x7f2c8c15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c82000640 1 -- 172.21.15.89:0/906491228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c1f4e80 con 0x7f2c8c0cb580 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c82000640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c0cb580 0x7f2c8c14b060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400c3f0 tx=0x7f2c7400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c83e00640 1 -- 172.21.15.89:0/906491228 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74017070 con 0x7f2c8c0cb580 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c83e00640 1 -- 172.21.15.89:0/906491228 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c740053c0 con 0x7f2c8c0cb580 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c152bc0 con 0x7f2c8c0cb580 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c83e00640 1 -- 172.21.15.89:0/906491228 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74003860 con 0x7f2c8c0cb580 2024-08-31T04:03:54.748 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c1f5140 con 0x7f2c8c0cb580 2024-08-31T04:03:54.749 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.741+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8c1571e0 con 0x7f2c8c0cb580 2024-08-31T04:03:54.749 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.745+0000 7f2c83e00640 1 -- 172.21.15.89:0/906491228 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2c7401a070 con 0x7f2c8c0cb580 2024-08-31T04:03:54.752 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.745+0000 7f2c83e00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c680720f0 0x7f2c68074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:54.753 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.745+0000 7f2c83e00640 1 -- 172.21.15.89:0/906491228 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f2c74092200 con 0x7f2c8c0cb580 2024-08-31T04:03:54.753 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.745+0000 7f2c8aa00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c680720f0 0x7f2c68074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:54.753 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.745+0000 7f2c8aa00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c680720f0 0x7f2c68074600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0af000 tx=0x7f2c7c01b4c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:54.753 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.749+0000 7f2c83e00640 1 -- 172.21.15.89:0/906491228 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2c74021070 con 0x7f2c8c0cb580 2024-08-31T04:03:54.919 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.913+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c8c150b60 con 0x7f2c8c0cb580 2024-08-31T04:03:54.920 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c83e00640 1 -- 172.21.15.89:0/906491228 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12896 (secure 0 0 0) 0x7f2c7405df10 con 0x7f2c8c0cb580 2024-08-31T04:03:54.921 INFO:teuthology.misc.health.smithi089.stdout: 2024-08-31T04:03:54.921 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":18,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:03:52.316642+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:03:54.923 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c680720f0 msgr2=0x7f2c68074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:54.923 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c680720f0 0x7f2c68074600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0af000 tx=0x7f2c7c01b4c0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.923 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c0cb580 msgr2=0x7f2c8c14b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:54.923 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c0cb580 0x7f2c8c14b060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400c3f0 tx=0x7f2c7400c8b0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.923 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 shutdown_connections 2024-08-31T04:03:54.923 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c680720f0 0x7f2c68074600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.923 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c8c0cb580 0x7f2c8c14b060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.923 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c8c156d80 0x7f2c8c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.924 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 --2- 172.21.15.89:0/906491228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c8c0c5e70 0x7f2c8c1f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:54.924 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 >> 172.21.15.89:0/906491228 conn(0x7f2c8c070e40 msgr2=0x7f2c8c0738b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:54.924 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 shutdown_connections 2024-08-31T04:03:54.924 INFO:teuthology.misc.health.smithi089.stderr:2024-08-31T04:03:54.917+0000 7f2c91e00640 1 -- 172.21.15.89:0/906491228 wait complete. 2024-08-31T04:03:54.940 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-31T04:03:54.941 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-31T04:03:54.941 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-31T04:03:54.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-31T04:03:54.944 INFO:tasks.ceph.mds.a:Started 2024-08-31T04:03:54.944 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-31T04:03:54.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-31T04:03:54.947 INFO:tasks.ceph.mds.c:Started 2024-08-31T04:03:54.947 INFO:tasks.ceph.mds.e:Restarting daemon 2024-08-31T04:03:54.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-08-31T04:03:54.950 INFO:tasks.ceph.mds.e:Started 2024-08-31T04:03:54.950 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-31T04:03:54.951 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-31T04:03:54.953 INFO:tasks.ceph.mds.b:Started 2024-08-31T04:03:54.953 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-31T04:03:54.953 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-31T04:03:54.956 INFO:tasks.ceph.mds.d:Started 2024-08-31T04:03:54.956 INFO:tasks.ceph.mds.f:Restarting daemon 2024-08-31T04:03:54.956 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-08-31T04:03:54.959 INFO:tasks.ceph.mds.f:Started 2024-08-31T04:03:54.959 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-31T04:03:54.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:03:55.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.117+0000 7f6cde600640 1 -- 172.21.15.89:0/614662061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cbc003a10 msgr2=0x7f6cbc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:55.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.117+0000 7f6cde600640 1 --2- 172.21.15.89:0/614662061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cbc003a10 0x7f6cbc003e80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c290 tx=0x7f6cc801cfa0 comp rx=0 tx=0).stop 2024-08-31T04:03:55.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.117+0000 7f6cd7e00640 1 -- 172.21.15.89:0/614662061 reap_dead start 2024-08-31T04:03:55.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.117+0000 7f6cde600640 1 -- 172.21.15.89:0/614662061 shutdown_connections 2024-08-31T04:03:55.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.117+0000 7f6cde600640 1 -- 172.21.15.89:0/614662061 >> 172.21.15.89:0/614662061 conn(0x7f6cd8071be0 msgr2=0x7f6cd806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:55.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.117+0000 7f6cde600640 1 -- 172.21.15.89:0/614662061 shutdown_connections 2024-08-31T04:03:55.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.117+0000 7f6cde600640 1 -- 172.21.15.89:0/614662061 wait complete. 2024-08-31T04:03:55.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6cde600640 1 Processor -- start 2024-08-31T04:03:55.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6cde600640 1 -- start start 2024-08-31T04:03:55.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6cde600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6cbc003a10 0x7f6cd815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:55.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6cde600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cd81f4ef0 0x7f6cd8158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:55.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6cde600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cd81557d0 0x7f6cd8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:55.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6cde600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd81596f0 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6cde600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd808cff0 con 0x7f6cd81557d0 2024-08-31T04:03:55.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6cde600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd80c5160 con 0x7f6cbc003a10 2024-08-31T04:03:55.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6ccea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cd81f4ef0 0x7f6cd8158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:55.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6ccea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cd81f4ef0 0x7f6cd8158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37932/0 (socket says 172.21.15.89:37932) 2024-08-31T04:03:55.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6ccea00640 1 -- 172.21.15.89:0/4053080858 learned_addr learned my addr 172.21.15.89:0/4053080858 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:55.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.121+0000 7f6cd7400640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6cbc003a10 0x7f6cd815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:55.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6ccea00640 1 -- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6cbc003a10 msgr2=0x7f6cd815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:55.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6ccea00640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6cbc003a10 0x7f6cd815b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6ccea00640 1 -- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cd81557d0 msgr2=0x7f6cd8155be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6ccea00640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cd81557d0 0x7f6cd8155be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6ccea00640 1 -- 172.21.15.89:0/4053080858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd80c80d0 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6ccea00640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cd81f4ef0 0x7f6cd8158af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0011750 tx=0x7f6cc0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6ccfe00640 1 -- 172.21.15.89:0/4053080858 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0004460 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6ccfe00640 1 -- 172.21.15.89:0/4053080858 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc0016070 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd80c83b0 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6ccfe00640 1 -- 172.21.15.89:0/4053080858 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000fba0 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd815a8b0 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.125+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd80c5d30 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.129+0000 7f6ccfe00640 1 -- 172.21.15.89:0/4053080858 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6cc0018030 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.132 INFO:tasks.ceph.mds.c.smithi089.stdout:starting mds.c at 2024-08-31T04:03:55.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.129+0000 7f6ccfe00640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6cb40720f0 0x7f6cb4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:55.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.129+0000 7f6ccfe00640 1 -- 172.21.15.89:0/4053080858 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f6cc0092ee0 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.129+0000 7f6cd7400640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6cb40720f0 0x7f6cb4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:55.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.129+0000 7f6cd7400640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6cb40720f0 0x7f6cb4074600 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c290 tx=0x7f6cc80b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:55.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.133+0000 7f6ccfe00640 1 -- 172.21.15.89:0/4053080858 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6cc005e490 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.156 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2024-08-31T04:03:55.156 INFO:tasks.ceph.mds.e.smithi089.stdout:starting mds.e at 2024-08-31T04:03:55.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.341+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cd80c57f0 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.341+0000 7f6ccfe00640 1 -- 172.21.15.89:0/4053080858 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f6cc0062c50 con 0x7f6cd81f4ef0 2024-08-31T04:03:55.346 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:55.346 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":2,"btime":"2024-08-31T04:03:55:142621+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T04:03:55.346 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 2 2024-08-31T04:03:55.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6cb40720f0 msgr2=0x7f6cb4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6cb40720f0 0x7f6cb4074600 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c290 tx=0x7f6cc80b2040 comp rx=0 tx=0).stop 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cd81f4ef0 msgr2=0x7f6cd8158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cd81f4ef0 0x7f6cd8158af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0011750 tx=0x7f6cc0011c10 comp rx=0 tx=0).stop 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 shutdown_connections 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6cb40720f0 0x7f6cb4074600 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cd81f4ef0 0x7f6cd8158af0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cd81557d0 0x7f6cd8155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 --2- 172.21.15.89:0/4053080858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6cbc003a10 0x7f6cd815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 >> 172.21.15.89:0/4053080858 conn(0x7f6cd8071be0 msgr2=0x7f6cd8156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 shutdown_connections 2024-08-31T04:03:55.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:55.345+0000 7f6cde600640 1 -- 172.21.15.89:0/4053080858 wait complete. 2024-08-31T04:03:55.452 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-08-31T04:03:55.457 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-08-31T04:03:55.465 INFO:tasks.ceph.mds.f.smithi170.stdout:starting mds.f at 2024-08-31T04:03:57.368 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:03:57.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.529+0000 7f2369600640 1 -- 172.21.15.89:0/830444643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23640c9330 msgr2=0x7f2364074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:57.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.529+0000 7f2369600640 1 --2- 172.21.15.89:0/830444643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23640c9330 0x7f2364074720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2364070b70 tx=0x7f235c01f580 comp rx=0 tx=0).stop 2024-08-31T04:03:57.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.529+0000 7f2369600640 1 -- 172.21.15.89:0/830444643 shutdown_connections 2024-08-31T04:03:57.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.529+0000 7f2369600640 1 --2- 172.21.15.89:0/830444643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23640c9330 0x7f2364074720 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.529+0000 7f2369600640 1 --2- 172.21.15.89:0/830444643 >> v2:172.21.15.170:3300/0 conn(0x7f23640c1f40 0x7f2364152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.529+0000 7f2369600640 1 -- 172.21.15.89:0/830444643 >> 172.21.15.89:0/830444643 conn(0x7f23640ccf20 msgr2=0x7f23640cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:57.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.529+0000 7f2369600640 1 -- 172.21.15.89:0/830444643 shutdown_connections 2024-08-31T04:03:57.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.529+0000 7f2369600640 1 -- 172.21.15.89:0/830444643 wait complete. 2024-08-31T04:03:57.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 Processor -- start 2024-08-31T04:03:57.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 -- start start 2024-08-31T04:03:57.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23640c1f40 0x7f2364153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:57.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23640c9330 0x7f236414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:57.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236415bc70 0x7f236414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:57.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f23640c8030 con 0x7f236415bc70 2024-08-31T04:03:57.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f23640c3150 con 0x7f23640c1f40 2024-08-31T04:03:57.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2364074c60 con 0x7f23640c9330 2024-08-31T04:03:57.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2363400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236415bc70 0x7f236414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:57.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2363400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236415bc70 0x7f236414c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37974/0 (socket says 172.21.15.89:37974) 2024-08-31T04:03:57.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2363400640 1 -- 172.21.15.89:0/3741083755 learned_addr learned my addr 172.21.15.89:0/3741083755 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:57.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f235a000640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23640c9330 0x7f236414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:57.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2362a00640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23640c1f40 0x7f2364153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:57.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2363400640 1 -- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23640c9330 msgr2=0x7f236414bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:57.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2363400640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23640c9330 0x7f236414bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2363400640 1 -- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23640c1f40 msgr2=0x7f2364153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:57.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2363400640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23640c1f40 0x7f2364153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2363400640 1 -- 172.21.15.89:0/3741083755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23640c67c0 con 0x7f236415bc70 2024-08-31T04:03:57.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2363400640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236415bc70 0x7f236414c040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f235c01c190 tx=0x7f235c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:57.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f235b400640 1 -- 172.21.15.89:0/3741083755 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c004c50 con 0x7f236415bc70 2024-08-31T04:03:57.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f235b400640 1 -- 172.21.15.89:0/3741083755 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f235c0be030 con 0x7f236415bc70 2024-08-31T04:03:57.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f235b400640 1 -- 172.21.15.89:0/3741083755 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c0afae0 con 0x7f236415bc70 2024-08-31T04:03:57.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23641e5e20 con 0x7f236415bc70 2024-08-31T04:03:57.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.533+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23641e63e0 con 0x7f236415bc70 2024-08-31T04:03:57.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.537+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2364152a10 con 0x7f236415bc70 2024-08-31T04:03:57.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.537+0000 7f235b400640 1 -- 172.21.15.89:0/3741083755 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f235c0afc80 con 0x7f236415bc70 2024-08-31T04:03:57.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.537+0000 7f235b400640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23400720f0 0x7f2340074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:57.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.537+0000 7f235b400640 1 -- 172.21.15.89:0/3741083755 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f235c1310d0 con 0x7f236415bc70 2024-08-31T04:03:57.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.537+0000 7f2362a00640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23400720f0 0x7f2340074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:57.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.541+0000 7f2362a00640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23400720f0 0x7f2340074600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2354001650 tx=0x7f2354009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:57.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.541+0000 7f235b400640 1 -- 172.21.15.89:0/3741083755 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f235c0190e0 con 0x7f236415bc70 2024-08-31T04:03:57.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.741+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23640717f0 con 0x7f236415bc70 2024-08-31T04:03:57.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.741+0000 7f235b400640 1 -- 172.21.15.89:0/3741083755 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5554 (secure 0 0 0) 0x7f235c0fcd60 con 0x7f236415bc70 2024-08-31T04:03:57.746 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:57.746 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":3,"btime":"2024-08-31T04:03:56:145825+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4420,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-31T04:03:57.746 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 3 2024-08-31T04:03:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.741+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23400720f0 msgr2=0x7f2340074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.741+0000 7f2369600640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23400720f0 0x7f2340074600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2354001650 tx=0x7f2354009040 comp rx=0 tx=0).stop 2024-08-31T04:03:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.741+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236415bc70 msgr2=0x7f236414c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.741+0000 7f2369600640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236415bc70 0x7f236414c040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f235c01c190 tx=0x7f235c005b00 comp rx=0 tx=0).stop 2024-08-31T04:03:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.745+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 shutdown_connections 2024-08-31T04:03:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.745+0000 7f2369600640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23400720f0 0x7f2340074600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.745+0000 7f2369600640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236415bc70 0x7f236414c040 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.745+0000 7f2369600640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23640c9330 0x7f236414bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.745+0000 7f2369600640 1 --2- 172.21.15.89:0/3741083755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23640c1f40 0x7f2364153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.745+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 >> 172.21.15.89:0/3741083755 conn(0x7f23640ccf20 msgr2=0x7f2364071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:57.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.745+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 shutdown_connections 2024-08-31T04:03:57.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.745+0000 7f2369600640 1 -- 172.21.15.89:0/3741083755 wait complete. 2024-08-31T04:03:57.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-31T04:03:57.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.917+0000 7fd8ccc00640 1 -- 172.21.15.89:0/286614661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 msgr2=0x7fd8c8156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:57.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.917+0000 7fd8ccc00640 1 --2- 172.21.15.89:0/286614661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 0x7fd8c8156e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8073410 tx=0x7fd8b801f0b0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.917+0000 7fd8ccc00640 1 -- 172.21.15.89:0/286614661 shutdown_connections 2024-08-31T04:03:57.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.917+0000 7fd8ccc00640 1 --2- 172.21.15.89:0/286614661 >> v2:172.21.15.170:3300/0 conn(0x7fd8c815ce10 0x7fd8c80c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.917+0000 7fd8ccc00640 1 --2- 172.21.15.89:0/286614661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 0x7fd8c8156e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.917+0000 7fd8ccc00640 1 -- 172.21.15.89:0/286614661 >> 172.21.15.89:0/286614661 conn(0x7fd8c80ccf20 msgr2=0x7fd8c80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:57.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.917+0000 7fd8ccc00640 1 -- 172.21.15.89:0/286614661 shutdown_connections 2024-08-31T04:03:57.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.917+0000 7fd8ccc00640 1 -- 172.21.15.89:0/286614661 wait complete. 2024-08-31T04:03:57.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 Processor -- start 2024-08-31T04:03:57.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 -- start start 2024-08-31T04:03:57.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 0x7fd8c80aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:57.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8c815ce10 0x7fd8c80cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:57.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8c815d220 0x7fd8c8152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8159c90 con 0x7fd8c8074e20 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c81599b0 con 0x7fd8c815ce10 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c8159f70 con 0x7fd8c815d220 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 0x7fd8c80aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 0x7fd8c80aea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37980/0 (socket says 172.21.15.89:37980) 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c5e00640 1 -- 172.21.15.89:0/1009912878 learned_addr learned my addr 172.21.15.89:0/1009912878 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8bd400640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8c815ce10 0x7fd8c80cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c6800640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8c815d220 0x7fd8c8152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c5e00640 1 -- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8c815d220 msgr2=0x7fd8c8152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c5e00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8c815d220 0x7fd8c8152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c5e00640 1 -- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8c815ce10 msgr2=0x7fd8c80cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c5e00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8c815ce10 0x7fd8c80cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c5e00640 1 -- 172.21.15.89:0/1009912878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c815cbc0 con 0x7fd8c8074e20 2024-08-31T04:03:57.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8bd400640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8c815ce10 0x7fd8c80cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:03:57.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8c5e00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 0x7fd8c80aea60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80b3040 tx=0x7fd8b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:57.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8bea00640 1 -- 172.21.15.89:0/1009912878 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80be070 con 0x7fd8c8074e20 2024-08-31T04:03:57.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8bea00640 1 -- 172.21.15.89:0/1009912878 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8b80053e0 con 0x7fd8c8074e20 2024-08-31T04:03:57.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8bea00640 1 -- 172.21.15.89:0/1009912878 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80b5040 con 0x7fd8c8074e20 2024-08-31T04:03:57.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c80b18c0 con 0x7fd8c8074e20 2024-08-31T04:03:57.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.921+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c815ad80 con 0x7fd8c8074e20 2024-08-31T04:03:57.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.925+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c8071e40 con 0x7fd8c8074e20 2024-08-31T04:03:57.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.925+0000 7fd8bea00640 1 -- 172.21.15.89:0/1009912878 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd8b8004930 con 0x7fd8c8074e20 2024-08-31T04:03:57.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.925+0000 7fd8bea00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd8a40720c0 0x7fd8a40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:57.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.925+0000 7fd8bea00640 1 -- 172.21.15.89:0/1009912878 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fd8b812f800 con 0x7fd8c8074e20 2024-08-31T04:03:57.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.925+0000 7fd8bd400640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd8a40720c0 0x7fd8a40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:57.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.929+0000 7fd8bd400640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd8a40720c0 0x7fd8a40745d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0005fd0 tx=0x7fd8b0005de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:57.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:57.929+0000 7fd8bea00640 1 -- 172.21.15.89:0/1009912878 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd8b8018c10 con 0x7fd8c8074e20 2024-08-31T04:03:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd8c8074c00 con 0x7fd8c8074e20 2024-08-31T04:03:58.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8bea00640 1 -- 172.21.15.89:0/1009912878 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7fd8b80fb490 con 0x7fd8c8074e20 2024-08-31T04:03:58.105 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:03:58.106 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2024-08-31T04:03:58.106 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-08-31T04:03:58.106 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2024-08-31T04:03:58.106 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2024-08-31T04:03:58.106 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:03:58.106 INFO:teuthology.orchestra.run.smithi089.stdout:] 2024-08-31T04:03:58.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd8a40720c0 msgr2=0x7fd8a40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd8a40720c0 0x7fd8a40745d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0005fd0 tx=0x7fd8b0005de0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 msgr2=0x7fd8c80aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 0x7fd8c80aea60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80b3040 tx=0x7fd8b8004600 comp rx=0 tx=0).stop 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 shutdown_connections 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd8a40720c0 0x7fd8a40745d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8c815d220 0x7fd8c8152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8c815ce10 0x7fd8c80cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 --2- 172.21.15.89:0/1009912878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8c8074e20 0x7fd8c80aea60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 >> 172.21.15.89:0/1009912878 conn(0x7fd8c80ccf20 msgr2=0x7fd8c80c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 shutdown_connections 2024-08-31T04:03:58.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.101+0000 7fd8ccc00640 1 -- 172.21.15.89:0/1009912878 wait complete. 2024-08-31T04:03:58.127 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-31T04:03:58.127 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-31T04:03:58.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 -- 172.21.15.89:0/4278953238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0ca9a0 msgr2=0x7fe7cc15ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:58.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/4278953238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0ca9a0 0x7fe7cc15ced0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0cff70 tx=0x7fe7c401cd80 comp rx=0 tx=0).stop 2024-08-31T04:03:58.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 -- 172.21.15.89:0/4278953238 shutdown_connections 2024-08-31T04:03:58.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/4278953238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0ca9a0 0x7fe7cc15ced0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/4278953238 >> v2:172.21.15.170:3300/0 conn(0x7fe7cc0c4790 0x7fe7cc0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/4278953238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7cc0c4ce0 0x7fe7cc1538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 -- 172.21.15.89:0/4278953238 >> 172.21.15.89:0/4278953238 conn(0x7fe7cc073630 msgr2=0x7fe7cc073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:58.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 -- 172.21.15.89:0/4278953238 shutdown_connections 2024-08-31T04:03:58.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 -- 172.21.15.89:0/4278953238 wait complete. 2024-08-31T04:03:58.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 Processor -- start 2024-08-31T04:03:58.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.281+0000 7fe7d0e00640 1 -- start start 2024-08-31T04:03:58.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7d0e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7cc0c4790 0x7fe7cc14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:58.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7d0e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0c4ce0 0x7fe7cc14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7d0e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7cc0ca9a0 0x7fe7cc13fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7d0e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc0c3fe0 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7d0e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc153e20 con 0x7fe7cc0ca9a0 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7d0e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe7cc14f800 con 0x7fe7cc0c4790 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0c4ce0 0x7fe7cc14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0c4ce0 0x7fe7cc14edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37994/0 (socket says 172.21.15.89:37994) 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c3e00640 1 -- 172.21.15.89:0/2172454842 learned_addr learned my addr 172.21.15.89:0/2172454842 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c9e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7cc0c4790 0x7fe7cc14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7ca800640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7cc0ca9a0 0x7fe7cc13fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c3e00640 1 -- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7cc0c4790 msgr2=0x7fe7cc14de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c3e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7cc0c4790 0x7fe7cc14de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c3e00640 1 -- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7cc0ca9a0 msgr2=0x7fe7cc13fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:58.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c3e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7cc0ca9a0 0x7fe7cc13fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c3e00640 1 -- 172.21.15.89:0/2172454842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7cc142ab0 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c3e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0c4ce0 0x7fe7cc14edf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400d660 tx=0x7fe7b400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:58.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c2000640 1 -- 172.21.15.89:0/2172454842 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4017070 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c2000640 1 -- 172.21.15.89:0/2172454842 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7b4009b10 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c2000640 1 -- 172.21.15.89:0/2172454842 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4010460 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7cc14f330 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7cc141af0 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7cc1538e0 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.285+0000 7fe7c2000640 1 -- 172.21.15.89:0/2172454842 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe7b401a070 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.289+0000 7fe7c2000640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7a80720c0 0x7fe7a80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:58.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.289+0000 7fe7c2000640 1 -- 172.21.15.89:0/2172454842 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fe7b4092890 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.289+0000 7fe7c9e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7a80720c0 0x7fe7a80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:58.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.289+0000 7fe7c9e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7a80720c0 0x7fe7a80745d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc004630 tx=0x7fe7bc00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:58.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.293+0000 7fe7c2000640 1 -- 172.21.15.89:0/2172454842 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe7b405ded0 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.457+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe7cc163fb0 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:03:58.739 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:03:58.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.801+0000 7fe7c2000640 1 -- 172.21.15.89:0/2172454842 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fe7b4062690 con 0x7fe7cc0c4ce0 2024-08-31T04:03:58.807 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' created 2024-08-31T04:03:58.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7a80720c0 msgr2=0x7fe7a80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:58.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7a80720c0 0x7fe7a80745d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc004630 tx=0x7fe7bc00b2e0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0c4ce0 msgr2=0x7fe7cc14edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:58.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0c4ce0 0x7fe7cc14edf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400d660 tx=0x7fe7b400db20 comp rx=0 tx=0).stop 2024-08-31T04:03:58.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 shutdown_connections 2024-08-31T04:03:58.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7a80720c0 0x7fe7a80745d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7cc0c4ce0 0x7fe7cc14edf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7cc0ca9a0 0x7fe7cc13fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 --2- 172.21.15.89:0/2172454842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7cc0c4790 0x7fe7cc14de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:58.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 >> 172.21.15.89:0/2172454842 conn(0x7fe7cc073630 msgr2=0x7fe7cc14fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:58.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 shutdown_connections 2024-08-31T04:03:58.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:58.805+0000 7fe7d0e00640 1 -- 172.21.15.89:0/2172454842 wait complete. 2024-08-31T04:03:58.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-31T04:03:59.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 -- 172.21.15.89:0/101594865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c06f3f0 msgr2=0x7f388c06f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:59.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 --2- 172.21.15.89:0/101594865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c06f3f0 0x7f388c06f800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f388c073220 tx=0x7f388401cd80 comp rx=0 tx=0).stop 2024-08-31T04:03:59.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 -- 172.21.15.89:0/101594865 shutdown_connections 2024-08-31T04:03:59.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 --2- 172.21.15.89:0/101594865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c06f3f0 0x7f388c06f800 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 --2- 172.21.15.89:0/101594865 >> v2:172.21.15.170:3300/0 conn(0x7f388c153800 0x7f388c074390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 --2- 172.21.15.89:0/101594865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f388c074d50 0x7f388c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 -- 172.21.15.89:0/101594865 >> 172.21.15.89:0/101594865 conn(0x7f388c0c99b0 msgr2=0x7f388c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:59.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 -- 172.21.15.89:0/101594865 shutdown_connections 2024-08-31T04:03:59.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 -- 172.21.15.89:0/101594865 wait complete. 2024-08-31T04:03:59.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 Processor -- start 2024-08-31T04:03:59.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.037+0000 7f3890a00640 1 -- start start 2024-08-31T04:03:59.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3890a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f388c06f3f0 0x7f388c15c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:59.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3890a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f388c074d50 0x7f388c0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:59.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3890a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c153800 0x7f388c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:59.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3890a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f388c069fc0 con 0x7f388c153800 2024-08-31T04:03:59.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3890a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f388c073e70 con 0x7f388c074d50 2024-08-31T04:03:59.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3890a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f388c153c10 con 0x7f388c06f3f0 2024-08-31T04:03:59.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f388a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c153800 0x7f388c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:59.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3889e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f388c06f3f0 0x7f388c15c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:59.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f388a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c153800 0x7f388c0cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38016/0 (socket says 172.21.15.89:38016) 2024-08-31T04:03:59.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f388a800640 1 -- 172.21.15.89:0/2976933990 learned_addr learned my addr 172.21.15.89:0/2976933990 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:03:59.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3881400640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f388c074d50 0x7f388c0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:59.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f388a800640 1 -- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f388c06f3f0 msgr2=0x7f388c15c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:59.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f388a800640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f388c06f3f0 0x7f388c15c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f388a800640 1 -- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f388c074d50 msgr2=0x7f388c0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:59.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f388a800640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f388c074d50 0x7f388c0cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f388a800640 1 -- 172.21.15.89:0/2976933990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c1f6410 con 0x7f388c153800 2024-08-31T04:03:59.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f388a800640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c153800 0x7f388c0cc760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3884009bd0 tx=0x7f3884005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:59.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3882a00640 1 -- 172.21.15.89:0/2976933990 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38840bc070 con 0x7f388c153800 2024-08-31T04:03:59.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3882a00640 1 -- 172.21.15.89:0/2976933990 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38840040b0 con 0x7f388c153800 2024-08-31T04:03:59.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c158050 con 0x7f388c153800 2024-08-31T04:03:59.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3882a00640 1 -- 172.21.15.89:0/2976933990 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38840b2040 con 0x7f388c153800 2024-08-31T04:03:59.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c14ed60 con 0x7f388c153800 2024-08-31T04:03:59.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.041+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388c06f800 con 0x7f388c153800 2024-08-31T04:03:59.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.045+0000 7f3882a00640 1 -- 172.21.15.89:0/2976933990 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f38840bf070 con 0x7f388c153800 2024-08-31T04:03:59.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.045+0000 7f3882a00640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38680720c0 0x7f38680745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:03:59.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.045+0000 7f3882a00640 1 -- 172.21.15.89:0/2976933990 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f388412c740 con 0x7f388c153800 2024-08-31T04:03:59.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.045+0000 7f3889e00640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38680720c0 0x7f38680745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:03:59.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.045+0000 7f3889e00640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38680720c0 0x7f38680745d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f387c009b40 tx=0x7f387c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:03:59.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.049+0000 7f3882a00640 1 -- 172.21.15.89:0/2976933990 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3884016970 con 0x7f388c153800 2024-08-31T04:03:59.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.217+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f388c1f61a0 con 0x7f388c153800 2024-08-31T04:03:59.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.805+0000 7f3882a00640 1 -- 172.21.15.89:0/2976933990 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f38840f7b90 con 0x7f388c153800 2024-08-31T04:03:59.810 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' created 2024-08-31T04:03:59.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38680720c0 msgr2=0x7f38680745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38680720c0 0x7f38680745d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f387c009b40 tx=0x7f387c0091e0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c153800 msgr2=0x7f388c0cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c153800 0x7f388c0cc760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3884009bd0 tx=0x7f3884005a60 comp rx=0 tx=0).stop 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 shutdown_connections 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38680720c0 0x7f38680745d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f388c153800 0x7f388c0cc760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f388c074d50 0x7f388c0cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 --2- 172.21.15.89:0/2976933990 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f388c06f3f0 0x7f388c15c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 >> 172.21.15.89:0/2976933990 conn(0x7f388c0c99b0 msgr2=0x7f388c0766f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 shutdown_connections 2024-08-31T04:03:59.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:03:59.809+0000 7f3890a00640 1 -- 172.21.15.89:0/2976933990 wait complete. 2024-08-31T04:03:59.861 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-31T04:04:00.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.021+0000 7f0ec5200640 1 -- 172.21.15.89:0/2149737606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ea40041d0 msgr2=0x7f0ea4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:00.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.021+0000 7f0ec5200640 1 --2- 172.21.15.89:0/2149737606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ea40041d0 0x7f0ea4004810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009940 tx=0x7f0eac01c740 comp rx=0 tx=0).stop 2024-08-31T04:04:00.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.021+0000 7f0ebe800640 1 -- 172.21.15.89:0/2149737606 reap_dead start 2024-08-31T04:04:00.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.021+0000 7f0ec5200640 1 -- 172.21.15.89:0/2149737606 shutdown_connections 2024-08-31T04:04:00.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.021+0000 7f0ec5200640 1 -- 172.21.15.89:0/2149737606 >> 172.21.15.89:0/2149737606 conn(0x7f0ec00ca360 msgr2=0x7f0ec00ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:00.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.021+0000 7f0ec5200640 1 -- 172.21.15.89:0/2149737606 shutdown_connections 2024-08-31T04:04:00.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.021+0000 7f0ec5200640 1 -- 172.21.15.89:0/2149737606 wait complete. 2024-08-31T04:04:00.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.021+0000 7f0ec5200640 1 Processor -- start 2024-08-31T04:04:00.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.021+0000 7f0ec5200640 1 -- start start 2024-08-31T04:04:00.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ec5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ea40041d0 0x7f0ec014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:00.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ec5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec0147530 0x7f0ec014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ec5200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ec014f3a0 0x7f0ec01f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ec5200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0073570 con 0x7f0ec0147530 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ec5200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0159220 con 0x7f0ea40041d0 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ec5200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec00cae80 con 0x7f0ec014f3a0 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebd400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec0147530 0x7f0ec014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebd400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec0147530 0x7f0ec014ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38036/0 (socket says 172.21.15.89:38036) 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebd400640 1 -- 172.21.15.89:0/1847600827 learned_addr learned my addr 172.21.15.89:0/1847600827 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebe800640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ec014f3a0 0x7f0ec01f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebde00640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ea40041d0 0x7f0ec014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebd400640 1 -- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ec014f3a0 msgr2=0x7f0ec01f0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebd400640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ec014f3a0 0x7f0ec01f0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebd400640 1 -- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ea40041d0 msgr2=0x7f0ec014d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebd400640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ea40041d0 0x7f0ec014d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:00.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebd400640 1 -- 172.21.15.89:0/1847600827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec014dae0 con 0x7f0ec0147530 2024-08-31T04:04:00.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebde00640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ea40041d0 0x7f0ec014d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:04:00.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ebd400640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec0147530 0x7f0ec014ee60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0eac01c570 tx=0x7f0eac005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:00.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0eb6000640 1 -- 172.21.15.89:0/1847600827 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0be070 con 0x7f0ec0147530 2024-08-31T04:04:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0eb6000640 1 -- 172.21.15.89:0/1847600827 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eac0a5be0 con 0x7f0ec0147530 2024-08-31T04:04:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec014cde0 con 0x7f0ec0147530 2024-08-31T04:04:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0eb6000640 1 -- 172.21.15.89:0/1847600827 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0b2040 con 0x7f0ec0147530 2024-08-31T04:04:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec014d080 con 0x7f0ec0147530 2024-08-31T04:04:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.025+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec0069030 con 0x7f0ec0147530 2024-08-31T04:04:00.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.029+0000 7f0eb6000640 1 -- 172.21.15.89:0/1847600827 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0eac0c1070 con 0x7f0ec0147530 2024-08-31T04:04:00.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.029+0000 7f0eb6000640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ea00720b0 0x7f0ea00745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:00.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.029+0000 7f0eb6000640 1 -- 172.21.15.89:0/1847600827 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f0eac12cb10 con 0x7f0ec0147530 2024-08-31T04:04:00.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.029+0000 7f0ebde00640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ea00720b0 0x7f0ea00745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:00.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.029+0000 7f0ebde00640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ea00720b0 0x7f0ea00745c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0006fd0 tx=0x7f0eb0006b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:00.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.033+0000 7f0eb6000640 1 -- 172.21.15.89:0/1847600827 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0eac016450 con 0x7f0ec0147530 2024-08-31T04:04:00.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.237+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0ec0151ef0 con 0x7f0ec0147530 2024-08-31T04:04:00.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.853+0000 7f0eb6000640 1 -- 172.21.15.89:0/1847600827 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f0eac0f7dd0 con 0x7f0ec0147530 2024-08-31T04:04:00.858 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 2 and data pool 3 2024-08-31T04:04:00.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ea00720b0 msgr2=0x7f0ea00745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:00.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ea00720b0 0x7f0ea00745c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0006fd0 tx=0x7f0eb0006b20 comp rx=0 tx=0).stop 2024-08-31T04:04:00.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec0147530 msgr2=0x7f0ec014ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:00.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec0147530 0x7f0ec014ee60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0eac01c570 tx=0x7f0eac005bf0 comp rx=0 tx=0).stop 2024-08-31T04:04:00.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 shutdown_connections 2024-08-31T04:04:00.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ea00720b0 0x7f0ea00745c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:00.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ec0147530 0x7f0ec014ee60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:00.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ec014f3a0 0x7f0ec01f0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:00.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 --2- 172.21.15.89:0/1847600827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ea40041d0 0x7f0ec014d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:00.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 >> 172.21.15.89:0/1847600827 conn(0x7f0ec00ca360 msgr2=0x7f0ec01589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:00.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 shutdown_connections 2024-08-31T04:04:00.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:00.873+0000 7f0ec5200640 1 -- 172.21.15.89:0/1847600827 wait complete. 2024-08-31T04:04:00.909 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-31T04:04:00.909 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-31T04:04:01.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.061+0000 7fdabce00640 1 -- 172.21.15.89:0/360430873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8070fe0 msgr2=0x7fdab80713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:01.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.061+0000 7fdabce00640 1 --2- 172.21.15.89:0/360430873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8070fe0 0x7fdab80713f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdab80cadd0 tx=0x7fdab001cd80 comp rx=0 tx=0).stop 2024-08-31T04:04:01.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.061+0000 7fdabce00640 1 -- 172.21.15.89:0/360430873 shutdown_connections 2024-08-31T04:04:01.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.061+0000 7fdabce00640 1 --2- 172.21.15.89:0/360430873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8070fe0 0x7fdab80713f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:01.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.061+0000 7fdabce00640 1 --2- 172.21.15.89:0/360430873 >> v2:172.21.15.170:3300/0 conn(0x7fdab81597c0 0x7fdab8153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:01.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.061+0000 7fdabce00640 1 -- 172.21.15.89:0/360430873 >> 172.21.15.89:0/360430873 conn(0x7fdab80ccf20 msgr2=0x7fdab80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:01.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.061+0000 7fdabce00640 1 -- 172.21.15.89:0/360430873 shutdown_connections 2024-08-31T04:04:01.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.061+0000 7fdabce00640 1 -- 172.21.15.89:0/360430873 wait complete. 2024-08-31T04:04:01.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdabce00640 1 Processor -- start 2024-08-31T04:04:01.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdabce00640 1 -- start start 2024-08-31T04:04:01.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdabce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdab8070fe0 0x7fdab8151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:01.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdabce00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8073680 0x7fdab814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:01.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdabce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdab81597c0 0x7fdab814ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:01.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdabce00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8074b10 con 0x7fdab8073680 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdabce00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdab80c8cd0 con 0x7fdab81597c0 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdabce00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdab81f85a0 con 0x7fdab8070fe0 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdaad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8073680 0x7fdab814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdaad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8073680 0x7fdab814bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38058/0 (socket says 172.21.15.89:38058) 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdaad400640 1 -- 172.21.15.89:0/2505247514 learned_addr learned my addr 172.21.15.89:0/2505247514 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdab6800640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdab81597c0 0x7fdab814ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdab5e00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdab8070fe0 0x7fdab8151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdaad400640 1 -- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdab8070fe0 msgr2=0x7fdab8151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdaad400640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdab8070fe0 0x7fdab8151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdaad400640 1 -- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdab81597c0 msgr2=0x7fdab814ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdaad400640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdab81597c0 0x7fdab814ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.065+0000 7fdaad400640 1 -- 172.21.15.89:0/2505247514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab8152100 con 0x7fdab8073680 2024-08-31T04:04:01.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.069+0000 7fdaad400640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8073680 0x7fdab814bb40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000d720 tx=0x7fdaa000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:01.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.069+0000 7fdaaea00640 1 -- 172.21.15.89:0/2505247514 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0017070 con 0x7fdab8073680 2024-08-31T04:04:01.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.069+0000 7fdaaea00640 1 -- 172.21.15.89:0/2505247514 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaa0009d20 con 0x7fdab8073680 2024-08-31T04:04:01.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.069+0000 7fdaaea00640 1 -- 172.21.15.89:0/2505247514 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0005280 con 0x7fdab8073680 2024-08-31T04:04:01.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.069+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab8157580 con 0x7fdab8073680 2024-08-31T04:04:01.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.069+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab8157b40 con 0x7fdab8073680 2024-08-31T04:04:01.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.069+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab80713f0 con 0x7fdab8073680 2024-08-31T04:04:01.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.069+0000 7fdaaea00640 1 -- 172.21.15.89:0/2505247514 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdaa0005420 con 0x7fdab8073680 2024-08-31T04:04:01.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.073+0000 7fdaaea00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fda940720f0 0x7fda94074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:01.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.073+0000 7fdaaea00640 1 -- 172.21.15.89:0/2505247514 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdaa0092cc0 con 0x7fdab8073680 2024-08-31T04:04:01.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.073+0000 7fdab5e00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fda940720f0 0x7fda94074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:01.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.073+0000 7fdab5e00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fda940720f0 0x7fda94074600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8001650 tx=0x7fdaa8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:01.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.077+0000 7fdaaea00640 1 -- 172.21.15.89:0/2505247514 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdaa0099080 con 0x7fdab8073680 2024-08-31T04:04:01.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.253+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fdab8073fe0 con 0x7fdab8073680 2024-08-31T04:04:01.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.857+0000 7fdaaea00640 1 -- 172.21.15.89:0/2505247514 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7fdaa005e570 con 0x7fdab8073680 2024-08-31T04:04:01.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.857+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fda940720f0 msgr2=0x7fda94074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:01.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.857+0000 7fdabce00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fda940720f0 0x7fda94074600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8001650 tx=0x7fdaa8009040 comp rx=0 tx=0).stop 2024-08-31T04:04:01.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.857+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8073680 msgr2=0x7fdab814bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:01.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.857+0000 7fdabce00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8073680 0x7fdab814bb40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000d720 tx=0x7fdaa000dbe0 comp rx=0 tx=0).stop 2024-08-31T04:04:01.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.861+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 shutdown_connections 2024-08-31T04:04:01.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.861+0000 7fdabce00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fda940720f0 0x7fda94074600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:01.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.861+0000 7fdabce00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab8073680 0x7fdab814bb40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:01.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.861+0000 7fdabce00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdab81597c0 0x7fdab814ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:01.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.861+0000 7fdabce00640 1 --2- 172.21.15.89:0/2505247514 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdab8070fe0 0x7fdab8151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:01.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.861+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 >> 172.21.15.89:0/2505247514 conn(0x7fdab80ccf20 msgr2=0x7fdab8150270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:01.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.861+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 shutdown_connections 2024-08-31T04:04:01.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:01.861+0000 7fdabce00640 1 -- 172.21.15.89:0/2505247514 wait complete. 2024-08-31T04:04:01.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-31T04:04:02.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.041+0000 7f7020600640 1 -- 172.21.15.89:0/55693171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7000003a60 msgr2=0x7f7000003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:02.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.041+0000 7f7020600640 1 --2- 172.21.15.89:0/55693171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7000003a60 0x7f7000003ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f700c00c2e0 tx=0x7f700c01cf20 comp rx=0 tx=0).stop 2024-08-31T04:04:02.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.041+0000 7f7020600640 1 -- 172.21.15.89:0/55693171 shutdown_connections 2024-08-31T04:04:02.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.041+0000 7f7020600640 1 --2- 172.21.15.89:0/55693171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7000003a60 0x7f7000003ed0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:02.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.041+0000 7f7020600640 1 -- 172.21.15.89:0/55693171 >> 172.21.15.89:0/55693171 conn(0x7f70180c99b0 msgr2=0x7f70180c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:02.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.041+0000 7f7020600640 1 -- 172.21.15.89:0/55693171 shutdown_connections 2024-08-31T04:04:02.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.041+0000 7f7020600640 1 -- 172.21.15.89:0/55693171 wait complete. 2024-08-31T04:04:02.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f7020600640 1 Processor -- start 2024-08-31T04:04:02.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f7020600640 1 -- start start 2024-08-31T04:04:02.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f7020600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7000003a60 0x7f70180c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:02.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f7020600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70181f7e50 0x7f7018159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:02.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f7020600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f701814e610 0x7f701814b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:02.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f7020600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f70180c32e0 con 0x7f70181f7e50 2024-08-31T04:04:02.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f7020600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f70180c3160 con 0x7f701814e610 2024-08-31T04:04:02.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f7020600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f70181585d0 con 0x7f7000003a60 2024-08-31T04:04:02.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f701d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70181f7e50 0x7f7018159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:02.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f701d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70181f7e50 0x7f7018159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40446/0 (socket says 172.21.15.89:40446) 2024-08-31T04:04:02.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f701d200640 1 -- 172.21.15.89:0/1373297480 learned_addr learned my addr 172.21.15.89:0/1373297480 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:02.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f701dc00640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7000003a60 0x7f70180c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:02.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.045+0000 7f701e600640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f701814e610 0x7f701814b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:02.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f701d200640 1 -- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7000003a60 msgr2=0x7f70180c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:02.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f701d200640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7000003a60 0x7f70180c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:02.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f701d200640 1 -- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f701814e610 msgr2=0x7f701814b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f701d200640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f701814e610 0x7f701814b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f701d200640 1 -- 172.21.15.89:0/1373297480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70181f4960 con 0x7f70181f7e50 2024-08-31T04:04:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f701e600640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f701814e610 0x7f701814b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f701d200640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70181f7e50 0x7f7018159790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7004004dd0 tx=0x7f7004001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f7015600640 1 -- 172.21.15.89:0/1373297480 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004001d50 con 0x7f70181f7e50 2024-08-31T04:04:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f7015600640 1 -- 172.21.15.89:0/1373297480 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7004016070 con 0x7f70181f7e50 2024-08-31T04:04:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70181f4c40 con 0x7f70181f7e50 2024-08-31T04:04:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f7015600640 1 -- 172.21.15.89:0/1373297480 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004010b20 con 0x7f70181f7e50 2024-08-31T04:04:02.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70181f5200 con 0x7f70181f7e50 2024-08-31T04:04:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70180c7290 con 0x7f70181f7e50 2024-08-31T04:04:02.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f7015600640 1 -- 172.21.15.89:0/1373297480 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f7004010cc0 con 0x7f70181f7e50 2024-08-31T04:04:02.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.049+0000 7f7015600640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ff80720f0 0x7f6ff8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:02.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.053+0000 7f7015600640 1 -- 172.21.15.89:0/1373297480 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f70040934a0 con 0x7f70181f7e50 2024-08-31T04:04:02.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.053+0000 7f701dc00640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ff80720f0 0x7f6ff8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:02.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.053+0000 7f701dc00640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ff80720f0 0x7f6ff8074600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f700c0ab000 tx=0x7f700c019d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:02.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.057+0000 7f7015600640 1 -- 172.21.15.89:0/1373297480 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f700405eb90 con 0x7f70181f7e50 2024-08-31T04:04:02.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:02.225+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f70180747b0 con 0x7f70181f7e50 2024-08-31T04:04:03.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.881+0000 7f7015600640 1 -- 172.21.15.89:0/1373297480 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f700405e490 con 0x7f70181f7e50 2024-08-31T04:04:03.888 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data_ec' created 2024-08-31T04:04:03.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.889+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ff80720f0 msgr2=0x7f6ff8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:03.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.889+0000 7f7020600640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ff80720f0 0x7f6ff8074600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f700c0ab000 tx=0x7f700c019d60 comp rx=0 tx=0).stop 2024-08-31T04:04:03.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.889+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70181f7e50 msgr2=0x7f7018159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:03.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.889+0000 7f7020600640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70181f7e50 0x7f7018159790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7004004dd0 tx=0x7f7004001640 comp rx=0 tx=0).stop 2024-08-31T04:04:03.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.893+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 shutdown_connections 2024-08-31T04:04:03.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.893+0000 7f7020600640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ff80720f0 0x7f6ff8074600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:03.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.893+0000 7f7020600640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70181f7e50 0x7f7018159790 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7004004dd0 tx=0x7f7004001640 comp rx=0 tx=0).stop 2024-08-31T04:04:03.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.893+0000 7f7020600640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f701814e610 0x7f701814b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:03.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.893+0000 7f7020600640 1 --2- 172.21.15.89:0/1373297480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7000003a60 0x7f70180c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:03.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.893+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 >> 172.21.15.89:0/1373297480 conn(0x7f70180c99b0 msgr2=0x7f70180736a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:03.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.893+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 shutdown_connections 2024-08-31T04:04:03.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:03.897+0000 7f7020600640 1 -- 172.21.15.89:0/1373297480 wait complete. 2024-08-31T04:04:03.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-31T04:04:04.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.081+0000 7fe09ec00640 1 -- 172.21.15.89:0/3421676345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0980c7920 msgr2=0x7fe09814e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:04.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.081+0000 7fe09ec00640 1 --2- 172.21.15.89:0/3421676345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0980c7920 0x7fe09814e8b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe09806dc10 tx=0x7fe090020450 comp rx=0 tx=0).stop 2024-08-31T04:04:04.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 -- 172.21.15.89:0/3421676345 shutdown_connections 2024-08-31T04:04:04.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 --2- 172.21.15.89:0/3421676345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0980c7920 0x7fe09814e8b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:04.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 --2- 172.21.15.89:0/3421676345 >> v2:172.21.15.170:3300/0 conn(0x7fe0980c3e50 0x7fe098073680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:04.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 -- 172.21.15.89:0/3421676345 >> 172.21.15.89:0/3421676345 conn(0x7fe0980ccf20 msgr2=0x7fe0980cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:04.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 -- 172.21.15.89:0/3421676345 shutdown_connections 2024-08-31T04:04:04.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 -- 172.21.15.89:0/3421676345 wait complete. 2024-08-31T04:04:04.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 Processor -- start 2024-08-31T04:04:04.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 -- start start 2024-08-31T04:04:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe098074990 0x7fe0980c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0980c3e50 0x7fe09814d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0980c7920 0x7fe09814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe098070a50 con 0x7fe098074990 2024-08-31T04:04:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe0980c2fb0 con 0x7fe0980c3e50 2024-08-31T04:04:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe09ec00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe09806fae0 con 0x7fe0980c7920 2024-08-31T04:04:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.085+0000 7fe097e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe098074990 0x7fe0980c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe097e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe098074990 0x7fe0980c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40462/0 (socket says 172.21.15.89:40462) 2024-08-31T04:04:04.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe097e00640 1 -- 172.21.15.89:0/1812546434 learned_addr learned my addr 172.21.15.89:0/1812546434 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe09cc00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0980c7920 0x7fe09814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe08f400640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0980c3e50 0x7fe09814d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe097e00640 1 -- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0980c7920 msgr2=0x7fe09814ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe097e00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0980c7920 0x7fe09814ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe097e00640 1 -- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0980c3e50 msgr2=0x7fe09814d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe097e00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0980c3e50 0x7fe09814d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe097e00640 1 -- 172.21.15.89:0/1812546434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0980c6700 con 0x7fe098074990 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe097e00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe098074990 0x7fe0980c61c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe08800d720 tx=0x7fe08800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe094c00640 1 -- 172.21.15.89:0/1812546434 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088017070 con 0x7fe098074990 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe094c00640 1 -- 172.21.15.89:0/1812546434 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe088005310 con 0x7fe098074990 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe094c00640 1 -- 172.21.15.89:0/1812546434 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0880097c0 con 0x7fe098074990 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09815b350 con 0x7fe098074990 2024-08-31T04:04:04.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe098158890 con 0x7fe098074990 2024-08-31T04:04:04.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe098073680 con 0x7fe098074990 2024-08-31T04:04:04.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.089+0000 7fe094c00640 1 -- 172.21.15.89:0/1812546434 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe088009960 con 0x7fe098074990 2024-08-31T04:04:04.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.093+0000 7fe094c00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0740720f0 0x7fe074074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:04.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.093+0000 7fe094c00640 1 -- 172.21.15.89:0/1812546434 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fe088092fb0 con 0x7fe098074990 2024-08-31T04:04:04.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.093+0000 7fe08f400640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0740720f0 0x7fe074074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:04.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.093+0000 7fe08f400640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0740720f0 0x7fe074074600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0980b1c20 tx=0x7fe080009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:04.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.097+0000 7fe094c00640 1 -- 172.21.15.89:0/1812546434 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe08805e4b0 con 0x7fe098074990 2024-08-31T04:04:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.261+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fe09814e8b0 con 0x7fe098074990 2024-08-31T04:04:04.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe094c00640 1 -- 172.21.15.89:0/1812546434 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7fe08805ddb0 con 0x7fe098074990 2024-08-31T04:04:04.897 INFO:teuthology.orchestra.run.smithi089.stderr:set pool 4 allow_ec_overwrites to true 2024-08-31T04:04:04.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0740720f0 msgr2=0x7fe074074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:04.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0740720f0 0x7fe074074600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0980b1c20 tx=0x7fe080009040 comp rx=0 tx=0).stop 2024-08-31T04:04:04.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe098074990 msgr2=0x7fe0980c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:04.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe098074990 0x7fe0980c61c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe08800d720 tx=0x7fe08800dbe0 comp rx=0 tx=0).stop 2024-08-31T04:04:04.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 shutdown_connections 2024-08-31T04:04:04.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0740720f0 0x7fe074074600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:04.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0980c7920 0x7fe09814ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:04.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0980c3e50 0x7fe09814d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:04.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 --2- 172.21.15.89:0/1812546434 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe098074990 0x7fe0980c61c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:04.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.893+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 >> 172.21.15.89:0/1812546434 conn(0x7fe0980ccf20 msgr2=0x7fe0980c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:04.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.897+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 shutdown_connections 2024-08-31T04:04:04.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:04.897+0000 7fe09ec00640 1 -- 172.21.15.89:0/1812546434 wait complete. 2024-08-31T04:04:04.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-31T04:04:05.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.101+0000 7f4b90c00640 1 -- 172.21.15.89:0/1795113202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8c0c90e0 msgr2=0x7f4b8c0747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:05.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.101+0000 7f4b90c00640 1 --2- 172.21.15.89:0/1795113202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8c0c90e0 0x7f4b8c0747b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009bc0 tx=0x7f4b8401cb10 comp rx=0 tx=0).stop 2024-08-31T04:04:05.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.101+0000 7f4b90c00640 1 -- 172.21.15.89:0/1795113202 shutdown_connections 2024-08-31T04:04:05.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.101+0000 7f4b90c00640 1 --2- 172.21.15.89:0/1795113202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8c0c90e0 0x7f4b8c0747b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:05.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.101+0000 7f4b90c00640 1 --2- 172.21.15.89:0/1795113202 >> v2:172.21.15.170:3300/0 conn(0x7f4b8c0b2d20 0x7f4b8c0c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:05.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.101+0000 7f4b90c00640 1 -- 172.21.15.89:0/1795113202 >> 172.21.15.89:0/1795113202 conn(0x7f4b8c0c99b0 msgr2=0x7f4b8c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:05.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.101+0000 7f4b90c00640 1 -- 172.21.15.89:0/1795113202 shutdown_connections 2024-08-31T04:04:05.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.101+0000 7f4b90c00640 1 -- 172.21.15.89:0/1795113202 wait complete. 2024-08-31T04:04:05.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b90c00640 1 Processor -- start 2024-08-31T04:04:05.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b90c00640 1 -- start start 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b90c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8c0b2860 0x7f4b8c147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b90c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b8c0b2d20 0x7f4b8c151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b90c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8c0c90e0 0x7f4b8c15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b90c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c165770 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b90c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c1658f0 con 0x7f4b8c0b2860 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b90c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8c165a70 con 0x7f4b8c0c90e0 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b89400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b8c0b2d20 0x7f4b8c151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b89400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b8c0b2d20 0x7f4b8c151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40466/0 (socket says 172.21.15.89:40466) 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b89400640 1 -- 172.21.15.89:0/2232712846 learned_addr learned my addr 172.21.15.89:0/2232712846 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b8a800640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8c0c90e0 0x7f4b8c15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.105+0000 7f4b89e00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8c0b2860 0x7f4b8c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:05.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b89400640 1 -- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8c0c90e0 msgr2=0x7f4b8c15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b89400640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8c0c90e0 0x7f4b8c15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b89400640 1 -- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8c0b2860 msgr2=0x7f4b8c147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b89400640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8c0b2860 0x7f4b8c147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b89400640 1 -- 172.21.15.89:0/2232712846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c156d80 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b8a800640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8c0c90e0 0x7f4b8c15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b89e00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8c0b2860 0x7f4b8c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b89400640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b8c0b2d20 0x7f4b8c151890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800e770 tx=0x7f4b7800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b82000640 1 -- 172.21.15.89:0/2232712846 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800ccc0 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b82000640 1 -- 172.21.15.89:0/2232712846 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b7800ee80 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8c147ec0 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b82000640 1 -- 172.21.15.89:0/2232712846 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800ce60 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8c148da0 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b8c0c1ed0 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b82000640 1 -- 172.21.15.89:0/2232712846 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4b78004260 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b82000640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4b6c0720c0 0x7f4b6c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:05.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.109+0000 7f4b82000640 1 -- 172.21.15.89:0/2232712846 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f4b780938d0 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.113+0000 7f4b89e00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4b6c0720c0 0x7f4b6c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:05.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.113+0000 7f4b89e00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4b6c0720c0 0x7f4b6c0745d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c007a60 tx=0x7f4b7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:05.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.117+0000 7f4b82000640 1 -- 172.21.15.89:0/2232712846 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4b7805ee60 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.321+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f4b8c14cb90 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.897+0000 7f4b82000640 1 -- 172.21.15.89:0/2232712846 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f4b7805e760 con 0x7f4b8c0b2d20 2024-08-31T04:04:05.899 INFO:teuthology.orchestra.run.smithi089.stderr:added data pool 4 to fsmap 2024-08-31T04:04:05.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4b6c0720c0 msgr2=0x7f4b6c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:05.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4b6c0720c0 0x7f4b6c0745d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c007a60 tx=0x7f4b7c009040 comp rx=0 tx=0).stop 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b8c0b2d20 msgr2=0x7f4b8c151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b8c0b2d20 0x7f4b8c151890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800e770 tx=0x7f4b7800ec30 comp rx=0 tx=0).stop 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 shutdown_connections 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4b6c0720c0 0x7f4b6c0745d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b8c0b2d20 0x7f4b8c151890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b8c0c90e0 0x7f4b8c15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 --2- 172.21.15.89:0/2232712846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b8c0b2860 0x7f4b8c147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 >> 172.21.15.89:0/2232712846 conn(0x7f4b8c0c99b0 msgr2=0x7f4b8c150450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 shutdown_connections 2024-08-31T04:04:05.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:05.901+0000 7f4b90c00640 1 -- 172.21.15.89:0/2232712846 wait complete. 2024-08-31T04:04:05.925 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:06.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.077+0000 7f5a73200640 1 -- 172.21.15.89:0/3040444465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c0c2ee0 msgr2=0x7f5a6c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.077+0000 7f5a73200640 1 --2- 172.21.15.89:0/3040444465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c0c2ee0 0x7f5a6c071ea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009900 tx=0x7f5a5c01c8e0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.077+0000 7f5a73200640 1 -- 172.21.15.89:0/3040444465 shutdown_connections 2024-08-31T04:04:06.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.077+0000 7f5a73200640 1 --2- 172.21.15.89:0/3040444465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c0c2ee0 0x7f5a6c071ea0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.077+0000 7f5a73200640 1 -- 172.21.15.89:0/3040444465 >> 172.21.15.89:0/3040444465 conn(0x7f5a6c0ca9c0 msgr2=0x7f5a6c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:06.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.077+0000 7f5a73200640 1 -- 172.21.15.89:0/3040444465 shutdown_connections 2024-08-31T04:04:06.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.077+0000 7f5a73200640 1 -- 172.21.15.89:0/3040444465 wait complete. 2024-08-31T04:04:06.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a73200640 1 Processor -- start 2024-08-31T04:04:06.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a73200640 1 -- start start 2024-08-31T04:04:06.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a73200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a6c0c2ee0 0x7f5a6c1f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a73200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a6c0c7df0 0x7f5a6c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a73200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c1588d0 0x7f5a6c06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a73200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0ca500 con 0x7f5a6c1588d0 2024-08-31T04:04:06.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a73200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0ca380 con 0x7f5a6c0c7df0 2024-08-31T04:04:06.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a73200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6c0c8200 con 0x7f5a6c0c2ee0 2024-08-31T04:04:06.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a71200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c1588d0 0x7f5a6c06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a71200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c1588d0 0x7f5a6c06ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40474/0 (socket says 172.21.15.89:40474) 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a71200640 1 -- 172.21.15.89:0/651102390 learned_addr learned my addr 172.21.15.89:0/651102390 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a6be00640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a6c0c2ee0 0x7f5a6c1f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a6b400640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a6c0c7df0 0x7f5a6c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a71200640 1 -- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a6c0c2ee0 msgr2=0x7f5a6c1f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a71200640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a6c0c2ee0 0x7f5a6c1f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a71200640 1 -- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a6c0c7df0 msgr2=0x7f5a6c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a71200640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a6c0c7df0 0x7f5a6c150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a71200640 1 -- 172.21.15.89:0/651102390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6c155de0 con 0x7f5a6c1588d0 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.081+0000 7f5a71200640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c1588d0 0x7f5a6c06ce00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c730 tx=0x7f5a6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:06.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.085+0000 7f5a63e00640 1 -- 172.21.15.89:0/651102390 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64003b80 con 0x7f5a6c1588d0 2024-08-31T04:04:06.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.085+0000 7f5a63e00640 1 -- 172.21.15.89:0/651102390 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a64003d20 con 0x7f5a6c1588d0 2024-08-31T04:04:06.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.085+0000 7f5a63e00640 1 -- 172.21.15.89:0/651102390 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400aab0 con 0x7f5a6c1588d0 2024-08-31T04:04:06.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.085+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6c155b00 con 0x7f5a6c1588d0 2024-08-31T04:04:06.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.085+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a6c1f5530 con 0x7f5a6c1588d0 2024-08-31T04:04:06.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.085+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a6c155870 con 0x7f5a6c1588d0 2024-08-31T04:04:06.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.085+0000 7f5a63e00640 1 -- 172.21.15.89:0/651102390 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f5a6400ac50 con 0x7f5a6c1588d0 2024-08-31T04:04:06.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.085+0000 7f5a63e00640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5a4c0720f0 0x7f5a4c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.085+0000 7f5a63e00640 1 -- 172.21.15.89:0/651102390 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5a640937d0 con 0x7f5a6c1588d0 2024-08-31T04:04:06.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.089+0000 7f5a6be00640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5a4c0720f0 0x7f5a4c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.089+0000 7f5a6be00640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5a4c0720f0 0x7f5a4c074600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0af000 tx=0x7f5a5c01b120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:06.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.089+0000 7f5a63e00640 1 -- 172.21.15.89:0/651102390 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5a6405ed30 con 0x7f5a6c1588d0 2024-08-31T04:04:06.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a6c071ea0 con 0x7f5a6c1588d0 2024-08-31T04:04:06.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a63e00640 1 -- 172.21.15.89:0/651102390 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6867 (secure 0 0 0) 0x7f5a64067270 con 0x7f5a6c1588d0 2024-08-31T04:04:06.293 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:06.293 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"btime":"2024-08-31T04:04:05:905956+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:05.898187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:06.294 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5a4c0720f0 msgr2=0x7f5a4c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5a4c0720f0 0x7f5a4c074600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0af000 tx=0x7f5a5c01b120 comp rx=0 tx=0).stop 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c1588d0 msgr2=0x7f5a6c06ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c1588d0 0x7f5a6c06ce00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c730 tx=0x7f5a6400cbf0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 shutdown_connections 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5a4c0720f0 0x7f5a4c074600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a6c1588d0 0x7f5a6c06ce00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a6c0c7df0 0x7f5a6c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 --2- 172.21.15.89:0/651102390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a6c0c2ee0 0x7f5a6c1f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 >> 172.21.15.89:0/651102390 conn(0x7f5a6c0ca9c0 msgr2=0x7f5a6c158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:06.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 shutdown_connections 2024-08-31T04:04:06.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.293+0000 7f5a73200640 1 -- 172.21.15.89:0/651102390 wait complete. 2024-08-31T04:04:06.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:06.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.469+0000 7fe922400640 1 -- 172.21.15.89:0/2517534721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe900004810 msgr2=0x7fe900004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.469+0000 7fe922400640 1 --2- 172.21.15.89:0/2517534721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe900004810 0x7fe900004c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe91c072e80 tx=0x7fe90401d210 comp rx=0 tx=0).stop 2024-08-31T04:04:06.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.469+0000 7fe91be00640 1 -- 172.21.15.89:0/2517534721 reap_dead start 2024-08-31T04:04:06.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.469+0000 7fe922400640 1 -- 172.21.15.89:0/2517534721 shutdown_connections 2024-08-31T04:04:06.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.469+0000 7fe922400640 1 -- 172.21.15.89:0/2517534721 >> 172.21.15.89:0/2517534721 conn(0x7fe91c072590 msgr2=0x7fe91c0cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:06.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.469+0000 7fe922400640 1 -- 172.21.15.89:0/2517534721 shutdown_connections 2024-08-31T04:04:06.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.469+0000 7fe922400640 1 -- 172.21.15.89:0/2517534721 wait complete. 2024-08-31T04:04:06.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 Processor -- start 2024-08-31T04:04:06.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 -- start start 2024-08-31T04:04:06.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe900004810 0x7fe91c14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe91c150bc0 0x7fe91c0cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe91c0cc9f0 0x7fe91c154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c152d80 con 0x7fe900004810 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0c8e20 con 0x7fe91c0cc9f0 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c0c4b60 con 0x7fe91c150bc0 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe900004810 0x7fe91c14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe900004810 0x7fe91c14e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40500/0 (socket says 172.21.15.89:40500) 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91b400640 1 -- 172.21.15.89:0/901757533 learned_addr learned my addr 172.21.15.89:0/901757533 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91be00640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe91c0cc9f0 0x7fe91c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe912a00640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe91c150bc0 0x7fe91c0cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91b400640 1 -- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe91c150bc0 msgr2=0x7fe91c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91b400640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe91c150bc0 0x7fe91c0cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91b400640 1 -- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe91c0cc9f0 msgr2=0x7fe91c154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91b400640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe91c0cc9f0 0x7fe91c154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91b400640 1 -- 172.21.15.89:0/901757533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c1521e0 con 0x7fe900004810 2024-08-31T04:04:06.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe91b400640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe900004810 0x7fe91c14e150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe90c012460 tx=0x7fe90c012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:06.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe913e00640 1 -- 172.21.15.89:0/901757533 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c013a40 con 0x7fe900004810 2024-08-31T04:04:06.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe913e00640 1 -- 172.21.15.89:0/901757533 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe90c017030 con 0x7fe900004810 2024-08-31T04:04:06.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe913e00640 1 -- 172.21.15.89:0/901757533 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c013e40 con 0x7fe900004810 2024-08-31T04:04:06.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91c153c30 con 0x7fe900004810 2024-08-31T04:04:06.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91c15b910 con 0x7fe900004810 2024-08-31T04:04:06.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.473+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91c14f3c0 con 0x7fe900004810 2024-08-31T04:04:06.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.477+0000 7fe913e00640 1 -- 172.21.15.89:0/901757533 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe90c01c3e0 con 0x7fe900004810 2024-08-31T04:04:06.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.477+0000 7fe913e00640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe8f80720c0 0x7fe8f80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.477+0000 7fe913e00640 1 -- 172.21.15.89:0/901757533 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe90c096af0 con 0x7fe900004810 2024-08-31T04:04:06.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.477+0000 7fe912a00640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe8f80720c0 0x7fe8f80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.477+0000 7fe912a00640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe8f80720c0 0x7fe8f80745d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ad000 tx=0x7fe904019fb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:06.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.481+0000 7fe913e00640 1 -- 172.21.15.89:0/901757533 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe90c062060 con 0x7fe900004810 2024-08-31T04:04:06.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.645+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe91c151940 con 0x7fe900004810 2024-08-31T04:04:06.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe913e00640 1 -- 172.21.15.89:0/901757533 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18602 (secure 0 0 0) 0x7fe90c061960 con 0x7fe900004810 2024-08-31T04:04:06.649 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:06.649 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:05.324706+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe8f80720c0 msgr2=0x7fe8f80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe8f80720c0 0x7fe8f80745d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ad000 tx=0x7fe904019fb0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe900004810 msgr2=0x7fe91c14e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe900004810 0x7fe91c14e150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe90c012460 tx=0x7fe90c012920 comp rx=0 tx=0).stop 2024-08-31T04:04:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 shutdown_connections 2024-08-31T04:04:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe8f80720c0 0x7fe8f80745d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe91c0cc9f0 0x7fe91c154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe91c150bc0 0x7fe91c0cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 --2- 172.21.15.89:0/901757533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe900004810 0x7fe91c14e150 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 >> 172.21.15.89:0/901757533 conn(0x7fe91c072590 msgr2=0x7fe91c1576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 shutdown_connections 2024-08-31T04:04:06.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.649+0000 7fe922400640 1 -- 172.21.15.89:0/901757533 wait complete. 2024-08-31T04:04:06.672 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:06.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.825+0000 7fc023000640 1 -- 172.21.15.89:0/741136539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc000003a40 msgr2=0x7fc000003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.825+0000 7fc023000640 1 --2- 172.21.15.89:0/741136539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc000003a40 0x7fc000003eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c310 tx=0x7fc00c01cf60 comp rx=0 tx=0).stop 2024-08-31T04:04:06.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.825+0000 7fc021000640 1 -- 172.21.15.89:0/741136539 reap_dead start 2024-08-31T04:04:06.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.825+0000 7fc023000640 1 -- 172.21.15.89:0/741136539 shutdown_connections 2024-08-31T04:04:06.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.825+0000 7fc023000640 1 -- 172.21.15.89:0/741136539 >> 172.21.15.89:0/741136539 conn(0x7fc01c071be0 msgr2=0x7fc01c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:06.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.825+0000 7fc023000640 1 -- 172.21.15.89:0/741136539 shutdown_connections 2024-08-31T04:04:06.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.825+0000 7fc023000640 1 -- 172.21.15.89:0/741136539 wait complete. 2024-08-31T04:04:06.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.825+0000 7fc023000640 1 Processor -- start 2024-08-31T04:04:06.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.825+0000 7fc023000640 1 -- start start 2024-08-31T04:04:06.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc023000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc000003a40 0x7fc01c1f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc023000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c15f030 0x7fc01c153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc023000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c15f440 0x7fc01c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc023000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c1596f0 con 0x7fc01c15f440 2024-08-31T04:04:06.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc023000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c0cf610 con 0x7fc000003a40 2024-08-31T04:04:06.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc023000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc01c0c5160 con 0x7fc01c15f030 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc021000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c15f440 0x7fc01c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc021000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c15f440 0x7fc01c153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40510/0 (socket says 172.21.15.89:40510) 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc021000640 1 -- 172.21.15.89:0/1113980564 learned_addr learned my addr 172.21.15.89:0/1113980564 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc01be00640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc000003a40 0x7fc01c1f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc013400640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c15f030 0x7fc01c153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc021000640 1 -- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c15f030 msgr2=0x7fc01c153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc021000640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c15f030 0x7fc01c153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc021000640 1 -- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc000003a40 msgr2=0x7fc01c1f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc021000640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc000003a40 0x7fc01c1f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc021000640 1 -- 172.21.15.89:0/1113980564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01c1f8700 con 0x7fc01c15f440 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc013400640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c15f030 0x7fc01c153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:06.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc01be00640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc000003a40 0x7fc01c1f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:06.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc021000640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c15f440 0x7fc01c153eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc01c15dda0 tx=0x7fc0140019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:06.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc018c00640 1 -- 172.21.15.89:0/1113980564 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014011870 con 0x7fc01c15f440 2024-08-31T04:04:06.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc018c00640 1 -- 172.21.15.89:0/1113980564 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc014017070 con 0x7fc01c15f440 2024-08-31T04:04:06.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc018c00640 1 -- 172.21.15.89:0/1113980564 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014011da0 con 0x7fc01c15f440 2024-08-31T04:04:06.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01c1ef170 con 0x7fc01c15f440 2024-08-31T04:04:06.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc01c1f4be0 con 0x7fc01c15f440 2024-08-31T04:04:06.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.829+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01c165520 con 0x7fc01c15f440 2024-08-31T04:04:06.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.833+0000 7fc018c00640 1 -- 172.21.15.89:0/1113980564 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc01401c460 con 0x7fc01c15f440 2024-08-31T04:04:06.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.833+0000 7fc018c00640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbff80720f0 0x7fbff8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:06.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.833+0000 7fc018c00640 1 -- 172.21.15.89:0/1113980564 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc014093800 con 0x7fc01c15f440 2024-08-31T04:04:06.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.833+0000 7fc01be00640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbff80720f0 0x7fbff8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:06.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.833+0000 7fc01be00640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbff80720f0 0x7fbff8074600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0ab000 tx=0x7fc00c019da0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:06.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:06.837+0000 7fc018c00640 1 -- 172.21.15.89:0/1113980564 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc01405ed70 con 0x7fc01c15f440 2024-08-31T04:04:07.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.005+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc01c154500 con 0x7fc01c15f440 2024-08-31T04:04:07.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.005+0000 7fc018c00640 1 -- 172.21.15.89:0/1113980564 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18602 (secure 0 0 0) 0x7fc014067220 con 0x7fc01c15f440 2024-08-31T04:04:07.007 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:07.007 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:05.324706+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:07.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbff80720f0 msgr2=0x7fbff8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbff80720f0 0x7fbff8074600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0ab000 tx=0x7fc00c019da0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c15f440 msgr2=0x7fc01c153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c15f440 0x7fc01c153eb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc01c15dda0 tx=0x7fc0140019c0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 shutdown_connections 2024-08-31T04:04:07.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbff80720f0 0x7fbff8074600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc01c15f440 0x7fc01c153eb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c15f030 0x7fc01c153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 --2- 172.21.15.89:0/1113980564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc000003a40 0x7fc01c1f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 >> 172.21.15.89:0/1113980564 conn(0x7fc01c071be0 msgr2=0x7fc01c1547c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:07.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 shutdown_connections 2024-08-31T04:04:07.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.009+0000 7fc023000640 1 -- 172.21.15.89:0/1113980564 wait complete. 2024-08-31T04:04:07.046 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:07.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.201+0000 7f4288400640 1 -- 172.21.15.89:0/1823406364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4268003a40 msgr2=0x7f4268003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.201+0000 7f4288400640 1 --2- 172.21.15.89:0/1823406364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4268003a40 0x7f4268003eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4274001d60 tx=0x7f427401cb20 comp rx=0 tx=0).stop 2024-08-31T04:04:07.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.201+0000 7f4286400640 1 -- 172.21.15.89:0/1823406364 reap_dead start 2024-08-31T04:04:07.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.201+0000 7f4288400640 1 -- 172.21.15.89:0/1823406364 shutdown_connections 2024-08-31T04:04:07.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.201+0000 7f4288400640 1 -- 172.21.15.89:0/1823406364 >> 172.21.15.89:0/1823406364 conn(0x7f42800ccf20 msgr2=0x7f42800cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:07.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.201+0000 7f4288400640 1 -- 172.21.15.89:0/1823406364 shutdown_connections 2024-08-31T04:04:07.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.201+0000 7f4288400640 1 -- 172.21.15.89:0/1823406364 wait complete. 2024-08-31T04:04:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 Processor -- start 2024-08-31T04:04:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 -- start start 2024-08-31T04:04:07.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268003a40 0x7f42801f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:07.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42800c4f40 0x7f42800cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:07.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42800c5350 0x7f428014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:07.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f42800c7cb0 con 0x7f42800c5350 2024-08-31T04:04:07.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42800c7b30 con 0x7f42800c4f40 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4280163b50 con 0x7f4268003a40 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4286400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42800c5350 0x7f428014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4286400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42800c5350 0x7f428014a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40524/0 (socket says 172.21.15.89:40524) 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4286400640 1 -- 172.21.15.89:0/3546533588 learned_addr learned my addr 172.21.15.89:0/3546533588 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4285a00640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268003a40 0x7f42801f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4285000640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42800c4f40 0x7f42800cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4286400640 1 -- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268003a40 msgr2=0x7f42801f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4286400640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268003a40 0x7f42801f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4286400640 1 -- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42800c4f40 msgr2=0x7f42800cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4286400640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42800c4f40 0x7f42800cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4286400640 1 -- 172.21.15.89:0/3546533588 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42801f7800 con 0x7f42800c5350 2024-08-31T04:04:07.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4285000640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42800c4f40 0x7f42800cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:07.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4286400640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42800c5350 0x7f428014a830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42800c7590 tx=0x7f427800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:07.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f427d600640 1 -- 172.21.15.89:0/3546533588 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427800dc20 con 0x7f42800c5350 2024-08-31T04:04:07.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f427d600640 1 -- 172.21.15.89:0/3546533588 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f427800de00 con 0x7f42800c5350 2024-08-31T04:04:07.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f427d600640 1 -- 172.21.15.89:0/3546533588 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278017670 con 0x7f42800c5350 2024-08-31T04:04:07.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42800b2b70 con 0x7f42800c5350 2024-08-31T04:04:07.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.205+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42800c6e60 con 0x7f42800c5350 2024-08-31T04:04:07.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.209+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42800c6bc0 con 0x7f42800c5350 2024-08-31T04:04:07.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.209+0000 7f427d600640 1 -- 172.21.15.89:0/3546533588 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4278017810 con 0x7f42800c5350 2024-08-31T04:04:07.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.209+0000 7f427d600640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42600720c0 0x7f42600745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:07.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.209+0000 7f427d600640 1 -- 172.21.15.89:0/3546533588 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4278093470 con 0x7f42800c5350 2024-08-31T04:04:07.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.209+0000 7f4285a00640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42600720c0 0x7f42600745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:07.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.213+0000 7f4285a00640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42600720c0 0x7f42600745d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42740aa000 tx=0x7f42740a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:07.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.213+0000 7f427d600640 1 -- 172.21.15.89:0/3546533588 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f42800c6bc0 con 0x7f42800c5350 2024-08-31T04:04:07.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4280070f40 con 0x7f42800c5350 2024-08-31T04:04:07.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f427d600640 1 -- 172.21.15.89:0/3546533588 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6867 (secure 0 0 0) 0x7f427805e950 con 0x7f42800c5350 2024-08-31T04:04:07.413 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:07.413 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"btime":"2024-08-31T04:04:05:905956+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:05.898187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:07.414 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 6 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42600720c0 msgr2=0x7f42600745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42600720c0 0x7f42600745d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42740aa000 tx=0x7f42740a7040 comp rx=0 tx=0).stop 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42800c5350 msgr2=0x7f428014a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42800c5350 0x7f428014a830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42800c7590 tx=0x7f427800ee80 comp rx=0 tx=0).stop 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 shutdown_connections 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42600720c0 0x7f42600745d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42800c5350 0x7f428014a830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42800c4f40 0x7f42800cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 --2- 172.21.15.89:0/3546533588 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4268003a40 0x7f42801f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 >> 172.21.15.89:0/3546533588 conn(0x7f42800ccf20 msgr2=0x7f4280150100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:07.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 shutdown_connections 2024-08-31T04:04:07.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.413+0000 7f4288400640 1 -- 172.21.15.89:0/3546533588 wait complete. 2024-08-31T04:04:07.435 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:07.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.589+0000 7f39bfa00640 1 -- 172.21.15.89:0/3097775118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f399c004d50 msgr2=0x7f399c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.589+0000 7f39bfa00640 1 --2- 172.21.15.89:0/3097775118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f399c004d50 0x7f399c005160 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c750 tx=0x7f39b001fa60 comp rx=0 tx=0).stop 2024-08-31T04:04:07.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.589+0000 7f39bda00640 1 -- 172.21.15.89:0/3097775118 reap_dead start 2024-08-31T04:04:07.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.589+0000 7f39bfa00640 1 -- 172.21.15.89:0/3097775118 shutdown_connections 2024-08-31T04:04:07.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.589+0000 7f39bfa00640 1 -- 172.21.15.89:0/3097775118 >> 172.21.15.89:0/3097775118 conn(0x7f39b8071be0 msgr2=0x7f39b806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:07.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.589+0000 7f39bfa00640 1 -- 172.21.15.89:0/3097775118 shutdown_connections 2024-08-31T04:04:07.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.589+0000 7f39bfa00640 1 -- 172.21.15.89:0/3097775118 wait complete. 2024-08-31T04:04:07.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 Processor -- start 2024-08-31T04:04:07.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 -- start start 2024-08-31T04:04:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f399c004d50 0x7f39b81f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39b8155330 0x7f39b814e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b8150890 0x7f39b80ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39b80c4f80 con 0x7f39b8150890 2024-08-31T04:04:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39b80c4ca0 con 0x7f399c004d50 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39b80c5260 con 0x7f39b8155330 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b8150890 0x7f39b80ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b8150890 0x7f39b80ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40542/0 (socket says 172.21.15.89:40542) 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bda00640 1 -- 172.21.15.89:0/1891024518 learned_addr learned my addr 172.21.15.89:0/1891024518 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39b7e00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39b8155330 0x7f39b814e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bd000640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f399c004d50 0x7f39b81f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bda00640 1 -- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39b8155330 msgr2=0x7f39b814e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bda00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39b8155330 0x7f39b814e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bda00640 1 -- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f399c004d50 msgr2=0x7f39b81f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bda00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f399c004d50 0x7f39b81f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bda00640 1 -- 172.21.15.89:0/1891024518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b814e990 con 0x7f39b8150890 2024-08-31T04:04:07.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bda00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b8150890 0x7f39b80ce1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c840 tx=0x7f39b0004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:07.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39b4c00640 1 -- 172.21.15.89:0/1891024518 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0004b50 con 0x7f39b8150890 2024-08-31T04:04:07.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39b4c00640 1 -- 172.21.15.89:0/1891024518 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b00014a0 con 0x7f39b8150890 2024-08-31T04:04:07.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b80c9000 con 0x7f39b8150890 2024-08-31T04:04:07.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39b4c00640 1 -- 172.21.15.89:0/1891024518 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b00a9890 con 0x7f39b8150890 2024-08-31T04:04:07.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b81f6230 con 0x7f39b8150890 2024-08-31T04:04:07.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.593+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b815c430 con 0x7f39b8150890 2024-08-31T04:04:07.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.597+0000 7f39b4c00640 1 -- 172.21.15.89:0/1891024518 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f39b00a9a30 con 0x7f39b8150890 2024-08-31T04:04:07.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.597+0000 7f39b4c00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:07.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.597+0000 7f39b4c00640 1 -- 172.21.15.89:0/1891024518 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f39b0131150 con 0x7f39b8150890 2024-08-31T04:04:07.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.597+0000 7f39bd000640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:07.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.597+0000 7f39bd000640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009b20 tx=0x7f39a80091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:07.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.601+0000 7f39b4c00640 1 -- 172.21.15.89:0/1891024518 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f39b80c5780 con 0x7f39b8150890 2024-08-31T04:04:07.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.769+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39b8150e90 con 0x7f39b8150890 2024-08-31T04:04:07.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.769+0000 7f39b4c00640 1 -- 172.21.15.89:0/1891024518 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18602 (secure 0 0 0) 0x7f39b00fc740 con 0x7f39b8150890 2024-08-31T04:04:07.771 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:07.771 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:05.324706+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 msgr2=0x7f39980745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009b20 tx=0x7f39a80091e0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b8150890 msgr2=0x7f39b80ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b8150890 0x7f39b80ce1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c840 tx=0x7f39b0004a20 comp rx=0 tx=0).stop 2024-08-31T04:04:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 shutdown_connections 2024-08-31T04:04:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b8150890 0x7f39b80ce1c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39b8155330 0x7f39b814e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 --2- 172.21.15.89:0/1891024518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f399c004d50 0x7f39b81f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 >> 172.21.15.89:0/1891024518 conn(0x7f39b8071be0 msgr2=0x7f39b80c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 shutdown_connections 2024-08-31T04:04:07.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:07.773+0000 7f39bfa00640 1 -- 172.21.15.89:0/1891024518 wait complete. 2024-08-31T04:04:08.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-31T04:04:00.242319+0000', 'modified': '2024-08-31T04:04:05.898187+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4420}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4420': {'gid': 4420, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.170:6835/890662790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6834', 'nonce': 890662790}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 890662790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4420, 'qdb_cluster': [4420]} 2024-08-31T04:04:08.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-31T04:04:08.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-31T04:04:08.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.553+0000 7f0737000640 1 -- 172.21.15.89:0/3764600467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0714003fe0 msgr2=0x7f0714004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:08.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.553+0000 7f0737000640 1 --2- 172.21.15.89:0/3764600467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0714003fe0 0x7f0714004810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f07300c99f0 tx=0x7f071801d150 comp rx=0 tx=0).stop 2024-08-31T04:04:08.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.553+0000 7f0735000640 1 -- 172.21.15.89:0/3764600467 reap_dead start 2024-08-31T04:04:08.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.553+0000 7f0737000640 1 -- 172.21.15.89:0/3764600467 shutdown_connections 2024-08-31T04:04:08.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.553+0000 7f0737000640 1 -- 172.21.15.89:0/3764600467 >> 172.21.15.89:0/3764600467 conn(0x7f07300ccf20 msgr2=0x7f07300cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:08.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.553+0000 7f0737000640 1 -- 172.21.15.89:0/3764600467 shutdown_connections 2024-08-31T04:04:08.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.553+0000 7f0737000640 1 -- 172.21.15.89:0/3764600467 wait complete. 2024-08-31T04:04:08.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.553+0000 7f0737000640 1 Processor -- start 2024-08-31T04:04:08.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.553+0000 7f0737000640 1 -- start start 2024-08-31T04:04:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0737000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0714003fe0 0x7f07300cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0737000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0730147340 0x7f07300cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0737000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f073014c400 0x7f07301467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0737000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0730158980 con 0x7f0730147340 2024-08-31T04:04:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0737000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0730158800 con 0x7f0714003fe0 2024-08-31T04:04:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0737000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0730163860 con 0x7f073014c400 2024-08-31T04:04:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0727400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0730147340 0x7f07300cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0727400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0730147340 0x7f07300cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40554/0 (socket says 172.21.15.89:40554) 2024-08-31T04:04:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0727400640 1 -- 172.21.15.89:0/1007229368 learned_addr learned my addr 172.21.15.89:0/1007229368 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0735000640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f073014c400 0x7f07301467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f072fe00640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0714003fe0 0x7f07300cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0727400640 1 -- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f073014c400 msgr2=0x7f07301467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0727400640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f073014c400 0x7f07301467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0727400640 1 -- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0714003fe0 msgr2=0x7f07300cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0727400640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0714003fe0 0x7f07300cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0727400640 1 -- 172.21.15.89:0/1007229368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07300cc8a0 con 0x7f0730147340 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0735000640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f073014c400 0x7f07301467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f072fe00640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0714003fe0 0x7f07300cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0727400640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0730147340 0x7f07300cadb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f071801cbc0 tx=0x7f0718005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f072cc00640 1 -- 172.21.15.89:0/1007229368 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07180bf070 con 0x7f0730147340 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f072cc00640 1 -- 172.21.15.89:0/1007229368 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07180b2040 con 0x7f0730147340 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f072cc00640 1 -- 172.21.15.89:0/1007229368 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07180b1070 con 0x7f0730147340 2024-08-31T04:04:08.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0737000640 1 -- 172.21.15.89:0/1007229368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07300cb2f0 con 0x7f0730147340 2024-08-31T04:04:08.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.557+0000 7f0737000640 1 -- 172.21.15.89:0/1007229368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07300ccb10 con 0x7f0730147340 2024-08-31T04:04:08.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f072cc00640 1 -- 172.21.15.89:0/1007229368 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f07300c9020 con 0x7f0730147340 2024-08-31T04:04:08.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f072cc00640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f070c0720c0 0x7f070c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f072cc00640 1 -- 172.21.15.89:0/1007229368 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f071812d800 con 0x7f0730147340 2024-08-31T04:04:08.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f073e6a5000 1 Processor -- start 2024-08-31T04:04:08.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f072fe00640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f070c0720c0 0x7f070c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f073e6a5000 1 -- start start 2024-08-31T04:04:08.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f072fe00640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f070c0720c0 0x7f070c0745d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0720001d70 tx=0x7f0720001e60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 0x560c1f009eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1f00db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 0x560c1f00e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f073e6a5000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560c1ee29360 con 0x560c1eec6d90 2024-08-31T04:04:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f073e6a5000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560c1ee188f0 con 0x560c1eeb0860 2024-08-31T04:04:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f073e6a5000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560c1ee1c8a0 con 0x560c1ead7460 2024-08-31T04:04:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f0727400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1f00db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f0727400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1f00db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40560/0 (socket says 172.21.15.89:40560) 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f0727400640 1 -- 172.21.15.89:0/435930346 learned_addr learned my addr 172.21.15.89:0/435930346 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f072fe00640 1 --2- 172.21.15.89:0/435930346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 0x560c1f009eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f0735000640 1 --2- 172.21.15.89:0/435930346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 0x560c1f00e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f0727400640 1 -- 172.21.15.89:0/435930346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 msgr2=0x560c1f009eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f0727400640 1 --2- 172.21.15.89:0/435930346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 0x560c1f009eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f0727400640 1 -- 172.21.15.89:0/435930346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 msgr2=0x560c1f00e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f0727400640 1 --2- 172.21.15.89:0/435930346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 0x560c1f00e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.561+0000 7f0727400640 1 -- 172.21.15.89:0/435930346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1edb8190 con 0x560c1eec6d90 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f0727400640 1 --2- 172.21.15.89:0/435930346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1f00db40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f07180f86b0 tx=0x7f0718101240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4c0f128db636f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f0724c00640 1 -- 172.21.15.89:0/435930346 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07180fcee0 con 0x560c1eec6d90 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f0724c00640 1 -- 172.21.15.89:0/435930346 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f071812ba60 con 0x560c1eec6d90 2024-08-31T04:04:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f0724c00640 1 -- 172.21.15.89:0/435930346 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718101470 con 0x560c1eec6d90 2024-08-31T04:04:08.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 -- 172.21.15.89:0/435930346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 msgr2=0x560c1f00db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:08.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 --2- 172.21.15.89:0/435930346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1f00db40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f07180f86b0 tx=0x7f0718101240 comp rx=0 tx=0).stop 2024-08-31T04:04:08.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 -- 172.21.15.89:0/435930346 shutdown_connections 2024-08-31T04:04:08.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 --2- 172.21.15.89:0/435930346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1f00db40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:08.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 --2- 172.21.15.89:0/435930346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 0x560c1f00e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:08.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 --2- 172.21.15.89:0/435930346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 0x560c1f009eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:08.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 -- 172.21.15.89:0/435930346 >> 172.21.15.89:0/435930346 conn(0x560c1ef9cae0 msgr2=0x560c1f00c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:08.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 -- 172.21.15.89:0/435930346 shutdown_connections 2024-08-31T04:04:08.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 -- 172.21.15.89:0/435930346 wait complete. 2024-08-31T04:04:08.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 -- start start 2024-08-31T04:04:08.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 Processor -- start 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1ead7460 0x560c1efd2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eeb0860 0x560c1efd2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eec6d90 0x560c1efd3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560c1ede5500 con 0x560c1eeb0860 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560c1ede6190 con 0x560c1ead7460 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560c1ee1bbb0 con 0x560c1eec6d90 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.565+0000 7f073e6a5000 10 client.0 _ll_register_callbacks cb 0x560c1efb9100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0727400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eeb0860 0x560c1efd2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0727400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eeb0860 0x560c1efd2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40572/0 (socket says 172.21.15.89:40572) 2024-08-31T04:04:08.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0727400640 1 -- 172.21.15.89:0/1596599154 learned_addr learned my addr 172.21.15.89:0/1596599154 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f072fe00640 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1ead7460 0x560c1efd2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0735000640 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eec6d90 0x560c1efd3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0727400640 1 -- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eec6d90 msgr2=0x560c1efd3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0727400640 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eec6d90 0x560c1efd3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0727400640 1 -- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1ead7460 msgr2=0x560c1efd2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0727400640 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1ead7460 0x560c1efd2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0727400640 1 -- 172.21.15.89:0/1596599154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c1edb3530 con 0x560c1eeb0860 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0735000640 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eec6d90 0x560c1efd3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f0727400640 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eeb0860 0x560c1efd2dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07180f86b0 tx=0x7f0718101a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fe7ccf9d71a22a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f071d600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f071d600640 1 -- 172.21.15.89:0/1596599154 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718101470 con 0x560c1eeb0860 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f071d600640 1 -- 172.21.15.89:0/1596599154 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0718101610 con 0x560c1eeb0860 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f073e6a5000 1 -- 172.21.15.89:0/1596599154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c1edb2110 con 0x560c1eeb0860 2024-08-31T04:04:08.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f071d600640 1 -- 172.21.15.89:0/1596599154 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f07180f7980 con 0x560c1eeb0860 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f073e6a5000 10 client.4467 fetch_fsmap learned FSMap version 6 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f073e6a5000 1 -- 172.21.15.89:0/1596599154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x560c1ee9dff0 con 0x560c1eeb0860 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f071d600640 1 -- 172.21.15.89:0/1596599154 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560c1edb2110 con 0x560c1eeb0860 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f071d600640 1 -- 172.21.15.89:0/1596599154 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7f071811d1c0 con 0x560c1eeb0860 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f073e6a5000 10 client.4467 fetch_fsmap finished waiting for FSMap version 6 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f073e6a5000 10 client.4467 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f073e6a5000 20 client.4467 populate_metadata read hostname 'smithi089' 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f073e6a5000 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eabc7d0 0x560c1f027850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f073e6a5000 4 client.4467 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f073e6a5000 1 -- 172.21.15.89:0/1596599154 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c1ee2b2b0 con 0x560c1eabc7d0 2024-08-31T04:04:08.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f072fe00640 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eabc7d0 0x560c1f027850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:08.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f072fe00640 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eabc7d0 0x560c1f027850 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=960caa395ac70694 server_cookie=d9173b84a42fb29e in_seq=0 out_seq=0 2024-08-31T04:04:08.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:08.569+0000 7f071d600640 10 client.4467 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:10.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f071d600640 1 -- 172.21.15.89:0/1596599154 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c1ee2b2b0 con 0x560c1eabc7d0 2024-08-31T04:04:10.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f071d600640 10 client.4467 handle_command_reply: tid=0 2024-08-31T04:04:10.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f073e6a5000 1 client.4467 shutdown 2024-08-31T04:04:10.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f073e6a5000 1 -- 172.21.15.89:0/1596599154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eeb0860 msgr2=0x560c1efd2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:10.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f073e6a5000 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eeb0860 0x560c1efd2dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07180f86b0 tx=0x7f0718101a10 comp rx=0 tx=0).stop 2024-08-31T04:04:10.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f073e6a5000 1 -- 172.21.15.89:0/1596599154 shutdown_connections 2024-08-31T04:04:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f073e6a5000 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eabc7d0 0x560c1f027850 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f073e6a5000 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eeb0860 0x560c1efd2dd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f073e6a5000 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eec6d90 0x560c1efd3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.901+0000 7f073e6a5000 1 --2- 172.21.15.89:0/1596599154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1ead7460 0x560c1efd2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.905+0000 7f071d600640 0 client.4467 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.905+0000 7f073e6a5000 1 -- 172.21.15.89:0/1596599154 >> 172.21.15.89:0/1596599154 conn(0x560c1ef9cae0 msgr2=0x560c1efd3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.905+0000 7f073e6a5000 1 -- 172.21.15.89:0/1596599154 shutdown_connections 2024-08-31T04:04:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.905+0000 7f073e6a5000 1 -- 172.21.15.89:0/1596599154 wait complete. 2024-08-31T04:04:10.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.905+0000 7f073e6a5000 20 client.4467 trim_cache size 0 max 16384 2024-08-31T04:04:10.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f073e6a5000 1 Processor -- start 2024-08-31T04:04:10.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f073e6a5000 1 -- start start 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 0x560c1efd23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 0x560c1efd2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1efcc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f073e6a5000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560c1ee20ed0 con 0x560c1eec6d90 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f073e6a5000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560c1edd0340 con 0x560c1eeb0860 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f073e6a5000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560c1edd8de0 con 0x560c1ead7460 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0735000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1efcc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0735000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1efcc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40584/0 (socket says 172.21.15.89:40584) 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0735000640 1 -- 172.21.15.89:0/4048544017 learned_addr learned my addr 172.21.15.89:0/4048544017 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:10.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f072fe00640 1 --2- 172.21.15.89:0/4048544017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 0x560c1efd23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:10.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0727400640 1 --2- 172.21.15.89:0/4048544017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 0x560c1efd2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:10.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0735000640 1 -- 172.21.15.89:0/4048544017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 msgr2=0x560c1efd23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:10.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0735000640 1 --2- 172.21.15.89:0/4048544017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 0x560c1efd23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0735000640 1 -- 172.21.15.89:0/4048544017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 msgr2=0x560c1efd2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:10.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0735000640 1 --2- 172.21.15.89:0/4048544017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 0x560c1efd2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0735000640 1 -- 172.21.15.89:0/4048544017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1ee754b0 con 0x560c1eec6d90 2024-08-31T04:04:10.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.925+0000 7f0735000640 1 --2- 172.21.15.89:0/4048544017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1efcc800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07300c3430 tx=0x7f0728003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c226d17afc6dd632 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:10.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f071fe00640 1 -- 172.21.15.89:0/4048544017 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07280044f0 con 0x560c1eec6d90 2024-08-31T04:04:10.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f071fe00640 1 -- 172.21.15.89:0/4048544017 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0728004690 con 0x560c1eec6d90 2024-08-31T04:04:10.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f071fe00640 1 -- 172.21.15.89:0/4048544017 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07280116a0 con 0x560c1eec6d90 2024-08-31T04:04:10.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 -- 172.21.15.89:0/4048544017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 msgr2=0x560c1efcc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:10.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4048544017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1efcc800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07300c3430 tx=0x7f0728003d50 comp rx=0 tx=0).stop 2024-08-31T04:04:10.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 -- 172.21.15.89:0/4048544017 shutdown_connections 2024-08-31T04:04:10.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4048544017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1eec6d90 0x560c1efcc800 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4048544017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eeb0860 0x560c1efd2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4048544017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1ead7460 0x560c1efd23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 -- 172.21.15.89:0/4048544017 >> 172.21.15.89:0/4048544017 conn(0x560c1ef9cae0 msgr2=0x560c1f023e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:10.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 -- 172.21.15.89:0/4048544017 shutdown_connections 2024-08-31T04:04:10.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 -- 172.21.15.89:0/4048544017 wait complete. 2024-08-31T04:04:10.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 -- start start 2024-08-31T04:04:10.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.929+0000 7f073e6a5000 1 Processor -- start 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1ead7460 0x560c1f02d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eeb0860 0x560c1f0288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eec6d90 0x560c1f028de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560c1ee1bbb0 con 0x560c1ead7460 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560c1edcfac0 con 0x560c1eec6d90 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560c1ede5500 con 0x560c1eeb0860 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 10 client.0 _ll_register_callbacks cb 0x7f07180f85c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f072fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1ead7460 0x560c1f02d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0727400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eeb0860 0x560c1f0288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:10.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0727400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eeb0860 0x560c1f0288a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:39130/0 (socket says 172.21.15.89:39130) 2024-08-31T04:04:10.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0727400640 1 -- 172.21.15.89:0/4038030659 learned_addr learned my addr 172.21.15.89:0/4038030659 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:10.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0735000640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eec6d90 0x560c1f028de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:10.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0727400640 1 -- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eec6d90 msgr2=0x560c1f028de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:10.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0727400640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eec6d90 0x560c1f028de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0727400640 1 -- 172.21.15.89:0/4038030659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1ead7460 msgr2=0x560c1f02d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:10.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0727400640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1ead7460 0x560c1f02d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0727400640 1 -- 172.21.15.89:0/4038030659 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x560c1edd2f30 con 0x560c1eeb0860 2024-08-31T04:04:10.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f072fe00640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1ead7460 0x560c1f02d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f0727400640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eeb0860 0x560c1f0288a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f07180f8420 tx=0x7f071812bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c071eead6e14dae5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f071d600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3301/0 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f071d600640 1 -- 172.21.15.89:0/4038030659 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07180f4d70 con 0x560c1eeb0860 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f071d600640 1 -- 172.21.15.89:0/4038030659 <== mon.2 v2:172.21.15.170:3301/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0718101470 con 0x560c1eeb0860 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 -- 172.21.15.89:0/4038030659 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0728004690 con 0x560c1eeb0860 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f071d600640 1 -- 172.21.15.89:0/4038030659 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f0718101670 con 0x560c1eeb0860 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 10 client.4421 fetch_fsmap learned FSMap version 6 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 -- 172.21.15.89:0/4038030659 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x560c1edbe590 con 0x560c1eeb0860 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f071d600640 1 -- 172.21.15.89:0/4038030659 <== mon.2 v2:172.21.15.170:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0728004690 con 0x560c1eeb0860 2024-08-31T04:04:10.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f071d600640 1 -- 172.21.15.89:0/4038030659 <== mon.2 v2:172.21.15.170:3301/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7f0718124af0 con 0x560c1eeb0860 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 10 client.4421 fetch_fsmap finished waiting for FSMap version 6 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 10 client.4421 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 20 client.4421 populate_metadata read hostname 'smithi089' 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 0x560c1f029320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 4 client.4421 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f073e6a5000 1 -- 172.21.15.89:0/4038030659 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "status"}) -- 0x560c1ee26d50 con 0x560c1eaaa830 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f072fe00640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 0x560c1f029320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f071d600640 10 client.4421 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.933+0000 7f072fe00640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 0x560c1f029320 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2462a270fda37049 server_cookie=8f9ebcf7be97a4e7 in_seq=0 out_seq=0 2024-08-31T04:04:10.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f072fe00640 1 -- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 msgr2=0x560c1f029320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-08-31T04:04:10.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f072fe00640 1 -- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 msgr2=0x560c1f029320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-31T04:04:10.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f072fe00640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 0x560c1f029320 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-31T04:04:10.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f072fe00640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 0x560c1f029320 unknown :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-08-31T04:04:10.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f072fe00640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 0x560c1f029320 unknown :-1 s=BANNER_CONNECTING pgs=15 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:10.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f072fe00640 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 0x560c1f029320 crc :-1 s=READY pgs=15 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2462a270fda37049 server_cookie=8f9ebcf7be97a4e7 in_seq=0 out_seq=1 2024-08-31T04:04:10.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f071d600640 10 client.4421 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:10.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f071d600640 1 -- 172.21.15.89:0/4038030659 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x560c1ee26d50 con 0x560c1eaaa830 2024-08-31T04:04:10.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f071d600640 10 client.4421 handle_command_reply: tid=0 2024-08-31T04:04:10.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 client.4421 shutdown 2024-08-31T04:04:10.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 -- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eeb0860 msgr2=0x560c1f0288a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eeb0860 0x560c1f0288a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f07180f8420 tx=0x7f071812bc00 comp rx=0 tx=0).stop 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 -- 172.21.15.89:0/4038030659 shutdown_connections 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560c1eaaa830 0x560c1f029320 crc :-1 s=READY pgs=15 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560c1eec6d90 0x560c1f028de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560c1eeb0860 0x560c1f0288a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 --2- 172.21.15.89:0/4038030659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560c1ead7460 0x560c1f02d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f071d600640 0 client.4421 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 -- 172.21.15.89:0/4038030659 >> 172.21.15.89:0/4038030659 conn(0x560c1ef9cae0 msgr2=0x560c1efd3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 -- 172.21.15.89:0/4038030659 shutdown_connections 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 1 -- 172.21.15.89:0/4038030659 wait complete. 2024-08-31T04:04:10.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f073e6a5000 20 client.4421 trim_cache size 0 max 16384 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "4a16b848-e6b2-47d6-97cd-edff59841cb1", 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4420, 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 10.066769837000001, 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 5, 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 26, 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 25, 2024-08-31T04:04:10.941 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 15.481528090999999 2024-08-31T04:04:10.942 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:04:10.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 -- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f070c0720c0 msgr2=0x7f070c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:10.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f070c0720c0 0x7f070c0745d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0720001d70 tx=0x7f0720001e60 comp rx=0 tx=0).stop 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 -- 172.21.15.89:0/1007229368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0730147340 msgr2=0x7f07300cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0730147340 0x7f07300cadb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f071801cbc0 tx=0x7f0718005520 comp rx=0 tx=0).stop 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 -- 172.21.15.89:0/1007229368 shutdown_connections 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f070c0720c0 0x7f070c0745d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0730147340 0x7f07300cadb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f073014c400 0x7f07301467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 --2- 172.21.15.89:0/1007229368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0714003fe0 0x7f07300cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 -- 172.21.15.89:0/1007229368 >> 172.21.15.89:0/1007229368 conn(0x7f07300ccf20 msgr2=0x7f07301618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 -- 172.21.15.89:0/1007229368 shutdown_connections 2024-08-31T04:04:10.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:10.937+0000 7f0737000640 1 -- 172.21.15.89:0/1007229368 wait complete. 2024-08-31T04:04:10.962 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T04:04:10.962 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:04:10.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-31T04:04:11.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.121+0000 7f358f200640 1 -- 172.21.15.89:0/3961789271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3590158fd0 msgr2=0x7f35900c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:11.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.121+0000 7f358f200640 1 --2- 172.21.15.89:0/3961789271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3590158fd0 0x7f35900c3e80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3578009900 tx=0x7f357801f0d0 comp rx=0 tx=0).stop 2024-08-31T04:04:11.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.121+0000 7f358f200640 1 -- 172.21.15.89:0/3961789271 shutdown_connections 2024-08-31T04:04:11.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.121+0000 7f358f200640 1 --2- 172.21.15.89:0/3961789271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3590158fd0 0x7f35900c3e80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:11.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.121+0000 7f358f200640 1 -- 172.21.15.89:0/3961789271 >> 172.21.15.89:0/3961789271 conn(0x7f35900cca80 msgr2=0x7f35900cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:11.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.121+0000 7f358f200640 1 -- 172.21.15.89:0/3961789271 shutdown_connections 2024-08-31T04:04:11.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.121+0000 7f358f200640 1 -- 172.21.15.89:0/3961789271 wait complete. 2024-08-31T04:04:11.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.121+0000 7f358f200640 1 Processor -- start 2024-08-31T04:04:11.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.121+0000 7f358f200640 1 -- start start 2024-08-31T04:04:11.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358f200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3590074ed0 0x7f35901f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:11.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358f200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35900c6620 0x7f35900c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:11.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3590158fd0 0x7f359014d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:11.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358f200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f35900c4950 con 0x7f35900c6620 2024-08-31T04:04:11.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f35900c4fa0 con 0x7f3590158fd0 2024-08-31T04:04:11.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358f200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f35900c4c30 con 0x7f3590074ed0 2024-08-31T04:04:11.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3585400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35900c6620 0x7f35900c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:11.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3585400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35900c6620 0x7f35900c2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40628/0 (socket says 172.21.15.89:40628) 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3585400640 1 -- 172.21.15.89:0/3426451949 learned_addr learned my addr 172.21.15.89:0/3426451949 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358e800640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3590158fd0 0x7f359014d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358de00640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3590074ed0 0x7f35901f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3585400640 1 -- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3590074ed0 msgr2=0x7f35901f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3585400640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3590074ed0 0x7f35901f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3585400640 1 -- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3590158fd0 msgr2=0x7f359014d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3585400640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3590158fd0 0x7f359014d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3585400640 1 -- 172.21.15.89:0/3426451949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35901f6050 con 0x7f35900c6620 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3585400640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35900c6620 0x7f35900c2a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3578009850 tx=0x7f35780a8ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3586a00640 1 -- 172.21.15.89:0/3426451949 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35780b5040 con 0x7f35900c6620 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3586a00640 1 -- 172.21.15.89:0/3426451949 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35780be070 con 0x7f35900c6620 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35901f2c30 con 0x7f35900c6620 2024-08-31T04:04:11.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f3586a00640 1 -- 172.21.15.89:0/3426451949 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578003b90 con 0x7f35900c6620 2024-08-31T04:04:11.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35900c8540 con 0x7f35900c6620 2024-08-31T04:04:11.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.125+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35901583d0 con 0x7f35900c6620 2024-08-31T04:04:11.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.129+0000 7f3586a00640 1 -- 172.21.15.89:0/3426451949 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f35780c3460 con 0x7f35900c6620 2024-08-31T04:04:11.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.129+0000 7f3586a00640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f356c0720c0 0x7f356c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:11.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.129+0000 7f3586a00640 1 -- 172.21.15.89:0/3426451949 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3578130be0 con 0x7f35900c6620 2024-08-31T04:04:11.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.129+0000 7f358de00640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f356c0720c0 0x7f356c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:11.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.129+0000 7f358de00640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f356c0720c0 0x7f356c0745d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f358000b810 tx=0x7f3580008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:11.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.133+0000 7f3586a00640 1 -- 172.21.15.89:0/3426451949 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3578018c30 con 0x7f35900c6620 2024-08-31T04:04:11.161 INFO:tasks.ceph.mds.b.smithi170.stderr:2024-08-31T04:04:11.158+0000 7f1b79b94640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T04:04:11.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3590076bf0 con 0x7f35900c6620 2024-08-31T04:04:11.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f3586a00640 1 -- 172.21.15.89:0/3426451949 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f35780fbb90 con 0x7f35900c6620 2024-08-31T04:04:11.337 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f356c0720c0 msgr2=0x7f356c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f356c0720c0 0x7f356c0745d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f358000b810 tx=0x7f3580008040 comp rx=0 tx=0).stop 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35900c6620 msgr2=0x7f35900c2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35900c6620 0x7f35900c2a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3578009850 tx=0x7f35780a8ce0 comp rx=0 tx=0).stop 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 shutdown_connections 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f356c0720c0 0x7f356c0745d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35900c6620 0x7f35900c2a40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3590158fd0 0x7f359014d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 --2- 172.21.15.89:0/3426451949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3590074ed0 0x7f35901f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:11.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 >> 172.21.15.89:0/3426451949 conn(0x7f35900cca80 msgr2=0x7f359014e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:11.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 shutdown_connections 2024-08-31T04:04:11.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11.337+0000 7f358f200640 1 -- 172.21.15.89:0/3426451949 wait complete. 2024-08-31T04:04:11.358 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-31T04:04:11.359 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T04:04:11.359 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2024-08-31T04:04:11.359 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-31T04:04:11.359 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:04:11.359 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-31T04:04:11.359 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T04:04:11.359 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T04:04:11.359 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-31T04:04:11.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:11.359 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2024-08-31T04:04:11.368 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T04:04:11.368 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T04:04:11.368 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:11.369 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T04:04:11.370 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:11.370 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-31T04:04:11.370 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42455sec preferred_lft 42455sec 2024-08-31T04:04:11.370 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2024-08-31T04:04:11.370 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:04:11.370 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-31T04:04:11.370 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:75:71:bb:f8 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:11.370 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-31T04:04:11.370 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:04:11.371 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T04:04:11.372 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:11.372 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:11.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2024-08-31T04:04:11.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2024-08-31T04:04:11.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2024-08-31T04:04:11.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T04:04:11.372 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:11.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:11.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:11.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:11.524 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T04:04:11.589 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-08-31T04:04:11.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:11.591 DEBUG:teuthology.orchestra.run.smithi089:> route 2024-08-31T04:04:11.663 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2024-08-31T04:04:11.663 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T04:04:11.663 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-31T04:04:11.663 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-31T04:04:11.664 INFO:teuthology.orchestra.run.smithi089.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-08-31T04:04:11.664 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-31T04:04:11.664 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-31T04:04:11.664 INFO:teuthology.orchestra.run.smithi089.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T04:04:11.664 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T04:04:11.664 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T04:04:11.664 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T04:04:11.664 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:11.665 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:11.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-31T04:04:11.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-31T04:04:11.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-31T04:04:11.665 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:11.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:11.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:11.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:11.796 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-08-31T04:04:11.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:11.806 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2024-08-31T04:04:11.856 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:11.856 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:11.856 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:04:11.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-31T04:04:11.857 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:11.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:11.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:11.986 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-31T04:04:11.986 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:11.986 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:11.986 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-31T04:04:11.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T04:04:11.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-31T04:04:11.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-31T04:04:11.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-31T04:04:11.987 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:12.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:12.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:12.162 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:12.162 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:12.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2024-08-31T04:04:12.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T04:04:12.163 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:12.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:12.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:12.291 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-31T04:04:12.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:04:12.291 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:04:12.301 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-31T04:04:12.302 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:04:12.302 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:04:12.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2024-08-31T04:04:12.415 DEBUG:teuthology.orchestra.run.smithi089:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T04:04:12.469 INFO:teuthology.orchestra.run.smithi089.stdout:/sys 2024-08-31T04:04:12.469 INFO:teuthology.orchestra.run.smithi089.stdout:/proc 2024-08-31T04:04:12.469 INFO:teuthology.orchestra.run.smithi089.stdout:/dev 2024-08-31T04:04:12.469 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/pts 2024-08-31T04:04:12.469 INFO:teuthology.orchestra.run.smithi089.stdout:/run 2024-08-31T04:04:12.469 INFO:teuthology.orchestra.run.smithi089.stdout:/ 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/security 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/shm 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/run/lock 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/cgroup 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/pstore 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/bpf 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/hugepages 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/mqueue 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/debug 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/tracing 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/fs/nfsd 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/fuse/connections 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/config 2024-08-31T04:04:12.470 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/run/rpc_pipefs 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/run/user/1000 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-0 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-1 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-2 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-3 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:04:12.471 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:04:12.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:12.472 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2024-08-31T04:04:12.527 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-31T04:04:12.527 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-31T04:04:12.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2024-08-31T04:04:12.590 DEBUG:teuthology.orchestra.run.smithi089:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T04:04:12.645 INFO:teuthology.orchestra.run.smithi089.stdout:/sys 2024-08-31T04:04:12.645 INFO:teuthology.orchestra.run.smithi089.stdout:/proc 2024-08-31T04:04:12.645 INFO:teuthology.orchestra.run.smithi089.stdout:/dev 2024-08-31T04:04:12.645 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/pts 2024-08-31T04:04:12.645 INFO:teuthology.orchestra.run.smithi089.stdout:/run 2024-08-31T04:04:12.645 INFO:teuthology.orchestra.run.smithi089.stdout:/ 2024-08-31T04:04:12.645 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/security 2024-08-31T04:04:12.645 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/shm 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/run/lock 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/cgroup 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/pstore 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/bpf 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/hugepages 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/mqueue 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/debug 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/tracing 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/fs/nfsd 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/fuse/connections 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/config 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/run/rpc_pipefs 2024-08-31T04:04:12.646 INFO:teuthology.orchestra.run.smithi089.stdout:/run/user/1000 2024-08-31T04:04:12.647 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph 2024-08-31T04:04:12.647 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-0 2024-08-31T04:04:12.647 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-1 2024-08-31T04:04:12.647 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-2 2024-08-31T04:04:12.647 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-3 2024-08-31T04:04:12.647 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns 2024-08-31T04:04:12.647 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:04:12.647 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:04:12.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:12.648 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2024-08-31T04:04:12.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi089.stderr:2024-08-31T04:04:12.677+0000 7ffab7646580 -1 init, newargv = 0x55dc052c0a10 newargc=15 2024-08-31T04:04:12.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi089.stderr:ceph-fuse[35722]: starting ceph client 2024-08-31T04:04:12.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi089.stderr:ceph-fuse[35722]: starting fuse 2024-08-31T04:04:13.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2024-08-31T04:04:13.807 DEBUG:teuthology.orchestra.run.smithi089:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T04:04:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/sys 2024-08-31T04:04:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/proc 2024-08-31T04:04:13.861 INFO:teuthology.orchestra.run.smithi089.stdout:/dev 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/pts 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/run 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/ 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/security 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/shm 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/run/lock 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/cgroup 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/pstore 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/bpf 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/hugepages 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/mqueue 2024-08-31T04:04:13.862 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/debug 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/tracing 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/fs/nfsd 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/fuse/connections 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/config 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/run/rpc_pipefs 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/run/user/1000 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-0 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-1 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-2 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph/osd/ceph-3 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns 2024-08-31T04:04:13.863 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:04:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:04:13.864 INFO:teuthology.orchestra.run.smithi089.stdout:/home/ubuntu/cephtest/mnt.admin 2024-08-31T04:04:13.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:13.865 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2024-08-31T04:04:13.915 INFO:teuthology.orchestra.run.smithi089.stdout:44 2024-08-31T04:04:13.916 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-08-31T04:04:13.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo stdin-killer -- python3 -c ' 2024-08-31T04:04:13.916 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2024-08-31T04:04:13.916 DEBUG:teuthology.orchestra.run.smithi089:> import re 2024-08-31T04:04:13.916 DEBUG:teuthology.orchestra.run.smithi089:> import os 2024-08-31T04:04:13.916 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2024-08-31T04:04:13.916 DEBUG:teuthology.orchestra.run.smithi089:> 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> 2024-08-31T04:04:13.917 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> return f 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.admin")) 2024-08-31T04:04:13.918 DEBUG:teuthology.orchestra.run.smithi089:> ' 2024-08-31T04:04:14.041 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.admin.35722.asok 2024-08-31T04:04:14.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:14.053 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.35722.asok 2024-08-31T04:04:14.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:14.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.35722.asok status 2024-08-31T04:04:14.233 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:04:14.233 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2024-08-31T04:04:14.233 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "d19e6118f7015f0047264006cb0c873528eb3ae6", 2024-08-31T04:04:14.234 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T04:04:14.234 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "admin", 2024-08-31T04:04:14.234 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2024-08-31T04:04:14.234 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-31T04:04:14.234 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "35722", 2024-08-31T04:04:14.234 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2024-08-31T04:04:14.235 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:04:14.235 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2024-08-31T04:04:14.235 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2024-08-31T04:04:14.235 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4485, 2024-08-31T04:04:14.235 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2024-08-31T04:04:14.235 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2024-08-31T04:04:14.235 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2024-08-31T04:04:14.235 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 4485 2024-08-31T04:04:14.236 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:04:14.236 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2024-08-31T04:04:14.236 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-08-31T04:04:14.236 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2024-08-31T04:04:14.236 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 3857069456 2024-08-31T04:04:14.236 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:04:14.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:04:14.237 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2024-08-31T04:04:14.237 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-08-31T04:04:14.237 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.89:0", 2024-08-31T04:04:14.237 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 3857069456 2024-08-31T04:04:14.237 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:04:14.238 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.4485 172.21.15.89:0/3857069456", 2024-08-31T04:04:14.238 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "172.21.15.89:0/3857069456", 2024-08-31T04:04:14.238 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2024-08-31T04:04:14.238 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 5, 2024-08-31T04:04:14.238 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 26, 2024-08-31T04:04:14.238 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2024-08-31T04:04:14.238 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2024-08-31T04:04:14.238 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2024-08-31T04:04:14.238 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:04:14.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:14.249 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2024-08-31T04:04:14.249 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:04:14.258 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2024-08-31T04:04:14.258 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:04:14.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:14.258 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:04:14.321 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-31T04:04:14.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:04:14.856 INFO:teuthology.orchestra.run.smithi089.stdout:# file: . 2024-08-31T04:04:14.856 INFO:teuthology.orchestra.run.smithi089.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-31T04:04:14.856 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:14.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:14.863 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:04:14.863 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:04:14.872 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-31T04:04:15.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.072+0000 7f375ce00640 1 -- 172.21.15.89:0/2392070116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f375815bc70 msgr2=0x7f3758152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.072+0000 7f375ce00640 1 --2- 172.21.15.89:0/2392070116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f375815bc70 0x7f3758152a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f37580c9020 tx=0x7f374801f010 comp rx=0 tx=0).stop 2024-08-31T04:04:15.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.072+0000 7f375ce00640 1 -- 172.21.15.89:0/2392070116 shutdown_connections 2024-08-31T04:04:15.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.072+0000 7f375ce00640 1 --2- 172.21.15.89:0/2392070116 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37580c1f40 0x7f37580c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.072+0000 7f375ce00640 1 --2- 172.21.15.89:0/2392070116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f375815bc70 0x7f3758152a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.072+0000 7f375ce00640 1 -- 172.21.15.89:0/2392070116 >> 172.21.15.89:0/2392070116 conn(0x7f37580ccf20 msgr2=0x7f37580cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:15.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.072+0000 7f375ce00640 1 -- 172.21.15.89:0/2392070116 shutdown_connections 2024-08-31T04:04:15.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.072+0000 7f375ce00640 1 -- 172.21.15.89:0/2392070116 wait complete. 2024-08-31T04:04:15.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.072+0000 7f375ce00640 1 Processor -- start 2024-08-31T04:04:15.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 -- start start 2024-08-31T04:04:15.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37580c1f40 0x7f37580c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:15.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37580c7920 0x7f37580cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:15.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f375815bc70 0x7f3758146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:15.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3758074fb0 con 0x7f37580c1f40 2024-08-31T04:04:15.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3758074e30 con 0x7f375815bc70 2024-08-31T04:04:15.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f37580c7d30 con 0x7f37580c7920 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3755e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37580c1f40 0x7f37580c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3755e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37580c1f40 0x7f37580c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35446/0 (socket says 172.21.15.89:35446) 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3755e00640 1 -- 172.21.15.89:0/150012029 learned_addr learned my addr 172.21.15.89:0/150012029 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f374d400640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37580c7920 0x7f37580cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3756800640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f375815bc70 0x7f3758146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3755e00640 1 -- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37580c7920 msgr2=0x7f37580cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3755e00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37580c7920 0x7f37580cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3755e00640 1 -- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f375815bc70 msgr2=0x7f3758146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3755e00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f375815bc70 0x7f3758146910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3755e00640 1 -- 172.21.15.89:0/150012029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3758148340 con 0x7f37580c1f40 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f374d400640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37580c7920 0x7f37580cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:04:15.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f3755e00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37580c1f40 0x7f37580c6220 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f374809b940 tx=0x7f3748005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:15.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f374ea00640 1 -- 172.21.15.89:0/150012029 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37480b5040 con 0x7f37580c1f40 2024-08-31T04:04:15.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f374ea00640 1 -- 172.21.15.89:0/150012029 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37480be070 con 0x7f37580c1f40 2024-08-31T04:04:15.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f374ea00640 1 -- 172.21.15.89:0/150012029 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748003a60 con 0x7f37580c1f40 2024-08-31T04:04:15.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37581effc0 con 0x7f37580c1f40 2024-08-31T04:04:15.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37580c52f0 con 0x7f37580c1f40 2024-08-31T04:04:15.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.076+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37580c9330 con 0x7f37580c1f40 2024-08-31T04:04:15.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.080+0000 7f374ea00640 1 -- 172.21.15.89:0/150012029 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3748003c00 con 0x7f37580c1f40 2024-08-31T04:04:15.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.080+0000 7f374ea00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f37340720f0 0x7f3734074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:15.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.080+0000 7f374ea00640 1 -- 172.21.15.89:0/150012029 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3748130a70 con 0x7f37580c1f40 2024-08-31T04:04:15.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.080+0000 7f374d400640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f37340720f0 0x7f3734074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:15.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.080+0000 7f374d400640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f37340720f0 0x7f3734074600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3740005fd0 tx=0x7f3740005e00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:15.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.084+0000 7f374ea00640 1 -- 172.21.15.89:0/150012029 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3748018b70 con 0x7f37580c1f40 2024-08-31T04:04:15.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.264+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f375814db90 con 0x7f37580c1f40 2024-08-31T04:04:15.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.264+0000 7f374ea00640 1 -- 172.21.15.89:0/150012029 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f37480fbff0 con 0x7f37580c1f40 2024-08-31T04:04:15.266 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2024-08-31T04:04:15.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.264+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f37340720f0 msgr2=0x7f3734074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.264+0000 7f375ce00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f37340720f0 0x7f3734074600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3740005fd0 tx=0x7f3740005e00 comp rx=0 tx=0).stop 2024-08-31T04:04:15.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.264+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37580c1f40 msgr2=0x7f37580c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.264+0000 7f375ce00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37580c1f40 0x7f37580c6220 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f374809b940 tx=0x7f3748005d20 comp rx=0 tx=0).stop 2024-08-31T04:04:15.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.268+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 shutdown_connections 2024-08-31T04:04:15.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.268+0000 7f375ce00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f37340720f0 0x7f3734074600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.268+0000 7f375ce00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f375815bc70 0x7f3758146910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.268+0000 7f375ce00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37580c7920 0x7f37580cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.268+0000 7f375ce00640 1 --2- 172.21.15.89:0/150012029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37580c1f40 0x7f37580c6220 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.268+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 >> 172.21.15.89:0/150012029 conn(0x7f37580ccf20 msgr2=0x7f375815c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:15.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.268+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 shutdown_connections 2024-08-31T04:04:15.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.268+0000 7f375ce00640 1 -- 172.21.15.89:0/150012029 wait complete. 2024-08-31T04:04:15.288 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:04:15.288 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:04:15.297 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-31T04:04:15.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 -- 172.21.15.89:0/2255691820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab6415d220 msgr2=0x7fab64164180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 --2- 172.21.15.89:0/2255691820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab6415d220 0x7fab64164180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009870 tx=0x7fab5c01eed0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 -- 172.21.15.89:0/2255691820 shutdown_connections 2024-08-31T04:04:15.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 --2- 172.21.15.89:0/2255691820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab6415d220 0x7fab64164180 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 --2- 172.21.15.89:0/2255691820 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab64074e20 0x7fab64156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 -- 172.21.15.89:0/2255691820 >> 172.21.15.89:0/2255691820 conn(0x7fab640ccf20 msgr2=0x7fab640cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:15.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 -- 172.21.15.89:0/2255691820 shutdown_connections 2024-08-31T04:04:15.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 -- 172.21.15.89:0/2255691820 wait complete. 2024-08-31T04:04:15.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 Processor -- start 2024-08-31T04:04:15.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.496+0000 7fab6c000640 1 -- start start 2024-08-31T04:04:15.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6c000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab64074e20 0x7fab640cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:15.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6c000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6415ce10 0x7fab64150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:15.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6c000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6415d220 0x7fab64147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:15.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6c000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fab64159c90 con 0x7fab6415ce10 2024-08-31T04:04:15.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6c000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab641599b0 con 0x7fab64074e20 2024-08-31T04:04:15.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6c000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab64159f70 con 0x7fab6415d220 2024-08-31T04:04:15.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab68c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6415ce10 0x7fab64150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab68c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6415ce10 0x7fab64150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35454/0 (socket says 172.21.15.89:35454) 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab68c00640 1 -- 172.21.15.89:0/4107256295 learned_addr learned my addr 172.21.15.89:0/4107256295 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab69600640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab64074e20 0x7fab640cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6a000640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6415d220 0x7fab64147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab68c00640 1 -- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6415d220 msgr2=0x7fab64147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab68c00640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6415d220 0x7fab64147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab68c00640 1 -- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab64074e20 msgr2=0x7fab640cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab68c00640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab64074e20 0x7fab640cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab68c00640 1 -- 172.21.15.89:0/4107256295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab640cbc90 con 0x7fab6415ce10 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab69600640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab64074e20 0x7fab640cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6a000640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6415d220 0x7fab64147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab68c00640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6415ce10 0x7fab64150e40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c530 tx=0x7fab5000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:15.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab61600640 1 -- 172.21.15.89:0/4107256295 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50016020 con 0x7fab6415ce10 2024-08-31T04:04:15.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab61600640 1 -- 172.21.15.89:0/4107256295 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab50012920 con 0x7fab6415ce10 2024-08-31T04:04:15.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab64155130 con 0x7fab6415ce10 2024-08-31T04:04:15.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab61600640 1 -- 172.21.15.89:0/4107256295 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50012d70 con 0x7fab6415ce10 2024-08-31T04:04:15.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab640cc260 con 0x7fab6415ce10 2024-08-31T04:04:15.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.500+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab641517a0 con 0x7fab6415ce10 2024-08-31T04:04:15.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.504+0000 7fab61600640 1 -- 172.21.15.89:0/4107256295 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fab50019020 con 0x7fab6415ce10 2024-08-31T04:04:15.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.504+0000 7fab61600640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab440720f0 0x7fab44074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:15.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.504+0000 7fab61600640 1 -- 172.21.15.89:0/4107256295 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fab500929a0 con 0x7fab6415ce10 2024-08-31T04:04:15.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.504+0000 7fab69600640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab440720f0 0x7fab44074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:15.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.504+0000 7fab69600640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab440720f0 0x7fab44074600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab58009f70 tx=0x7fab58009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:15.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.508+0000 7fab61600640 1 -- 172.21.15.89:0/4107256295 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fab50020070 con 0x7fab6415ce10 2024-08-31T04:04:15.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fab640cc080 con 0x7fab6415ce10 2024-08-31T04:04:15.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab61600640 1 -- 172.21.15.89:0/4107256295 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fab640cc080 con 0x7fab6415ce10 2024-08-31T04:04:15.686 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab440720f0 msgr2=0x7fab44074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab440720f0 0x7fab44074600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab58009f70 tx=0x7fab58009500 comp rx=0 tx=0).stop 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6415ce10 msgr2=0x7fab64150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6415ce10 0x7fab64150e40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c530 tx=0x7fab5000c9f0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 shutdown_connections 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab440720f0 0x7fab44074600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab6415ce10 0x7fab64150e40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab6415d220 0x7fab64147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 --2- 172.21.15.89:0/4107256295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab64074e20 0x7fab640cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:15.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 >> 172.21.15.89:0/4107256295 conn(0x7fab640ccf20 msgr2=0x7fab6414ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:15.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 shutdown_connections 2024-08-31T04:04:15.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:15.684+0000 7fab6c000640 1 -- 172.21.15.89:0/4107256295 wait complete. 2024-08-31T04:04:15.707 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi089.front.sepia.ceph.com... 2024-08-31T04:04:15.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:15.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-31T04:04:15.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi089.stderr:ceph-fuse[35722]: fuse finished with error 0 and tester_r 0 2024-08-31T04:04:15.736 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:04:21.837 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:04:21.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:21.838 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-31T04:04:21.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:22.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 -- 172.21.15.89:0/1014212412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5eb00cc100 msgr2=0x7f5eb00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 --2- 172.21.15.89:0/1014212412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5eb00cc100 0x7f5eb00cf320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009bc0 tx=0x7f5ea801f3b0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 -- 172.21.15.89:0/1014212412 shutdown_connections 2024-08-31T04:04:22.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 --2- 172.21.15.89:0/1014212412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5eb00cc100 0x7f5eb00cf320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 --2- 172.21.15.89:0/1014212412 >> v2:172.21.15.170:3300/0 conn(0x7f5eb0150520 0x7f5eb00c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 -- 172.21.15.89:0/1014212412 >> 172.21.15.89:0/1014212412 conn(0x7f5eb0071a00 msgr2=0x7f5eb006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:22.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 -- 172.21.15.89:0/1014212412 shutdown_connections 2024-08-31T04:04:22.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 -- 172.21.15.89:0/1014212412 wait complete. 2024-08-31T04:04:22.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 Processor -- start 2024-08-31T04:04:22.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.056+0000 7f5eb6400640 1 -- start start 2024-08-31T04:04:22.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eb6400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb00cc100 0x7f5eb006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eb6400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5eb00cef10 0x7f5eb01f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eb6400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb0150520 0x7f5eb014baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eb6400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0159ed0 con 0x7f5eb0150520 2024-08-31T04:04:22.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eb6400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0159bf0 con 0x7f5eb00cc100 2024-08-31T04:04:22.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eb6400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb015a1b0 con 0x7f5eb00cef10 2024-08-31T04:04:22.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb0150520 0x7f5eb014baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb0150520 0x7f5eb014baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41406/0 (socket says 172.21.15.89:41406) 2024-08-31T04:04:22.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eafe00640 1 -- 172.21.15.89:0/1690947016 learned_addr learned my addr 172.21.15.89:0/1690947016 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:22.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eaf400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb00cc100 0x7f5eb006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eaea00640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5eb00cef10 0x7f5eb01f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eafe00640 1 -- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5eb00cef10 msgr2=0x7f5eb01f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eafe00640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5eb00cef10 0x7f5eb01f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eafe00640 1 -- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb00cc100 msgr2=0x7f5eb006e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eafe00640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb00cc100 0x7f5eb006e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eafe00640 1 -- 172.21.15.89:0/1690947016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb01f2fa0 con 0x7f5eb0150520 2024-08-31T04:04:22.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eaea00640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5eb00cef10 0x7f5eb01f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:22.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eafe00640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb0150520 0x7f5eb014baf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ea801cfe0 tx=0x7f5ea8003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:22.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5ea7400640 1 -- 172.21.15.89:0/1690947016 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80b4040 con 0x7f5eb0150520 2024-08-31T04:04:22.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5ea7400640 1 -- 172.21.15.89:0/1690947016 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ea80be070 con 0x7f5eb0150520 2024-08-31T04:04:22.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5ea7400640 1 -- 172.21.15.89:0/1690947016 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80af8a0 con 0x7f5eb0150520 2024-08-31T04:04:22.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb014e160 con 0x7f5eb0150520 2024-08-31T04:04:22.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb01f31b0 con 0x7f5eb0150520 2024-08-31T04:04:22.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.060+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb0153d80 con 0x7f5eb0150520 2024-08-31T04:04:22.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.064+0000 7f5ea7400640 1 -- 172.21.15.89:0/1690947016 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f5ea80afa40 con 0x7f5eb0150520 2024-08-31T04:04:22.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.064+0000 7f5ea7400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e900720f0 0x7f5e90074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.064+0000 7f5ea7400640 1 -- 172.21.15.89:0/1690947016 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5ea81310a0 con 0x7f5eb0150520 2024-08-31T04:04:22.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.064+0000 7f5eaf400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e900720f0 0x7f5e90074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.064+0000 7f5eaf400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e900720f0 0x7f5e90074600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009600 tx=0x7f5ea00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:22.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.068+0000 7f5ea7400640 1 -- 172.21.15.89:0/1690947016 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5ea8018f10 con 0x7f5eb0150520 2024-08-31T04:04:22.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.236+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5eb0146bc0 con 0x7f5eb0150520 2024-08-31T04:04:22.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.236+0000 7f5ea7400640 1 -- 172.21.15.89:0/1690947016 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18602 (secure 0 0 0) 0x7f5ea80fc580 con 0x7f5eb0150520 2024-08-31T04:04:22.240 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:22.240 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:05.324706+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:22.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e900720f0 msgr2=0x7f5e90074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e900720f0 0x7f5e90074600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009600 tx=0x7f5ea00091e0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb0150520 msgr2=0x7f5eb014baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb0150520 0x7f5eb014baf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ea801cfe0 tx=0x7f5ea8003f60 comp rx=0 tx=0).stop 2024-08-31T04:04:22.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 shutdown_connections 2024-08-31T04:04:22.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e900720f0 0x7f5e90074600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5eb0150520 0x7f5eb014baf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5eb00cef10 0x7f5eb01f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 --2- 172.21.15.89:0/1690947016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb00cc100 0x7f5eb006e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 >> 172.21.15.89:0/1690947016 conn(0x7f5eb0071a00 msgr2=0x7f5eb00ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:22.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 shutdown_connections 2024-08-31T04:04:22.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.240+0000 7f5eb6400640 1 -- 172.21.15.89:0/1690947016 wait complete. 2024-08-31T04:04:22.262 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:22.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.412+0000 7f10d4000640 1 -- 172.21.15.89:0/2621008476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc0c97e0 msgr2=0x7f10cc156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.412+0000 7f10d4000640 1 --2- 172.21.15.89:0/2621008476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc0c97e0 0x7f10cc156b70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009900 tx=0x7f10c001c8e0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.412+0000 7f10d4000640 1 -- 172.21.15.89:0/2621008476 shutdown_connections 2024-08-31T04:04:22.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.412+0000 7f10d4000640 1 --2- 172.21.15.89:0/2621008476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc15a370 0x7f10cc164070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.412+0000 7f10d4000640 1 --2- 172.21.15.89:0/2621008476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc0c97e0 0x7f10cc156b70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.412+0000 7f10d4000640 1 -- 172.21.15.89:0/2621008476 >> 172.21.15.89:0/2621008476 conn(0x7f10cc071be0 msgr2=0x7f10cc06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:22.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.412+0000 7f10d4000640 1 -- 172.21.15.89:0/2621008476 shutdown_connections 2024-08-31T04:04:22.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.412+0000 7f10d4000640 1 -- 172.21.15.89:0/2621008476 wait complete. 2024-08-31T04:04:22.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d4000640 1 Processor -- start 2024-08-31T04:04:22.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d4000640 1 -- start start 2024-08-31T04:04:22.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d4000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc0c97e0 0x7f10cc0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d4000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc159f60 0x7f10cc0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d4000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc15a370 0x7f10cc15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d4000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc1570b0 con 0x7f10cc15a370 2024-08-31T04:04:22.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d4000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc0cac70 con 0x7f10cc159f60 2024-08-31T04:04:22.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d4000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f10cc1596f0 con 0x7f10cc0c97e0 2024-08-31T04:04:22.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc15a370 0x7f10cc15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc15a370 0x7f10cc15caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41426/0 (socket says 172.21.15.89:41426) 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d2000640 1 -- 172.21.15.89:0/3114411965 learned_addr learned my addr 172.21.15.89:0/3114411965 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d1600640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc0c97e0 0x7f10cc0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d0c00640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc159f60 0x7f10cc0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d2000640 1 -- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc0c97e0 msgr2=0x7f10cc0cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d2000640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc0c97e0 0x7f10cc0cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d2000640 1 -- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc159f60 msgr2=0x7f10cc0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d2000640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc159f60 0x7f10cc0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.416+0000 7f10d2000640 1 -- 172.21.15.89:0/3114411965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc0cd5f0 con 0x7f10cc15a370 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10d2000640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc15a370 0x7f10cc15caa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10c400e940 tx=0x7f10c400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10c9600640 1 -- 172.21.15.89:0/3114411965 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c4004d30 con 0x7f10cc15a370 2024-08-31T04:04:22.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10c9600640 1 -- 172.21.15.89:0/3114411965 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10c400cb20 con 0x7f10cc15a370 2024-08-31T04:04:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10cc06d650 con 0x7f10cc15a370 2024-08-31T04:04:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10c9600640 1 -- 172.21.15.89:0/3114411965 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c4005020 con 0x7f10cc15a370 2024-08-31T04:04:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10cc1f5bc0 con 0x7f10cc15a370 2024-08-31T04:04:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10cc0c5d30 con 0x7f10cc15a370 2024-08-31T04:04:22.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10c9600640 1 -- 172.21.15.89:0/3114411965 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f10c40051c0 con 0x7f10cc15a370 2024-08-31T04:04:22.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10c9600640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10ac0720c0 0x7f10ac0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.420+0000 7f10c9600640 1 -- 172.21.15.89:0/3114411965 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f10c4093650 con 0x7f10cc15a370 2024-08-31T04:04:22.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.424+0000 7f10d1600640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10ac0720c0 0x7f10ac0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.424+0000 7f10d1600640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10ac0720c0 0x7f10ac0745d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10c00af000 tx=0x7f10c001b120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:22.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.428+0000 7f10c9600640 1 -- 172.21.15.89:0/3114411965 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f10c4016030 con 0x7f10cc15a370 2024-08-31T04:04:22.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.596+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10cc154f50 con 0x7f10cc15a370 2024-08-31T04:04:22.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.596+0000 7f10c9600640 1 -- 172.21.15.89:0/3114411965 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18602 (secure 0 0 0) 0x7f10c4067100 con 0x7f10cc15a370 2024-08-31T04:04:22.599 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:22.599 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:05.324706+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10ac0720c0 msgr2=0x7f10ac0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10ac0720c0 0x7f10ac0745d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10c00af000 tx=0x7f10c001b120 comp rx=0 tx=0).stop 2024-08-31T04:04:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc15a370 msgr2=0x7f10cc15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc15a370 0x7f10cc15caa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10c400e940 tx=0x7f10c400ee00 comp rx=0 tx=0).stop 2024-08-31T04:04:22.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 shutdown_connections 2024-08-31T04:04:22.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10ac0720c0 0x7f10ac0745d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc15a370 0x7f10cc15caa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc159f60 0x7f10cc0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 --2- 172.21.15.89:0/3114411965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc0c97e0 0x7f10cc0cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 >> 172.21.15.89:0/3114411965 conn(0x7f10cc071be0 msgr2=0x7f10cc163ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:22.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 shutdown_connections 2024-08-31T04:04:22.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.600+0000 7f10d4000640 1 -- 172.21.15.89:0/3114411965 wait complete. 2024-08-31T04:04:22.621 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-31T04:04:22.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.776+0000 7fa0c6e00640 1 -- 172.21.15.89:0/2656433858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c0158bf0 msgr2=0x7fa0c0159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.776+0000 7fa0c6e00640 1 --2- 172.21.15.89:0/2656433858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c0158bf0 0x7fa0c0159000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0073700 tx=0x7fa0b801f580 comp rx=0 tx=0).stop 2024-08-31T04:04:22.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.776+0000 7fa0c6e00640 1 -- 172.21.15.89:0/2656433858 shutdown_connections 2024-08-31T04:04:22.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.776+0000 7fa0c6e00640 1 --2- 172.21.15.89:0/2656433858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c0158bf0 0x7fa0c0159000 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.776+0000 7fa0c6e00640 1 --2- 172.21.15.89:0/2656433858 >> v2:172.21.15.170:3300/0 conn(0x7fa0c00c8840 0x7fa0c0152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.776+0000 7fa0c6e00640 1 -- 172.21.15.89:0/2656433858 >> 172.21.15.89:0/2656433858 conn(0x7fa0c0072370 msgr2=0x7fa0c00cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:22.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.776+0000 7fa0c6e00640 1 -- 172.21.15.89:0/2656433858 shutdown_connections 2024-08-31T04:04:22.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.776+0000 7fa0c6e00640 1 -- 172.21.15.89:0/2656433858 wait complete. 2024-08-31T04:04:22.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 Processor -- start 2024-08-31T04:04:22.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 -- start start 2024-08-31T04:04:22.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0c00c8840 0x7fa0c01f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c00c8ee0 0x7fa0c014a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0c0158bf0 0x7fa0c01e48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c00c4930 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01586d0 con 0x7fa0c0158bf0 2024-08-31T04:04:22.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c00c4ab0 con 0x7fa0c00c8840 2024-08-31T04:04:22.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c00c8ee0 0x7fa0c014a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c00c8ee0 0x7fa0c014a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41432/0 (socket says 172.21.15.89:41432) 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5000640 1 -- 172.21.15.89:0/1353458474 learned_addr learned my addr 172.21.15.89:0/1353458474 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6400640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0c0158bf0 0x7fa0c01e48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5a00640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0c00c8840 0x7fa0c01f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5000640 1 -- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0c00c8840 msgr2=0x7fa0c01f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5000640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0c00c8840 0x7fa0c01f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5000640 1 -- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0c0158bf0 msgr2=0x7fa0c01e48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5000640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0c0158bf0 0x7fa0c01e48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5000640 1 -- 172.21.15.89:0/1353458474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c01e5610 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c5000640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c00c8ee0 0x7fa0c014a130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00c3f0 tx=0x7fa0ac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:22.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0bd600640 1 -- 172.21.15.89:0/1353458474 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac017070 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0bd600640 1 -- 172.21.15.89:0/1353458474 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0ac0053c0 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c01ef980 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0bd600640 1 -- 172.21.15.89:0/1353458474 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac003860 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.780+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c014a670 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.784+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c00c72b0 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.784+0000 7fa0bd600640 1 -- 172.21.15.89:0/1353458474 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa0ac01a070 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.784+0000 7fa0bd600640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0a00720f0 0x7fa0a0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:22.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.784+0000 7fa0bd600640 1 -- 172.21.15.89:0/1353458474 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa0ac0921d0 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.784+0000 7fa0c5a00640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0a00720f0 0x7fa0a0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:22.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.784+0000 7fa0c5a00640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0a00720f0 0x7fa0a0074600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40058d0 tx=0x7fa0b4005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:22.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.788+0000 7fa0bd600640 1 -- 172.21.15.89:0/1353458474 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa0ac05d750 con 0x7fa0c00c8ee0 2024-08-31T04:04:22.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:22.988+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa0c01570d0 con 0x7fa0c00c8ee0 2024-08-31T04:04:23.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0bd600640 1 -- 172.21.15.89:0/1353458474 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa0ac05d050 con 0x7fa0c00c8ee0 2024-08-31T04:04:23.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0a00720f0 msgr2=0x7fa0a0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:23.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0a00720f0 0x7fa0a0074600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40058d0 tx=0x7fa0b4005860 comp rx=0 tx=0).stop 2024-08-31T04:04:23.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c00c8ee0 msgr2=0x7fa0c014a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c00c8ee0 0x7fa0c014a130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00c3f0 tx=0x7fa0ac00c8b0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 shutdown_connections 2024-08-31T04:04:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0a00720f0 0x7fa0a0074600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c00c8ee0 0x7fa0c014a130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0c0158bf0 0x7fa0c01e48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 --2- 172.21.15.89:0/1353458474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0c00c8840 0x7fa0c01f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 >> 172.21.15.89:0/1353458474 conn(0x7fa0c0072370 msgr2=0x7fa0c014ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 shutdown_connections 2024-08-31T04:04:23.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.188+0000 7fa0c6e00640 1 -- 172.21.15.89:0/1353458474 wait complete. 2024-08-31T04:04:23.211 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300} 2024-08-31T04:04:23.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-31T04:04:23.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.364+0000 7f3175400640 1 -- 172.21.15.89:0/1468320591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3170074d50 msgr2=0x7f317015a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:23.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.364+0000 7f3175400640 1 --2- 172.21.15.89:0/1468320591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3170074d50 0x7f317015a120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f31700b31d0 tx=0x7f316001c8c0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.364+0000 7f3175400640 1 -- 172.21.15.89:0/1468320591 shutdown_connections 2024-08-31T04:04:23.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.364+0000 7f3175400640 1 --2- 172.21.15.89:0/1468320591 >> v2:172.21.15.170:3300/0 conn(0x7f317006f3f0 0x7f317006f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.364+0000 7f3175400640 1 --2- 172.21.15.89:0/1468320591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3170074d50 0x7f317015a120 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.364+0000 7f3175400640 1 -- 172.21.15.89:0/1468320591 >> 172.21.15.89:0/1468320591 conn(0x7f31700c99b0 msgr2=0x7f31700c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:23.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.364+0000 7f3175400640 1 -- 172.21.15.89:0/1468320591 shutdown_connections 2024-08-31T04:04:23.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.364+0000 7f3175400640 1 -- 172.21.15.89:0/1468320591 wait complete. 2024-08-31T04:04:23.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f3175400640 1 Processor -- start 2024-08-31T04:04:23.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f3175400640 1 -- start start 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f3175400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f317006f3f0 0x7f31701f9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f3175400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170074d50 0x7f317014f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f3175400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3170153800 0x7f317013d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f3175400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3170073e70 con 0x7f317006f3f0 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f3175400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3170073b90 con 0x7f3170153800 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f3175400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3170069fc0 con 0x7f3170074d50 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f317006f3f0 0x7f31701f9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f317006f3f0 0x7f31701f9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41460/0 (socket says 172.21.15.89:41460) 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316e800640 1 -- 172.21.15.89:0/3585615009 learned_addr learned my addr 172.21.15.89:0/3585615009 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316f200640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3170153800 0x7f317013d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:23.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316de00640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170074d50 0x7f317014f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:23.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316e800640 1 -- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170074d50 msgr2=0x7f317014f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:23.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316e800640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170074d50 0x7f317014f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316e800640 1 -- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3170153800 msgr2=0x7f317013d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:23.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316e800640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3170153800 0x7f317013d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:23.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.368+0000 7f316e800640 1 -- 172.21.15.89:0/3585615009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317014f940 con 0x7f317006f3f0 2024-08-31T04:04:23.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f316e800640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f317006f3f0 0x7f31701f9440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f31600b0040 tx=0x7f31600a57c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f3166a00640 1 -- 172.21.15.89:0/3585615009 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31600b2040 con 0x7f317006f3f0 2024-08-31T04:04:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f3166a00640 1 -- 172.21.15.89:0/3585615009 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31600044b0 con 0x7f317006f3f0 2024-08-31T04:04:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317013d600 con 0x7f317006f3f0 2024-08-31T04:04:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f3166a00640 1 -- 172.21.15.89:0/3585615009 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160003860 con 0x7f317006f3f0 2024-08-31T04:04:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31701580d0 con 0x7f317006f3f0 2024-08-31T04:04:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3170153cf0 con 0x7f317006f3f0 2024-08-31T04:04:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f3166a00640 1 -- 172.21.15.89:0/3585615009 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3160003a00 con 0x7f317006f3f0 2024-08-31T04:04:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f3166a00640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31500720c0 0x7f31500745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.372+0000 7f3166a00640 1 -- 172.21.15.89:0/3585615009 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f316012ce00 con 0x7f317006f3f0 2024-08-31T04:04:23.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.376+0000 7f316de00640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31500720c0 0x7f31500745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:23.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.376+0000 7f316de00640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31500720c0 0x7f31500745d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3170151f50 tx=0x7f315c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:23.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.376+0000 7f3166a00640 1 -- 172.21.15.89:0/3585615009 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f31600bd060 con 0x7f317006f3f0 2024-08-31T04:04:23.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:23.576+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f31700b2c10 con 0x7f317006f3f0 2024-08-31T04:04:24.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.196+0000 7f3166a00640 1 -- 172.21.15.89:0/3585615009 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f31600164b0 con 0x7f317006f3f0 2024-08-31T04:04:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.196+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31500720c0 msgr2=0x7f31500745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.196+0000 7f3175400640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31500720c0 0x7f31500745d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3170151f50 tx=0x7f315c008040 comp rx=0 tx=0).stop 2024-08-31T04:04:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f317006f3f0 msgr2=0x7f31701f9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f317006f3f0 0x7f31701f9440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f31600b0040 tx=0x7f31600a57c0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 shutdown_connections 2024-08-31T04:04:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31500720c0 0x7f31500745d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3170153800 0x7f317013d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170074d50 0x7f317014f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 --2- 172.21.15.89:0/3585615009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f317006f3f0 0x7f31701f9440 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 >> 172.21.15.89:0/3585615009 conn(0x7f31700c99b0 msgr2=0x7f31701477c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:24.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 shutdown_connections 2024-08-31T04:04:24.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.200+0000 7f3175400640 1 -- 172.21.15.89:0/3585615009 wait complete. 2024-08-31T04:04:24.221 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-08-31T04:04:24.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.372+0000 7fdec8600640 1 -- 172.21.15.89:0/1405778499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00c4ce0 msgr2=0x7fdec01538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:24.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.372+0000 7fdec8600640 1 --2- 172.21.15.89:0/1405778499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00c4ce0 0x7fdec01538e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdec0071070 tx=0x7fdeb401c8c0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 -- 172.21.15.89:0/1405778499 shutdown_connections 2024-08-31T04:04:24.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 --2- 172.21.15.89:0/1405778499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00ca9a0 0x7fdec015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 --2- 172.21.15.89:0/1405778499 >> v2:172.21.15.170:3300/0 conn(0x7fdec00c4790 0x7fdec00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 --2- 172.21.15.89:0/1405778499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00c4ce0 0x7fdec01538e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 -- 172.21.15.89:0/1405778499 >> 172.21.15.89:0/1405778499 conn(0x7fdec0073630 msgr2=0x7fdec0073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:24.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 -- 172.21.15.89:0/1405778499 shutdown_connections 2024-08-31T04:04:24.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 -- 172.21.15.89:0/1405778499 wait complete. 2024-08-31T04:04:24.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 Processor -- start 2024-08-31T04:04:24.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 -- start start 2024-08-31T04:04:24.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec00c4790 0x7fdec0151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:24.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00c4ce0 0x7fdec013a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:24.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ca9a0 0x7fdec013ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:24.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdec00c3fe0 con 0x7fdec00ca9a0 2024-08-31T04:04:24.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdec0153e20 con 0x7fdec00c4790 2024-08-31T04:04:24.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec8600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdec014e1d0 con 0x7fdec00c4ce0 2024-08-31T04:04:24.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec6600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ca9a0 0x7fdec013ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:24.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec6600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ca9a0 0x7fdec013ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41482/0 (socket says 172.21.15.89:41482) 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.376+0000 7fdec6600640 1 -- 172.21.15.89:0/1861684860 learned_addr learned my addr 172.21.15.89:0/1861684860 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec5200640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00c4ce0 0x7fdec013a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec5c00640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec00c4790 0x7fdec0151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec6600640 1 -- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00c4ce0 msgr2=0x7fdec013a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec6600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00c4ce0 0x7fdec013a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec6600640 1 -- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec00c4790 msgr2=0x7fdec0151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec6600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec00c4790 0x7fdec0151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec6600640 1 -- 172.21.15.89:0/1861684860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec01f7830 con 0x7fdec00ca9a0 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec5200640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00c4ce0 0x7fdec013a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec5c00640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec00c4790 0x7fdec0151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec6600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ca9a0 0x7fdec013ae10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800e9a0 tx=0x7fdeb800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdebd600640 1 -- 172.21.15.89:0/1861684860 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8004d30 con 0x7fdec00ca9a0 2024-08-31T04:04:24.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdebd600640 1 -- 172.21.15.89:0/1861684860 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeb800cb20 con 0x7fdec00ca9a0 2024-08-31T04:04:24.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec01f6a70 con 0x7fdec00ca9a0 2024-08-31T04:04:24.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdebd600640 1 -- 172.21.15.89:0/1861684860 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8005020 con 0x7fdec00ca9a0 2024-08-31T04:04:24.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec01f7030 con 0x7fdec00ca9a0 2024-08-31T04:04:24.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec01538e0 con 0x7fdec00ca9a0 2024-08-31T04:04:24.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.380+0000 7fdebd600640 1 -- 172.21.15.89:0/1861684860 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdeb80051c0 con 0x7fdec00ca9a0 2024-08-31T04:04:24.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.384+0000 7fdebd600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdea00720c0 0x7fdea00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:24.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.384+0000 7fdebd600640 1 -- 172.21.15.89:0/1861684860 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdeb8093810 con 0x7fdec00ca9a0 2024-08-31T04:04:24.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.384+0000 7fdec5c00640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdea00720c0 0x7fdea00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:24.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.384+0000 7fdec5c00640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdea00720c0 0x7fdea00745d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40af000 tx=0x7fdeb401b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:24.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.388+0000 7fdebd600640 1 -- 172.21.15.89:0/1861684860 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdeb8016030 con 0x7fdec00ca9a0 2024-08-31T04:04:24.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:24.584+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fdec0157270 con 0x7fdec00ca9a0 2024-08-31T04:04:25.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.204+0000 7fdebd600640 1 -- 172.21.15.89:0/1861684860 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7fdeb805ee10 con 0x7fdec00ca9a0 2024-08-31T04:04:25.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdea00720c0 msgr2=0x7fdea00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdea00720c0 0x7fdea00745d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40af000 tx=0x7fdeb401b100 comp rx=0 tx=0).stop 2024-08-31T04:04:25.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ca9a0 msgr2=0x7fdec013ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ca9a0 0x7fdec013ae10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800e9a0 tx=0x7fdeb800ee60 comp rx=0 tx=0).stop 2024-08-31T04:04:25.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 shutdown_connections 2024-08-31T04:04:25.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdea00720c0 0x7fdea00745d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdec00ca9a0 0x7fdec013ae10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00c4ce0 0x7fdec013a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 --2- 172.21.15.89:0/1861684860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec00c4790 0x7fdec0151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 >> 172.21.15.89:0/1861684860 conn(0x7fdec0073630 msgr2=0x7fdec00cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:25.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 shutdown_connections 2024-08-31T04:04:25.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.208+0000 7fdec8600640 1 -- 172.21.15.89:0/1861684860 wait complete. 2024-08-31T04:04:25.231 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-31T04:04:25.231 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:25.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 -- 172.21.15.89:0/3626403302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00c8810 msgr2=0x7f60f00c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 --2- 172.21.15.89:0/3626403302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00c8810 0x7f60f00c8c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f60f0070fd0 tx=0x7f60e801c570 comp rx=0 tx=0).stop 2024-08-31T04:04:25.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 -- 172.21.15.89:0/3626403302 shutdown_connections 2024-08-31T04:04:25.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 --2- 172.21.15.89:0/3626403302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00c8810 0x7f60f00c8c20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 --2- 172.21.15.89:0/3626403302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60f00b2900 0x7f60f01520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 -- 172.21.15.89:0/3626403302 >> 172.21.15.89:0/3626403302 conn(0x7f60f00ccf20 msgr2=0x7f60f00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:25.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 -- 172.21.15.89:0/3626403302 shutdown_connections 2024-08-31T04:04:25.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 -- 172.21.15.89:0/3626403302 wait complete. 2024-08-31T04:04:25.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 Processor -- start 2024-08-31T04:04:25.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.384+0000 7f60f6800640 1 -- start start 2024-08-31T04:04:25.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60f6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00b2900 0x7f60f01f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:25.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60f6800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60f00b2fe0 0x7f60f00cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:25.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60f6800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60f00c8810 0x7f60f01529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:25.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60f6800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f60f0158980 con 0x7f60f00b2900 2024-08-31T04:04:25.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60f6800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f60f0158800 con 0x7f60f00b2fe0 2024-08-31T04:04:25.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60f6800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f60f0162750 con 0x7f60f00c8810 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60ef400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00b2900 0x7f60f01f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60ef400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00b2900 0x7f60f01f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41496/0 (socket says 172.21.15.89:41496) 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60ef400640 1 -- 172.21.15.89:0/2373364235 learned_addr learned my addr 172.21.15.89:0/2373364235 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60efe00640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60f00c8810 0x7f60f01529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60eea00640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60f00b2fe0 0x7f60f00cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60ef400640 1 -- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60f00c8810 msgr2=0x7f60f01529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60ef400640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60f00c8810 0x7f60f01529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60ef400640 1 -- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60f00b2fe0 msgr2=0x7f60f00cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60ef400640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60f00b2fe0 0x7f60f00cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60ef400640 1 -- 172.21.15.89:0/2373364235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f01f5d10 con 0x7f60f00b2900 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60ef400640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00b2900 0x7f60f01f57d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60e000ba80 tx=0x7f60e000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60e7400640 1 -- 172.21.15.89:0/2373364235 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e000cba0 con 0x7f60f00b2900 2024-08-31T04:04:25.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60e7400640 1 -- 172.21.15.89:0/2373364235 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60e000ce30 con 0x7f60f00b2900 2024-08-31T04:04:25.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60e7400640 1 -- 172.21.15.89:0/2373364235 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0003be0 con 0x7f60f00b2900 2024-08-31T04:04:25.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f0156460 con 0x7f60f00b2900 2024-08-31T04:04:25.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f01f8cc0 con 0x7f60f00b2900 2024-08-31T04:04:25.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.388+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f01520f0 con 0x7f60f00b2900 2024-08-31T04:04:25.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.392+0000 7f60e7400640 1 -- 172.21.15.89:0/2373364235 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f60e0006d10 con 0x7f60f00b2900 2024-08-31T04:04:25.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.392+0000 7f60e7400640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f60d00720c0 0x7f60d00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:25.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.392+0000 7f60e7400640 1 -- 172.21.15.89:0/2373364235 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f60e0092b00 con 0x7f60f00b2900 2024-08-31T04:04:25.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.392+0000 7f60eea00640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f60d00720c0 0x7f60d00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:25.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.392+0000 7f60eea00640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f60d00720c0 0x7f60d00745d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0058d0 tx=0x7f60dc005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:25.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.396+0000 7f60e7400640 1 -- 172.21.15.89:0/2373364235 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f60e005e110 con 0x7f60f00b2900 2024-08-31T04:04:25.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.592+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60f00c2fb0 con 0x7f60f00b2900 2024-08-31T04:04:25.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60e7400640 1 -- 172.21.15.89:0/2373364235 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f60e005da10 con 0x7f60f00b2900 2024-08-31T04:04:25.597 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:25.597 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:25.597 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:04:25.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f60d00720c0 msgr2=0x7f60d00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f60d00720c0 0x7f60d00745d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0058d0 tx=0x7f60dc005860 comp rx=0 tx=0).stop 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00b2900 msgr2=0x7f60f01f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00b2900 0x7f60f01f57d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60e000ba80 tx=0x7f60e000bf40 comp rx=0 tx=0).stop 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 shutdown_connections 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f60d00720c0 0x7f60d00745d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60f00c8810 0x7f60f01529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60f00b2fe0 0x7f60f00cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 --2- 172.21.15.89:0/2373364235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f00b2900 0x7f60f01f57d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 >> 172.21.15.89:0/2373364235 conn(0x7f60f00ccf20 msgr2=0x7f60f0156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 shutdown_connections 2024-08-31T04:04:25.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.596+0000 7f60f6800640 1 -- 172.21.15.89:0/2373364235 wait complete. 2024-08-31T04:04:25.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:25.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.772+0000 7fb328800640 1 -- 172.21.15.89:0/2964205192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 msgr2=0x7fb30800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.772+0000 7fb328800640 1 --2- 172.21.15.89:0/2964205192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 0x7fb30800b9d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3200c89e0 tx=0x7fb31c01d260 comp rx=0 tx=0).stop 2024-08-31T04:04:25.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.772+0000 7fb328800640 1 -- 172.21.15.89:0/2964205192 shutdown_connections 2024-08-31T04:04:25.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.772+0000 7fb328800640 1 --2- 172.21.15.89:0/2964205192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 0x7fb30800b9d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.772+0000 7fb328800640 1 -- 172.21.15.89:0/2964205192 >> 172.21.15.89:0/2964205192 conn(0x7fb320072590 msgr2=0x7fb3200cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:25.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.772+0000 7fb328800640 1 -- 172.21.15.89:0/2964205192 shutdown_connections 2024-08-31T04:04:25.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.772+0000 7fb328800640 1 -- 172.21.15.89:0/2964205192 wait complete. 2024-08-31T04:04:25.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.772+0000 7fb328800640 1 Processor -- start 2024-08-31T04:04:25.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.772+0000 7fb328800640 1 -- start start 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb328800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 0x7fb3201efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb328800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3200b9940 0x7fb320152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb328800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3200ba6e0 0x7fb3200baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb328800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb3200c8e20 con 0x7fb308005260 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb328800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb320159670 con 0x7fb3200b9940 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb328800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb3200c4b60 con 0x7fb3200ba6e0 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 0x7fb3201efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 0x7fb3201efb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41526/0 (socket says 172.21.15.89:41526) 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325e00640 1 -- 172.21.15.89:0/3430169426 learned_addr learned my addr 172.21.15.89:0/3430169426 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:25.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325400640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3200b9940 0x7fb320152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:25.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb326800640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3200ba6e0 0x7fb3200baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:25.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325e00640 1 -- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3200ba6e0 msgr2=0x7fb3200baaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325e00640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3200ba6e0 0x7fb3200baaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325e00640 1 -- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3200b9940 msgr2=0x7fb320152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325e00640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3200b9940 0x7fb320152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325e00640 1 -- 172.21.15.89:0/3430169426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3201f00a0 con 0x7fb308005260 2024-08-31T04:04:25.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb326800640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3200ba6e0 0x7fb3200baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:25.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325400640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3200b9940 0x7fb320152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:25.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb325e00640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 0x7fb3201efb60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb314003ee0 tx=0x7fb314001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:25.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb31a000640 1 -- 172.21.15.89:0/3430169426 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314015070 con 0x7fb308005260 2024-08-31T04:04:25.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb31a000640 1 -- 172.21.15.89:0/3430169426 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb314011840 con 0x7fb308005260 2024-08-31T04:04:25.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb31a000640 1 -- 172.21.15.89:0/3430169426 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314011c70 con 0x7fb308005260 2024-08-31T04:04:25.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3201550f0 con 0x7fb308005260 2024-08-31T04:04:25.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb320155690 con 0x7fb308005260 2024-08-31T04:04:25.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.776+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3200c81f0 con 0x7fb308005260 2024-08-31T04:04:25.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.780+0000 7fb31a000640 1 -- 172.21.15.89:0/3430169426 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb314018070 con 0x7fb308005260 2024-08-31T04:04:25.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.780+0000 7fb31a000640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb3040720f0 0x7fb304074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:25.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.780+0000 7fb31a000640 1 -- 172.21.15.89:0/3430169426 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb314093b80 con 0x7fb308005260 2024-08-31T04:04:25.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.780+0000 7fb325400640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb3040720f0 0x7fb304074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:25.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.780+0000 7fb325400640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb3040720f0 0x7fb304074600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3201ecf00 tx=0x7fb3100091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:25.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.784+0000 7fb31a000640 1 -- 172.21.15.89:0/3430169426 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb31405f0f0 con 0x7fb308005260 2024-08-31T04:04:25.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.952+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb320068d80 con 0x7fb308005260 2024-08-31T04:04:25.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.952+0000 7fb31a000640 1 -- 172.21.15.89:0/3430169426 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18602 (secure 0 0 0) 0x7fb31405e9f0 con 0x7fb308005260 2024-08-31T04:04:25.955 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:25.955 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:05.324706+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb3040720f0 msgr2=0x7fb304074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb3040720f0 0x7fb304074600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3201ecf00 tx=0x7fb3100091e0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 msgr2=0x7fb3201efb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 0x7fb3201efb60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb314003ee0 tx=0x7fb314001640 comp rx=0 tx=0).stop 2024-08-31T04:04:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 shutdown_connections 2024-08-31T04:04:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb3040720f0 0x7fb304074600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3200ba6e0 0x7fb3200baaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3200b9940 0x7fb320152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 --2- 172.21.15.89:0/3430169426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb308005260 0x7fb3201efb60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:25.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 >> 172.21.15.89:0/3430169426 conn(0x7fb320072590 msgr2=0x7fb3200c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:25.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 shutdown_connections 2024-08-31T04:04:25.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:25.956+0000 7fb328800640 1 -- 172.21.15.89:0/3430169426 wait complete. 2024-08-31T04:04:25.977 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-31T04:04:25.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:04:26.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.128+0000 7fc0ace00640 1 -- 172.21.15.89:0/2734219833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0a80ca0e0 msgr2=0x7fc0a81672f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.128+0000 7fc0ace00640 1 --2- 172.21.15.89:0/2734219833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0a80ca0e0 0x7fc0a81672f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80ca540 tx=0x7fc0a001ca50 comp rx=0 tx=0).stop 2024-08-31T04:04:26.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.128+0000 7fc0ace00640 1 -- 172.21.15.89:0/2734219833 shutdown_connections 2024-08-31T04:04:26.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.128+0000 7fc0ace00640 1 --2- 172.21.15.89:0/2734219833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0a80ca0e0 0x7fc0a81672f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.128+0000 7fc0ace00640 1 -- 172.21.15.89:0/2734219833 >> 172.21.15.89:0/2734219833 conn(0x7fc0a806e340 msgr2=0x7fc0a80cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:26.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.128+0000 7fc0ace00640 1 -- 172.21.15.89:0/2734219833 shutdown_connections 2024-08-31T04:04:26.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.128+0000 7fc0ace00640 1 -- 172.21.15.89:0/2734219833 wait complete. 2024-08-31T04:04:26.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0ace00640 1 Processor -- start 2024-08-31T04:04:26.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0ace00640 1 -- start start 2024-08-31T04:04:26.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0ace00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0a8071720 0x7fc0a8158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:26.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0ace00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a80ca0e0 0x7fc0a81f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:26.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0ace00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8155c50 0x7fc0a81511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0ace00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a80cec40 con 0x7fc0a8155c50 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0ace00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a80c4ff0 con 0x7fc0a80ca0e0 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0ace00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a80cedc0 con 0x7fc0a8071720 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0a6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8155c50 0x7fc0a81511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0a6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8155c50 0x7fc0a81511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41532/0 (socket says 172.21.15.89:41532) 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0a6800640 1 -- 172.21.15.89:0/3434253663 learned_addr learned my addr 172.21.15.89:0/3434253663 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0a5e00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0a8071720 0x7fc0a8158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc09d400640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a80ca0e0 0x7fc0a81f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0a6800640 1 -- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0a8071720 msgr2=0x7fc0a8158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0a6800640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0a8071720 0x7fc0a8158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0a6800640 1 -- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a80ca0e0 msgr2=0x7fc0a81f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0a6800640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a80ca0e0 0x7fc0a81f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.132+0000 7fc0a6800640 1 -- 172.21.15.89:0/3434253663 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a81f62f0 con 0x7fc0a8155c50 2024-08-31T04:04:26.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc0a6800640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8155c50 0x7fc0a81511b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc0a001c4c0 tx=0x7fc0a00092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:26.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc09ea00640 1 -- 172.21.15.89:0/3434253663 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00bb070 con 0x7fc0a8155c50 2024-08-31T04:04:26.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc09ea00640 1 -- 172.21.15.89:0/3434253663 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0a0004d40 con 0x7fc0a8155c50 2024-08-31T04:04:26.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc09ea00640 1 -- 172.21.15.89:0/3434253663 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00b2040 con 0x7fc0a8155c50 2024-08-31T04:04:26.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a81f55f0 con 0x7fc0a8155c50 2024-08-31T04:04:26.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a8157a30 con 0x7fc0a8155c50 2024-08-31T04:04:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a80c8c60 con 0x7fc0a8155c50 2024-08-31T04:04:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc09ea00640 1 -- 172.21.15.89:0/3434253663 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc0a00be070 con 0x7fc0a8155c50 2024-08-31T04:04:26.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc09ea00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0840720f0 0x7fc084074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc09ea00640 1 -- 172.21.15.89:0/3434253663 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc0a012ca30 con 0x7fc0a8155c50 2024-08-31T04:04:26.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.136+0000 7fc0a5e00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0840720f0 0x7fc084074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:26.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.140+0000 7fc0a5e00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0840720f0 0x7fc084074600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc098001870 tx=0x7fc0980016a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.144+0000 7fc09ea00640 1 -- 172.21.15.89:0/3434253663 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc0a00f2cf0 con 0x7fc0a8155c50 2024-08-31T04:04:26.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.308+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0a8159380 con 0x7fc0840720f0 2024-08-31T04:04:26.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.428+0000 7fc09ea00640 1 -- 172.21.15.89:0/3434253663 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7fc0a8159380 con 0x7fc0840720f0 2024-08-31T04:04:26.434 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:26.436 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:04:26.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0840720f0 msgr2=0x7fc084074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0840720f0 0x7fc084074600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc098001870 tx=0x7fc0980016a0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8155c50 msgr2=0x7fc0a81511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8155c50 0x7fc0a81511b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc0a001c4c0 tx=0x7fc0a00092a0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 shutdown_connections 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0840720f0 0x7fc084074600 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8155c50 0x7fc0a81511b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a80ca0e0 0x7fc0a81f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 --2- 172.21.15.89:0/3434253663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0a8071720 0x7fc0a8158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 >> 172.21.15.89:0/3434253663 conn(0x7fc0a806e340 msgr2=0x7fc0a80765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 shutdown_connections 2024-08-31T04:04:26.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.432+0000 7fc0ace00640 1 -- 172.21.15.89:0/3434253663 wait complete. 2024-08-31T04:04:26.455 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-08-31T04:04:26.126940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730220,"statfs":{"total":773094113280,"available":772843745280,"internally_reserved":0,"allocated":3383296,"data_stored":2028208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005830"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905721+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:04:05.905721+0000","last_peered":"2024-08-31T04:04:05.905721+0000","last_clean":"2024-08-31T04:04:05.905721+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:04:05.905721+0000","last_undegraded":"2024-08-31T04:04:05.905721+0000","last_fullsized":"2024-08-31T04:04:05.905721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040713+0000","last_change":"2024-08-31T04:04:00.866522+0000","last_active":"2024-08-31T04:04:06.040713+0000","last_peered":"2024-08-31T04:04:06.040713+0000","last_clean":"2024-08-31T04:04:06.040713+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:04:06.040713+0000","last_undegraded":"2024-08-31T04:04:06.040713+0000","last_fullsized":"2024-08-31T04:04:06.040713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:05.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039577+0000","last_change":"2024-08-31T04:04:04.956192+0000","last_active":"2024-08-31T04:04:06.039577+0000","last_peered":"2024-08-31T04:04:06.039577+0000","last_clean":"2024-08-31T04:04:06.039577+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:04:06.039577+0000","last_undegraded":"2024-08-31T04:04:06.039577+0000","last_fullsized":"2024-08-31T04:04:06.039577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:42.517705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041009+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:04:06.041009+0000","last_peered":"2024-08-31T04:04:06.041009+0000","last_clean":"2024-08-31T04:04:06.041009+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:04:06.041009+0000","last_undegraded":"2024-08-31T04:04:06.041009+0000","last_fullsized":"2024-08-31T04:04:06.041009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040614+0000","last_change":"2024-08-31T04:04:00.880748+0000","last_active":"2024-08-31T04:04:06.040614+0000","last_peered":"2024-08-31T04:04:06.040614+0000","last_clean":"2024-08-31T04:04:06.040614+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:04:06.040614+0000","last_undegraded":"2024-08-31T04:04:06.040614+0000","last_fullsized":"2024-08-31T04:04:06.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:45.564722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904053+0000","last_change":"2024-08-31T04:04:04.951253+0000","last_active":"2024-08-31T04:04:05.904053+0000","last_peered":"2024-08-31T04:04:05.904053+0000","last_clean":"2024-08-31T04:04:05.904053+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:04:05.904053+0000","last_undegraded":"2024-08-31T04:04:05.904053+0000","last_fullsized":"2024-08-31T04:04:05.904053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:06.131485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035168+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:04:06.035168+0000","last_peered":"2024-08-31T04:04:06.035168+0000","last_clean":"2024-08-31T04:04:06.035168+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:04:06.035168+0000","last_undegraded":"2024-08-31T04:04:06.035168+0000","last_fullsized":"2024-08-31T04:04:06.035168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036133+0000","last_change":"2024-08-31T04:04:00.873539+0000","last_active":"2024-08-31T04:04:06.036133+0000","last_peered":"2024-08-31T04:04:06.036133+0000","last_clean":"2024-08-31T04:04:06.036133+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:04:06.036133+0000","last_undegraded":"2024-08-31T04:04:06.036133+0000","last_fullsized":"2024-08-31T04:04:06.036133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:48.946116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904728+0000","last_change":"2024-08-31T04:04:04.972277+0000","last_active":"2024-08-31T04:04:05.904728+0000","last_peered":"2024-08-31T04:04:05.904728+0000","last_clean":"2024-08-31T04:04:05.904728+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:04:05.904728+0000","last_undegraded":"2024-08-31T04:04:05.904728+0000","last_fullsized":"2024-08-31T04:04:05.904728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:25.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035597+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:04:06.035597+0000","last_peered":"2024-08-31T04:04:06.035597+0000","last_clean":"2024-08-31T04:04:06.035597+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:04:06.035597+0000","last_undegraded":"2024-08-31T04:04:06.035597+0000","last_fullsized":"2024-08-31T04:04:06.035597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907747+0000","last_change":"2024-08-31T04:04:00.874519+0000","last_active":"2024-08-31T04:04:05.907747+0000","last_peered":"2024-08-31T04:04:05.907747+0000","last_clean":"2024-08-31T04:04:05.907747+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:04:05.907747+0000","last_undegraded":"2024-08-31T04:04:05.907747+0000","last_fullsized":"2024-08-31T04:04:05.907747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:31.628140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904382+0000","last_change":"2024-08-31T04:04:04.974184+0000","last_active":"2024-08-31T04:04:05.904382+0000","last_peered":"2024-08-31T04:04:05.904382+0000","last_clean":"2024-08-31T04:04:05.904382+0000","last_became_active":"2024-08-31T04:04:04.973794+0000","last_became_peered":"2024-08-31T04:04:04.973794+0000","last_unstale":"2024-08-31T04:04:05.904382+0000","last_undegraded":"2024-08-31T04:04:05.904382+0000","last_fullsized":"2024-08-31T04:04:05.904382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:52.867283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907152+0000","last_change":"2024-08-31T04:04:00.867964+0000","last_active":"2024-08-31T04:04:05.907152+0000","last_peered":"2024-08-31T04:04:05.907152+0000","last_clean":"2024-08-31T04:04:05.907152+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:04:05.907152+0000","last_undegraded":"2024-08-31T04:04:05.907152+0000","last_fullsized":"2024-08-31T04:04:05.907152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:43.911244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906774+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:04:05.906774+0000","last_peered":"2024-08-31T04:04:05.906774+0000","last_clean":"2024-08-31T04:04:05.906774+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:04:05.906774+0000","last_undegraded":"2024-08-31T04:04:05.906774+0000","last_fullsized":"2024-08-31T04:04:05.906774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907485+0000","last_change":"2024-08-31T04:04:04.966791+0000","last_active":"2024-08-31T04:04:05.907485+0000","last_peered":"2024-08-31T04:04:05.907485+0000","last_clean":"2024-08-31T04:04:05.907485+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:04:05.907485+0000","last_undegraded":"2024-08-31T04:04:05.907485+0000","last_fullsized":"2024-08-31T04:04:05.907485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:57.768934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041469+0000","last_change":"2024-08-31T04:04:00.887746+0000","last_active":"2024-08-31T04:04:06.041469+0000","last_peered":"2024-08-31T04:04:06.041469+0000","last_clean":"2024-08-31T04:04:06.041469+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:04:06.041469+0000","last_undegraded":"2024-08-31T04:04:06.041469+0000","last_fullsized":"2024-08-31T04:04:06.041469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:27:35.901081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041029+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:04:06.041029+0000","last_peered":"2024-08-31T04:04:06.041029+0000","last_clean":"2024-08-31T04:04:06.041029+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:04:06.041029+0000","last_undegraded":"2024-08-31T04:04:06.041029+0000","last_fullsized":"2024-08-31T04:04:06.041029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034751+0000","last_change":"2024-08-31T04:04:04.954690+0000","last_active":"2024-08-31T04:04:06.034751+0000","last_peered":"2024-08-31T04:04:06.034751+0000","last_clean":"2024-08-31T04:04:06.034751+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:04:06.034751+0000","last_undegraded":"2024-08-31T04:04:06.034751+0000","last_fullsized":"2024-08-31T04:04:06.034751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:11.009989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904518+0000","last_change":"2024-08-31T04:04:00.896360+0000","last_active":"2024-08-31T04:04:05.904518+0000","last_peered":"2024-08-31T04:04:05.904518+0000","last_clean":"2024-08-31T04:04:05.904518+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:04:05.904518+0000","last_undegraded":"2024-08-31T04:04:05.904518+0000","last_fullsized":"2024-08-31T04:04:05.904518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:04.855778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904586+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:04:05.904586+0000","last_peered":"2024-08-31T04:04:05.904586+0000","last_clean":"2024-08-31T04:04:05.904586+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:04:05.904586+0000","last_undegraded":"2024-08-31T04:04:05.904586+0000","last_fullsized":"2024-08-31T04:04:05.904586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044402+0000","last_change":"2024-08-31T04:04:04.946958+0000","last_active":"2024-08-31T04:04:06.044402+0000","last_peered":"2024-08-31T04:04:06.044402+0000","last_clean":"2024-08-31T04:04:06.044402+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:04:06.044402+0000","last_undegraded":"2024-08-31T04:04:06.044402+0000","last_fullsized":"2024-08-31T04:04:06.044402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:41:42.006072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906335+0000","last_change":"2024-08-31T04:04:00.892688+0000","last_active":"2024-08-31T04:04:05.906335+0000","last_peered":"2024-08-31T04:04:05.906335+0000","last_clean":"2024-08-31T04:04:05.906335+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:04:05.906335+0000","last_undegraded":"2024-08-31T04:04:05.906335+0000","last_fullsized":"2024-08-31T04:04:05.906335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:53.521514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034425+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:04:06.034425+0000","last_peered":"2024-08-31T04:04:06.034425+0000","last_clean":"2024-08-31T04:04:06.034425+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:04:06.034425+0000","last_undegraded":"2024-08-31T04:04:06.034425+0000","last_fullsized":"2024-08-31T04:04:06.034425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905529+0000","last_change":"2024-08-31T04:04:04.936785+0000","last_active":"2024-08-31T04:04:05.905529+0000","last_peered":"2024-08-31T04:04:05.905529+0000","last_clean":"2024-08-31T04:04:05.905529+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:04:05.905529+0000","last_undegraded":"2024-08-31T04:04:05.905529+0000","last_fullsized":"2024-08-31T04:04:05.905529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:28:32.101080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905349+0000","last_change":"2024-08-31T04:04:00.891194+0000","last_active":"2024-08-31T04:04:05.905349+0000","last_peered":"2024-08-31T04:04:05.905349+0000","last_clean":"2024-08-31T04:04:05.905349+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:04:05.905349+0000","last_undegraded":"2024-08-31T04:04:05.905349+0000","last_fullsized":"2024-08-31T04:04:05.905349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:20.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908435+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:04:05.908435+0000","last_peered":"2024-08-31T04:04:05.908435+0000","last_clean":"2024-08-31T04:04:05.908435+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:04:05.908435+0000","last_undegraded":"2024-08-31T04:04:05.908435+0000","last_fullsized":"2024-08-31T04:04:05.908435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904222+0000","last_change":"2024-08-31T04:04:04.947787+0000","last_active":"2024-08-31T04:04:05.904222+0000","last_peered":"2024-08-31T04:04:05.904222+0000","last_clean":"2024-08-31T04:04:05.904222+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:04:05.904222+0000","last_undegraded":"2024-08-31T04:04:05.904222+0000","last_fullsized":"2024-08-31T04:04:05.904222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:40.922656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905481+0000","last_change":"2024-08-31T04:04:00.890893+0000","last_active":"2024-08-31T04:04:05.905481+0000","last_peered":"2024-08-31T04:04:05.905481+0000","last_clean":"2024-08-31T04:04:05.905481+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:04:05.905481+0000","last_undegraded":"2024-08-31T04:04:05.905481+0000","last_fullsized":"2024-08-31T04:04:05.905481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:39:17.163345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905683+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:04:05.905683+0000","last_peered":"2024-08-31T04:04:05.905683+0000","last_clean":"2024-08-31T04:04:05.905683+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:04:05.905683+0000","last_undegraded":"2024-08-31T04:04:05.905683+0000","last_fullsized":"2024-08-31T04:04:05.905683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904211+0000","last_change":"2024-08-31T04:04:04.951050+0000","last_active":"2024-08-31T04:04:05.904211+0000","last_peered":"2024-08-31T04:04:05.904211+0000","last_clean":"2024-08-31T04:04:05.904211+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:04:05.904211+0000","last_undegraded":"2024-08-31T04:04:05.904211+0000","last_fullsized":"2024-08-31T04:04:05.904211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:39.320190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042706+0000","last_change":"2024-08-31T04:04:00.887709+0000","last_active":"2024-08-31T04:04:06.042706+0000","last_peered":"2024-08-31T04:04:06.042706+0000","last_clean":"2024-08-31T04:04:06.042706+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:04:06.042706+0000","last_undegraded":"2024-08-31T04:04:06.042706+0000","last_fullsized":"2024-08-31T04:04:06.042706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:15.464663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908034+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:04:05.908034+0000","last_peered":"2024-08-31T04:04:05.908034+0000","last_clean":"2024-08-31T04:04:05.908034+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:04:05.908034+0000","last_undegraded":"2024-08-31T04:04:05.908034+0000","last_fullsized":"2024-08-31T04:04:05.908034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040767+0000","last_change":"2024-08-31T04:04:04.953273+0000","last_active":"2024-08-31T04:04:06.040767+0000","last_peered":"2024-08-31T04:04:06.040767+0000","last_clean":"2024-08-31T04:04:06.040767+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:04:06.040767+0000","last_undegraded":"2024-08-31T04:04:06.040767+0000","last_fullsized":"2024-08-31T04:04:06.040767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:30.841472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905304+0000","last_change":"2024-08-31T04:04:00.887566+0000","last_active":"2024-08-31T04:04:05.905304+0000","last_peered":"2024-08-31T04:04:05.905304+0000","last_clean":"2024-08-31T04:04:05.905304+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:04:05.905304+0000","last_undegraded":"2024-08-31T04:04:05.905304+0000","last_fullsized":"2024-08-31T04:04:05.905304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:17.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038640+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:04:06.038640+0000","last_peered":"2024-08-31T04:04:06.038640+0000","last_clean":"2024-08-31T04:04:06.038640+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:04:06.038640+0000","last_undegraded":"2024-08-31T04:04:06.038640+0000","last_fullsized":"2024-08-31T04:04:06.038640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040223+0000","last_change":"2024-08-31T04:04:04.975251+0000","last_active":"2024-08-31T04:04:06.040223+0000","last_peered":"2024-08-31T04:04:06.040223+0000","last_clean":"2024-08-31T04:04:06.040223+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:04:06.040223+0000","last_undegraded":"2024-08-31T04:04:06.040223+0000","last_fullsized":"2024-08-31T04:04:06.040223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:12.488672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035080+0000","last_change":"2024-08-31T04:04:00.881311+0000","last_active":"2024-08-31T04:04:06.035080+0000","last_peered":"2024-08-31T04:04:06.035080+0000","last_clean":"2024-08-31T04:04:06.035080+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:04:06.035080+0000","last_undegraded":"2024-08-31T04:04:06.035080+0000","last_fullsized":"2024-08-31T04:04:06.035080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:44.361701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907364+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:04:05.907364+0000","last_peered":"2024-08-31T04:04:05.907364+0000","last_clean":"2024-08-31T04:04:05.907364+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:04:05.907364+0000","last_undegraded":"2024-08-31T04:04:05.907364+0000","last_fullsized":"2024-08-31T04:04:05.907364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042168+0000","last_change":"2024-08-31T04:04:04.954216+0000","last_active":"2024-08-31T04:04:06.042168+0000","last_peered":"2024-08-31T04:04:06.042168+0000","last_clean":"2024-08-31T04:04:06.042168+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:04:06.042168+0000","last_undegraded":"2024-08-31T04:04:06.042168+0000","last_fullsized":"2024-08-31T04:04:06.042168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:04.563322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039679+0000","last_change":"2024-08-31T04:04:00.884692+0000","last_active":"2024-08-31T04:04:06.039679+0000","last_peered":"2024-08-31T04:04:06.039679+0000","last_clean":"2024-08-31T04:04:06.039679+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:04:06.039679+0000","last_undegraded":"2024-08-31T04:04:06.039679+0000","last_fullsized":"2024-08-31T04:04:06.039679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:07:45.274820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037948+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:04:06.037948+0000","last_peered":"2024-08-31T04:04:06.037948+0000","last_clean":"2024-08-31T04:04:06.037948+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:04:06.037948+0000","last_undegraded":"2024-08-31T04:04:06.037948+0000","last_fullsized":"2024-08-31T04:04:06.037948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044165+0000","last_change":"2024-08-31T04:04:04.950642+0000","last_active":"2024-08-31T04:04:06.044165+0000","last_peered":"2024-08-31T04:04:06.044165+0000","last_clean":"2024-08-31T04:04:06.044165+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:04:06.044165+0000","last_undegraded":"2024-08-31T04:04:06.044165+0000","last_fullsized":"2024-08-31T04:04:06.044165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:49.300897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038082+0000","last_change":"2024-08-31T04:04:00.886674+0000","last_active":"2024-08-31T04:04:06.038082+0000","last_peered":"2024-08-31T04:04:06.038082+0000","last_clean":"2024-08-31T04:04:06.038082+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:04:06.038082+0000","last_undegraded":"2024-08-31T04:04:06.038082+0000","last_fullsized":"2024-08-31T04:04:06.038082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:46:28.682868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905953+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:04:05.905953+0000","last_peered":"2024-08-31T04:04:05.905953+0000","last_clean":"2024-08-31T04:04:05.905953+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:04:05.905953+0000","last_undegraded":"2024-08-31T04:04:05.905953+0000","last_fullsized":"2024-08-31T04:04:05.905953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040199+0000","last_change":"2024-08-31T04:04:04.973347+0000","last_active":"2024-08-31T04:04:06.040199+0000","last_peered":"2024-08-31T04:04:06.040199+0000","last_clean":"2024-08-31T04:04:06.040199+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:04:06.040199+0000","last_undegraded":"2024-08-31T04:04:06.040199+0000","last_fullsized":"2024-08-31T04:04:06.040199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:30.204653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904564+0000","last_change":"2024-08-31T04:04:00.896365+0000","last_active":"2024-08-31T04:04:05.904564+0000","last_peered":"2024-08-31T04:04:05.904564+0000","last_clean":"2024-08-31T04:04:05.904564+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:04:05.904564+0000","last_undegraded":"2024-08-31T04:04:05.904564+0000","last_fullsized":"2024-08-31T04:04:05.904564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:39.300217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906837+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:04:05.906837+0000","last_peered":"2024-08-31T04:04:05.906837+0000","last_clean":"2024-08-31T04:04:05.906837+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:04:05.906837+0000","last_undegraded":"2024-08-31T04:04:05.906837+0000","last_fullsized":"2024-08-31T04:04:05.906837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034604+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:04:06.034604+0000","last_peered":"2024-08-31T04:04:06.034604+0000","last_clean":"2024-08-31T04:04:06.034604+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:04:06.034604+0000","last_undegraded":"2024-08-31T04:04:06.034604+0000","last_fullsized":"2024-08-31T04:04:06.034604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907888+0000","last_change":"2024-08-31T04:04:04.922468+0000","last_active":"2024-08-31T04:04:05.907888+0000","last_peered":"2024-08-31T04:04:05.907888+0000","last_clean":"2024-08-31T04:04:05.907888+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:04:05.907888+0000","last_undegraded":"2024-08-31T04:04:05.907888+0000","last_fullsized":"2024-08-31T04:04:05.907888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:15.555948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907801+0000","last_change":"2024-08-31T04:04:00.867024+0000","last_active":"2024-08-31T04:04:05.907801+0000","last_peered":"2024-08-31T04:04:05.907801+0000","last_clean":"2024-08-31T04:04:05.907801+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:04:05.907801+0000","last_undegraded":"2024-08-31T04:04:05.907801+0000","last_fullsized":"2024-08-31T04:04:05.907801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:43.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042885+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:04:06.042885+0000","last_peered":"2024-08-31T04:04:06.042885+0000","last_clean":"2024-08-31T04:04:06.042885+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:04:06.042885+0000","last_undegraded":"2024-08-31T04:04:06.042885+0000","last_fullsized":"2024-08-31T04:04:06.042885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904426+0000","last_change":"2024-08-31T04:04:04.938034+0000","last_active":"2024-08-31T04:04:05.904426+0000","last_peered":"2024-08-31T04:04:05.904426+0000","last_clean":"2024-08-31T04:04:05.904426+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:04:05.904426+0000","last_undegraded":"2024-08-31T04:04:05.904426+0000","last_fullsized":"2024-08-31T04:04:05.904426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:46.961448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035417+0000","last_change":"2024-08-31T04:04:00.883610+0000","last_active":"2024-08-31T04:04:06.035417+0000","last_peered":"2024-08-31T04:04:06.035417+0000","last_clean":"2024-08-31T04:04:06.035417+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:04:06.035417+0000","last_undegraded":"2024-08-31T04:04:06.035417+0000","last_fullsized":"2024-08-31T04:04:06.035417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:29.250924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041581+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:04:06.041581+0000","last_peered":"2024-08-31T04:04:06.041581+0000","last_clean":"2024-08-31T04:04:06.041581+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:04:06.041581+0000","last_undegraded":"2024-08-31T04:04:06.041581+0000","last_fullsized":"2024-08-31T04:04:06.041581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039391+0000","last_change":"2024-08-31T04:04:04.979418+0000","last_active":"2024-08-31T04:04:06.039391+0000","last_peered":"2024-08-31T04:04:06.039391+0000","last_clean":"2024-08-31T04:04:06.039391+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:04:06.039391+0000","last_undegraded":"2024-08-31T04:04:06.039391+0000","last_fullsized":"2024-08-31T04:04:06.039391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:40.023243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035347+0000","last_change":"2024-08-31T04:04:00.874137+0000","last_active":"2024-08-31T04:04:06.035347+0000","last_peered":"2024-08-31T04:04:06.035347+0000","last_clean":"2024-08-31T04:04:06.035347+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:04:06.035347+0000","last_undegraded":"2024-08-31T04:04:06.035347+0000","last_fullsized":"2024-08-31T04:04:06.035347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:44.411622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905534+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:04:05.905534+0000","last_peered":"2024-08-31T04:04:05.905534+0000","last_clean":"2024-08-31T04:04:05.905534+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:04:05.905534+0000","last_undegraded":"2024-08-31T04:04:05.905534+0000","last_fullsized":"2024-08-31T04:04:05.905534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904981+0000","last_change":"2024-08-31T04:04:04.918718+0000","last_active":"2024-08-31T04:04:05.904981+0000","last_peered":"2024-08-31T04:04:05.904981+0000","last_clean":"2024-08-31T04:04:05.904981+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:04:05.904981+0000","last_undegraded":"2024-08-31T04:04:05.904981+0000","last_fullsized":"2024-08-31T04:04:05.904981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:04:40.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905941+0000","last_change":"2024-08-31T04:04:00.877667+0000","last_active":"2024-08-31T04:04:05.905941+0000","last_peered":"2024-08-31T04:04:05.905941+0000","last_clean":"2024-08-31T04:04:05.905941+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:04:05.905941+0000","last_undegraded":"2024-08-31T04:04:05.905941+0000","last_fullsized":"2024-08-31T04:04:05.905941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:06:31.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035613+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:04:06.035613+0000","last_peered":"2024-08-31T04:04:06.035613+0000","last_clean":"2024-08-31T04:04:06.035613+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:04:06.035613+0000","last_undegraded":"2024-08-31T04:04:06.035613+0000","last_fullsized":"2024-08-31T04:04:06.035613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034877+0000","last_change":"2024-08-31T04:04:04.959068+0000","last_active":"2024-08-31T04:04:06.034877+0000","last_peered":"2024-08-31T04:04:06.034877+0000","last_clean":"2024-08-31T04:04:06.034877+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:04:06.034877+0000","last_undegraded":"2024-08-31T04:04:06.034877+0000","last_fullsized":"2024-08-31T04:04:06.034877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:46:16.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906227+0000","last_change":"2024-08-31T04:04:00.864542+0000","last_active":"2024-08-31T04:04:05.906227+0000","last_peered":"2024-08-31T04:04:05.906227+0000","last_clean":"2024-08-31T04:04:05.906227+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:04:05.906227+0000","last_undegraded":"2024-08-31T04:04:05.906227+0000","last_fullsized":"2024-08-31T04:04:05.906227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:47.241152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904710+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:04:05.904710+0000","last_peered":"2024-08-31T04:04:05.904710+0000","last_clean":"2024-08-31T04:04:05.904710+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:04:05.904710+0000","last_undegraded":"2024-08-31T04:04:05.904710+0000","last_fullsized":"2024-08-31T04:04:05.904710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040786+0000","last_change":"2024-08-31T04:04:04.966400+0000","last_active":"2024-08-31T04:04:06.040786+0000","last_peered":"2024-08-31T04:04:06.040786+0000","last_clean":"2024-08-31T04:04:06.040786+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:04:06.040786+0000","last_undegraded":"2024-08-31T04:04:06.040786+0000","last_fullsized":"2024-08-31T04:04:06.040786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:18:16.700443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034482+0000","last_change":"2024-08-31T04:04:00.880127+0000","last_active":"2024-08-31T04:04:06.034482+0000","last_peered":"2024-08-31T04:04:06.034482+0000","last_clean":"2024-08-31T04:04:06.034482+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:04:06.034482+0000","last_undegraded":"2024-08-31T04:04:06.034482+0000","last_fullsized":"2024-08-31T04:04:06.034482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034827+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:04:06.034827+0000","last_peered":"2024-08-31T04:04:06.034827+0000","last_clean":"2024-08-31T04:04:06.034827+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:04:06.034827+0000","last_undegraded":"2024-08-31T04:04:06.034827+0000","last_fullsized":"2024-08-31T04:04:06.034827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040447+0000","last_change":"2024-08-31T04:04:04.971102+0000","last_active":"2024-08-31T04:04:06.040447+0000","last_peered":"2024-08-31T04:04:06.040447+0000","last_clean":"2024-08-31T04:04:06.040447+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:04:06.040447+0000","last_undegraded":"2024-08-31T04:04:06.040447+0000","last_fullsized":"2024-08-31T04:04:06.040447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:40.427017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906629+0000","last_change":"2024-08-31T04:04:00.882328+0000","last_active":"2024-08-31T04:04:05.906629+0000","last_peered":"2024-08-31T04:04:05.906629+0000","last_clean":"2024-08-31T04:04:05.906629+0000","last_became_active":"2024-08-31T04:04:00.882009+0000","last_became_peered":"2024-08-31T04:04:00.882009+0000","last_unstale":"2024-08-31T04:04:05.906629+0000","last_undegraded":"2024-08-31T04:04:05.906629+0000","last_fullsized":"2024-08-31T04:04:05.906629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:10:14.622717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907313+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:04:05.907313+0000","last_peered":"2024-08-31T04:04:05.907313+0000","last_clean":"2024-08-31T04:04:05.907313+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:04:05.907313+0000","last_undegraded":"2024-08-31T04:04:05.907313+0000","last_fullsized":"2024-08-31T04:04:05.907313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041921+0000","last_change":"2024-08-31T04:04:04.964690+0000","last_active":"2024-08-31T04:04:06.041921+0000","last_peered":"2024-08-31T04:04:06.041921+0000","last_clean":"2024-08-31T04:04:06.041921+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:04:06.041921+0000","last_undegraded":"2024-08-31T04:04:06.041921+0000","last_fullsized":"2024-08-31T04:04:06.041921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:23.711105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040884+0000","last_change":"2024-08-31T04:04:00.887168+0000","last_active":"2024-08-31T04:04:06.040884+0000","last_peered":"2024-08-31T04:04:06.040884+0000","last_clean":"2024-08-31T04:04:06.040884+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:04:06.040884+0000","last_undegraded":"2024-08-31T04:04:06.040884+0000","last_fullsized":"2024-08-31T04:04:06.040884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:58.272934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043729+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:04:06.043729+0000","last_peered":"2024-08-31T04:04:06.043729+0000","last_clean":"2024-08-31T04:04:06.043729+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:04:06.043729+0000","last_undegraded":"2024-08-31T04:04:06.043729+0000","last_fullsized":"2024-08-31T04:04:06.043729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907657+0000","last_change":"2024-08-31T04:04:04.967183+0000","last_active":"2024-08-31T04:04:05.907657+0000","last_peered":"2024-08-31T04:04:05.907657+0000","last_clean":"2024-08-31T04:04:05.907657+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:04:05.907657+0000","last_undegraded":"2024-08-31T04:04:05.907657+0000","last_fullsized":"2024-08-31T04:04:05.907657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:54.094714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034962+0000","last_change":"2024-08-31T04:04:00.886779+0000","last_active":"2024-08-31T04:04:06.034962+0000","last_peered":"2024-08-31T04:04:06.034962+0000","last_clean":"2024-08-31T04:04:06.034962+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:04:06.034962+0000","last_undegraded":"2024-08-31T04:04:06.034962+0000","last_fullsized":"2024-08-31T04:04:06.034962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:45:51.487016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:14.844048+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:04:14.844048+0000","last_peered":"2024-08-31T04:04:14.844048+0000","last_clean":"2024-08-31T04:04:14.844048+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:04:14.844048+0000","last_undegraded":"2024-08-31T04:04:14.844048+0000","last_fullsized":"2024-08-31T04:04:14.844048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904234+0000","last_change":"2024-08-31T04:04:04.960945+0000","last_active":"2024-08-31T04:04:05.904234+0000","last_peered":"2024-08-31T04:04:05.904234+0000","last_clean":"2024-08-31T04:04:05.904234+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:04:05.904234+0000","last_undegraded":"2024-08-31T04:04:05.904234+0000","last_fullsized":"2024-08-31T04:04:05.904234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:50.907644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906484+0000","last_change":"2024-08-31T04:04:00.869565+0000","last_active":"2024-08-31T04:04:05.906484+0000","last_peered":"2024-08-31T04:04:05.906484+0000","last_clean":"2024-08-31T04:04:05.906484+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:04:05.906484+0000","last_undegraded":"2024-08-31T04:04:05.906484+0000","last_fullsized":"2024-08-31T04:04:05.906484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:37.334753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043126+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:04:06.043126+0000","last_peered":"2024-08-31T04:04:06.043126+0000","last_clean":"2024-08-31T04:04:06.043126+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:04:06.043126+0000","last_undegraded":"2024-08-31T04:04:06.043126+0000","last_fullsized":"2024-08-31T04:04:06.043126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904892+0000","last_change":"2024-08-31T04:04:04.940655+0000","last_active":"2024-08-31T04:04:05.904892+0000","last_peered":"2024-08-31T04:04:05.904892+0000","last_clean":"2024-08-31T04:04:05.904892+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:04:05.904892+0000","last_undegraded":"2024-08-31T04:04:05.904892+0000","last_fullsized":"2024-08-31T04:04:05.904892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:12:39.145645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040892+0000","last_change":"2024-08-31T04:04:00.881774+0000","last_active":"2024-08-31T04:04:06.040892+0000","last_peered":"2024-08-31T04:04:06.040892+0000","last_clean":"2024-08-31T04:04:06.040892+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:04:06.040892+0000","last_undegraded":"2024-08-31T04:04:06.040892+0000","last_fullsized":"2024-08-31T04:04:06.040892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:19.539642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034980+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:04:06.034980+0000","last_peered":"2024-08-31T04:04:06.034980+0000","last_clean":"2024-08-31T04:04:06.034980+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:04:06.034980+0000","last_undegraded":"2024-08-31T04:04:06.034980+0000","last_fullsized":"2024-08-31T04:04:06.034980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037542+0000","last_change":"2024-08-31T04:04:04.948582+0000","last_active":"2024-08-31T04:04:06.037542+0000","last_peered":"2024-08-31T04:04:06.037542+0000","last_clean":"2024-08-31T04:04:06.037542+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:04:06.037542+0000","last_undegraded":"2024-08-31T04:04:06.037542+0000","last_fullsized":"2024-08-31T04:04:06.037542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:35.294731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905846+0000","last_change":"2024-08-31T04:04:00.863199+0000","last_active":"2024-08-31T04:04:05.905846+0000","last_peered":"2024-08-31T04:04:05.905846+0000","last_clean":"2024-08-31T04:04:05.905846+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:04:05.905846+0000","last_undegraded":"2024-08-31T04:04:05.905846+0000","last_fullsized":"2024-08-31T04:04:05.905846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:52.086202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036024+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:04:06.036024+0000","last_peered":"2024-08-31T04:04:06.036024+0000","last_clean":"2024-08-31T04:04:06.036024+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:04:06.036024+0000","last_undegraded":"2024-08-31T04:04:06.036024+0000","last_fullsized":"2024-08-31T04:04:06.036024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904421+0000","last_change":"2024-08-31T04:04:04.940930+0000","last_active":"2024-08-31T04:04:05.904421+0000","last_peered":"2024-08-31T04:04:05.904421+0000","last_clean":"2024-08-31T04:04:05.904421+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:04:05.904421+0000","last_undegraded":"2024-08-31T04:04:05.904421+0000","last_fullsized":"2024-08-31T04:04:05.904421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:07:30.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905335+0000","last_change":"2024-08-31T04:04:04.970283+0000","last_active":"2024-08-31T04:04:05.905335+0000","last_peered":"2024-08-31T04:04:05.905335+0000","last_clean":"2024-08-31T04:04:05.905335+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:04:05.905335+0000","last_undegraded":"2024-08-31T04:04:05.905335+0000","last_fullsized":"2024-08-31T04:04:05.905335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:37.086560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904353+0000","last_change":"2024-08-31T04:04:00.897277+0000","last_active":"2024-08-31T04:04:05.904353+0000","last_peered":"2024-08-31T04:04:05.904353+0000","last_clean":"2024-08-31T04:04:05.904353+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:04:05.904353+0000","last_undegraded":"2024-08-31T04:04:05.904353+0000","last_fullsized":"2024-08-31T04:04:05.904353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:45:42.808934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905834+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:04:05.905834+0000","last_peered":"2024-08-31T04:04:05.905834+0000","last_clean":"2024-08-31T04:04:05.905834+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:04:05.905834+0000","last_undegraded":"2024-08-31T04:04:05.905834+0000","last_fullsized":"2024-08-31T04:04:05.905834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906316+0000","last_change":"2024-08-31T04:04:04.966233+0000","last_active":"2024-08-31T04:04:05.906316+0000","last_peered":"2024-08-31T04:04:05.906316+0000","last_clean":"2024-08-31T04:04:05.906316+0000","last_became_active":"2024-08-31T04:04:04.965854+0000","last_became_peered":"2024-08-31T04:04:04.965854+0000","last_unstale":"2024-08-31T04:04:05.906316+0000","last_undegraded":"2024-08-31T04:04:05.906316+0000","last_fullsized":"2024-08-31T04:04:05.906316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:16.448331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040110+0000","last_change":"2024-08-31T04:04:00.888009+0000","last_active":"2024-08-31T04:04:06.040110+0000","last_peered":"2024-08-31T04:04:06.040110+0000","last_clean":"2024-08-31T04:04:06.040110+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:04:06.040110+0000","last_undegraded":"2024-08-31T04:04:06.040110+0000","last_fullsized":"2024-08-31T04:04:06.040110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:31.977791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038384+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:04:06.038384+0000","last_peered":"2024-08-31T04:04:06.038384+0000","last_clean":"2024-08-31T04:04:06.038384+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:04:06.038384+0000","last_undegraded":"2024-08-31T04:04:06.038384+0000","last_fullsized":"2024-08-31T04:04:06.038384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907256+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:04:05.907256+0000","last_peered":"2024-08-31T04:04:05.907256+0000","last_clean":"2024-08-31T04:04:05.907256+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:04:05.907256+0000","last_undegraded":"2024-08-31T04:04:05.907256+0000","last_fullsized":"2024-08-31T04:04:05.907256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904794+0000","last_change":"2024-08-31T04:04:00.897537+0000","last_active":"2024-08-31T04:04:05.904794+0000","last_peered":"2024-08-31T04:04:05.904794+0000","last_clean":"2024-08-31T04:04:05.904794+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:04:05.904794+0000","last_undegraded":"2024-08-31T04:04:05.904794+0000","last_fullsized":"2024-08-31T04:04:05.904794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:46.422487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905083+0000","last_change":"2024-08-31T04:04:04.961002+0000","last_active":"2024-08-31T04:04:05.905083+0000","last_peered":"2024-08-31T04:04:05.905083+0000","last_clean":"2024-08-31T04:04:05.905083+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:04:05.905083+0000","last_undegraded":"2024-08-31T04:04:05.905083+0000","last_fullsized":"2024-08-31T04:04:05.905083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:45:04.605970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039694+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:04:06.039694+0000","last_peered":"2024-08-31T04:04:06.039694+0000","last_clean":"2024-08-31T04:04:06.039694+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:04:06.039694+0000","last_undegraded":"2024-08-31T04:04:06.039694+0000","last_fullsized":"2024-08-31T04:04:06.039694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035174+0000","last_change":"2024-08-31T04:04:00.878599+0000","last_active":"2024-08-31T04:04:06.035174+0000","last_peered":"2024-08-31T04:04:06.035174+0000","last_clean":"2024-08-31T04:04:06.035174+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:04:06.035174+0000","last_undegraded":"2024-08-31T04:04:06.035174+0000","last_fullsized":"2024-08-31T04:04:06.035174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:37.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043082+0000","last_change":"2024-08-31T04:04:04.975414+0000","last_active":"2024-08-31T04:04:06.043082+0000","last_peered":"2024-08-31T04:04:06.043082+0000","last_clean":"2024-08-31T04:04:06.043082+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:04:06.043082+0000","last_undegraded":"2024-08-31T04:04:06.043082+0000","last_fullsized":"2024-08-31T04:04:06.043082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:12.992949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904092+0000","last_change":"2024-08-31T04:04:00.887117+0000","last_active":"2024-08-31T04:04:05.904092+0000","last_peered":"2024-08-31T04:04:05.904092+0000","last_clean":"2024-08-31T04:04:05.904092+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:04:05.904092+0000","last_undegraded":"2024-08-31T04:04:05.904092+0000","last_fullsized":"2024-08-31T04:04:05.904092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:18:37.474694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037663+0000","last_change":"2024-08-31T04:04:00.881033+0000","last_active":"2024-08-31T04:04:06.037663+0000","last_peered":"2024-08-31T04:04:06.037663+0000","last_clean":"2024-08-31T04:04:06.037663+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:04:06.037663+0000","last_undegraded":"2024-08-31T04:04:06.037663+0000","last_fullsized":"2024-08-31T04:04:06.037663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:46.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907098+0000","last_change":"2024-08-31T04:04:00.879791+0000","last_active":"2024-08-31T04:04:05.907098+0000","last_peered":"2024-08-31T04:04:05.907098+0000","last_clean":"2024-08-31T04:04:05.907098+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:04:05.907098+0000","last_undegraded":"2024-08-31T04:04:05.907098+0000","last_fullsized":"2024-08-31T04:04:05.907098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:00:26.128387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039321+0000","last_change":"2024-08-31T04:04:00.876487+0000","last_active":"2024-08-31T04:04:06.039321+0000","last_peered":"2024-08-31T04:04:06.039321+0000","last_clean":"2024-08-31T04:04:06.039321+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:04:06.039321+0000","last_undegraded":"2024-08-31T04:04:06.039321+0000","last_fullsized":"2024-08-31T04:04:06.039321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:10.867317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042600+0000","last_change":"2024-08-31T04:04:00.888017+0000","last_active":"2024-08-31T04:04:06.042600+0000","last_peered":"2024-08-31T04:04:06.042600+0000","last_clean":"2024-08-31T04:04:06.042600+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:04:06.042600+0000","last_undegraded":"2024-08-31T04:04:06.042600+0000","last_fullsized":"2024-08-31T04:04:06.042600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:53.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042480+0000","last_change":"2024-08-31T04:04:00.885850+0000","last_active":"2024-08-31T04:04:06.042480+0000","last_peered":"2024-08-31T04:04:06.042480+0000","last_clean":"2024-08-31T04:04:06.042480+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:04:06.042480+0000","last_undegraded":"2024-08-31T04:04:06.042480+0000","last_fullsized":"2024-08-31T04:04:06.042480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:07.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905742+0000","last_change":"2024-08-31T04:04:00.870086+0000","last_active":"2024-08-31T04:04:05.905742+0000","last_peered":"2024-08-31T04:04:05.905742+0000","last_clean":"2024-08-31T04:04:05.905742+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:04:05.905742+0000","last_undegraded":"2024-08-31T04:04:05.905742+0000","last_fullsized":"2024-08-31T04:04:05.905742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:59.724104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040115+0000","last_change":"2024-08-31T04:04:00.881124+0000","last_active":"2024-08-31T04:04:06.040115+0000","last_peered":"2024-08-31T04:04:06.040115+0000","last_clean":"2024-08-31T04:04:06.040115+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:04:06.040115+0000","last_undegraded":"2024-08-31T04:04:06.040115+0000","last_fullsized":"2024-08-31T04:04:06.040115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:40.389131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905727+0000","last_change":"2024-08-31T04:04:00.880040+0000","last_active":"2024-08-31T04:04:05.905727+0000","last_peered":"2024-08-31T04:04:05.905727+0000","last_clean":"2024-08-31T04:04:05.905727+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:04:05.905727+0000","last_undegraded":"2024-08-31T04:04:05.905727+0000","last_fullsized":"2024-08-31T04:04:05.905727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:23.110254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039483+0000","last_change":"2024-08-31T04:04:00.867373+0000","last_active":"2024-08-31T04:04:06.039483+0000","last_peered":"2024-08-31T04:04:06.039483+0000","last_clean":"2024-08-31T04:04:06.039483+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:04:06.039483+0000","last_undegraded":"2024-08-31T04:04:06.039483+0000","last_fullsized":"2024-08-31T04:04:06.039483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:47.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035293+0000","last_change":"2024-08-31T04:04:00.884497+0000","last_active":"2024-08-31T04:04:06.035293+0000","last_peered":"2024-08-31T04:04:06.035293+0000","last_clean":"2024-08-31T04:04:06.035293+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:04:06.035293+0000","last_undegraded":"2024-08-31T04:04:06.035293+0000","last_fullsized":"2024-08-31T04:04:06.035293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:10.005789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904753+0000","last_change":"2024-08-31T04:04:00.899676+0000","last_active":"2024-08-31T04:04:05.904753+0000","last_peered":"2024-08-31T04:04:05.904753+0000","last_clean":"2024-08-31T04:04:05.904753+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:04:05.904753+0000","last_undegraded":"2024-08-31T04:04:05.904753+0000","last_fullsized":"2024-08-31T04:04:05.904753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:46.887325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035316+0000","last_change":"2024-08-31T04:04:00.872910+0000","last_active":"2024-08-31T04:04:06.035316+0000","last_peered":"2024-08-31T04:04:06.035316+0000","last_clean":"2024-08-31T04:04:06.035316+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:04:06.035316+0000","last_undegraded":"2024-08-31T04:04:06.035316+0000","last_fullsized":"2024-08-31T04:04:06.035316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:22.208293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907979+0000","last_change":"2024-08-31T04:04:00.897114+0000","last_active":"2024-08-31T04:04:05.907979+0000","last_peered":"2024-08-31T04:04:05.907979+0000","last_clean":"2024-08-31T04:04:05.907979+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:04:05.907979+0000","last_undegraded":"2024-08-31T04:04:05.907979+0000","last_fullsized":"2024-08-31T04:04:05.907979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:13.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044036+0000","last_change":"2024-08-31T04:04:00.879907+0000","last_active":"2024-08-31T04:04:06.044036+0000","last_peered":"2024-08-31T04:04:06.044036+0000","last_clean":"2024-08-31T04:04:06.044036+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:04:06.044036+0000","last_undegraded":"2024-08-31T04:04:06.044036+0000","last_fullsized":"2024-08-31T04:04:06.044036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:11.042911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908418+0000","last_change":"2024-08-31T04:04:00.874247+0000","last_active":"2024-08-31T04:04:05.908418+0000","last_peered":"2024-08-31T04:04:05.908418+0000","last_clean":"2024-08-31T04:04:05.908418+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:04:05.908418+0000","last_undegraded":"2024-08-31T04:04:05.908418+0000","last_fullsized":"2024-08-31T04:04:05.908418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:00.974919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905612+0000","last_change":"2024-08-31T04:04:00.861922+0000","last_active":"2024-08-31T04:04:05.905612+0000","last_peered":"2024-08-31T04:04:05.905612+0000","last_clean":"2024-08-31T04:04:05.905612+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:04:05.905612+0000","last_undegraded":"2024-08-31T04:04:05.905612+0000","last_fullsized":"2024-08-31T04:04:05.905612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:07.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038950+0000","last_change":"2024-08-31T04:04:00.873986+0000","last_active":"2024-08-31T04:04:06.038950+0000","last_peered":"2024-08-31T04:04:06.038950+0000","last_clean":"2024-08-31T04:04:06.038950+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:04:06.038950+0000","last_undegraded":"2024-08-31T04:04:06.038950+0000","last_fullsized":"2024-08-31T04:04:06.038950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:39.934600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040728+0000","last_change":"2024-08-31T04:04:00.887510+0000","last_active":"2024-08-31T04:04:06.040728+0000","last_peered":"2024-08-31T04:04:06.040728+0000","last_clean":"2024-08-31T04:04:06.040728+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:04:06.040728+0000","last_undegraded":"2024-08-31T04:04:06.040728+0000","last_fullsized":"2024-08-31T04:04:06.040728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:29.689714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041269+0000","last_change":"2024-08-31T04:04:00.886364+0000","last_active":"2024-08-31T04:04:06.041269+0000","last_peered":"2024-08-31T04:04:06.041269+0000","last_clean":"2024-08-31T04:04:06.041269+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:04:06.041269+0000","last_undegraded":"2024-08-31T04:04:06.041269+0000","last_fullsized":"2024-08-31T04:04:06.041269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:17.949115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035208+0000","last_change":"2024-08-31T04:04:00.885452+0000","last_active":"2024-08-31T04:04:06.035208+0000","last_peered":"2024-08-31T04:04:06.035208+0000","last_clean":"2024-08-31T04:04:06.035208+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:04:06.035208+0000","last_undegraded":"2024-08-31T04:04:06.035208+0000","last_fullsized":"2024-08-31T04:04:06.035208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:34:58.727576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035971+0000","last_change":"2024-08-31T04:04:00.876816+0000","last_active":"2024-08-31T04:04:06.035971+0000","last_peered":"2024-08-31T04:04:06.035971+0000","last_clean":"2024-08-31T04:04:06.035971+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:04:06.035971+0000","last_undegraded":"2024-08-31T04:04:06.035971+0000","last_fullsized":"2024-08-31T04:04:06.035971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:38.896525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034790+0000","last_change":"2024-08-31T04:04:00.878584+0000","last_active":"2024-08-31T04:04:06.034790+0000","last_peered":"2024-08-31T04:04:06.034790+0000","last_clean":"2024-08-31T04:04:06.034790+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:04:06.034790+0000","last_undegraded":"2024-08-31T04:04:06.034790+0000","last_fullsized":"2024-08-31T04:04:06.034790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:30.201712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035980+0000","last_change":"2024-08-31T04:04:00.866007+0000","last_active":"2024-08-31T04:04:06.035980+0000","last_peered":"2024-08-31T04:04:06.035980+0000","last_clean":"2024-08-31T04:04:06.035980+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:04:06.035980+0000","last_undegraded":"2024-08-31T04:04:06.035980+0000","last_fullsized":"2024-08-31T04:04:06.035980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:05.236271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039665+0000","last_change":"2024-08-31T04:04:00.882356+0000","last_active":"2024-08-31T04:04:06.039665+0000","last_peered":"2024-08-31T04:04:06.039665+0000","last_clean":"2024-08-31T04:04:06.039665+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:04:06.039665+0000","last_undegraded":"2024-08-31T04:04:06.039665+0000","last_fullsized":"2024-08-31T04:04:06.039665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:44:37.026732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034726+0000","last_change":"2024-08-31T04:04:00.897170+0000","last_active":"2024-08-31T04:04:06.034726+0000","last_peered":"2024-08-31T04:04:06.034726+0000","last_clean":"2024-08-31T04:04:06.034726+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:04:06.034726+0000","last_undegraded":"2024-08-31T04:04:06.034726+0000","last_fullsized":"2024-08-31T04:04:06.034726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:05.673647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904588+0000","last_change":"2024-08-31T04:04:00.897956+0000","last_active":"2024-08-31T04:04:05.904588+0000","last_peered":"2024-08-31T04:04:05.904588+0000","last_clean":"2024-08-31T04:04:05.904588+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:04:05.904588+0000","last_undegraded":"2024-08-31T04:04:05.904588+0000","last_fullsized":"2024-08-31T04:04:05.904588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.686037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035844+0000","last_change":"2024-08-31T04:04:00.883315+0000","last_active":"2024-08-31T04:04:06.035844+0000","last_peered":"2024-08-31T04:04:06.035844+0000","last_clean":"2024-08-31T04:04:06.035844+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:04:06.035844+0000","last_undegraded":"2024-08-31T04:04:06.035844+0000","last_fullsized":"2024-08-31T04:04:06.035844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:41.258604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904958+0000","last_change":"2024-08-31T04:04:00.892502+0000","last_active":"2024-08-31T04:04:05.904958+0000","last_peered":"2024-08-31T04:04:05.904958+0000","last_clean":"2024-08-31T04:04:05.904958+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:04:05.904958+0000","last_undegraded":"2024-08-31T04:04:05.904958+0000","last_fullsized":"2024-08-31T04:04:05.904958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:04:48.381328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041280+0000","last_change":"2024-08-31T04:04:00.892994+0000","last_active":"2024-08-31T04:04:06.041280+0000","last_peered":"2024-08-31T04:04:06.041280+0000","last_clean":"2024-08-31T04:04:06.041280+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:04:06.041280+0000","last_undegraded":"2024-08-31T04:04:06.041280+0000","last_fullsized":"2024-08-31T04:04:06.041280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:00.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040294+0000","last_change":"2024-08-31T04:04:00.887325+0000","last_active":"2024-08-31T04:04:06.040294+0000","last_peered":"2024-08-31T04:04:06.040294+0000","last_clean":"2024-08-31T04:04:06.040294+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:04:06.040294+0000","last_undegraded":"2024-08-31T04:04:06.040294+0000","last_fullsized":"2024-08-31T04:04:06.040294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:15.674452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035235+0000","last_change":"2024-08-31T04:04:00.881745+0000","last_active":"2024-08-31T04:04:06.035235+0000","last_peered":"2024-08-31T04:04:06.035235+0000","last_clean":"2024-08-31T04:04:06.035235+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:04:06.035235+0000","last_undegraded":"2024-08-31T04:04:06.035235+0000","last_fullsized":"2024-08-31T04:04:06.035235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:01.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476746,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":105356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476746,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476747,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476747,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":104830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":868352,"data_stored":695234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35624,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336216,"statfs":{"total":96636764160,"available":96600285184,"internally_reserved":0,"allocated":286720,"data_stored":109288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":104898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:04:26.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:04:26.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 -- 172.21.15.89:0/3043669499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6d015a370 msgr2=0x7fb6d0164070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 --2- 172.21.15.89:0/3043669499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6d015a370 0x7fb6d0164070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009840 tx=0x7fb6c801c820 comp rx=0 tx=0).stop 2024-08-31T04:04:26.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 -- 172.21.15.89:0/3043669499 shutdown_connections 2024-08-31T04:04:26.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 --2- 172.21.15.89:0/3043669499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6d015a370 0x7fb6d0164070 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 --2- 172.21.15.89:0/3043669499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6d00c97e0 0x7fb6d0156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 -- 172.21.15.89:0/3043669499 >> 172.21.15.89:0/3043669499 conn(0x7fb6d0071be0 msgr2=0x7fb6d006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:26.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 -- 172.21.15.89:0/3043669499 shutdown_connections 2024-08-31T04:04:26.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 -- 172.21.15.89:0/3043669499 wait complete. 2024-08-31T04:04:26.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 Processor -- start 2024-08-31T04:04:26.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 -- start start 2024-08-31T04:04:26.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d00c97e0 0x7fb6d015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6d0159f60 0x7fb6d01f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6d015a370 0x7fb6d0152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d01596f0 con 0x7fb6d00c97e0 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d01570b0 con 0x7fb6d015a370 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.652+0000 7fb6d5800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d00c5160 con 0x7fb6d0159f60 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d00c97e0 0x7fb6d015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d00c97e0 0x7fb6d015d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41544/0 (socket says 172.21.15.89:41544) 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cea00640 1 -- 172.21.15.89:0/2103695250 learned_addr learned my addr 172.21.15.89:0/2103695250 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cf400640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6d015a370 0x7fb6d0152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6c6000640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6d0159f60 0x7fb6d01f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cea00640 1 -- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6d0159f60 msgr2=0x7fb6d01f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cea00640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6d0159f60 0x7fb6d01f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cea00640 1 -- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6d015a370 msgr2=0x7fb6d0152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cea00640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6d015a370 0x7fb6d0152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cea00640 1 -- 172.21.15.89:0/2103695250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d015d250 con 0x7fb6d00c97e0 2024-08-31T04:04:26.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6cea00640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d00c97e0 0x7fb6d015d680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000eb30 tx=0x7fb6c000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:26.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6c7400640 1 -- 172.21.15.89:0/2103695250 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0004b30 con 0x7fb6d00c97e0 2024-08-31T04:04:26.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6c7400640 1 -- 172.21.15.89:0/2103695250 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6c0004cf0 con 0x7fb6d00c97e0 2024-08-31T04:04:26.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6c7400640 1 -- 172.21.15.89:0/2103695250 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0005280 con 0x7fb6d00c97e0 2024-08-31T04:04:26.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d00c8c30 con 0x7fb6d00c97e0 2024-08-31T04:04:26.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d01f2750 con 0x7fb6d00c97e0 2024-08-31T04:04:26.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d00c5d30 con 0x7fb6d00c97e0 2024-08-31T04:04:26.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.656+0000 7fb6c7400640 1 -- 172.21.15.89:0/2103695250 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb6c0005420 con 0x7fb6d00c97e0 2024-08-31T04:04:26.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.660+0000 7fb6c7400640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6ac0720f0 0x7fb6ac074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:26.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.660+0000 7fb6c7400640 1 -- 172.21.15.89:0/2103695250 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb6c0093aa0 con 0x7fb6d00c97e0 2024-08-31T04:04:26.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.660+0000 7fb6c6000640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6ac0720f0 0x7fb6ac074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:26.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.660+0000 7fb6c6000640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6ac0720f0 0x7fb6ac074600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6d01f33d0 tx=0x7fb6b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:26.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.664+0000 7fb6c7400640 1 -- 172.21.15.89:0/2103695250 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb6c005f0a0 con 0x7fb6d00c97e0 2024-08-31T04:04:26.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.824+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6d0153100 con 0x7fb6ac0720f0 2024-08-31T04:04:26.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.840+0000 7fb6c7400640 1 -- 172.21.15.89:0/2103695250 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7fb6d0153100 con 0x7fb6ac0720f0 2024-08-31T04:04:26.845 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:26.847 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6ac0720f0 msgr2=0x7fb6ac074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6ac0720f0 0x7fb6ac074600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6d01f33d0 tx=0x7fb6b8009040 comp rx=0 tx=0).stop 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d00c97e0 msgr2=0x7fb6d015d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d00c97e0 0x7fb6d015d680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000eb30 tx=0x7fb6c000c2d0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 shutdown_connections 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6ac0720f0 0x7fb6ac074600 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6d015a370 0x7fb6d0152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6d0159f60 0x7fb6d01f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 --2- 172.21.15.89:0/2103695250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6d00c97e0 0x7fb6d015d680 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 >> 172.21.15.89:0/2103695250 conn(0x7fb6d0071be0 msgr2=0x7fb6d0158490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 shutdown_connections 2024-08-31T04:04:26.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:26.844+0000 7fb6d5800640 1 -- 172.21.15.89:0/2103695250 wait complete. 2024-08-31T04:04:26.866 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-08-31T04:04:26.126940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730220,"statfs":{"total":773094113280,"available":772843745280,"internally_reserved":0,"allocated":3383296,"data_stored":2028208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005830"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905721+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:04:05.905721+0000","last_peered":"2024-08-31T04:04:05.905721+0000","last_clean":"2024-08-31T04:04:05.905721+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:04:05.905721+0000","last_undegraded":"2024-08-31T04:04:05.905721+0000","last_fullsized":"2024-08-31T04:04:05.905721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040713+0000","last_change":"2024-08-31T04:04:00.866522+0000","last_active":"2024-08-31T04:04:06.040713+0000","last_peered":"2024-08-31T04:04:06.040713+0000","last_clean":"2024-08-31T04:04:06.040713+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:04:06.040713+0000","last_undegraded":"2024-08-31T04:04:06.040713+0000","last_fullsized":"2024-08-31T04:04:06.040713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:05.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039577+0000","last_change":"2024-08-31T04:04:04.956192+0000","last_active":"2024-08-31T04:04:06.039577+0000","last_peered":"2024-08-31T04:04:06.039577+0000","last_clean":"2024-08-31T04:04:06.039577+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:04:06.039577+0000","last_undegraded":"2024-08-31T04:04:06.039577+0000","last_fullsized":"2024-08-31T04:04:06.039577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:42.517705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041009+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:04:06.041009+0000","last_peered":"2024-08-31T04:04:06.041009+0000","last_clean":"2024-08-31T04:04:06.041009+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:04:06.041009+0000","last_undegraded":"2024-08-31T04:04:06.041009+0000","last_fullsized":"2024-08-31T04:04:06.041009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040614+0000","last_change":"2024-08-31T04:04:00.880748+0000","last_active":"2024-08-31T04:04:06.040614+0000","last_peered":"2024-08-31T04:04:06.040614+0000","last_clean":"2024-08-31T04:04:06.040614+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:04:06.040614+0000","last_undegraded":"2024-08-31T04:04:06.040614+0000","last_fullsized":"2024-08-31T04:04:06.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:45.564722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904053+0000","last_change":"2024-08-31T04:04:04.951253+0000","last_active":"2024-08-31T04:04:05.904053+0000","last_peered":"2024-08-31T04:04:05.904053+0000","last_clean":"2024-08-31T04:04:05.904053+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:04:05.904053+0000","last_undegraded":"2024-08-31T04:04:05.904053+0000","last_fullsized":"2024-08-31T04:04:05.904053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:06.131485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035168+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:04:06.035168+0000","last_peered":"2024-08-31T04:04:06.035168+0000","last_clean":"2024-08-31T04:04:06.035168+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:04:06.035168+0000","last_undegraded":"2024-08-31T04:04:06.035168+0000","last_fullsized":"2024-08-31T04:04:06.035168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036133+0000","last_change":"2024-08-31T04:04:00.873539+0000","last_active":"2024-08-31T04:04:06.036133+0000","last_peered":"2024-08-31T04:04:06.036133+0000","last_clean":"2024-08-31T04:04:06.036133+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:04:06.036133+0000","last_undegraded":"2024-08-31T04:04:06.036133+0000","last_fullsized":"2024-08-31T04:04:06.036133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:48.946116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904728+0000","last_change":"2024-08-31T04:04:04.972277+0000","last_active":"2024-08-31T04:04:05.904728+0000","last_peered":"2024-08-31T04:04:05.904728+0000","last_clean":"2024-08-31T04:04:05.904728+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:04:05.904728+0000","last_undegraded":"2024-08-31T04:04:05.904728+0000","last_fullsized":"2024-08-31T04:04:05.904728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:25.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035597+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:04:06.035597+0000","last_peered":"2024-08-31T04:04:06.035597+0000","last_clean":"2024-08-31T04:04:06.035597+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:04:06.035597+0000","last_undegraded":"2024-08-31T04:04:06.035597+0000","last_fullsized":"2024-08-31T04:04:06.035597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907747+0000","last_change":"2024-08-31T04:04:00.874519+0000","last_active":"2024-08-31T04:04:05.907747+0000","last_peered":"2024-08-31T04:04:05.907747+0000","last_clean":"2024-08-31T04:04:05.907747+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:04:05.907747+0000","last_undegraded":"2024-08-31T04:04:05.907747+0000","last_fullsized":"2024-08-31T04:04:05.907747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:31.628140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904382+0000","last_change":"2024-08-31T04:04:04.974184+0000","last_active":"2024-08-31T04:04:05.904382+0000","last_peered":"2024-08-31T04:04:05.904382+0000","last_clean":"2024-08-31T04:04:05.904382+0000","last_became_active":"2024-08-31T04:04:04.973794+0000","last_became_peered":"2024-08-31T04:04:04.973794+0000","last_unstale":"2024-08-31T04:04:05.904382+0000","last_undegraded":"2024-08-31T04:04:05.904382+0000","last_fullsized":"2024-08-31T04:04:05.904382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:52.867283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907152+0000","last_change":"2024-08-31T04:04:00.867964+0000","last_active":"2024-08-31T04:04:05.907152+0000","last_peered":"2024-08-31T04:04:05.907152+0000","last_clean":"2024-08-31T04:04:05.907152+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:04:05.907152+0000","last_undegraded":"2024-08-31T04:04:05.907152+0000","last_fullsized":"2024-08-31T04:04:05.907152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:43.911244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906774+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:04:05.906774+0000","last_peered":"2024-08-31T04:04:05.906774+0000","last_clean":"2024-08-31T04:04:05.906774+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:04:05.906774+0000","last_undegraded":"2024-08-31T04:04:05.906774+0000","last_fullsized":"2024-08-31T04:04:05.906774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907485+0000","last_change":"2024-08-31T04:04:04.966791+0000","last_active":"2024-08-31T04:04:05.907485+0000","last_peered":"2024-08-31T04:04:05.907485+0000","last_clean":"2024-08-31T04:04:05.907485+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:04:05.907485+0000","last_undegraded":"2024-08-31T04:04:05.907485+0000","last_fullsized":"2024-08-31T04:04:05.907485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:57.768934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041469+0000","last_change":"2024-08-31T04:04:00.887746+0000","last_active":"2024-08-31T04:04:06.041469+0000","last_peered":"2024-08-31T04:04:06.041469+0000","last_clean":"2024-08-31T04:04:06.041469+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:04:06.041469+0000","last_undegraded":"2024-08-31T04:04:06.041469+0000","last_fullsized":"2024-08-31T04:04:06.041469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:27:35.901081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041029+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:04:06.041029+0000","last_peered":"2024-08-31T04:04:06.041029+0000","last_clean":"2024-08-31T04:04:06.041029+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:04:06.041029+0000","last_undegraded":"2024-08-31T04:04:06.041029+0000","last_fullsized":"2024-08-31T04:04:06.041029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034751+0000","last_change":"2024-08-31T04:04:04.954690+0000","last_active":"2024-08-31T04:04:06.034751+0000","last_peered":"2024-08-31T04:04:06.034751+0000","last_clean":"2024-08-31T04:04:06.034751+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:04:06.034751+0000","last_undegraded":"2024-08-31T04:04:06.034751+0000","last_fullsized":"2024-08-31T04:04:06.034751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:11.009989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904518+0000","last_change":"2024-08-31T04:04:00.896360+0000","last_active":"2024-08-31T04:04:05.904518+0000","last_peered":"2024-08-31T04:04:05.904518+0000","last_clean":"2024-08-31T04:04:05.904518+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:04:05.904518+0000","last_undegraded":"2024-08-31T04:04:05.904518+0000","last_fullsized":"2024-08-31T04:04:05.904518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:04.855778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904586+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:04:05.904586+0000","last_peered":"2024-08-31T04:04:05.904586+0000","last_clean":"2024-08-31T04:04:05.904586+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:04:05.904586+0000","last_undegraded":"2024-08-31T04:04:05.904586+0000","last_fullsized":"2024-08-31T04:04:05.904586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044402+0000","last_change":"2024-08-31T04:04:04.946958+0000","last_active":"2024-08-31T04:04:06.044402+0000","last_peered":"2024-08-31T04:04:06.044402+0000","last_clean":"2024-08-31T04:04:06.044402+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:04:06.044402+0000","last_undegraded":"2024-08-31T04:04:06.044402+0000","last_fullsized":"2024-08-31T04:04:06.044402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:41:42.006072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906335+0000","last_change":"2024-08-31T04:04:00.892688+0000","last_active":"2024-08-31T04:04:05.906335+0000","last_peered":"2024-08-31T04:04:05.906335+0000","last_clean":"2024-08-31T04:04:05.906335+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:04:05.906335+0000","last_undegraded":"2024-08-31T04:04:05.906335+0000","last_fullsized":"2024-08-31T04:04:05.906335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:53.521514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034425+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:04:06.034425+0000","last_peered":"2024-08-31T04:04:06.034425+0000","last_clean":"2024-08-31T04:04:06.034425+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:04:06.034425+0000","last_undegraded":"2024-08-31T04:04:06.034425+0000","last_fullsized":"2024-08-31T04:04:06.034425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905529+0000","last_change":"2024-08-31T04:04:04.936785+0000","last_active":"2024-08-31T04:04:05.905529+0000","last_peered":"2024-08-31T04:04:05.905529+0000","last_clean":"2024-08-31T04:04:05.905529+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:04:05.905529+0000","last_undegraded":"2024-08-31T04:04:05.905529+0000","last_fullsized":"2024-08-31T04:04:05.905529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:28:32.101080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905349+0000","last_change":"2024-08-31T04:04:00.891194+0000","last_active":"2024-08-31T04:04:05.905349+0000","last_peered":"2024-08-31T04:04:05.905349+0000","last_clean":"2024-08-31T04:04:05.905349+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:04:05.905349+0000","last_undegraded":"2024-08-31T04:04:05.905349+0000","last_fullsized":"2024-08-31T04:04:05.905349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:20.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908435+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:04:05.908435+0000","last_peered":"2024-08-31T04:04:05.908435+0000","last_clean":"2024-08-31T04:04:05.908435+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:04:05.908435+0000","last_undegraded":"2024-08-31T04:04:05.908435+0000","last_fullsized":"2024-08-31T04:04:05.908435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904222+0000","last_change":"2024-08-31T04:04:04.947787+0000","last_active":"2024-08-31T04:04:05.904222+0000","last_peered":"2024-08-31T04:04:05.904222+0000","last_clean":"2024-08-31T04:04:05.904222+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:04:05.904222+0000","last_undegraded":"2024-08-31T04:04:05.904222+0000","last_fullsized":"2024-08-31T04:04:05.904222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:40.922656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905481+0000","last_change":"2024-08-31T04:04:00.890893+0000","last_active":"2024-08-31T04:04:05.905481+0000","last_peered":"2024-08-31T04:04:05.905481+0000","last_clean":"2024-08-31T04:04:05.905481+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:04:05.905481+0000","last_undegraded":"2024-08-31T04:04:05.905481+0000","last_fullsized":"2024-08-31T04:04:05.905481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:39:17.163345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905683+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:04:05.905683+0000","last_peered":"2024-08-31T04:04:05.905683+0000","last_clean":"2024-08-31T04:04:05.905683+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:04:05.905683+0000","last_undegraded":"2024-08-31T04:04:05.905683+0000","last_fullsized":"2024-08-31T04:04:05.905683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904211+0000","last_change":"2024-08-31T04:04:04.951050+0000","last_active":"2024-08-31T04:04:05.904211+0000","last_peered":"2024-08-31T04:04:05.904211+0000","last_clean":"2024-08-31T04:04:05.904211+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:04:05.904211+0000","last_undegraded":"2024-08-31T04:04:05.904211+0000","last_fullsized":"2024-08-31T04:04:05.904211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:39.320190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042706+0000","last_change":"2024-08-31T04:04:00.887709+0000","last_active":"2024-08-31T04:04:06.042706+0000","last_peered":"2024-08-31T04:04:06.042706+0000","last_clean":"2024-08-31T04:04:06.042706+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:04:06.042706+0000","last_undegraded":"2024-08-31T04:04:06.042706+0000","last_fullsized":"2024-08-31T04:04:06.042706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:15.464663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908034+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:04:05.908034+0000","last_peered":"2024-08-31T04:04:05.908034+0000","last_clean":"2024-08-31T04:04:05.908034+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:04:05.908034+0000","last_undegraded":"2024-08-31T04:04:05.908034+0000","last_fullsized":"2024-08-31T04:04:05.908034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040767+0000","last_change":"2024-08-31T04:04:04.953273+0000","last_active":"2024-08-31T04:04:06.040767+0000","last_peered":"2024-08-31T04:04:06.040767+0000","last_clean":"2024-08-31T04:04:06.040767+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:04:06.040767+0000","last_undegraded":"2024-08-31T04:04:06.040767+0000","last_fullsized":"2024-08-31T04:04:06.040767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:30.841472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905304+0000","last_change":"2024-08-31T04:04:00.887566+0000","last_active":"2024-08-31T04:04:05.905304+0000","last_peered":"2024-08-31T04:04:05.905304+0000","last_clean":"2024-08-31T04:04:05.905304+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:04:05.905304+0000","last_undegraded":"2024-08-31T04:04:05.905304+0000","last_fullsized":"2024-08-31T04:04:05.905304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:17.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038640+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:04:06.038640+0000","last_peered":"2024-08-31T04:04:06.038640+0000","last_clean":"2024-08-31T04:04:06.038640+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:04:06.038640+0000","last_undegraded":"2024-08-31T04:04:06.038640+0000","last_fullsized":"2024-08-31T04:04:06.038640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040223+0000","last_change":"2024-08-31T04:04:04.975251+0000","last_active":"2024-08-31T04:04:06.040223+0000","last_peered":"2024-08-31T04:04:06.040223+0000","last_clean":"2024-08-31T04:04:06.040223+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:04:06.040223+0000","last_undegraded":"2024-08-31T04:04:06.040223+0000","last_fullsized":"2024-08-31T04:04:06.040223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:12.488672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035080+0000","last_change":"2024-08-31T04:04:00.881311+0000","last_active":"2024-08-31T04:04:06.035080+0000","last_peered":"2024-08-31T04:04:06.035080+0000","last_clean":"2024-08-31T04:04:06.035080+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:04:06.035080+0000","last_undegraded":"2024-08-31T04:04:06.035080+0000","last_fullsized":"2024-08-31T04:04:06.035080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:44.361701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907364+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:04:05.907364+0000","last_peered":"2024-08-31T04:04:05.907364+0000","last_clean":"2024-08-31T04:04:05.907364+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:04:05.907364+0000","last_undegraded":"2024-08-31T04:04:05.907364+0000","last_fullsized":"2024-08-31T04:04:05.907364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042168+0000","last_change":"2024-08-31T04:04:04.954216+0000","last_active":"2024-08-31T04:04:06.042168+0000","last_peered":"2024-08-31T04:04:06.042168+0000","last_clean":"2024-08-31T04:04:06.042168+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:04:06.042168+0000","last_undegraded":"2024-08-31T04:04:06.042168+0000","last_fullsized":"2024-08-31T04:04:06.042168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:04.563322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039679+0000","last_change":"2024-08-31T04:04:00.884692+0000","last_active":"2024-08-31T04:04:06.039679+0000","last_peered":"2024-08-31T04:04:06.039679+0000","last_clean":"2024-08-31T04:04:06.039679+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:04:06.039679+0000","last_undegraded":"2024-08-31T04:04:06.039679+0000","last_fullsized":"2024-08-31T04:04:06.039679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:07:45.274820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037948+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:04:06.037948+0000","last_peered":"2024-08-31T04:04:06.037948+0000","last_clean":"2024-08-31T04:04:06.037948+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:04:06.037948+0000","last_undegraded":"2024-08-31T04:04:06.037948+0000","last_fullsized":"2024-08-31T04:04:06.037948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044165+0000","last_change":"2024-08-31T04:04:04.950642+0000","last_active":"2024-08-31T04:04:06.044165+0000","last_peered":"2024-08-31T04:04:06.044165+0000","last_clean":"2024-08-31T04:04:06.044165+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:04:06.044165+0000","last_undegraded":"2024-08-31T04:04:06.044165+0000","last_fullsized":"2024-08-31T04:04:06.044165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:49.300897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038082+0000","last_change":"2024-08-31T04:04:00.886674+0000","last_active":"2024-08-31T04:04:06.038082+0000","last_peered":"2024-08-31T04:04:06.038082+0000","last_clean":"2024-08-31T04:04:06.038082+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:04:06.038082+0000","last_undegraded":"2024-08-31T04:04:06.038082+0000","last_fullsized":"2024-08-31T04:04:06.038082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:46:28.682868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905953+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:04:05.905953+0000","last_peered":"2024-08-31T04:04:05.905953+0000","last_clean":"2024-08-31T04:04:05.905953+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:04:05.905953+0000","last_undegraded":"2024-08-31T04:04:05.905953+0000","last_fullsized":"2024-08-31T04:04:05.905953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040199+0000","last_change":"2024-08-31T04:04:04.973347+0000","last_active":"2024-08-31T04:04:06.040199+0000","last_peered":"2024-08-31T04:04:06.040199+0000","last_clean":"2024-08-31T04:04:06.040199+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:04:06.040199+0000","last_undegraded":"2024-08-31T04:04:06.040199+0000","last_fullsized":"2024-08-31T04:04:06.040199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:30.204653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904564+0000","last_change":"2024-08-31T04:04:00.896365+0000","last_active":"2024-08-31T04:04:05.904564+0000","last_peered":"2024-08-31T04:04:05.904564+0000","last_clean":"2024-08-31T04:04:05.904564+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:04:05.904564+0000","last_undegraded":"2024-08-31T04:04:05.904564+0000","last_fullsized":"2024-08-31T04:04:05.904564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:39.300217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906837+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:04:05.906837+0000","last_peered":"2024-08-31T04:04:05.906837+0000","last_clean":"2024-08-31T04:04:05.906837+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:04:05.906837+0000","last_undegraded":"2024-08-31T04:04:05.906837+0000","last_fullsized":"2024-08-31T04:04:05.906837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034604+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:04:06.034604+0000","last_peered":"2024-08-31T04:04:06.034604+0000","last_clean":"2024-08-31T04:04:06.034604+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:04:06.034604+0000","last_undegraded":"2024-08-31T04:04:06.034604+0000","last_fullsized":"2024-08-31T04:04:06.034604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907888+0000","last_change":"2024-08-31T04:04:04.922468+0000","last_active":"2024-08-31T04:04:05.907888+0000","last_peered":"2024-08-31T04:04:05.907888+0000","last_clean":"2024-08-31T04:04:05.907888+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:04:05.907888+0000","last_undegraded":"2024-08-31T04:04:05.907888+0000","last_fullsized":"2024-08-31T04:04:05.907888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:15.555948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907801+0000","last_change":"2024-08-31T04:04:00.867024+0000","last_active":"2024-08-31T04:04:05.907801+0000","last_peered":"2024-08-31T04:04:05.907801+0000","last_clean":"2024-08-31T04:04:05.907801+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:04:05.907801+0000","last_undegraded":"2024-08-31T04:04:05.907801+0000","last_fullsized":"2024-08-31T04:04:05.907801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:43.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042885+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:04:06.042885+0000","last_peered":"2024-08-31T04:04:06.042885+0000","last_clean":"2024-08-31T04:04:06.042885+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:04:06.042885+0000","last_undegraded":"2024-08-31T04:04:06.042885+0000","last_fullsized":"2024-08-31T04:04:06.042885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904426+0000","last_change":"2024-08-31T04:04:04.938034+0000","last_active":"2024-08-31T04:04:05.904426+0000","last_peered":"2024-08-31T04:04:05.904426+0000","last_clean":"2024-08-31T04:04:05.904426+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:04:05.904426+0000","last_undegraded":"2024-08-31T04:04:05.904426+0000","last_fullsized":"2024-08-31T04:04:05.904426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:46.961448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035417+0000","last_change":"2024-08-31T04:04:00.883610+0000","last_active":"2024-08-31T04:04:06.035417+0000","last_peered":"2024-08-31T04:04:06.035417+0000","last_clean":"2024-08-31T04:04:06.035417+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:04:06.035417+0000","last_undegraded":"2024-08-31T04:04:06.035417+0000","last_fullsized":"2024-08-31T04:04:06.035417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:29.250924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041581+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:04:06.041581+0000","last_peered":"2024-08-31T04:04:06.041581+0000","last_clean":"2024-08-31T04:04:06.041581+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:04:06.041581+0000","last_undegraded":"2024-08-31T04:04:06.041581+0000","last_fullsized":"2024-08-31T04:04:06.041581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039391+0000","last_change":"2024-08-31T04:04:04.979418+0000","last_active":"2024-08-31T04:04:06.039391+0000","last_peered":"2024-08-31T04:04:06.039391+0000","last_clean":"2024-08-31T04:04:06.039391+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:04:06.039391+0000","last_undegraded":"2024-08-31T04:04:06.039391+0000","last_fullsized":"2024-08-31T04:04:06.039391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:40.023243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035347+0000","last_change":"2024-08-31T04:04:00.874137+0000","last_active":"2024-08-31T04:04:06.035347+0000","last_peered":"2024-08-31T04:04:06.035347+0000","last_clean":"2024-08-31T04:04:06.035347+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:04:06.035347+0000","last_undegraded":"2024-08-31T04:04:06.035347+0000","last_fullsized":"2024-08-31T04:04:06.035347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:44.411622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905534+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:04:05.905534+0000","last_peered":"2024-08-31T04:04:05.905534+0000","last_clean":"2024-08-31T04:04:05.905534+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:04:05.905534+0000","last_undegraded":"2024-08-31T04:04:05.905534+0000","last_fullsized":"2024-08-31T04:04:05.905534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904981+0000","last_change":"2024-08-31T04:04:04.918718+0000","last_active":"2024-08-31T04:04:05.904981+0000","last_peered":"2024-08-31T04:04:05.904981+0000","last_clean":"2024-08-31T04:04:05.904981+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:04:05.904981+0000","last_undegraded":"2024-08-31T04:04:05.904981+0000","last_fullsized":"2024-08-31T04:04:05.904981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:04:40.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905941+0000","last_change":"2024-08-31T04:04:00.877667+0000","last_active":"2024-08-31T04:04:05.905941+0000","last_peered":"2024-08-31T04:04:05.905941+0000","last_clean":"2024-08-31T04:04:05.905941+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:04:05.905941+0000","last_undegraded":"2024-08-31T04:04:05.905941+0000","last_fullsized":"2024-08-31T04:04:05.905941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:06:31.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035613+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:04:06.035613+0000","last_peered":"2024-08-31T04:04:06.035613+0000","last_clean":"2024-08-31T04:04:06.035613+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:04:06.035613+0000","last_undegraded":"2024-08-31T04:04:06.035613+0000","last_fullsized":"2024-08-31T04:04:06.035613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034877+0000","last_change":"2024-08-31T04:04:04.959068+0000","last_active":"2024-08-31T04:04:06.034877+0000","last_peered":"2024-08-31T04:04:06.034877+0000","last_clean":"2024-08-31T04:04:06.034877+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:04:06.034877+0000","last_undegraded":"2024-08-31T04:04:06.034877+0000","last_fullsized":"2024-08-31T04:04:06.034877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:46:16.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906227+0000","last_change":"2024-08-31T04:04:00.864542+0000","last_active":"2024-08-31T04:04:05.906227+0000","last_peered":"2024-08-31T04:04:05.906227+0000","last_clean":"2024-08-31T04:04:05.906227+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:04:05.906227+0000","last_undegraded":"2024-08-31T04:04:05.906227+0000","last_fullsized":"2024-08-31T04:04:05.906227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:47.241152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904710+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:04:05.904710+0000","last_peered":"2024-08-31T04:04:05.904710+0000","last_clean":"2024-08-31T04:04:05.904710+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:04:05.904710+0000","last_undegraded":"2024-08-31T04:04:05.904710+0000","last_fullsized":"2024-08-31T04:04:05.904710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040786+0000","last_change":"2024-08-31T04:04:04.966400+0000","last_active":"2024-08-31T04:04:06.040786+0000","last_peered":"2024-08-31T04:04:06.040786+0000","last_clean":"2024-08-31T04:04:06.040786+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:04:06.040786+0000","last_undegraded":"2024-08-31T04:04:06.040786+0000","last_fullsized":"2024-08-31T04:04:06.040786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:18:16.700443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034482+0000","last_change":"2024-08-31T04:04:00.880127+0000","last_active":"2024-08-31T04:04:06.034482+0000","last_peered":"2024-08-31T04:04:06.034482+0000","last_clean":"2024-08-31T04:04:06.034482+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:04:06.034482+0000","last_undegraded":"2024-08-31T04:04:06.034482+0000","last_fullsized":"2024-08-31T04:04:06.034482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034827+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:04:06.034827+0000","last_peered":"2024-08-31T04:04:06.034827+0000","last_clean":"2024-08-31T04:04:06.034827+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:04:06.034827+0000","last_undegraded":"2024-08-31T04:04:06.034827+0000","last_fullsized":"2024-08-31T04:04:06.034827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040447+0000","last_change":"2024-08-31T04:04:04.971102+0000","last_active":"2024-08-31T04:04:06.040447+0000","last_peered":"2024-08-31T04:04:06.040447+0000","last_clean":"2024-08-31T04:04:06.040447+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:04:06.040447+0000","last_undegraded":"2024-08-31T04:04:06.040447+0000","last_fullsized":"2024-08-31T04:04:06.040447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:40.427017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906629+0000","last_change":"2024-08-31T04:04:00.882328+0000","last_active":"2024-08-31T04:04:05.906629+0000","last_peered":"2024-08-31T04:04:05.906629+0000","last_clean":"2024-08-31T04:04:05.906629+0000","last_became_active":"2024-08-31T04:04:00.882009+0000","last_became_peered":"2024-08-31T04:04:00.882009+0000","last_unstale":"2024-08-31T04:04:05.906629+0000","last_undegraded":"2024-08-31T04:04:05.906629+0000","last_fullsized":"2024-08-31T04:04:05.906629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:10:14.622717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907313+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:04:05.907313+0000","last_peered":"2024-08-31T04:04:05.907313+0000","last_clean":"2024-08-31T04:04:05.907313+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:04:05.907313+0000","last_undegraded":"2024-08-31T04:04:05.907313+0000","last_fullsized":"2024-08-31T04:04:05.907313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041921+0000","last_change":"2024-08-31T04:04:04.964690+0000","last_active":"2024-08-31T04:04:06.041921+0000","last_peered":"2024-08-31T04:04:06.041921+0000","last_clean":"2024-08-31T04:04:06.041921+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:04:06.041921+0000","last_undegraded":"2024-08-31T04:04:06.041921+0000","last_fullsized":"2024-08-31T04:04:06.041921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:23.711105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040884+0000","last_change":"2024-08-31T04:04:00.887168+0000","last_active":"2024-08-31T04:04:06.040884+0000","last_peered":"2024-08-31T04:04:06.040884+0000","last_clean":"2024-08-31T04:04:06.040884+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:04:06.040884+0000","last_undegraded":"2024-08-31T04:04:06.040884+0000","last_fullsized":"2024-08-31T04:04:06.040884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:58.272934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043729+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:04:06.043729+0000","last_peered":"2024-08-31T04:04:06.043729+0000","last_clean":"2024-08-31T04:04:06.043729+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:04:06.043729+0000","last_undegraded":"2024-08-31T04:04:06.043729+0000","last_fullsized":"2024-08-31T04:04:06.043729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907657+0000","last_change":"2024-08-31T04:04:04.967183+0000","last_active":"2024-08-31T04:04:05.907657+0000","last_peered":"2024-08-31T04:04:05.907657+0000","last_clean":"2024-08-31T04:04:05.907657+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:04:05.907657+0000","last_undegraded":"2024-08-31T04:04:05.907657+0000","last_fullsized":"2024-08-31T04:04:05.907657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:54.094714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034962+0000","last_change":"2024-08-31T04:04:00.886779+0000","last_active":"2024-08-31T04:04:06.034962+0000","last_peered":"2024-08-31T04:04:06.034962+0000","last_clean":"2024-08-31T04:04:06.034962+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:04:06.034962+0000","last_undegraded":"2024-08-31T04:04:06.034962+0000","last_fullsized":"2024-08-31T04:04:06.034962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:45:51.487016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:14.844048+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:04:14.844048+0000","last_peered":"2024-08-31T04:04:14.844048+0000","last_clean":"2024-08-31T04:04:14.844048+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:04:14.844048+0000","last_undegraded":"2024-08-31T04:04:14.844048+0000","last_fullsized":"2024-08-31T04:04:14.844048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904234+0000","last_change":"2024-08-31T04:04:04.960945+0000","last_active":"2024-08-31T04:04:05.904234+0000","last_peered":"2024-08-31T04:04:05.904234+0000","last_clean":"2024-08-31T04:04:05.904234+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:04:05.904234+0000","last_undegraded":"2024-08-31T04:04:05.904234+0000","last_fullsized":"2024-08-31T04:04:05.904234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:50.907644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906484+0000","last_change":"2024-08-31T04:04:00.869565+0000","last_active":"2024-08-31T04:04:05.906484+0000","last_peered":"2024-08-31T04:04:05.906484+0000","last_clean":"2024-08-31T04:04:05.906484+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:04:05.906484+0000","last_undegraded":"2024-08-31T04:04:05.906484+0000","last_fullsized":"2024-08-31T04:04:05.906484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:37.334753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043126+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:04:06.043126+0000","last_peered":"2024-08-31T04:04:06.043126+0000","last_clean":"2024-08-31T04:04:06.043126+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:04:06.043126+0000","last_undegraded":"2024-08-31T04:04:06.043126+0000","last_fullsized":"2024-08-31T04:04:06.043126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904892+0000","last_change":"2024-08-31T04:04:04.940655+0000","last_active":"2024-08-31T04:04:05.904892+0000","last_peered":"2024-08-31T04:04:05.904892+0000","last_clean":"2024-08-31T04:04:05.904892+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:04:05.904892+0000","last_undegraded":"2024-08-31T04:04:05.904892+0000","last_fullsized":"2024-08-31T04:04:05.904892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:12:39.145645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040892+0000","last_change":"2024-08-31T04:04:00.881774+0000","last_active":"2024-08-31T04:04:06.040892+0000","last_peered":"2024-08-31T04:04:06.040892+0000","last_clean":"2024-08-31T04:04:06.040892+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:04:06.040892+0000","last_undegraded":"2024-08-31T04:04:06.040892+0000","last_fullsized":"2024-08-31T04:04:06.040892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:19.539642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034980+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:04:06.034980+0000","last_peered":"2024-08-31T04:04:06.034980+0000","last_clean":"2024-08-31T04:04:06.034980+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:04:06.034980+0000","last_undegraded":"2024-08-31T04:04:06.034980+0000","last_fullsized":"2024-08-31T04:04:06.034980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037542+0000","last_change":"2024-08-31T04:04:04.948582+0000","last_active":"2024-08-31T04:04:06.037542+0000","last_peered":"2024-08-31T04:04:06.037542+0000","last_clean":"2024-08-31T04:04:06.037542+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:04:06.037542+0000","last_undegraded":"2024-08-31T04:04:06.037542+0000","last_fullsized":"2024-08-31T04:04:06.037542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:35.294731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905846+0000","last_change":"2024-08-31T04:04:00.863199+0000","last_active":"2024-08-31T04:04:05.905846+0000","last_peered":"2024-08-31T04:04:05.905846+0000","last_clean":"2024-08-31T04:04:05.905846+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:04:05.905846+0000","last_undegraded":"2024-08-31T04:04:05.905846+0000","last_fullsized":"2024-08-31T04:04:05.905846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:52.086202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036024+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:04:06.036024+0000","last_peered":"2024-08-31T04:04:06.036024+0000","last_clean":"2024-08-31T04:04:06.036024+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:04:06.036024+0000","last_undegraded":"2024-08-31T04:04:06.036024+0000","last_fullsized":"2024-08-31T04:04:06.036024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904421+0000","last_change":"2024-08-31T04:04:04.940930+0000","last_active":"2024-08-31T04:04:05.904421+0000","last_peered":"2024-08-31T04:04:05.904421+0000","last_clean":"2024-08-31T04:04:05.904421+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:04:05.904421+0000","last_undegraded":"2024-08-31T04:04:05.904421+0000","last_fullsized":"2024-08-31T04:04:05.904421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:07:30.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905335+0000","last_change":"2024-08-31T04:04:04.970283+0000","last_active":"2024-08-31T04:04:05.905335+0000","last_peered":"2024-08-31T04:04:05.905335+0000","last_clean":"2024-08-31T04:04:05.905335+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:04:05.905335+0000","last_undegraded":"2024-08-31T04:04:05.905335+0000","last_fullsized":"2024-08-31T04:04:05.905335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:37.086560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904353+0000","last_change":"2024-08-31T04:04:00.897277+0000","last_active":"2024-08-31T04:04:05.904353+0000","last_peered":"2024-08-31T04:04:05.904353+0000","last_clean":"2024-08-31T04:04:05.904353+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:04:05.904353+0000","last_undegraded":"2024-08-31T04:04:05.904353+0000","last_fullsized":"2024-08-31T04:04:05.904353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:45:42.808934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905834+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:04:05.905834+0000","last_peered":"2024-08-31T04:04:05.905834+0000","last_clean":"2024-08-31T04:04:05.905834+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:04:05.905834+0000","last_undegraded":"2024-08-31T04:04:05.905834+0000","last_fullsized":"2024-08-31T04:04:05.905834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906316+0000","last_change":"2024-08-31T04:04:04.966233+0000","last_active":"2024-08-31T04:04:05.906316+0000","last_peered":"2024-08-31T04:04:05.906316+0000","last_clean":"2024-08-31T04:04:05.906316+0000","last_became_active":"2024-08-31T04:04:04.965854+0000","last_became_peered":"2024-08-31T04:04:04.965854+0000","last_unstale":"2024-08-31T04:04:05.906316+0000","last_undegraded":"2024-08-31T04:04:05.906316+0000","last_fullsized":"2024-08-31T04:04:05.906316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:16.448331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040110+0000","last_change":"2024-08-31T04:04:00.888009+0000","last_active":"2024-08-31T04:04:06.040110+0000","last_peered":"2024-08-31T04:04:06.040110+0000","last_clean":"2024-08-31T04:04:06.040110+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:04:06.040110+0000","last_undegraded":"2024-08-31T04:04:06.040110+0000","last_fullsized":"2024-08-31T04:04:06.040110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:31.977791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038384+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:04:06.038384+0000","last_peered":"2024-08-31T04:04:06.038384+0000","last_clean":"2024-08-31T04:04:06.038384+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:04:06.038384+0000","last_undegraded":"2024-08-31T04:04:06.038384+0000","last_fullsized":"2024-08-31T04:04:06.038384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907256+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:04:05.907256+0000","last_peered":"2024-08-31T04:04:05.907256+0000","last_clean":"2024-08-31T04:04:05.907256+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:04:05.907256+0000","last_undegraded":"2024-08-31T04:04:05.907256+0000","last_fullsized":"2024-08-31T04:04:05.907256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904794+0000","last_change":"2024-08-31T04:04:00.897537+0000","last_active":"2024-08-31T04:04:05.904794+0000","last_peered":"2024-08-31T04:04:05.904794+0000","last_clean":"2024-08-31T04:04:05.904794+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:04:05.904794+0000","last_undegraded":"2024-08-31T04:04:05.904794+0000","last_fullsized":"2024-08-31T04:04:05.904794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:46.422487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905083+0000","last_change":"2024-08-31T04:04:04.961002+0000","last_active":"2024-08-31T04:04:05.905083+0000","last_peered":"2024-08-31T04:04:05.905083+0000","last_clean":"2024-08-31T04:04:05.905083+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:04:05.905083+0000","last_undegraded":"2024-08-31T04:04:05.905083+0000","last_fullsized":"2024-08-31T04:04:05.905083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:45:04.605970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039694+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:04:06.039694+0000","last_peered":"2024-08-31T04:04:06.039694+0000","last_clean":"2024-08-31T04:04:06.039694+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:04:06.039694+0000","last_undegraded":"2024-08-31T04:04:06.039694+0000","last_fullsized":"2024-08-31T04:04:06.039694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035174+0000","last_change":"2024-08-31T04:04:00.878599+0000","last_active":"2024-08-31T04:04:06.035174+0000","last_peered":"2024-08-31T04:04:06.035174+0000","last_clean":"2024-08-31T04:04:06.035174+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:04:06.035174+0000","last_undegraded":"2024-08-31T04:04:06.035174+0000","last_fullsized":"2024-08-31T04:04:06.035174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:37.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043082+0000","last_change":"2024-08-31T04:04:04.975414+0000","last_active":"2024-08-31T04:04:06.043082+0000","last_peered":"2024-08-31T04:04:06.043082+0000","last_clean":"2024-08-31T04:04:06.043082+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:04:06.043082+0000","last_undegraded":"2024-08-31T04:04:06.043082+0000","last_fullsized":"2024-08-31T04:04:06.043082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:12.992949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904092+0000","last_change":"2024-08-31T04:04:00.887117+0000","last_active":"2024-08-31T04:04:05.904092+0000","last_peered":"2024-08-31T04:04:05.904092+0000","last_clean":"2024-08-31T04:04:05.904092+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:04:05.904092+0000","last_undegraded":"2024-08-31T04:04:05.904092+0000","last_fullsized":"2024-08-31T04:04:05.904092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:18:37.474694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037663+0000","last_change":"2024-08-31T04:04:00.881033+0000","last_active":"2024-08-31T04:04:06.037663+0000","last_peered":"2024-08-31T04:04:06.037663+0000","last_clean":"2024-08-31T04:04:06.037663+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:04:06.037663+0000","last_undegraded":"2024-08-31T04:04:06.037663+0000","last_fullsized":"2024-08-31T04:04:06.037663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:46.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907098+0000","last_change":"2024-08-31T04:04:00.879791+0000","last_active":"2024-08-31T04:04:05.907098+0000","last_peered":"2024-08-31T04:04:05.907098+0000","last_clean":"2024-08-31T04:04:05.907098+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:04:05.907098+0000","last_undegraded":"2024-08-31T04:04:05.907098+0000","last_fullsized":"2024-08-31T04:04:05.907098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:00:26.128387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039321+0000","last_change":"2024-08-31T04:04:00.876487+0000","last_active":"2024-08-31T04:04:06.039321+0000","last_peered":"2024-08-31T04:04:06.039321+0000","last_clean":"2024-08-31T04:04:06.039321+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:04:06.039321+0000","last_undegraded":"2024-08-31T04:04:06.039321+0000","last_fullsized":"2024-08-31T04:04:06.039321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:10.867317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042600+0000","last_change":"2024-08-31T04:04:00.888017+0000","last_active":"2024-08-31T04:04:06.042600+0000","last_peered":"2024-08-31T04:04:06.042600+0000","last_clean":"2024-08-31T04:04:06.042600+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:04:06.042600+0000","last_undegraded":"2024-08-31T04:04:06.042600+0000","last_fullsized":"2024-08-31T04:04:06.042600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:53.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042480+0000","last_change":"2024-08-31T04:04:00.885850+0000","last_active":"2024-08-31T04:04:06.042480+0000","last_peered":"2024-08-31T04:04:06.042480+0000","last_clean":"2024-08-31T04:04:06.042480+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:04:06.042480+0000","last_undegraded":"2024-08-31T04:04:06.042480+0000","last_fullsized":"2024-08-31T04:04:06.042480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:07.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905742+0000","last_change":"2024-08-31T04:04:00.870086+0000","last_active":"2024-08-31T04:04:05.905742+0000","last_peered":"2024-08-31T04:04:05.905742+0000","last_clean":"2024-08-31T04:04:05.905742+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:04:05.905742+0000","last_undegraded":"2024-08-31T04:04:05.905742+0000","last_fullsized":"2024-08-31T04:04:05.905742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:59.724104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040115+0000","last_change":"2024-08-31T04:04:00.881124+0000","last_active":"2024-08-31T04:04:06.040115+0000","last_peered":"2024-08-31T04:04:06.040115+0000","last_clean":"2024-08-31T04:04:06.040115+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:04:06.040115+0000","last_undegraded":"2024-08-31T04:04:06.040115+0000","last_fullsized":"2024-08-31T04:04:06.040115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:40.389131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905727+0000","last_change":"2024-08-31T04:04:00.880040+0000","last_active":"2024-08-31T04:04:05.905727+0000","last_peered":"2024-08-31T04:04:05.905727+0000","last_clean":"2024-08-31T04:04:05.905727+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:04:05.905727+0000","last_undegraded":"2024-08-31T04:04:05.905727+0000","last_fullsized":"2024-08-31T04:04:05.905727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:23.110254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039483+0000","last_change":"2024-08-31T04:04:00.867373+0000","last_active":"2024-08-31T04:04:06.039483+0000","last_peered":"2024-08-31T04:04:06.039483+0000","last_clean":"2024-08-31T04:04:06.039483+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:04:06.039483+0000","last_undegraded":"2024-08-31T04:04:06.039483+0000","last_fullsized":"2024-08-31T04:04:06.039483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:47.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035293+0000","last_change":"2024-08-31T04:04:00.884497+0000","last_active":"2024-08-31T04:04:06.035293+0000","last_peered":"2024-08-31T04:04:06.035293+0000","last_clean":"2024-08-31T04:04:06.035293+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:04:06.035293+0000","last_undegraded":"2024-08-31T04:04:06.035293+0000","last_fullsized":"2024-08-31T04:04:06.035293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:10.005789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904753+0000","last_change":"2024-08-31T04:04:00.899676+0000","last_active":"2024-08-31T04:04:05.904753+0000","last_peered":"2024-08-31T04:04:05.904753+0000","last_clean":"2024-08-31T04:04:05.904753+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:04:05.904753+0000","last_undegraded":"2024-08-31T04:04:05.904753+0000","last_fullsized":"2024-08-31T04:04:05.904753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:46.887325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035316+0000","last_change":"2024-08-31T04:04:00.872910+0000","last_active":"2024-08-31T04:04:06.035316+0000","last_peered":"2024-08-31T04:04:06.035316+0000","last_clean":"2024-08-31T04:04:06.035316+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:04:06.035316+0000","last_undegraded":"2024-08-31T04:04:06.035316+0000","last_fullsized":"2024-08-31T04:04:06.035316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:22.208293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907979+0000","last_change":"2024-08-31T04:04:00.897114+0000","last_active":"2024-08-31T04:04:05.907979+0000","last_peered":"2024-08-31T04:04:05.907979+0000","last_clean":"2024-08-31T04:04:05.907979+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:04:05.907979+0000","last_undegraded":"2024-08-31T04:04:05.907979+0000","last_fullsized":"2024-08-31T04:04:05.907979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:13.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044036+0000","last_change":"2024-08-31T04:04:00.879907+0000","last_active":"2024-08-31T04:04:06.044036+0000","last_peered":"2024-08-31T04:04:06.044036+0000","last_clean":"2024-08-31T04:04:06.044036+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:04:06.044036+0000","last_undegraded":"2024-08-31T04:04:06.044036+0000","last_fullsized":"2024-08-31T04:04:06.044036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:11.042911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908418+0000","last_change":"2024-08-31T04:04:00.874247+0000","last_active":"2024-08-31T04:04:05.908418+0000","last_peered":"2024-08-31T04:04:05.908418+0000","last_clean":"2024-08-31T04:04:05.908418+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:04:05.908418+0000","last_undegraded":"2024-08-31T04:04:05.908418+0000","last_fullsized":"2024-08-31T04:04:05.908418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:00.974919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905612+0000","last_change":"2024-08-31T04:04:00.861922+0000","last_active":"2024-08-31T04:04:05.905612+0000","last_peered":"2024-08-31T04:04:05.905612+0000","last_clean":"2024-08-31T04:04:05.905612+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:04:05.905612+0000","last_undegraded":"2024-08-31T04:04:05.905612+0000","last_fullsized":"2024-08-31T04:04:05.905612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:07.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038950+0000","last_change":"2024-08-31T04:04:00.873986+0000","last_active":"2024-08-31T04:04:06.038950+0000","last_peered":"2024-08-31T04:04:06.038950+0000","last_clean":"2024-08-31T04:04:06.038950+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:04:06.038950+0000","last_undegraded":"2024-08-31T04:04:06.038950+0000","last_fullsized":"2024-08-31T04:04:06.038950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:39.934600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040728+0000","last_change":"2024-08-31T04:04:00.887510+0000","last_active":"2024-08-31T04:04:06.040728+0000","last_peered":"2024-08-31T04:04:06.040728+0000","last_clean":"2024-08-31T04:04:06.040728+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:04:06.040728+0000","last_undegraded":"2024-08-31T04:04:06.040728+0000","last_fullsized":"2024-08-31T04:04:06.040728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:29.689714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041269+0000","last_change":"2024-08-31T04:04:00.886364+0000","last_active":"2024-08-31T04:04:06.041269+0000","last_peered":"2024-08-31T04:04:06.041269+0000","last_clean":"2024-08-31T04:04:06.041269+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:04:06.041269+0000","last_undegraded":"2024-08-31T04:04:06.041269+0000","last_fullsized":"2024-08-31T04:04:06.041269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:17.949115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035208+0000","last_change":"2024-08-31T04:04:00.885452+0000","last_active":"2024-08-31T04:04:06.035208+0000","last_peered":"2024-08-31T04:04:06.035208+0000","last_clean":"2024-08-31T04:04:06.035208+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:04:06.035208+0000","last_undegraded":"2024-08-31T04:04:06.035208+0000","last_fullsized":"2024-08-31T04:04:06.035208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:34:58.727576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035971+0000","last_change":"2024-08-31T04:04:00.876816+0000","last_active":"2024-08-31T04:04:06.035971+0000","last_peered":"2024-08-31T04:04:06.035971+0000","last_clean":"2024-08-31T04:04:06.035971+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:04:06.035971+0000","last_undegraded":"2024-08-31T04:04:06.035971+0000","last_fullsized":"2024-08-31T04:04:06.035971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:38.896525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034790+0000","last_change":"2024-08-31T04:04:00.878584+0000","last_active":"2024-08-31T04:04:06.034790+0000","last_peered":"2024-08-31T04:04:06.034790+0000","last_clean":"2024-08-31T04:04:06.034790+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:04:06.034790+0000","last_undegraded":"2024-08-31T04:04:06.034790+0000","last_fullsized":"2024-08-31T04:04:06.034790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:30.201712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035980+0000","last_change":"2024-08-31T04:04:00.866007+0000","last_active":"2024-08-31T04:04:06.035980+0000","last_peered":"2024-08-31T04:04:06.035980+0000","last_clean":"2024-08-31T04:04:06.035980+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:04:06.035980+0000","last_undegraded":"2024-08-31T04:04:06.035980+0000","last_fullsized":"2024-08-31T04:04:06.035980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:05.236271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039665+0000","last_change":"2024-08-31T04:04:00.882356+0000","last_active":"2024-08-31T04:04:06.039665+0000","last_peered":"2024-08-31T04:04:06.039665+0000","last_clean":"2024-08-31T04:04:06.039665+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:04:06.039665+0000","last_undegraded":"2024-08-31T04:04:06.039665+0000","last_fullsized":"2024-08-31T04:04:06.039665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:44:37.026732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034726+0000","last_change":"2024-08-31T04:04:00.897170+0000","last_active":"2024-08-31T04:04:06.034726+0000","last_peered":"2024-08-31T04:04:06.034726+0000","last_clean":"2024-08-31T04:04:06.034726+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:04:06.034726+0000","last_undegraded":"2024-08-31T04:04:06.034726+0000","last_fullsized":"2024-08-31T04:04:06.034726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:05.673647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904588+0000","last_change":"2024-08-31T04:04:00.897956+0000","last_active":"2024-08-31T04:04:05.904588+0000","last_peered":"2024-08-31T04:04:05.904588+0000","last_clean":"2024-08-31T04:04:05.904588+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:04:05.904588+0000","last_undegraded":"2024-08-31T04:04:05.904588+0000","last_fullsized":"2024-08-31T04:04:05.904588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.686037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035844+0000","last_change":"2024-08-31T04:04:00.883315+0000","last_active":"2024-08-31T04:04:06.035844+0000","last_peered":"2024-08-31T04:04:06.035844+0000","last_clean":"2024-08-31T04:04:06.035844+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:04:06.035844+0000","last_undegraded":"2024-08-31T04:04:06.035844+0000","last_fullsized":"2024-08-31T04:04:06.035844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:41.258604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904958+0000","last_change":"2024-08-31T04:04:00.892502+0000","last_active":"2024-08-31T04:04:05.904958+0000","last_peered":"2024-08-31T04:04:05.904958+0000","last_clean":"2024-08-31T04:04:05.904958+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:04:05.904958+0000","last_undegraded":"2024-08-31T04:04:05.904958+0000","last_fullsized":"2024-08-31T04:04:05.904958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:04:48.381328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041280+0000","last_change":"2024-08-31T04:04:00.892994+0000","last_active":"2024-08-31T04:04:06.041280+0000","last_peered":"2024-08-31T04:04:06.041280+0000","last_clean":"2024-08-31T04:04:06.041280+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:04:06.041280+0000","last_undegraded":"2024-08-31T04:04:06.041280+0000","last_fullsized":"2024-08-31T04:04:06.041280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:00.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040294+0000","last_change":"2024-08-31T04:04:00.887325+0000","last_active":"2024-08-31T04:04:06.040294+0000","last_peered":"2024-08-31T04:04:06.040294+0000","last_clean":"2024-08-31T04:04:06.040294+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:04:06.040294+0000","last_undegraded":"2024-08-31T04:04:06.040294+0000","last_fullsized":"2024-08-31T04:04:06.040294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:15.674452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035235+0000","last_change":"2024-08-31T04:04:00.881745+0000","last_active":"2024-08-31T04:04:06.035235+0000","last_peered":"2024-08-31T04:04:06.035235+0000","last_clean":"2024-08-31T04:04:06.035235+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:04:06.035235+0000","last_undegraded":"2024-08-31T04:04:06.035235+0000","last_fullsized":"2024-08-31T04:04:06.035235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:01.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476746,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":105356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476746,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476747,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476747,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":104830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":868352,"data_stored":695234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35624,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336216,"statfs":{"total":96636764160,"available":96600285184,"internally_reserved":0,"allocated":286720,"data_stored":109288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":104898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:04:26.871 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-31T04:04:26.871 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-08-31T04:04:26.871 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-31T04:04:27.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.060+0000 7fbbbc200640 1 -- 172.21.15.89:0/1890112427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb9c004810 msgr2=0x7fbb9c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.060+0000 7fbbbc200640 1 --2- 172.21.15.89:0/1890112427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb9c004810 0x7fbb9c004c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbba000c310 tx=0x7fbba001cf20 comp rx=0 tx=0).stop 2024-08-31T04:04:27.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.060+0000 7fbbbc200640 1 -- 172.21.15.89:0/1890112427 shutdown_connections 2024-08-31T04:04:27.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.060+0000 7fbbbc200640 1 --2- 172.21.15.89:0/1890112427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb9c004810 0x7fbb9c004c20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.060+0000 7fbbbc200640 1 -- 172.21.15.89:0/1890112427 >> 172.21.15.89:0/1890112427 conn(0x7fbbb40ccf20 msgr2=0x7fbbb40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:27.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.060+0000 7fbbbc200640 1 -- 172.21.15.89:0/1890112427 shutdown_connections 2024-08-31T04:04:27.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.060+0000 7fbbbc200640 1 -- 172.21.15.89:0/1890112427 wait complete. 2024-08-31T04:04:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 Processor -- start 2024-08-31T04:04:27.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 -- start start 2024-08-31T04:04:27.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb9c004810 0x7fbbb40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbbb40cb400 0x7fbbb41f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb414fdd0 0x7fbbb40c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb40c94b0 con 0x7fbbb414fdd0 2024-08-31T04:04:27.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb40c9330 con 0x7fbb9c004810 2024-08-31T04:04:27.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb40c9630 con 0x7fbbb40cb400 2024-08-31T04:04:27.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbba200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb414fdd0 0x7fbbb40c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbba200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb414fdd0 0x7fbbb40c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41560/0 (socket says 172.21.15.89:41560) 2024-08-31T04:04:27.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbba200640 1 -- 172.21.15.89:0/2288500079 learned_addr learned my addr 172.21.15.89:0/2288500079 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbb8e00640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbbb40cb400 0x7fbbb41f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbb9800640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb9c004810 0x7fbbb40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbba200640 1 -- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbbb40cb400 msgr2=0x7fbbb41f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbba200640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbbb40cb400 0x7fbbb41f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbba200640 1 -- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb9c004810 msgr2=0x7fbbb40cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbba200640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb9c004810 0x7fbbb40cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbba200640 1 -- 172.21.15.89:0/2288500079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb40c5190 con 0x7fbbb414fdd0 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbba200640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb414fdd0 0x7fbbb40c5890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40cadf0 tx=0x7fbbac010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbb1600640 1 -- 172.21.15.89:0/2288500079 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac017070 con 0x7fbbb414fdd0 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbb1600640 1 -- 172.21.15.89:0/2288500079 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbac015070 con 0x7fbbb414fdd0 2024-08-31T04:04:27.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbb1600640 1 -- 172.21.15.89:0/2288500079 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac004d90 con 0x7fbbb414fdd0 2024-08-31T04:04:27.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb41f62f0 con 0x7fbbb414fdd0 2024-08-31T04:04:27.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.064+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb41e6660 con 0x7fbbb414fdd0 2024-08-31T04:04:27.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.068+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb40c7920 con 0x7fbbb414fdd0 2024-08-31T04:04:27.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.068+0000 7fbbb1600640 1 -- 172.21.15.89:0/2288500079 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbbac003980 con 0x7fbbb414fdd0 2024-08-31T04:04:27.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.068+0000 7fbbb1600640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbb94072090 0x7fbb940745a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.068+0000 7fbbb1600640 1 -- 172.21.15.89:0/2288500079 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbbac0934b0 con 0x7fbbb414fdd0 2024-08-31T04:04:27.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.068+0000 7fbbb9800640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbb94072090 0x7fbb940745a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.072+0000 7fbbb9800640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbb94072090 0x7fbb940745a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbba8006fd0 tx=0x7fbba8006b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:27.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.072+0000 7fbbb1600640 1 -- 172.21.15.89:0/2288500079 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbbb40c5190 con 0x7fbbb414fdd0 2024-08-31T04:04:27.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.240+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fbbb41560a0 con 0x7fbbb414fdd0 2024-08-31T04:04:27.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbb1600640 1 -- 172.21.15.89:0/2288500079 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v32) ==== 86+0+160 (secure 0 0 0) 0x7fbbac05e3d0 con 0x7fbbb414fdd0 2024-08-31T04:04:27.244 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:27.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbb94072090 msgr2=0x7fbb940745a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbb94072090 0x7fbb940745a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbba8006fd0 tx=0x7fbba8006b80 comp rx=0 tx=0).stop 2024-08-31T04:04:27.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb414fdd0 msgr2=0x7fbbb40c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb414fdd0 0x7fbbb40c5890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40cadf0 tx=0x7fbbac010f20 comp rx=0 tx=0).stop 2024-08-31T04:04:27.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 shutdown_connections 2024-08-31T04:04:27.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbb94072090 0x7fbb940745a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbb414fdd0 0x7fbbb40c5890 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbbb40cb400 0x7fbbb41f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 --2- 172.21.15.89:0/2288500079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb9c004810 0x7fbbb40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 >> 172.21.15.89:0/2288500079 conn(0x7fbbb40ccf20 msgr2=0x7fbbb40b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:27.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 shutdown_connections 2024-08-31T04:04:27.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.244+0000 7fbbbc200640 1 -- 172.21.15.89:0/2288500079 wait complete. 2024-08-31T04:04:27.266 INFO:teuthology.orchestra.run.smithi089.stdout:[{"version":32,"timestamp":"2024-08-31T04:03:49.352138+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"3414.516172"}]}] 2024-08-31T04:04:27.267 INFO:tasks.ceph_manager:config epoch is 32 2024-08-31T04:04:27.267 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T04:04:27.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-31T04:04:27.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-31T04:04:27.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.420+0000 7f3404e00640 1 -- 172.21.15.89:0/4119483651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e4003a40 msgr2=0x7f33e4003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.420+0000 7f3404e00640 1 --2- 172.21.15.89:0/4119483651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e4003a40 0x7f33e4003eb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33f000c2e0 tx=0x7f33f001f6e0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.420+0000 7f33fe800640 1 -- 172.21.15.89:0/4119483651 reap_dead start 2024-08-31T04:04:27.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.420+0000 7f3404e00640 1 -- 172.21.15.89:0/4119483651 shutdown_connections 2024-08-31T04:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.420+0000 7f3404e00640 1 -- 172.21.15.89:0/4119483651 >> 172.21.15.89:0/4119483651 conn(0x7f34000ccf20 msgr2=0x7f34000cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.420+0000 7f3404e00640 1 -- 172.21.15.89:0/4119483651 shutdown_connections 2024-08-31T04:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.420+0000 7f3404e00640 1 -- 172.21.15.89:0/4119483651 wait complete. 2024-08-31T04:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.420+0000 7f3404e00640 1 Processor -- start 2024-08-31T04:04:27.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.420+0000 7f3404e00640 1 -- start start 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f3404e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e4003a40 0x7f34001f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f3404e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34000c3bd0 0x7f3400157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f3404e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f340015bdb0 0x7f340015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f3404e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f34001599b0 con 0x7f33e4003a40 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f3404e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f340015a2e0 con 0x7f34000c3bd0 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f3404e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3400159c90 con 0x7f340015bdb0 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fde00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e4003a40 0x7f34001f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fde00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e4003a40 0x7f34001f5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41576/0 (socket says 172.21.15.89:41576) 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fde00640 1 -- 172.21.15.89:0/2794609933 learned_addr learned my addr 172.21.15.89:0/2794609933 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:27.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33f5400640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34000c3bd0 0x7f3400157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fe800640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f340015bdb0 0x7f340015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fde00640 1 -- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f340015bdb0 msgr2=0x7f340015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fde00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f340015bdb0 0x7f340015c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fde00640 1 -- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34000c3bd0 msgr2=0x7f3400157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fde00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34000c3bd0 0x7f3400157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fde00640 1 -- 172.21.15.89:0/2794609933 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34001f5ed0 con 0x7f33e4003a40 2024-08-31T04:04:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fe800640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f340015bdb0 0x7f340015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:27.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33fde00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e4003a40 0x7f34001f5990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f33f00b1040 tx=0x7f33f0003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33f6a00640 1 -- 172.21.15.89:0/2794609933 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f00bf070 con 0x7f33e4003a40 2024-08-31T04:04:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33f6a00640 1 -- 172.21.15.89:0/2794609933 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33f0003e50 con 0x7f33e4003a40 2024-08-31T04:04:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34001f2470 con 0x7f33e4003a40 2024-08-31T04:04:27.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f33f6a00640 1 -- 172.21.15.89:0/2794609933 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f00b3070 con 0x7f33e4003a40 2024-08-31T04:04:27.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34001f2a30 con 0x7f33e4003a40 2024-08-31T04:04:27.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.424+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3400157220 con 0x7f33e4003a40 2024-08-31T04:04:27.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.428+0000 7f33f6a00640 1 -- 172.21.15.89:0/2794609933 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f33f00c2070 con 0x7f33e4003a40 2024-08-31T04:04:27.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.428+0000 7f33f6a00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f33dc072120 0x7f33dc074630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.428+0000 7f33f6a00640 1 -- 172.21.15.89:0/2794609933 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f33f01305e0 con 0x7f33e4003a40 2024-08-31T04:04:27.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.428+0000 7f33f5400640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f33dc072120 0x7f33dc074630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.428+0000 7f33f5400640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f33dc072120 0x7f33dc074630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f34000c2820 tx=0x7f33e800d2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:27.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.432+0000 7f33f6a00640 1 -- 172.21.15.89:0/2794609933 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f33f0019490 con 0x7f33e4003a40 2024-08-31T04:04:27.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.636+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3400074c00 con 0x7f33e4003a40 2024-08-31T04:04:27.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.640+0000 7f33f6a00640 1 -- 172.21.15.89:0/2794609933 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+184300 (secure 0 0 0) 0x7f33f00fb500 con 0x7f33e4003a40 2024-08-31T04:04:27.646 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:27.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f33dc072120 msgr2=0x7f33dc074630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f33dc072120 0x7f33dc074630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f34000c2820 tx=0x7f33e800d2e0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e4003a40 msgr2=0x7f34001f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e4003a40 0x7f34001f5990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f33f00b1040 tx=0x7f33f0003c60 comp rx=0 tx=0).stop 2024-08-31T04:04:27.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 shutdown_connections 2024-08-31T04:04:27.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f33dc072120 0x7f33dc074630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f340015bdb0 0x7f340015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34000c3bd0 0x7f3400157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 --2- 172.21.15.89:0/2794609933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e4003a40 0x7f34001f5990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 >> 172.21.15.89:0/2794609933 conn(0x7f34000ccf20 msgr2=0x7f340014caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:27.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 shutdown_connections 2024-08-31T04:04:27.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.644+0000 7f3404e00640 1 -- 172.21.15.89:0/2794609933 wait complete. 2024-08-31T04:04:27.666 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2607723370},{"type":"v1","addr":"172.21.15.170:6801","nonce":2607723370}]},"active_addr":"172.21.15.170:6801/2607723370","active_change":"2024-08-31T04:03:40.102381+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1576628515}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1303668891}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1427048170}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1804820926}]}]} 2024-08-31T04:04:27.670 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-31T04:04:27.670 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-31T04:04:27.671 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:27.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.820+0000 7f948e400640 1 -- 172.21.15.89:0/510471757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94880c97e0 msgr2=0x7f9488156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.820+0000 7f948e400640 1 --2- 172.21.15.89:0/510471757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94880c97e0 0x7f9488156b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f94880b5270 tx=0x7f947801c8c0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.820+0000 7f948e400640 1 -- 172.21.15.89:0/510471757 shutdown_connections 2024-08-31T04:04:27.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.820+0000 7f948e400640 1 --2- 172.21.15.89:0/510471757 >> v2:172.21.15.170:3300/0 conn(0x7f9488159f60 0x7f948815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.820+0000 7f948e400640 1 --2- 172.21.15.89:0/510471757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94880c97e0 0x7f9488156b70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.820+0000 7f948e400640 1 -- 172.21.15.89:0/510471757 >> 172.21.15.89:0/510471757 conn(0x7f9488071be0 msgr2=0x7f948806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:27.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.820+0000 7f948e400640 1 -- 172.21.15.89:0/510471757 shutdown_connections 2024-08-31T04:04:27.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.820+0000 7f948e400640 1 -- 172.21.15.89:0/510471757 wait complete. 2024-08-31T04:04:27.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f948e400640 1 Processor -- start 2024-08-31T04:04:27.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f948e400640 1 -- start start 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f948e400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94880c97e0 0x7f94881f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f948e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94880cedf0 0x7f948814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f948e400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9488159f60 0x7f94880c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f948e400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f94880cf610 con 0x7f9488159f60 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f948e400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f948808cff0 con 0x7f94880cedf0 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f948e400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f94881570b0 con 0x7f94880c97e0 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9487e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9488159f60 0x7f94880c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9487e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9488159f60 0x7f94880c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41586/0 (socket says 172.21.15.89:41586) 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9487400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94880c97e0 0x7f94881f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9487e00640 1 -- 172.21.15.89:0/1854129845 learned_addr learned my addr 172.21.15.89:0/1854129845 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:27.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9486a00640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94880cedf0 0x7f948814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9487e00640 1 -- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94880c97e0 msgr2=0x7f94881f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9487e00640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94880c97e0 0x7f94881f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9487e00640 1 -- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94880cedf0 msgr2=0x7f948814fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:27.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9487e00640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94880cedf0 0x7f948814fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:27.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.824+0000 7f9487e00640 1 -- 172.21.15.89:0/1854129845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9488153020 con 0x7f9488159f60 2024-08-31T04:04:27.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f9487e00640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9488159f60 0x7f94880c71b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f948000c6b0 tx=0x7f948000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:27.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f947f400640 1 -- 172.21.15.89:0/1854129845 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480003b80 con 0x7f9488159f60 2024-08-31T04:04:27.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f947f400640 1 -- 172.21.15.89:0/1854129845 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9480003d20 con 0x7f9488159f60 2024-08-31T04:04:27.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f947f400640 1 -- 172.21.15.89:0/1854129845 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480005330 con 0x7f9488159f60 2024-08-31T04:04:27.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94881f53a0 con 0x7f9488159f60 2024-08-31T04:04:27.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9488152980 con 0x7f9488159f60 2024-08-31T04:04:27.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94880c5160 con 0x7f9488159f60 2024-08-31T04:04:27.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f947f400640 1 -- 172.21.15.89:0/1854129845 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f94800054d0 con 0x7f9488159f60 2024-08-31T04:04:27.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f947f400640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f94680720f0 0x7f9468074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:27.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.828+0000 7f947f400640 1 -- 172.21.15.89:0/1854129845 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9480092ac0 con 0x7f9488159f60 2024-08-31T04:04:27.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.832+0000 7f9487400640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f94680720f0 0x7f9468074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:27.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.832+0000 7f9487400640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f94680720f0 0x7f9468074600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94780af000 tx=0x7f947801b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:27.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:27.836+0000 7f947f400640 1 -- 172.21.15.89:0/1854129845 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9488153020 con 0x7f9488159f60 2024-08-31T04:04:28.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94881524c0 con 0x7f9488159f60 2024-08-31T04:04:28.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f947f400640 1 -- 172.21.15.89:0/1854129845 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18602 (secure 0 0 0) 0x7f948005d9e0 con 0x7f9488159f60 2024-08-31T04:04:28.002 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:28.002 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:05.324706+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:28.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f94680720f0 msgr2=0x7f9468074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f94680720f0 0x7f9468074600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94780af000 tx=0x7f947801b100 comp rx=0 tx=0).stop 2024-08-31T04:04:28.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9488159f60 msgr2=0x7f94880c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9488159f60 0x7f94880c71b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f948000c6b0 tx=0x7f948000cb70 comp rx=0 tx=0).stop 2024-08-31T04:04:28.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 shutdown_connections 2024-08-31T04:04:28.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f94680720f0 0x7f9468074600 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9488159f60 0x7f94880c71b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94880cedf0 0x7f948814fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 --2- 172.21.15.89:0/1854129845 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94880c97e0 0x7f94881f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 >> 172.21.15.89:0/1854129845 conn(0x7f9488071be0 msgr2=0x7f94881573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 shutdown_connections 2024-08-31T04:04:28.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.000+0000 7f948e400640 1 -- 172.21.15.89:0/1854129845 wait complete. 2024-08-31T04:04:28.025 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-31T04:04:28.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:28.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.180+0000 7f07ac400640 1 -- 172.21.15.89:0/3569654495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 msgr2=0x7f078c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.180+0000 7f07ac400640 1 --2- 172.21.15.89:0/3569654495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 0x7f078c00b9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07a40c75e0 tx=0x7f079c01d260 comp rx=0 tx=0).stop 2024-08-31T04:04:28.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.180+0000 7f07ac400640 1 -- 172.21.15.89:0/3569654495 shutdown_connections 2024-08-31T04:04:28.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.180+0000 7f07ac400640 1 --2- 172.21.15.89:0/3569654495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 0x7f078c00b9d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.180+0000 7f07ac400640 1 -- 172.21.15.89:0/3569654495 >> 172.21.15.89:0/3569654495 conn(0x7f07a40ccf20 msgr2=0x7f07a40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.180+0000 7f07ac400640 1 -- 172.21.15.89:0/3569654495 shutdown_connections 2024-08-31T04:04:28.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.180+0000 7f07ac400640 1 -- 172.21.15.89:0/3569654495 wait complete. 2024-08-31T04:04:28.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.180+0000 7f07ac400640 1 Processor -- start 2024-08-31T04:04:28.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.180+0000 7f07ac400640 1 -- start start 2024-08-31T04:04:28.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07ac400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 0x7f07a414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07ac400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a41f5610 0x7f07a415a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07ac400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07a415b040 0x7f07a415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07ac400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f07a40c3150 con 0x7f078c005260 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07ac400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f07a40c26e0 con 0x7f07a41f5610 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07ac400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f07a4152a10 con 0x7f07a415b040 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 0x7f07a414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 0x7f07a414acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41604/0 (socket says 172.21.15.89:41604) 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9a00640 1 -- 172.21.15.89:0/2917014456 learned_addr learned my addr 172.21.15.89:0/2917014456 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9000640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a41f5610 0x7f07a415a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07aa400640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07a415b040 0x7f07a415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9a00640 1 -- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07a415b040 msgr2=0x7f07a415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9a00640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07a415b040 0x7f07a415b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9a00640 1 -- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a41f5610 msgr2=0x7f07a415a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9a00640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a41f5610 0x7f07a415a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9a00640 1 -- 172.21.15.89:0/2917014456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a41f2080 con 0x7f078c005260 2024-08-31T04:04:28.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a9a00640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 0x7f07a414acc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0798011820 tx=0x7f0798011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a1600640 1 -- 172.21.15.89:0/2917014456 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798004460 con 0x7f078c005260 2024-08-31T04:04:28.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a1600640 1 -- 172.21.15.89:0/2917014456 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0798016070 con 0x7f078c005260 2024-08-31T04:04:28.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a41f2360 con 0x7f078c005260 2024-08-31T04:04:28.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a1600640 1 -- 172.21.15.89:0/2917014456 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079800fae0 con 0x7f078c005260 2024-08-31T04:04:28.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a41f2920 con 0x7f078c005260 2024-08-31T04:04:28.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a40c7920 con 0x7f078c005260 2024-08-31T04:04:28.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.184+0000 7f07a1600640 1 -- 172.21.15.89:0/2917014456 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0798018030 con 0x7f078c005260 2024-08-31T04:04:28.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.188+0000 7f07a1600640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f07840720f0 0x7f0784074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.188+0000 7f07a1600640 1 -- 172.21.15.89:0/2917014456 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0798093520 con 0x7f078c005260 2024-08-31T04:04:28.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.188+0000 7f07a9000640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f07840720f0 0x7f0784074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.188+0000 7f07a9000640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f07840720f0 0x7f0784074600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07a41ef9d0 tx=0x7f0790006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.192+0000 7f07a1600640 1 -- 172.21.15.89:0/2917014456 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f079805ebc0 con 0x7f078c005260 2024-08-31T04:04:28.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.360+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07a40b2cb0 con 0x7f078c005260 2024-08-31T04:04:28.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07a1600640 1 -- 172.21.15.89:0/2917014456 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18602 (secure 0 0 0) 0x7f079805e4c0 con 0x7f078c005260 2024-08-31T04:04:28.365 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:28.365 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:05.324706+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:28.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f07840720f0 msgr2=0x7f0784074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f07840720f0 0x7f0784074600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f07a41ef9d0 tx=0x7f0790006a30 comp rx=0 tx=0).stop 2024-08-31T04:04:28.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 msgr2=0x7f07a414acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 0x7f07a414acc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0798011820 tx=0x7f0798011ce0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 shutdown_connections 2024-08-31T04:04:28.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f07840720f0 0x7f0784074600 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07a415b040 0x7f07a415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07a41f5610 0x7f07a415a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 --2- 172.21.15.89:0/2917014456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f078c005260 0x7f07a414acc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 >> 172.21.15.89:0/2917014456 conn(0x7f07a40ccf20 msgr2=0x7f07a414fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 shutdown_connections 2024-08-31T04:04:28.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.364+0000 7f07ac400640 1 -- 172.21.15.89:0/2917014456 wait complete. 2024-08-31T04:04:28.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-31T04:04:28.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-31T04:04:28.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-31T04:04:28.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-31T04:04:28.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-31T04:04:28.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-31T04:04:28.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-31T04:04:28.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-31T04:04:28.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.664+0000 7fe833400640 1 -- 172.21.15.89:0/492077311 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8200a6dd0 con 0x7fe8340cb470 2024-08-31T04:04:28.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.668+0000 7fe83a000640 1 -- 172.21.15.89:0/492077311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8340cb470 msgr2=0x7fe8340ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.668+0000 7fe83a000640 1 --2- 172.21.15.89:0/492077311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8340cb470 0x7fe8340ca220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe820009840 tx=0x7fe82001c820 comp rx=0 tx=0).stop 2024-08-31T04:04:28.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.668+0000 7fe83a000640 1 -- 172.21.15.89:0/492077311 shutdown_connections 2024-08-31T04:04:28.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.668+0000 7fe83a000640 1 --2- 172.21.15.89:0/492077311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8340cb470 0x7fe8340ca220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.668+0000 7fe83a000640 1 -- 172.21.15.89:0/492077311 >> 172.21.15.89:0/492077311 conn(0x7fe8340cf030 msgr2=0x7fe8340cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.668+0000 7fe83a000640 1 -- 172.21.15.89:0/492077311 shutdown_connections 2024-08-31T04:04:28.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.668+0000 7fe83a000640 1 -- 172.21.15.89:0/492077311 wait complete. 2024-08-31T04:04:28.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f55ef800640 1 -- 172.21.15.89:0/1526834195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e8155b30 msgr2=0x7f55e8163d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f55ef800640 1 --2- 172.21.15.89:0/1526834195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e8155b30 0x7f55e8163d50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009870 tx=0x7f55e001ef70 comp rx=0 tx=0).stop 2024-08-31T04:04:28.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f55ef800640 1 -- 172.21.15.89:0/1526834195 shutdown_connections 2024-08-31T04:04:28.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f55ef800640 1 --2- 172.21.15.89:0/1526834195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e8155b30 0x7f55e8163d50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f55ef800640 1 -- 172.21.15.89:0/1526834195 >> 172.21.15.89:0/1526834195 conn(0x7f55e80cd1e0 msgr2=0x7f55e80c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7fe83a000640 1 Processor -- start 2024-08-31T04:04:28.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7fe83a000640 1 -- start start 2024-08-31T04:04:28.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f0f0fa00640 1 -- 172.21.15.89:0/1305716815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f080c1f40 msgr2=0x7f0f080c3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f0f0fa00640 1 --2- 172.21.15.89:0/1305716815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f080c1f40 0x7f0f080c3980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009900 tx=0x7f0ef401f0d0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f55ef800640 1 -- 172.21.15.89:0/1526834195 shutdown_connections 2024-08-31T04:04:28.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f0f0fa00640 1 -- 172.21.15.89:0/1305716815 shutdown_connections 2024-08-31T04:04:28.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f0f0fa00640 1 --2- 172.21.15.89:0/1305716815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f080c8cd0 0x7f0f08151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f0f0fa00640 1 --2- 172.21.15.89:0/1305716815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f080c1f40 0x7f0f080c3980 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009900 tx=0x7f0ef401f0d0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f0f0fa00640 1 -- 172.21.15.89:0/1305716815 >> 172.21.15.89:0/1305716815 conn(0x7f0f080ccf20 msgr2=0x7f0f080cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f55ef800640 1 -- 172.21.15.89:0/1526834195 wait complete. 2024-08-31T04:04:28.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f2bdfe00640 1 -- 172.21.15.89:0/1704540002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd80b2fd0 msgr2=0x7f2bd80c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7f2bdfe00640 1 --2- 172.21.15.89:0/1704540002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd80b2fd0 0x7f2bd80c7920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80719a0 tx=0x7f2bd001cbc0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7fe83a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8340c59f0 0x7fe8340c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7fe83a000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8340cb470 0x7fe8340b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7fe83a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe83415a190 0x7fe83414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7fe83a000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe834167210 con 0x7fe8340c59f0 2024-08-31T04:04:28.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7fe83a000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe834167090 con 0x7fe83415a190 2024-08-31T04:04:28.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.672+0000 7fe83a000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe834167390 con 0x7fe8340cb470 2024-08-31T04:04:28.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f0f0fa00640 1 -- 172.21.15.89:0/1305716815 shutdown_connections 2024-08-31T04:04:28.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f2bdfe00640 1 -- 172.21.15.89:0/1704540002 shutdown_connections 2024-08-31T04:04:28.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f2bdfe00640 1 --2- 172.21.15.89:0/1704540002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd80b2fd0 0x7f2bd80c7920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f2bdfe00640 1 --2- 172.21.15.89:0/1704540002 >> v2:172.21.15.89:3300/0 conn(0x7f2bd8073610 0x7f2bd80c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f2bdfe00640 1 -- 172.21.15.89:0/1704540002 >> 172.21.15.89:0/1704540002 conn(0x7f2bd80ccf20 msgr2=0x7f2bd80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f0f0fa00640 1 -- 172.21.15.89:0/1305716815 wait complete. 2024-08-31T04:04:28.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f2bdfe00640 1 -- 172.21.15.89:0/1704540002 shutdown_connections 2024-08-31T04:04:28.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe833e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8340cb470 0x7fe8340b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe839600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe83415a190 0x7fe83414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe833e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8340cb470 0x7fe8340b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45336/0 (socket says 172.21.15.89:45336) 2024-08-31T04:04:28.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe833e00640 1 -- 172.21.15.89:0/1265702465 learned_addr learned my addr 172.21.15.89:0/1265702465 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f2bdfe00640 1 -- 172.21.15.89:0/1704540002 wait complete. 2024-08-31T04:04:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f55ef800640 1 Processor -- start 2024-08-31T04:04:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f55ef800640 1 -- start start 2024-08-31T04:04:28.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe833e00640 1 -- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe83415a190 msgr2=0x7fe83414b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe833e00640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe83415a190 0x7fe83414b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe833e00640 1 -- 172.21.15.89:0/1265702465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8340c59f0 msgr2=0x7fe8340c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe833e00640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8340c59f0 0x7fe8340c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe833e00640 1 -- 172.21.15.89:0/1265702465 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8340c67a0 con 0x7fe8340cb470 2024-08-31T04:04:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7fe833e00640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8340cb470 0x7fe8340b3d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe820009790 tx=0x7fe8200a6760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.676+0000 7f0f0fa00640 1 Processor -- start 2024-08-31T04:04:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fe830c00640 1 -- 172.21.15.89:0/1265702465 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8200be020 con 0x7fe8340cb470 2024-08-31T04:04:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fe830c00640 1 -- 172.21.15.89:0/1265702465 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe820004230 con 0x7fe8340cb470 2024-08-31T04:04:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fe830c00640 1 -- 172.21.15.89:0/1265702465 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820003600 con 0x7fe8340cb470 2024-08-31T04:04:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fbea6200640 1 -- 172.21.15.89:0/908987847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbea00b2fe0 msgr2=0x7fbea01520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fbea6200640 1 --2- 172.21.15.89:0/908987847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbea00b2fe0 0x7fbea01520f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009840 tx=0x7fbe8c01c790 comp rx=0 tx=0).stop 2024-08-31T04:04:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0fa00640 1 -- start start 2024-08-31T04:04:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdfe00640 1 Processor -- start 2024-08-31T04:04:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ef800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e80c6740 0x7f55e8153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ef800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e80c9070 0x7f55e8157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ef800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e8155b30 0x7f55e8150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ef800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80c3080 con 0x7f55e80c9070 2024-08-31T04:04:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ef800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80c2250 con 0x7f55e8155b30 2024-08-31T04:04:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ef800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f55e80c6c70 con 0x7f55e80c6740 2024-08-31T04:04:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fe83a000640 1 -- 172.21.15.89:0/1265702465 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8340b4e40 con 0x7fe8340cb470 2024-08-31T04:04:28.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdfe00640 1 -- start start 2024-08-31T04:04:28.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ece00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e80c6740 0x7f55e8153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fe83a000640 1 -- 172.21.15.89:0/1265702465 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8341638c0 con 0x7fe8340cb470 2024-08-31T04:04:28.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ece00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e80c6740 0x7f55e8153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45358/0 (socket says 172.21.15.89:45358) 2024-08-31T04:04:28.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ece00640 1 -- 172.21.15.89:0/3402802147 learned_addr learned my addr 172.21.15.89:0/3402802147 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:28.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fbea6200640 1 -- 172.21.15.89:0/908987847 shutdown_connections 2024-08-31T04:04:28.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fbea6200640 1 --2- 172.21.15.89:0/908987847 >> v2:172.21.15.170:3300/0 conn(0x7fbea00b2900 0x7fbea00c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fbea6200640 1 --2- 172.21.15.89:0/908987847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbea00b2fe0 0x7fbea01520f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fbea6200640 1 -- 172.21.15.89:0/908987847 >> 172.21.15.89:0/908987847 conn(0x7fbea00ccf20 msgr2=0x7fbea00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f112e600640 1 -- 172.21.15.89:0/1194732983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f112814fe20 msgr2=0x7f1128073b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f112e600640 1 --2- 172.21.15.89:0/1194732983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f112814fe20 0x7f1128073b80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1114009900 tx=0x7f111401f0d0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55dfe00640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e80c9070 0x7f55e8157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fbea6200640 1 -- 172.21.15.89:0/908987847 shutdown_connections 2024-08-31T04:04:28.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fbea6200640 1 -- 172.21.15.89:0/908987847 wait complete. 2024-08-31T04:04:28.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ed800640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e8155b30 0x7f55e8150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f112e600640 1 -- 172.21.15.89:0/1194732983 shutdown_connections 2024-08-31T04:04:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f112e600640 1 --2- 172.21.15.89:0/1194732983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f112814fe20 0x7f1128073b80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f112e600640 1 --2- 172.21.15.89:0/1194732983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11280c7520 0x7f11280732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f112e600640 1 -- 172.21.15.89:0/1194732983 >> 172.21.15.89:0/1194732983 conn(0x7f11280cca80 msgr2=0x7f11280cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f112e600640 1 -- 172.21.15.89:0/1194732983 shutdown_connections 2024-08-31T04:04:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0fa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f080b2f00 0x7f0f08155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0fa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f080c8cd0 0x7f0f08154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ece00640 1 -- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e8155b30 msgr2=0x7f55e8150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ece00640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e8155b30 0x7f55e8150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0fa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f081fa010 0x7f0f0815f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ece00640 1 -- 172.21.15.89:0/3402802147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e80c9070 msgr2=0x7f55e8157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ece00640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e80c9070 0x7f55e8157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ece00640 1 -- 172.21.15.89:0/3402802147 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e8154d80 con 0x7f55e80c6740 2024-08-31T04:04:28.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55dfe00640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e80c9070 0x7f55e8157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:04:28.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0fa00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0f080c3ec0 con 0x7f0f081fa010 2024-08-31T04:04:28.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0fa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0815c670 con 0x7f0f080b2f00 2024-08-31T04:04:28.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0fa00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f080c4040 con 0x7f0f080c8cd0 2024-08-31T04:04:28.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f112e600640 1 -- 172.21.15.89:0/1194732983 wait complete. 2024-08-31T04:04:28.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7fe83a000640 1 -- 172.21.15.89:0/1265702465 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8340ca220 con 0x7fe8340cb470 2024-08-31T04:04:28.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f080b2f00 0x7f0f08155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f080b2f00 0x7f0f08155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38290/0 (socket says 172.21.15.89:38290) 2024-08-31T04:04:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0d000640 1 -- 172.21.15.89:0/2442750570 learned_addr learned my addr 172.21.15.89:0/2442750570 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f07e00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f080c8cd0 0x7f0f08154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f0f0da00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f081fa010 0x7f0f0815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdfe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd8073610 0x7f2bd8152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdfe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd80b2fd0 0x7f2bd8147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd80c8b00 0x7f2bd814bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdfe00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd81646d0 con 0x7f2bd8073610 2024-08-31T04:04:28.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdfe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd8164550 con 0x7f2bd80c8b00 2024-08-31T04:04:28.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdfe00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd8164850 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f55ece00640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e80c6740 0x7f55e8153b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c7a0 tx=0x7f55d800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd80b2fd0 0x7f2bd8147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd80b2fd0 0x7f2bd8147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45372/0 (socket says 172.21.15.89:45372) 2024-08-31T04:04:28.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdca00640 1 -- 172.21.15.89:0/4019876034 learned_addr learned my addr 172.21.15.89:0/4019876034 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:28.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.680+0000 7f2bdde00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd80c8b00 0x7f2bd814bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f0d000640 1 -- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f080c8cd0 msgr2=0x7f0f08154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdd400640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd8073610 0x7f2bd8152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdca00640 1 -- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd80c8b00 msgr2=0x7f2bd814bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdca00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd80c8b00 0x7f2bd814bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdca00640 1 -- 172.21.15.89:0/4019876034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd8073610 msgr2=0x7f2bd8152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdca00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd8073610 0x7f2bd8152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdca00640 1 -- 172.21.15.89:0/4019876034 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd8152e60 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdde00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2bd80c8b00 0x7f2bd814bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:04:28.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f55e5600640 1 -- 172.21.15.89:0/3402802147 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8017070 con 0x7f55e80c6740 2024-08-31T04:04:28.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f55e5600640 1 -- 172.21.15.89:0/3402802147 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d8005070 con 0x7f55e80c6740 2024-08-31T04:04:28.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f55e5600640 1 -- 172.21.15.89:0/3402802147 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8005500 con 0x7f55e80c6740 2024-08-31T04:04:28.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f0d000640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f080c8cd0 0x7f0f08154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f0d000640 1 -- 172.21.15.89:0/2442750570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f081fa010 msgr2=0x7f0f0815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f0d000640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f081fa010 0x7f0f0815f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f0d000640 1 -- 172.21.15.89:0/2442750570 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f08154d50 con 0x7f0f080b2f00 2024-08-31T04:04:28.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f0da00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f081fa010 0x7f0f0815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:04:28.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f07e00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f080c8cd0 0x7f0f08154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:28.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe496400640 1 -- 172.21.15.89:0/2480418209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe474004810 msgr2=0x7fe474004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe496400640 1 --2- 172.21.15.89:0/2480418209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe474004810 0x7fe474004c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe48000aaf0 tx=0x7fe48001c790 comp rx=0 tx=0).stop 2024-08-31T04:04:28.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdca00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd80b2fd0 0x7f2bd8147b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c460 tx=0x7f2bc400c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe830c00640 1 -- 172.21.15.89:0/1265702465 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe8200037a0 con 0x7fe8340cb470 2024-08-31T04:04:28.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f55ef800640 1 -- 172.21.15.89:0/3402802147 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e8155000 con 0x7f55e80c6740 2024-08-31T04:04:28.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f55ef800640 1 -- 172.21.15.89:0/3402802147 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e81e2190 con 0x7f55e80c6740 2024-08-31T04:04:28.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f0d000640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f080b2f00 0x7f0f08155b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009850 tx=0x7f0ef4005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bd5600640 1 -- 172.21.15.89:0/4019876034 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4016020 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bd5600640 1 -- 172.21.15.89:0/4019876034 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bc4012920 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f112e600640 1 Processor -- start 2024-08-31T04:04:28.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe496400640 1 -- 172.21.15.89:0/2480418209 shutdown_connections 2024-08-31T04:04:28.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe496400640 1 --2- 172.21.15.89:0/2480418209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe474004810 0x7fe474004c20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe496400640 1 -- 172.21.15.89:0/2480418209 >> 172.21.15.89:0/2480418209 conn(0x7fe4900ccf20 msgr2=0x7fe4900cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bd5600640 1 -- 172.21.15.89:0/4019876034 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4016020 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f04c00640 1 -- 172.21.15.89:0/2442750570 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40b5040 con 0x7f0f080b2f00 2024-08-31T04:04:28.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fbea6200640 1 Processor -- start 2024-08-31T04:04:28.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fbea6200640 1 -- start start 2024-08-31T04:04:28.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f04c00640 1 -- 172.21.15.89:0/2442750570 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ef4005310 con 0x7f0f080b2f00 2024-08-31T04:04:28.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe496400640 1 -- 172.21.15.89:0/2480418209 shutdown_connections 2024-08-31T04:04:28.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe496400640 1 -- 172.21.15.89:0/2480418209 wait complete. 2024-08-31T04:04:28.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f081571a0 con 0x7f0f080b2f00 2024-08-31T04:04:28.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd814e3e0 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0f04c00640 1 -- 172.21.15.89:0/2442750570 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40b5040 con 0x7f0f080b2f00 2024-08-31T04:04:28.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd814de20 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f55ef800640 1 -- 172.21.15.89:0/3402802147 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55e80ca3f0 con 0x7f55e80c6740 2024-08-31T04:04:28.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe830c00640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe814072190 0x7fe8140746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7fe830c00640 1 -- 172.21.15.89:0/1265702465 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe82012d580 con 0x7fe8340cb470 2024-08-31T04:04:28.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0995e00640 1 -- 172.21.15.89:0/4000709297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09900ca2d0 msgr2=0x7f09900c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f0995e00640 1 --2- 172.21.15.89:0/4000709297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09900ca2d0 0x7f09900c1fd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f097c0082a0 tx=0x7f097c01c6b0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.684+0000 7f112e600640 1 -- start start 2024-08-31T04:04:28.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7fe838c00640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe814072190 0x7fe8140746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7fe830c00640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7fe81407b960 0x7fe81407ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f0995e00640 1 -- 172.21.15.89:0/4000709297 shutdown_connections 2024-08-31T04:04:28.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f0995e00640 1 --2- 172.21.15.89:0/4000709297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09900ca2d0 0x7f09900c1fd0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f097c0082a0 tx=0x7f097c01c6b0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f0995e00640 1 --2- 172.21.15.89:0/4000709297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09900c7f90 0x7f09900c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f0995e00640 1 -- 172.21.15.89:0/4000709297 >> 172.21.15.89:0/4000709297 conn(0x7f09900cd1e0 msgr2=0x7f09900c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7fe830c00640 1 -- 172.21.15.89:0/1265702465 --> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe820005530 con 0x7fe81407b960 2024-08-31T04:04:28.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7fe830c00640 1 -- 172.21.15.89:0/1265702465 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe820134050 con 0x7fe8340cb470 2024-08-31T04:04:28.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bd80c22b0 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f081f9810 con 0x7f0f080b2f00 2024-08-31T04:04:28.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f0995e00640 1 -- 172.21.15.89:0/4000709297 shutdown_connections 2024-08-31T04:04:28.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7fe839600640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7fe81407b960 0x7fe81407ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f0995e00640 1 -- 172.21.15.89:0/4000709297 wait complete. 2024-08-31T04:04:28.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112e600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11280740c0 0x7f112814b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11280c7520 0x7f11281407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112e600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f112814fe20 0x7f1128154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f08154fc0 con 0x7f0f080b2f00 2024-08-31T04:04:28.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7fe496400640 1 Processor -- start 2024-08-31T04:04:28.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f1127e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11280c7520 0x7f11281407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112e600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1128073820 con 0x7f11280740c0 2024-08-31T04:04:28.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112e600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f11280c9030 con 0x7f11280c7520 2024-08-31T04:04:28.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11280740c0 0x7f112814b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11280740c0 0x7f112814b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41686/0 (socket says 172.21.15.89:41686) 2024-08-31T04:04:28.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112d200640 1 -- 172.21.15.89:0/574475294 learned_addr learned my addr 172.21.15.89:0/574475294 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:28.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f11280cd880 con 0x7f112814fe20 2024-08-31T04:04:28.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7fe839600640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7fe81407b960 0x7fe81407ddf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f112dc00640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f112814fe20 0x7f1128154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbea6200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbea00b2900 0x7fbea01fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbea6200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbea00b2fe0 0x7fbea0150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f2bd5600640 1 -- 172.21.15.89:0/4019876034 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2bc4019020 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7f55e5600640 1 -- 172.21.15.89:0/3402802147 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f55d801a070 con 0x7f55e80c6740 2024-08-31T04:04:28.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbea6200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea00c2480 0x7fbea0147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.688+0000 7fe496400640 1 -- start start 2024-08-31T04:04:28.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe838c00640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe814072190 0x7fe8140746a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe828000f70 tx=0x7fe8280079e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbea6200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbea00c8f20 con 0x7fbea00b2fe0 2024-08-31T04:04:28.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbea6200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0158a50 con 0x7fbea00c2480 2024-08-31T04:04:28.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbea6200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbea00c90a0 con 0x7fbea00b2900 2024-08-31T04:04:28.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe496400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004810 0x7fe4901f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f112dc00640 1 -- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11280c7520 msgr2=0x7f11281407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f112dc00640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11280c7520 0x7f11281407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f112dc00640 1 -- 172.21.15.89:0/574475294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11280740c0 msgr2=0x7f112814b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f112dc00640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11280740c0 0x7f112814b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f112dc00640 1 -- 172.21.15.89:0/574475294 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1128142860 con 0x7f112814fe20 2024-08-31T04:04:28.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe496400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4900c51b0 0x7fe4900c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe496400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4900c55c0 0x7fe490143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe830c00640 1 -- 172.21.15.89:0/1265702465 <== osd.1 v2:172.21.15.89:6808/2972667834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe820005530 con 0x7fe81407b960 2024-08-31T04:04:28.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f0f04c00640 1 -- 172.21.15.89:0/2442750570 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0ef40046d0 con 0x7f0f080b2f00 2024-08-31T04:04:28.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea00c2480 0x7fbea0147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9f400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbea00b2900 0x7fbea01fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea00c2480 0x7fbea0147d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38316/0 (socket says 172.21.15.89:38316) 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9fe00640 1 -- 172.21.15.89:0/1582670973 learned_addr learned my addr 172.21.15.89:0/1582670973 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9ea00640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbea00b2fe0 0x7fbea0150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9fe00640 1 -- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbea00b2900 msgr2=0x7fbea01fcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9fe00640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbea00b2900 0x7fbea01fcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9fe00640 1 -- 172.21.15.89:0/1582670973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbea00b2fe0 msgr2=0x7fbea0150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9fe00640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbea00b2fe0 0x7fbea0150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9fe00640 1 -- 172.21.15.89:0/1582670973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea01fd080 con 0x7fbea00c2480 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9ea00640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbea00b2fe0 0x7fbea0150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004810 0x7fe4901f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe496400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe490152480 con 0x7fe4900c55c0 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe496400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe490152300 con 0x7fe474004810 2024-08-31T04:04:28.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004810 0x7fe4901f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38304/0 (socket says 172.21.15.89:38304) 2024-08-31T04:04:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48f400640 1 -- 172.21.15.89:0/1027918015 learned_addr learned my addr 172.21.15.89:0/1027918015 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe496400640 1 -- 172.21.15.89:0/1027918015 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe490158a10 con 0x7fe4900c51b0 2024-08-31T04:04:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48ea00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4900c51b0 0x7fe4900c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48fe00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4900c55c0 0x7fe490143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f0995e00640 1 Processor -- start 2024-08-31T04:04:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f0995e00640 1 -- start start 2024-08-31T04:04:28.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fbe9fe00640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea00c2480 0x7fbea0147d50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000c3c0 tx=0x7fbe9000c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48fe00640 1 -- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4900c51b0 msgr2=0x7fe4900c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48fe00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4900c51b0 0x7fe4900c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48fe00640 1 -- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004810 msgr2=0x7fe4901f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48fe00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004810 0x7fe4901f18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48fe00640 1 -- 172.21.15.89:0/1027918015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4901f1e00 con 0x7fe4900c55c0 2024-08-31T04:04:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe48fe00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4900c55c0 0x7fe490143b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4900b2f90 tx=0x7fe47c0066c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f2bd5600640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2bb80722c0 0x7f2bb80747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f2bd5600640 1 -- 172.21.15.89:0/4019876034 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2bc4093130 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f2bd5600640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f2bb807ba80 0x7f2bb807df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f2bd5600640 1 -- 172.21.15.89:0/4019876034 --> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bc4010e50 con 0x7f2bb807ba80 2024-08-31T04:04:28.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f2bd5600640 1 -- 172.21.15.89:0/4019876034 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2bc4093520 con 0x7f2bd80b2fd0 2024-08-31T04:04:28.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f2bdd400640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2bb80722c0 0x7f2bb80747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f2bdde00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f2bb807ba80 0x7f2bb807df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f112dc00640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f112814fe20 0x7f1128154a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f112000c7b0 tx=0x7f112000cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f1124c00640 1 -- 172.21.15.89:0/574475294 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1120016020 con 0x7f112814fe20 2024-08-31T04:04:28.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f1124c00640 1 -- 172.21.15.89:0/574475294 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f112000a8f0 con 0x7f112814fe20 2024-08-31T04:04:28.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f1124c00640 1 -- 172.21.15.89:0/574475294 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112000ad80 con 0x7f112814fe20 2024-08-31T04:04:28.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1128142c50 con 0x7f112814fe20 2024-08-31T04:04:28.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1128155810 con 0x7f112814fe20 2024-08-31T04:04:28.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f55e5600640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c40721c0 0x7f55c40746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f2bdd400640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2bb80722c0 0x7f2bb80747d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0058d0 tx=0x7f2bcc005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f2bdde00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f2bb807ba80 0x7f2bb807df10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe487400640 1 -- 172.21.15.89:0/1027918015 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c011900 con 0x7fe4900c55c0 2024-08-31T04:04:28.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe487400640 1 -- 172.21.15.89:0/1027918015 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe47c017070 con 0x7fe4900c55c0 2024-08-31T04:04:28.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe496400640 1 -- 172.21.15.89:0/1027918015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4900c4380 con 0x7fe4900c55c0 2024-08-31T04:04:28.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe496400640 1 -- 172.21.15.89:0/1027918015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4901f10c0 con 0x7fe4900c55c0 2024-08-31T04:04:28.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1128150230 con 0x7f112814fe20 2024-08-31T04:04:28.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7fe487400640 1 -- 172.21.15.89:0/1027918015 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c011ca0 con 0x7fe4900c55c0 2024-08-31T04:04:28.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.692+0000 7f0f04c00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ee80722c0 0x7f0ee80747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0f04c00640 1 -- 172.21.15.89:0/2442750570 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0ef412f720 con 0x7f0f080b2f00 2024-08-31T04:04:28.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0f07e00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ee80722c0 0x7f0ee80747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0f04c00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f0ee807ba80 0x7f0ee807df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0f04c00640 1 -- 172.21.15.89:0/2442750570 --> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ef40bde50 con 0x7f0ee807ba80 2024-08-31T04:04:28.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0f04c00640 1 -- 172.21.15.89:0/2442750570 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0ef4136050 con 0x7f0f080b2f00 2024-08-31T04:04:28.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7fbe97400640 1 -- 172.21.15.89:0/1582670973 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90011790 con 0x7fbea00c2480 2024-08-31T04:04:28.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0995e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09900b2c70 0x7f0990156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0995e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09900c7f90 0x7f099015c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0995e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09901f3d30 0x7f099014c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0995e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f09900714f0 con 0x7f09900b2c70 2024-08-31T04:04:28.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0995e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0990071370 con 0x7f09901f3d30 2024-08-31T04:04:28.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0995e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f09900b3080 con 0x7f09900c7f90 2024-08-31T04:04:28.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f55e5600640 1 -- 172.21.15.89:0/3402802147 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f55d8092b00 con 0x7f55e80c6740 2024-08-31T04:04:28.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f55dfe00640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c40721c0 0x7f55c40746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7fbe97400640 1 -- 172.21.15.89:0/1582670973 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe90017070 con 0x7fbea00c2480 2024-08-31T04:04:28.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7fbe97400640 1 -- 172.21.15.89:0/1582670973 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90011cc0 con 0x7fbea00c2480 2024-08-31T04:04:28.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea014d690 con 0x7fbea00c2480 2024-08-31T04:04:28.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea014cfc0 con 0x7fbea00c2480 2024-08-31T04:04:28.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7fe484c00640 1 -- 172.21.15.89:0/1027918015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4900c48a0 con 0x7fe4900c55c0 2024-08-31T04:04:28.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f55e5600640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f55c407b980 0x7f55c407de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f55e5600640 1 -- 172.21.15.89:0/3402802147 --> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55d800ae50 con 0x7f55c407b980 2024-08-31T04:04:28.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f55e5600640 1 -- 172.21.15.89:0/3402802147 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f55d8092ef0 con 0x7f55e80c6740 2024-08-31T04:04:28.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0f0da00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f0ee807ba80 0x7f0ee807df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbea00c1f40 con 0x7fbea00c2480 2024-08-31T04:04:28.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f098fe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09900c7f90 0x7f099015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f098fe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09900c7f90 0x7f099015c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45390/0 (socket says 172.21.15.89:45390) 2024-08-31T04:04:28.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f098fe00640 1 -- 172.21.15.89:0/2842210289 learned_addr learned my addr 172.21.15.89:0/2842210289 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:28.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0995400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09901f3d30 0x7f099014c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0994a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09900b2c70 0x7f0990156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0f07e00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ee80722c0 0x7f0ee80747d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f0815b5a0 tx=0x7f0ef8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0f0da00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f0ee807ba80 0x7f0ee807df10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f2bd5600640 1 -- 172.21.15.89:0/4019876034 <== osd.5 v2:172.21.15.170:6810/3687562268 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2bc4010e50 con 0x7f2bb807ba80 2024-08-31T04:04:28.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f1124c00640 1 -- 172.21.15.89:0/574475294 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f1120019020 con 0x7f112814fe20 2024-08-31T04:04:28.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0994a00640 1 -- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09900c7f90 msgr2=0x7f099015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0994a00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09900c7f90 0x7f099015c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0994a00640 1 -- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09901f3d30 msgr2=0x7f099014c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0994a00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09901f3d30 0x7f099014c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.696+0000 7f0994a00640 1 -- 172.21.15.89:0/2842210289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09900cb960 con 0x7f09900b2c70 2024-08-31T04:04:28.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fe487400640 1 -- 172.21.15.89:0/1027918015 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe47c01c460 con 0x7fe4900c55c0 2024-08-31T04:04:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f0994a00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09900b2c70 0x7f0990156f10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f098400ff70 tx=0x7f0984003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f55ed800640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f55c407b980 0x7f55c407de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f1124c00640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11080722c0 0x7f11080747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f1124c00640 1 -- 172.21.15.89:0/574475294 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f112000ab20 con 0x7f112814fe20 2024-08-31T04:04:28.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f0f04c00640 1 -- 172.21.15.89:0/2442750570 <== osd.2 v2:172.21.15.89:6824/208143917 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ef40bde50 con 0x7f0ee807ba80 2024-08-31T04:04:28.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f098cc00640 1 -- 172.21.15.89:0/2842210289 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0984009af0 con 0x7f09900b2c70 2024-08-31T04:04:28.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f098cc00640 1 -- 172.21.15.89:0/2842210289 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f098401d070 con 0x7f09900b2c70 2024-08-31T04:04:28.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f098cc00640 1 -- 172.21.15.89:0/2842210289 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0984018420 con 0x7f09900b2c70 2024-08-31T04:04:28.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f112d200640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11080722c0 0x7f11080747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f1124c00640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f110807b990 0x7f110807de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f1124c00640 1 -- 172.21.15.89:0/574475294 --> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f110807e4f0 con 0x7f110807b990 2024-08-31T04:04:28.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f1124c00640 1 -- 172.21.15.89:0/574475294 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1120093090 con 0x7f112814fe20 2024-08-31T04:04:28.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f55dfe00640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c40721c0 0x7f55c40746d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f55d0001230 tx=0x7f55d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f55ed800640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f55c407b980 0x7f55c407de10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fbe97400640 1 -- 172.21.15.89:0/1582670973 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbe9001c460 con 0x7fbea00c2480 2024-08-31T04:04:28.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fe487400640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4700721c0 0x7fe4700746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fe487400640 1 -- 172.21.15.89:0/1027918015 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe47c093740 con 0x7fe4900c55c0 2024-08-31T04:04:28.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fe487400640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7fe47007b910 0x7fe47007dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fe487400640 1 -- 172.21.15.89:0/1027918015 --> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe47c00eea0 con 0x7fe47007b910 2024-08-31T04:04:28.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fe487400640 1 -- 172.21.15.89:0/1027918015 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe47c09a050 con 0x7fe4900c55c0 2024-08-31T04:04:28.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fe48f400640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4700721c0 0x7fe4700746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fe48ea00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7fe47007b910 0x7fe47007dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099014e5a0 con 0x7f09900b2c70 2024-08-31T04:04:28.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09901f4900 con 0x7f09900b2c70 2024-08-31T04:04:28.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f1127e00640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f110807b990 0x7f110807de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f112d200640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11080722c0 0x7f11080747d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1118009c00 tx=0x7f11180091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7f1127e00640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f110807b990 0x7f110807de20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fbe97400640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe80072190 0x7fbe800746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fbe97400640 1 -- 172.21.15.89:0/1582670973 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbe90093540 con 0x7fbea00c2480 2024-08-31T04:04:28.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fbe97400640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7fbe8007b950 0x7fbe8007dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fbe97400640 1 -- 172.21.15.89:0/1582670973 --> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe8007e4b0 con 0x7fbe8007b950 2024-08-31T04:04:28.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.700+0000 7fbe97400640 1 -- 172.21.15.89:0/1582670973 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbe90093930 con 0x7fbea00c2480 2024-08-31T04:04:28.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7fbe9f400640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe80072190 0x7fbe800746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0990075190 con 0x7f09900b2c70 2024-08-31T04:04:28.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7fe48f400640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4700721c0 0x7fe4700746d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe488009f40 tx=0x7fe488009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7fe48ea00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7fe47007b910 0x7fe47007dda0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7fbe9f400640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe80072190 0x7fbe800746a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0ae000 tx=0x7fbe8c01afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7fbe9ea00640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7fbe8007b950 0x7fbe8007dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7f1124c00640 1 -- 172.21.15.89:0/574475294 <== osd.7 v2:172.21.15.170:6802/2770203152 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f110807e4f0 con 0x7f110807b990 2024-08-31T04:04:28.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7f55e5600640 1 -- 172.21.15.89:0/3402802147 <== osd.0 v2:172.21.15.89:6800/1617233830 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f55d800ae50 con 0x7f55c407b980 2024-08-31T04:04:28.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7fbe9ea00640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7fbe8007b950 0x7fbe8007dde0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7fe487400640 1 -- 172.21.15.89:0/1027918015 <== osd.4 v2:172.21.15.170:6826/3130076970 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe47c00eea0 con 0x7fe47007b910 2024-08-31T04:04:28.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.704+0000 7f098cc00640 1 -- 172.21.15.89:0/2842210289 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f09840185c0 con 0x7f09900b2c70 2024-08-31T04:04:28.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7f098cc00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f09700720c0 0x7f09700745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7f098cc00640 1 -- 172.21.15.89:0/2842210289 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0984097ed0 con 0x7f09900b2c70 2024-08-31T04:04:28.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7f098cc00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f097007b810 0x7f097007dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:28.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7f098cc00640 1 -- 172.21.15.89:0/2842210289 --> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0984021e50 con 0x7f097007b810 2024-08-31T04:04:28.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7f098cc00640 1 -- 172.21.15.89:0/2842210289 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0984098280 con 0x7f09900b2c70 2024-08-31T04:04:28.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7f098fe00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f09700720c0 0x7f09700745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7fbe97400640 1 -- 172.21.15.89:0/1582670973 <== osd.3 v2:172.21.15.89:6816/208411581 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe8007e4b0 con 0x7fbe8007b950 2024-08-31T04:04:28.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7f0995400640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f097007b810 0x7f097007dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:28.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7f0995400640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f097007b810 0x7f097007dca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.708+0000 7f098fe00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f09700720c0 0x7f09700745d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c10 tx=0x7f097c0b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:28.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.712+0000 7f098cc00640 1 -- 172.21.15.89:0/2842210289 <== osd.6 v2:172.21.15.170:6818/4213050289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0984021e50 con 0x7f097007b810 2024-08-31T04:04:28.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.720+0000 7fe83a000640 1 -- 172.21.15.89:0/1265702465 --> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8340b46c0 con 0x7fe81407b960 2024-08-31T04:04:28.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.720+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 --> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2bd81526e0 con 0x7f2bb807ba80 2024-08-31T04:04:28.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe830c00640 1 -- 172.21.15.89:0/1265702465 <== osd.1 v2:172.21.15.89:6808/2972667834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe8340b46c0 con 0x7fe81407b960 2024-08-31T04:04:28.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 -- 172.21.15.89:0/1265702465 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7fe81407b960 msgr2=0x7fe81407ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7fe81407b960 0x7fe81407ddf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 -- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe814072190 msgr2=0x7fe8140746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe814072190 0x7fe8140746a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe828000f70 tx=0x7fe8280079e0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 -- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8340cb470 msgr2=0x7fe8340b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 --2- 172.21.15.89:0/1265702465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8340cb470 0x7fe8340b3d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe820009790 tx=0x7fe8200a6760 comp rx=0 tx=0).stop 2024-08-31T04:04:28.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe839600640 1 -- 172.21.15.89:0/1265702465 reap_dead start 2024-08-31T04:04:28.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bd5600640 1 -- 172.21.15.89:0/4019876034 <== osd.5 v2:172.21.15.170:6810/3687562268 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2bd81526e0 con 0x7f2bb807ba80 2024-08-31T04:04:28.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 -- 172.21.15.89:0/1265702465 shutdown_connections 2024-08-31T04:04:28.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 -- 172.21.15.89:0/1265702465 >> 172.21.15.89:0/1265702465 conn(0x7fe8340cf030 msgr2=0x7fe83414e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f2bb807ba80 msgr2=0x7f2bb807df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f2bb807ba80 0x7f2bb807df10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 -- 172.21.15.89:0/1265702465 shutdown_connections 2024-08-31T04:04:28.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7fe826000640 1 -- 172.21.15.89:0/1265702465 wait complete. 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2bb80722c0 msgr2=0x7f2bb80747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2bb80722c0 0x7f2bb80747d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0058d0 tx=0x7f2bcc005860 comp rx=0 tx=0).stop 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd80b2fd0 msgr2=0x7f2bd8147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 --2- 172.21.15.89:0/4019876034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2bd80b2fd0 0x7f2bd8147b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c460 tx=0x7f2bc400c920 comp rx=0 tx=0).stop 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdde00640 1 -- 172.21.15.89:0/4019876034 reap_dead start 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 shutdown_connections 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 >> 172.21.15.89:0/4019876034 conn(0x7f2bd80ccf20 msgr2=0x7f2bd814f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 shutdown_connections 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.724+0000 7f2bdfe00640 1 -- 172.21.15.89:0/4019876034 wait complete. 2024-08-31T04:04:28.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.732+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 --> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f080c7920 con 0x7f0ee807ba80 2024-08-31T04:04:28.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.732+0000 7f0f04c00640 1 -- 172.21.15.89:0/2442750570 <== osd.2 v2:172.21.15.89:6824/208143917 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0f080c7920 con 0x7f0ee807ba80 2024-08-31T04:04:28.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f0ee807ba80 msgr2=0x7f0ee807df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f0ee807ba80 0x7f0ee807df10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ee80722c0 msgr2=0x7f0ee80747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0ee80722c0 0x7f0ee80747d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f0815b5a0 tx=0x7f0ef8008040 comp rx=0 tx=0).stop 2024-08-31T04:04:28.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f080b2f00 msgr2=0x7f0f08155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 --2- 172.21.15.89:0/2442750570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f080b2f00 0x7f0f08155b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009850 tx=0x7f0ef4005de0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0da00640 1 -- 172.21.15.89:0/2442750570 reap_dead start 2024-08-31T04:04:28.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 shutdown_connections 2024-08-31T04:04:28.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 >> 172.21.15.89:0/2442750570 conn(0x7f0f080ccf20 msgr2=0x7f0f080765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 shutdown_connections 2024-08-31T04:04:28.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0f0fa00640 1 -- 172.21.15.89:0/2442750570 wait complete. 2024-08-31T04:04:28.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 --> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1128156dd0 con 0x7f110807b990 2024-08-31T04:04:28.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f55ef800640 1 -- 172.21.15.89:0/3402802147 --> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f55e80c7860 con 0x7f55c407b980 2024-08-31T04:04:28.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f1124c00640 1 -- 172.21.15.89:0/574475294 <== osd.7 v2:172.21.15.170:6802/2770203152 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1128156dd0 con 0x7f110807b990 2024-08-31T04:04:28.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7fe484c00640 1 -- 172.21.15.89:0/1027918015 --> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe4901f0eb0 con 0x7fe47007b910 2024-08-31T04:04:28.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 --> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbea00c71a0 con 0x7fbe8007b950 2024-08-31T04:04:28.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 --> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f099015a360 con 0x7f097007b810 2024-08-31T04:04:28.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f110807b990 msgr2=0x7f110807de20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f110807b990 0x7f110807de20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f55e5600640 1 -- 172.21.15.89:0/3402802147 <== osd.0 v2:172.21.15.89:6800/1617233830 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f55e80c7860 con 0x7f55c407b980 2024-08-31T04:04:28.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11080722c0 msgr2=0x7f11080747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11080722c0 0x7f11080747d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1118009c00 tx=0x7f11180091e0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f112814fe20 msgr2=0x7f1128154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 --2- 172.21.15.89:0/574475294 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f112814fe20 0x7f1128154a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f112000c7b0 tx=0x7f112000cc70 comp rx=0 tx=0).stop 2024-08-31T04:04:28.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7fe487400640 1 -- 172.21.15.89:0/1027918015 <== osd.4 v2:172.21.15.170:6826/3130076970 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe4901f0eb0 con 0x7fe47007b910 2024-08-31T04:04:28.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112dc00640 1 -- 172.21.15.89:0/574475294 reap_dead start 2024-08-31T04:04:28.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 shutdown_connections 2024-08-31T04:04:28.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 >> 172.21.15.89:0/574475294 conn(0x7f11280cca80 msgr2=0x7f112814db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7fbe97400640 1 -- 172.21.15.89:0/1582670973 <== osd.3 v2:172.21.15.89:6816/208411581 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbea00c71a0 con 0x7fbe8007b950 2024-08-31T04:04:28.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.736+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 shutdown_connections 2024-08-31T04:04:28.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f112e600640 1 -- 172.21.15.89:0/574475294 wait complete. 2024-08-31T04:04:28.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f098cc00640 1 -- 172.21.15.89:0/2842210289 <== osd.6 v2:172.21.15.170:6818/4213050289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f099015a360 con 0x7f097007b810 2024-08-31T04:04:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 -- 172.21.15.89:0/3402802147 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f55c407b980 msgr2=0x7f55c407de10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f55c407b980 0x7f55c407de10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 -- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c40721c0 msgr2=0x7f55c40746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c40721c0 0x7f55c40746d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f55d0001230 tx=0x7f55d0009040 comp rx=0 tx=0).stop 2024-08-31T04:04:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 -- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e80c6740 msgr2=0x7f55e8153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 --2- 172.21.15.89:0/3402802147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e80c6740 0x7f55e8153b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c7a0 tx=0x7f55d800cc60 comp rx=0 tx=0).stop 2024-08-31T04:04:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55ed800640 1 -- 172.21.15.89:0/3402802147 reap_dead start 2024-08-31T04:04:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 -- 172.21.15.89:0/3402802147 shutdown_connections 2024-08-31T04:04:28.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 -- 172.21.15.89:0/3402802147 >> 172.21.15.89:0/3402802147 conn(0x7f55e80cd1e0 msgr2=0x7f55e8070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7fbe8007b950 msgr2=0x7fbe8007dde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7fbe8007b950 0x7fbe8007dde0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe80072190 msgr2=0x7fbe800746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 -- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7fe47007b910 msgr2=0x7fe47007dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7fe47007b910 0x7fe47007dda0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 -- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4700721c0 msgr2=0x7fe4700746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe80072190 0x7fbe800746a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0ae000 tx=0x7fbe8c01afd0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4700721c0 0x7fe4700746d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe488009f40 tx=0x7fe488009500 comp rx=0 tx=0).stop 2024-08-31T04:04:28.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 -- 172.21.15.89:0/1027918015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4900c55c0 msgr2=0x7fe490143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 --2- 172.21.15.89:0/1027918015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4900c55c0 0x7fe490143b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4900b2f90 tx=0x7fe47c0066c0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe48fe00640 1 -- 172.21.15.89:0/1027918015 reap_dead start 2024-08-31T04:04:28.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea00c2480 msgr2=0x7fbea0147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 -- 172.21.15.89:0/1027918015 shutdown_connections 2024-08-31T04:04:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 -- 172.21.15.89:0/1027918015 >> 172.21.15.89:0/1027918015 conn(0x7fe4900ccf20 msgr2=0x7fe49014f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 -- 172.21.15.89:0/3402802147 shutdown_connections 2024-08-31T04:04:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 --2- 172.21.15.89:0/1582670973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea00c2480 0x7fbea0147d50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000c3c0 tx=0x7fbe9000c7c0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbe9fe00640 1 -- 172.21.15.89:0/1582670973 reap_dead start 2024-08-31T04:04:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 shutdown_connections 2024-08-31T04:04:28.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 >> 172.21.15.89:0/1582670973 conn(0x7fbea00ccf20 msgr2=0x7fbea0155d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 -- 172.21.15.89:0/1027918015 shutdown_connections 2024-08-31T04:04:28.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fe484c00640 1 -- 172.21.15.89:0/1027918015 wait complete. 2024-08-31T04:04:28.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f55de000640 1 -- 172.21.15.89:0/3402802147 wait complete. 2024-08-31T04:04:28.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f097007b810 msgr2=0x7f097007dca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f0995e00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f097007b810 0x7f097007dca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 shutdown_connections 2024-08-31T04:04:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7fbea6200640 1 -- 172.21.15.89:0/1582670973 wait complete. 2024-08-31T04:04:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f09700720c0 msgr2=0x7f09700745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f0995e00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f09700720c0 0x7f09700745d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c10 tx=0x7f097c0b2040 comp rx=0 tx=0).stop 2024-08-31T04:04:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09900b2c70 msgr2=0x7f0990156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f0995e00640 1 --2- 172.21.15.89:0/2842210289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09900b2c70 0x7f0990156f10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f098400ff70 tx=0x7f0984003ab0 comp rx=0 tx=0).stop 2024-08-31T04:04:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f0995400640 1 -- 172.21.15.89:0/2842210289 reap_dead start 2024-08-31T04:04:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 shutdown_connections 2024-08-31T04:04:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.740+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 >> 172.21.15.89:0/2842210289 conn(0x7f09900cd1e0 msgr2=0x7f0990158990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.748+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 shutdown_connections 2024-08-31T04:04:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:28.748+0000 7f0995e00640 1 -- 172.21.15.89:0/2842210289 wait complete. 2024-08-31T04:04:28.771 INFO:teuthology.orchestra.run.smithi089.stdout:64424509451 2024-08-31T04:04:28.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-31T04:04:28.772 INFO:teuthology.orchestra.run.smithi089.stdout:68719476748 2024-08-31T04:04:28.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-31T04:04:28.780 INFO:teuthology.orchestra.run.smithi089.stdout:64424509449 2024-08-31T04:04:28.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-31T04:04:28.784 INFO:teuthology.orchestra.run.smithi089.stdout:55834574859 2024-08-31T04:04:28.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-31T04:04:28.787 INFO:teuthology.orchestra.run.smithi089.stdout:68719476748 2024-08-31T04:04:28.787 INFO:teuthology.orchestra.run.smithi089.stdout:68719476747 2024-08-31T04:04:28.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-31T04:04:28.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-31T04:04:28.790 INFO:teuthology.orchestra.run.smithi089.stdout:68719476747 2024-08-31T04:04:28.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-31T04:04:28.793 INFO:teuthology.orchestra.run.smithi089.stdout:64424509450 2024-08-31T04:04:28.793 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-31T04:04:28.793 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:04:28.816 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:04:29.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.056+0000 7f2205600640 1 -- 172.21.15.89:0/131233602 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f80b2070 con 0x7f22000e06a0 2024-08-31T04:04:29.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.056+0000 7f220d800640 1 -- 172.21.15.89:0/131233602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22000e06a0 msgr2=0x7f2200006f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.056+0000 7f220d800640 1 --2- 172.21.15.89:0/131233602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22000e06a0 0x7f2200006f30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2200037f10 tx=0x7f21f801c8c0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.060+0000 7f220d800640 1 -- 172.21.15.89:0/131233602 shutdown_connections 2024-08-31T04:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.060+0000 7f220d800640 1 --2- 172.21.15.89:0/131233602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2200007470 0x7f22000e6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.060+0000 7f220d800640 1 --2- 172.21.15.89:0/131233602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22000e06a0 0x7f2200006f30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.060+0000 7f220d800640 1 --2- 172.21.15.89:0/131233602 >> v2:172.21.15.170:3300/0 conn(0x7f2200038960 0x7f2200038e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.060+0000 7f220d800640 1 -- 172.21.15.89:0/131233602 >> 172.21.15.89:0/131233602 conn(0x7f2200050bf0 msgr2=0x7f2200051000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.060+0000 7f220d800640 1 -- 172.21.15.89:0/131233602 shutdown_connections 2024-08-31T04:04:29.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.060+0000 7f220d800640 1 -- 172.21.15.89:0/131233602 wait complete. 2024-08-31T04:04:29.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7f220d800640 1 Processor -- start 2024-08-31T04:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7f220d800640 1 -- start start 2024-08-31T04:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7fbddfe00640 1 -- 172.21.15.89:0/353967496 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd8044cc0 msgr2=0x7fbdd8034d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7fbddfe00640 1 --2- 172.21.15.89:0/353967496 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd8044cc0 0x7fbdd8034d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009930 tx=0x7fbdcc01c770 comp rx=0 tx=0).stop 2024-08-31T04:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7fbddfe00640 1 -- 172.21.15.89:0/353967496 shutdown_connections 2024-08-31T04:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7fbddfe00640 1 --2- 172.21.15.89:0/353967496 >> v2:172.21.15.89:3300/0 conn(0x7fbdd8032e50 0x7fbdd804b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7fbddfe00640 1 --2- 172.21.15.89:0/353967496 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd8044cc0 0x7fbdd8034d60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7fbddfe00640 1 -- 172.21.15.89:0/353967496 >> 172.21.15.89:0/353967496 conn(0x7fbdd804fe40 msgr2=0x7fbdd8050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7fbddfe00640 1 -- 172.21.15.89:0/353967496 shutdown_connections 2024-08-31T04:04:29.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7fbddfe00640 1 -- 172.21.15.89:0/353967496 wait complete. 2024-08-31T04:04:29.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7f220d800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2200007470 0x7f22000e5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7f220d800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2200038960 0x7f22000e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7f220d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22000e06a0 0x7f22000533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7f220d800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2200038160 con 0x7f2200007470 2024-08-31T04:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7f220d800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2200037fe0 con 0x7f22000e06a0 2024-08-31T04:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.064+0000 7f220d800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2200049090 con 0x7f2200038960 2024-08-31T04:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2200007470 0x7f22000e5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2200038960 0x7f22000e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2207400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22000e06a0 0x7f22000533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2200038960 0x7f22000e4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45420/0 (socket says 172.21.15.89:45420) 2024-08-31T04:04:29.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206000640 1 -- 172.21.15.89:0/1215414621 learned_addr learned my addr 172.21.15.89:0/1215414621 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206000640 1 -- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22000e06a0 msgr2=0x7f22000533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206000640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22000e06a0 0x7f22000533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206000640 1 -- 172.21.15.89:0/1215414621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2200007470 msgr2=0x7f22000e5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206000640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2200007470 0x7f22000e5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206000640 1 -- 172.21.15.89:0/1215414621 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22000e4fc0 con 0x7f2200038960 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f2206000640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2200038960 0x7f22000e4a80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009230 tx=0x7f21f8005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f21fea00640 1 -- 172.21.15.89:0/1215414621 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f80b2070 con 0x7f2200038960 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f21fea00640 1 -- 172.21.15.89:0/1215414621 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21f8004230 con 0x7f2200038960 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f21fea00640 1 -- 172.21.15.89:0/1215414621 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8004480 con 0x7f2200038960 2024-08-31T04:04:29.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220004de60 con 0x7f2200038960 2024-08-31T04:04:29.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2200053cf0 con 0x7f2200038960 2024-08-31T04:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7fbddfe00640 1 Processor -- start 2024-08-31T04:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.068+0000 7fbddfe00640 1 -- start start 2024-08-31T04:04:29.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22000e45f0 con 0x7f2200038960 2024-08-31T04:04:29.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddfe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd8032e50 0x7fbdd8174a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddfe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd8044cc0 0x7fbdd80c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd8046020 0x7fbdd80c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddfe00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd804c5c0 con 0x7fbdd8044cc0 2024-08-31T04:04:29.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddfe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8034840 con 0x7fbdd8046020 2024-08-31T04:04:29.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddfe00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd804c740 con 0x7fbdd8032e50 2024-08-31T04:04:29.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd8032e50 0x7fbdd8174a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd8032e50 0x7fbdd8174a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45438/0 (socket says 172.21.15.89:45438) 2024-08-31T04:04:29.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddea00640 1 -- 172.21.15.89:0/2900044578 learned_addr learned my addr 172.21.15.89:0/2900044578 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:29.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddf400640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd8046020 0x7fbdd80c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddf400640 1 -- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd8032e50 msgr2=0x7fbdd8174a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddf400640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd8032e50 0x7fbdd8174a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddf400640 1 -- 172.21.15.89:0/2900044578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd8044cc0 msgr2=0x7fbdd80c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddf400640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd8044cc0 0x7fbdd80c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddf400640 1 -- 172.21.15.89:0/2900044578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd8174f40 con 0x7fbdd8046020 2024-08-31T04:04:29.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7f21fea00640 1 -- 172.21.15.89:0/1215414621 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f21f80c0020 con 0x7f2200038960 2024-08-31T04:04:29.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbddf400640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd8046020 0x7fbdd80c9a80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbde006a360 tx=0x7fbde0073820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.072+0000 7fbdd6a00640 1 -- 172.21.15.89:0/2900044578 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde009a070 con 0x7fbdd8046020 2024-08-31T04:04:29.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd80c76c0 con 0x7fbdd8046020 2024-08-31T04:04:29.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd8174200 con 0x7fbdd8046020 2024-08-31T04:04:29.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7fbdd6a00640 1 -- 172.21.15.89:0/2900044578 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbde0093870 con 0x7fbdd8046020 2024-08-31T04:04:29.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7fbdd6a00640 1 -- 172.21.15.89:0/2900044578 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0091050 con 0x7fbdd8046020 2024-08-31T04:04:29.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f21fea00640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21e80720f0 0x7f21e8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f21fea00640 1 -- 172.21.15.89:0/1215414621 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f21f812d2e0 con 0x7f2200038960 2024-08-31T04:04:29.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f2206a00640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21e80720f0 0x7f21e8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f7496c00640 1 -- 172.21.15.89:0/1224816244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74900c68f0 msgr2=0x7f74900c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f7496c00640 1 --2- 172.21.15.89:0/1224816244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74900c68f0 0x7f74900c1ed0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74900caa70 tx=0x7f748401eff0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb80052a0 con 0x7fbdd8046020 2024-08-31T04:04:29.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f7496c00640 1 -- 172.21.15.89:0/1224816244 shutdown_connections 2024-08-31T04:04:29.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f7496c00640 1 --2- 172.21.15.89:0/1224816244 >> v2:172.21.15.170:3300/0 conn(0x7f74901584e0 0x7f7490074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f7496c00640 1 --2- 172.21.15.89:0/1224816244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74900c68f0 0x7f74900c1ed0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f7496c00640 1 --2- 172.21.15.89:0/1224816244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74900c9190 0x7f7490155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f7496c00640 1 -- 172.21.15.89:0/1224816244 >> 172.21.15.89:0/1224816244 conn(0x7f74900cd1e0 msgr2=0x7f74900c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f7496c00640 1 -- 172.21.15.89:0/1224816244 shutdown_connections 2024-08-31T04:04:29.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.076+0000 7f7496c00640 1 -- 172.21.15.89:0/1224816244 wait complete. 2024-08-31T04:04:29.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fc8ca800640 1 -- 172.21.15.89:0/2231750509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8c415b2f0 msgr2=0x7fc8c415b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fc8ca800640 1 --2- 172.21.15.89:0/2231750509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8c415b2f0 0x7fc8c415b700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4070750 tx=0x7fc8b801d4b0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f2206a00640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21e80720f0 0x7f21e8074600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009b40 tx=0x7f21f40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fc8ca800640 1 -- 172.21.15.89:0/2231750509 shutdown_connections 2024-08-31T04:04:29.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fc8ca800640 1 --2- 172.21.15.89:0/2231750509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8c415b2f0 0x7fc8c415b700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fc8ca800640 1 --2- 172.21.15.89:0/2231750509 >> v2:172.21.15.89:3300/0 conn(0x7fc8c4151780 0x7fc8c415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fc8ca800640 1 -- 172.21.15.89:0/2231750509 >> 172.21.15.89:0/2231750509 conn(0x7fc8c40c9b00 msgr2=0x7fc8c40c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f7496c00640 1 Processor -- start 2024-08-31T04:04:29.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fbdd6a00640 1 -- 172.21.15.89:0/2900044578 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbde009d070 con 0x7fbdd8046020 2024-08-31T04:04:29.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fbdd6a00640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdc00720f0 0x7fbdc0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fbdd6a00640 1 -- 172.21.15.89:0/2900044578 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbde01127a0 con 0x7fbdd8046020 2024-08-31T04:04:29.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f063f200640 1 -- 172.21.15.89:0/1986281761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f064014fe20 msgr2=0x7f0640073b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f063f200640 1 --2- 172.21.15.89:0/1986281761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f064014fe20 0x7f0640073b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0640072b70 tx=0x7f063001eff0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f063f200640 1 -- 172.21.15.89:0/1986281761 shutdown_connections 2024-08-31T04:04:29.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f063f200640 1 --2- 172.21.15.89:0/1986281761 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06400740c0 0x7f0640159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f063f200640 1 --2- 172.21.15.89:0/1986281761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f064014fe20 0x7f0640073b80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f063f200640 1 --2- 172.21.15.89:0/1986281761 >> v2:172.21.15.170:3300/0 conn(0x7f06400c7520 0x7f06400732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f063f200640 1 -- 172.21.15.89:0/1986281761 >> 172.21.15.89:0/1986281761 conn(0x7f06400cca80 msgr2=0x7f06400cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f7496c00640 1 -- start start 2024-08-31T04:04:29.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f063f200640 1 -- 172.21.15.89:0/1986281761 shutdown_connections 2024-08-31T04:04:29.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7f063f200640 1 -- 172.21.15.89:0/1986281761 wait complete. 2024-08-31T04:04:29.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fc8ca800640 1 -- 172.21.15.89:0/2231750509 shutdown_connections 2024-08-31T04:04:29.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fbddea00640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdc00720f0 0x7fbdc0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.080+0000 7fc8ca800640 1 -- 172.21.15.89:0/2231750509 wait complete. 2024-08-31T04:04:29.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7fbddea00640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdc00720f0 0x7fbdc0074600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009930 tx=0x7fbdcc01afb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7496c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74900c68f0 0x7f74900c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7496c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74900c9190 0x7f74900c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7496c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74901584e0 0x7f74901502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7496c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f74900ca460 con 0x7f74900c9190 2024-08-31T04:04:29.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7496c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74900c2410 con 0x7f74900c68f0 2024-08-31T04:04:29.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7496c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f74900ca5e0 con 0x7f74901584e0 2024-08-31T04:04:29.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7496200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74901584e0 0x7f74901502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7495800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74900c68f0 0x7f74900c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7495800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74900c68f0 0x7f74900c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38398/0 (socket says 172.21.15.89:38398) 2024-08-31T04:04:29.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7495800640 1 -- 172.21.15.89:0/2932758058 learned_addr learned my addr 172.21.15.89:0/2932758058 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:29.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7495800640 1 -- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74901584e0 msgr2=0x7f74901502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7495800640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74901584e0 0x7f74901502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7495800640 1 -- 172.21.15.89:0/2932758058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74900c9190 msgr2=0x7f74900c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7495800640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74900c9190 0x7f74900c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7495800640 1 -- 172.21.15.89:0/2932758058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74900cb5b0 con 0x7f74900c68f0 2024-08-31T04:04:29.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7fc8ca800640 1 Processor -- start 2024-08-31T04:04:29.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7fc8ca800640 1 -- start start 2024-08-31T04:04:29.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f7495800640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74900c68f0 0x7f74900c5a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f748800eae0 tx=0x7f748800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.084+0000 7f063f200640 1 Processor -- start 2024-08-31T04:04:29.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063f200640 1 -- start start 2024-08-31T04:04:29.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8ca800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8c406f8e0 0x7fc8c41f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8ca800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8c4151780 0x7fc8c415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8c406f8e0 0x7fc8c41f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8c406f8e0 0x7fc8c41f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41820/0 (socket says 172.21.15.89:41820) 2024-08-31T04:04:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9400640 1 -- 172.21.15.89:0/3985345652 learned_addr learned my addr 172.21.15.89:0/3985345652 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8ca800640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8c415b2f0 0x7fc8c40741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f21fea00640 1 -- 172.21.15.89:0/1215414621 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f21f80c7020 con 0x7f2200038960 2024-08-31T04:04:29.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c4073ea0 con 0x7fc8c406f8e0 2024-08-31T04:04:29.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c4151b90 con 0x7fc8c4151780 2024-08-31T04:04:29.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c41f94a0 con 0x7fc8c415b2f0 2024-08-31T04:04:29.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063f200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06400740c0 0x7f06400c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063f200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c7520 0x7f064014b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c8a00640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8c4151780 0x7fc8c415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f064014fe20 0x7f0640142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063f200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0640073820 con 0x7f06400c7520 2024-08-31T04:04:29.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f06400c9030 con 0x7f064014fe20 2024-08-31T04:04:29.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063f200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f06400cd880 con 0x7f06400740c0 2024-08-31T04:04:29.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f2a64600640 1 -- 172.21.15.89:0/3206400042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a5c071540 msgr2=0x7f2a5c155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f2a64600640 1 --2- 172.21.15.89:0/3206400042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a5c071540 0x7f2a5c155bc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c06d7f0 tx=0x7f2a4801c820 comp rx=0 tx=0).stop 2024-08-31T04:04:29.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9e00640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8c415b2f0 0x7fc8c40741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06400740c0 0x7f06400c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06400740c0 0x7f06400c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45462/0 (socket says 172.21.15.89:45462) 2024-08-31T04:04:29.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063de00640 1 -- 172.21.15.89:0/981166070 learned_addr learned my addr 172.21.15.89:0/981166070 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:29.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9400640 1 -- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8c415b2f0 msgr2=0x7fc8c40741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9400640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8c415b2f0 0x7fc8c40741b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9400640 1 -- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8c4151780 msgr2=0x7fc8c415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9400640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8c4151780 0x7fc8c415a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f2a64600640 1 -- 172.21.15.89:0/3206400042 shutdown_connections 2024-08-31T04:04:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9400640 1 -- 172.21.15.89:0/3985345652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c4147500 con 0x7fc8c406f8e0 2024-08-31T04:04:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f2a64600640 1 --2- 172.21.15.89:0/3206400042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a5c071540 0x7f2a5c155bc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f2a64600640 1 -- 172.21.15.89:0/3206400042 >> 172.21.15.89:0/3206400042 conn(0x7f2a5c0ca9c0 msgr2=0x7f2a5c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f2a64600640 1 -- 172.21.15.89:0/3206400042 shutdown_connections 2024-08-31T04:04:29.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063e800640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f064014fe20 0x7f0640142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f2a64600640 1 -- 172.21.15.89:0/3206400042 wait complete. 2024-08-31T04:04:29.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063de00640 1 -- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f064014fe20 msgr2=0x7f0640142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063de00640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f064014fe20 0x7f0640142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063de00640 1 -- 172.21.15.89:0/981166070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c7520 msgr2=0x7f064014b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063de00640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c7520 0x7f064014b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063de00640 1 -- 172.21.15.89:0/981166070 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064014e250 con 0x7f06400740c0 2024-08-31T04:04:29.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7f063e800640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f064014fe20 0x7f0640142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:29.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.088+0000 7fc8c9400640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8c406f8e0 0x7fc8c41f5060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000c460 tx=0x7fc8b000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f063de00640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06400740c0 0x7f06400c4890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f063800ee10 tx=0x7f063800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7fc8c1600640 1 -- 172.21.15.89:0/3985345652 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0016020 con 0x7fc8c406f8e0 2024-08-31T04:04:29.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c41f86e0 con 0x7fc8c406f8e0 2024-08-31T04:04:29.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c41f8ca0 con 0x7fc8c406f8e0 2024-08-31T04:04:29.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0636000640 1 -- 172.21.15.89:0/981166070 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638004d30 con 0x7f06400740c0 2024-08-31T04:04:29.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7fc8c1600640 1 -- 172.21.15.89:0/3985345652 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8b0012920 con 0x7fc8c406f8e0 2024-08-31T04:04:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06400c5370 con 0x7f06400740c0 2024-08-31T04:04:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0636000640 1 -- 172.21.15.89:0/981166070 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f063800b570 con 0x7f06400740c0 2024-08-31T04:04:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0636000640 1 -- 172.21.15.89:0/981166070 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063800b9a0 con 0x7f06400740c0 2024-08-31T04:04:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f064014c0b0 con 0x7f06400740c0 2024-08-31T04:04:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7fc8c1600640 1 -- 172.21.15.89:0/3985345652 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0012cd0 con 0x7fc8c406f8e0 2024-08-31T04:04:29.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a00052a0 con 0x7fc8c406f8e0 2024-08-31T04:04:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0b2a600640 1 -- 172.21.15.89:0/3817373251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b240c2ee0 msgr2=0x7f0b24071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0b2a600640 1 --2- 172.21.15.89:0/3817373251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b240c2ee0 0x7f0b24071ea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009840 tx=0x7f0b1401c820 comp rx=0 tx=0).stop 2024-08-31T04:04:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0b2a600640 1 -- 172.21.15.89:0/3817373251 shutdown_connections 2024-08-31T04:04:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0b2a600640 1 --2- 172.21.15.89:0/3817373251 >> v2:172.21.15.89:3300/0 conn(0x7f0b241588d0 0x7f0b24158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0b2a600640 1 --2- 172.21.15.89:0/3817373251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b240c2ee0 0x7f0b24071ea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0b2a600640 1 -- 172.21.15.89:0/3817373251 >> 172.21.15.89:0/3817373251 conn(0x7f0b240ca9c0 msgr2=0x7f0b240cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0b2a600640 1 -- 172.21.15.89:0/3817373251 shutdown_connections 2024-08-31T04:04:29.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.092+0000 7f0b2a600640 1 -- 172.21.15.89:0/3817373251 wait complete. 2024-08-31T04:04:29.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06400c5890 con 0x7f06400740c0 2024-08-31T04:04:29.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f2a64600640 1 Processor -- start 2024-08-31T04:04:29.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f0b2a600640 1 Processor -- start 2024-08-31T04:04:29.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7fc8c1600640 1 -- 172.21.15.89:0/3985345652 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc8b0019020 con 0x7fc8c406f8e0 2024-08-31T04:04:29.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f0b2a600640 1 -- start start 2024-08-31T04:04:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f748d600640 1 -- 172.21.15.89:0/2932758058 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488010430 con 0x7f74900c68f0 2024-08-31T04:04:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f748d600640 1 -- 172.21.15.89:0/2932758058 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74880105d0 con 0x7f74900c68f0 2024-08-31T04:04:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f748d600640 1 -- 172.21.15.89:0/2932758058 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488010430 con 0x7f74900c68f0 2024-08-31T04:04:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74900cb080 con 0x7f74900c68f0 2024-08-31T04:04:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74900cbe80 con 0x7f74900c68f0 2024-08-31T04:04:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f0636000640 1 -- 172.21.15.89:0/981166070 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f063800bb40 con 0x7f06400740c0 2024-08-31T04:04:29.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f0636000640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f06200720f0 0x7f0620074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7f0636000640 1 -- 172.21.15.89:0/981166070 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0638093900 con 0x7f06400740c0 2024-08-31T04:04:29.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f063d400640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f06200720f0 0x7f0620074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.096+0000 7fc8c1600640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc8a40720f0 0x7fc8a4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7fc8c8a00640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc8a40720f0 0x7fc8a4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7fbdd6a00640 1 -- 172.21.15.89:0/2900044578 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbdd8046430 con 0x7fbdd8046020 2024-08-31T04:04:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7fc8c1600640 1 -- 172.21.15.89:0/3985345652 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc8b005a560 con 0x7fc8c406f8e0 2024-08-31T04:04:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7fc8c8a00640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc8a40720f0 0x7fc8a4074600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40ca360 tx=0x7fc8bc00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c0052a0 con 0x7f74900c68f0 2024-08-31T04:04:29.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b2a600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b240c2ee0 0x7f0b2414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b2a600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b240c7df0 0x7f0b24149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b2a600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b241588d0 0x7f0b24149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b2a600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0b240ca500 con 0x7f0b240c2ee0 2024-08-31T04:04:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b2a600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b240ca380 con 0x7f0b240c7df0 2024-08-31T04:04:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b2a600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b240c8200 con 0x7f0b241588d0 2024-08-31T04:04:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a64600640 1 -- start start 2024-08-31T04:04:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a64600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5c071540 0x7f2a5c14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a64600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a5c0c2ee0 0x7f2a5c14ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a64600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a5c0c88c0 0x7f2a5c1466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b23400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b240c2ee0 0x7f0b2414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f063d400640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f06200720f0 0x7f0620074600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06300b2000 tx=0x7f063001bd90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b23400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b240c2ee0 0x7f0b2414fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41838/0 (socket says 172.21.15.89:41838) 2024-08-31T04:04:29.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b23400640 1 -- 172.21.15.89:0/366943305 learned_addr learned my addr 172.21.15.89:0/366943305 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:29.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b22a00640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b240c7df0 0x7f0b24149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a64600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c15c8b0 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a64600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c15ca30 con 0x7f2a5c071540 2024-08-31T04:04:29.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a64600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5c169c90 con 0x7f2a5c0c2ee0 2024-08-31T04:04:29.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a61200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a5c0c2ee0 0x7f2a5c14ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a61c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5c071540 0x7f2a5c14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a61c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5c071540 0x7f2a5c14dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38428/0 (socket says 172.21.15.89:38428) 2024-08-31T04:04:29.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a61c00640 1 -- 172.21.15.89:0/327417086 learned_addr learned my addr 172.21.15.89:0/327417086 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:29.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a62600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a5c0c88c0 0x7f2a5c1466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f2a61200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a5c0c2ee0 0x7f2a5c14ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45480/0 (socket says 172.21.15.89:45480) 2024-08-31T04:04:29.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f748d600640 1 -- 172.21.15.89:0/2932758058 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f748803a790 con 0x7f74900c68f0 2024-08-31T04:04:29.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.100+0000 7f0b23e00640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b241588d0 0x7f0b24149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a62600640 1 -- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a5c0c2ee0 msgr2=0x7f2a5c14ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a62600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a5c0c2ee0 0x7f2a5c14ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a62600640 1 -- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5c071540 msgr2=0x7f2a5c14dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a62600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5c071540 0x7f2a5c14dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a62600640 1 -- 172.21.15.89:0/327417086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c15e4b0 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7fc8c1600640 1 -- 172.21.15.89:0/3985345652 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc8b0020030 con 0x7fc8c406f8e0 2024-08-31T04:04:29.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b23400640 1 -- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b241588d0 msgr2=0x7f0b24149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b23400640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b241588d0 0x7f0b24149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b23400640 1 -- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b240c7df0 msgr2=0x7f0b24149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b23400640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b240c7df0 0x7f0b24149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b23400640 1 -- 172.21.15.89:0/366943305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b24150ff0 con 0x7f0b240c2ee0 2024-08-31T04:04:29.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f748d600640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74700724f0 0x7f7470074a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a62600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a5c0c88c0 0x7f2a5c1466b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c7e0 tx=0x7f2a5400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f748d600640 1 -- 172.21.15.89:0/2932758058 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f748800ccb0 con 0x7f74900c68f0 2024-08-31T04:04:29.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b23400640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b240c2ee0 0x7f0b2414fd70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b140b0040 tx=0x7f0b14004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a59600640 1 -- 172.21.15.89:0/327417086 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54016020 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a59600640 1 -- 172.21.15.89:0/327417086 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a5400a930 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a59600640 1 -- 172.21.15.89:0/327417086 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400ad80 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5c151e60 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5c1472c0 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b1b400640 1 -- 172.21.15.89:0/366943305 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14004430 con 0x7f0b240c2ee0 2024-08-31T04:04:29.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f7494e00640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74700724f0 0x7f7470074a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b1b400640 1 -- 172.21.15.89:0/366943305 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b140be070 con 0x7f0b240c2ee0 2024-08-31T04:04:29.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b1b400640 1 -- 172.21.15.89:0/366943305 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14003990 con 0x7f0b240c2ee0 2024-08-31T04:04:29.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b241512d0 con 0x7f0b240c2ee0 2024-08-31T04:04:29.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5c155bc0 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.104+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b240c6be0 con 0x7f0b240c2ee0 2024-08-31T04:04:29.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.108+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b24071ea0 con 0x7f0b240c2ee0 2024-08-31T04:04:29.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.108+0000 7f7494e00640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74700724f0 0x7f7470074a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f74840b2000 tx=0x7f748401bd90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.108+0000 7f2a59600640 1 -- 172.21.15.89:0/327417086 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2a54019020 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.108+0000 7f2a59600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a3c0720f0 0x7f2a3c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.108+0000 7f2a59600640 1 -- 172.21.15.89:0/327417086 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2a540930e0 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.112+0000 7f0b1b400640 1 -- 172.21.15.89:0/366943305 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0b14003b30 con 0x7f0b240c2ee0 2024-08-31T04:04:29.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.112+0000 7f2a61c00640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a3c0720f0 0x7f2a3c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.112+0000 7f0b1b400640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0b040720c0 0x7f0b040745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.112+0000 7f0b22a00640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0b040720c0 0x7f0b040745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.112+0000 7f2a61c00640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a3c0720f0 0x7f2a3c074600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2a500046c0 tx=0x7f2a50007f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.112+0000 7f0b22a00640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0b040720c0 0x7f0b040745d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0b24162e70 tx=0x7f0b10007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.112+0000 7f0636000640 1 -- 172.21.15.89:0/981166070 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f06400c5890 con 0x7f06400740c0 2024-08-31T04:04:29.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.116+0000 7f0b1b400640 1 -- 172.21.15.89:0/366943305 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0b14003e20 con 0x7f0b240c2ee0 2024-08-31T04:04:29.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.116+0000 7f2a59600640 1 -- 172.21.15.89:0/327417086 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2a54020070 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.116+0000 7f748d600640 1 -- 172.21.15.89:0/2932758058 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f748805ed90 con 0x7f74900c68f0 2024-08-31T04:04:29.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.120+0000 7f2cf9a00640 1 -- 172.21.15.89:0/187066344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038e40 msgr2=0x7f2cec006f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.120+0000 7f2cf9a00640 1 --2- 172.21.15.89:0/187066344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038e40 0x7f2cec006f60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009840 tx=0x7f2ce001c820 comp rx=0 tx=0).stop 2024-08-31T04:04:29.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.120+0000 7f2cf9a00640 1 -- 172.21.15.89:0/187066344 shutdown_connections 2024-08-31T04:04:29.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.120+0000 7f2cf9a00640 1 --2- 172.21.15.89:0/187066344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038e40 0x7f2cec006f60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.120+0000 7f2cf9a00640 1 -- 172.21.15.89:0/187066344 >> 172.21.15.89:0/187066344 conn(0x7f2cec050c20 msgr2=0x7f2cec051030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.120+0000 7f2cf9a00640 1 -- 172.21.15.89:0/187066344 shutdown_connections 2024-08-31T04:04:29.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.124+0000 7f2cf9a00640 1 -- 172.21.15.89:0/187066344 wait complete. 2024-08-31T04:04:29.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.124+0000 7f2cf9a00640 1 Processor -- start 2024-08-31T04:04:29.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.124+0000 7f0b1b400640 1 -- 172.21.15.89:0/366943305 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0b140c7020 con 0x7f0b240c2ee0 2024-08-31T04:04:29.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf9a00640 1 -- start start 2024-08-31T04:04:29.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf9a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cec0074a0 0x7f2cec0e5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf9a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038990 0x7f2cec17d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf9a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cec038e40 0x7f2cec0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf9a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec049240 con 0x7f2cec0074a0 2024-08-31T04:04:29.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf9a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec0490c0 con 0x7f2cec038990 2024-08-31T04:04:29.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf9a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec0f14d0 con 0x7f2cec038e40 2024-08-31T04:04:29.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf2a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cec0074a0 0x7f2cec0e5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cec038e40 0x7f2cec0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038990 0x7f2cec17d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf3400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cec038e40 0x7f2cec0cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45496/0 (socket says 172.21.15.89:45496) 2024-08-31T04:04:29.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038990 0x7f2cec17d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38436/0 (socket says 172.21.15.89:38436) 2024-08-31T04:04:29.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.128+0000 7f2cf3400640 1 -- 172.21.15.89:0/1232470289 learned_addr learned my addr 172.21.15.89:0/1232470289 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:29.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.132+0000 7f2cf3400640 1 -- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038990 msgr2=0x7f2cec17d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.132+0000 7f2cf3400640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038990 0x7f2cec17d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.132+0000 7f2cf3400640 1 -- 172.21.15.89:0/1232470289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cec0074a0 msgr2=0x7f2cec0e5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.132+0000 7f2cf3400640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cec0074a0 0x7f2cec0e5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.132+0000 7f2cf3400640 1 -- 172.21.15.89:0/1232470289 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec0cd880 con 0x7f2cec038e40 2024-08-31T04:04:29.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.132+0000 7f2cf2000640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038990 0x7f2cec17d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:04:29.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.132+0000 7f2cf2a00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cec0074a0 0x7f2cec0e5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:04:29.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.136+0000 7f2cf3400640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cec038e40 0x7f2cec0cca40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4066680 tx=0x7f2cf406a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.136+0000 7f2ceaa00640 1 -- 172.21.15.89:0/1232470289 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4076b80 con 0x7f2cec038e40 2024-08-31T04:04:29.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.136+0000 7f2ceaa00640 1 -- 172.21.15.89:0/1232470289 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cf4076e10 con 0x7f2cec038e40 2024-08-31T04:04:29.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.136+0000 7f2ceaa00640 1 -- 172.21.15.89:0/1232470289 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4076b80 con 0x7f2cec038e40 2024-08-31T04:04:29.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.136+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec0cdb60 con 0x7f2cec038e40 2024-08-31T04:04:29.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.136+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec0df450 con 0x7f2cec038e40 2024-08-31T04:04:29.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.136+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cec006f60 con 0x7f2cec038e40 2024-08-31T04:04:29.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.140+0000 7f2ceaa00640 1 -- 172.21.15.89:0/1232470289 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2cf4095420 con 0x7f2cec038e40 2024-08-31T04:04:29.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.140+0000 7f2ceaa00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2cd40722f0 0x7f2cd4074800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:29.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.140+0000 7f2ceaa00640 1 -- 172.21.15.89:0/1232470289 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2cf40d6950 con 0x7f2cec038e40 2024-08-31T04:04:29.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.140+0000 7f2cf2a00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2cd40722f0 0x7f2cd4074800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:29.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.144+0000 7f2cf2a00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2cd40722f0 0x7f2cd4074800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40046c0 tx=0x7f2ce4004630 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:29.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.152+0000 7f2ceaa00640 1 -- 172.21.15.89:0/1232470289 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2cf40da360 con 0x7f2cec038e40 2024-08-31T04:04:29.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.448+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f22000e0b40 con 0x7f2200038960 2024-08-31T04:04:29.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.452+0000 7f21fea00640 1 -- 172.21.15.89:0/1215414621 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f21f80164b0 con 0x7f2200038960 2024-08-31T04:04:29.452 INFO:teuthology.orchestra.run.smithi089.stdout:64424509448 2024-08-31T04:04:29.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21e80720f0 msgr2=0x7f21e8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7f220d800640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21e80720f0 0x7f21e8074600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009b40 tx=0x7f21f40091e0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2200038960 msgr2=0x7f22000e4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7f220d800640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2200038960 0x7f22000e4a80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009230 tx=0x7f21f8005de0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbdb8005590 con 0x7fbdd8046020 2024-08-31T04:04:29.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 shutdown_connections 2024-08-31T04:04:29.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7f220d800640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21e80720f0 0x7f21e8074600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7f220d800640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22000e06a0 0x7f22000533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7f220d800640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2200038960 0x7f22000e4a80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.456+0000 7f220d800640 1 --2- 172.21.15.89:0/1215414621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2200007470 0x7f22000e5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.460+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 >> 172.21.15.89:0/1215414621 conn(0x7f2200050bf0 msgr2=0x7f2200051000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.460+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 shutdown_connections 2024-08-31T04:04:29.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.460+0000 7f220d800640 1 -- 172.21.15.89:0/1215414621 wait complete. 2024-08-31T04:04:29.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.460+0000 7fbdd6a00640 1 -- 172.21.15.89:0/2900044578 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbde00dd750 con 0x7fbdd8046020 2024-08-31T04:04:29.462 INFO:teuthology.orchestra.run.smithi089.stdout:68719476747 2024-08-31T04:04:29.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdc00720f0 msgr2=0x7fbdc0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdc00720f0 0x7fbdc0074600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009930 tx=0x7fbdcc01afb0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd8046020 msgr2=0x7fbdd80c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd8046020 0x7fbdd80c9a80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbde006a360 tx=0x7fbde0073820 comp rx=0 tx=0).stop 2024-08-31T04:04:29.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 shutdown_connections 2024-08-31T04:04:29.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdc00720f0 0x7fbdc0074600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd8044cc0 0x7fbdd80c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdd8046020 0x7fbdd80c9a80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.466 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 --2- 172.21.15.89:0/2900044578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbdd8032e50 0x7fbdd8174a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 >> 172.21.15.89:0/2900044578 conn(0x7fbdd804fe40 msgr2=0x7fbdd804ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 shutdown_connections 2024-08-31T04:04:29.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fbddfe00640 1 -- 172.21.15.89:0/2900044578 wait complete. 2024-08-31T04:04:29.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.464+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc8a0005860 con 0x7fc8c406f8e0 2024-08-31T04:04:29.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.472+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f746c005860 con 0x7f74900c68f0 2024-08-31T04:04:29.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.472+0000 7fc8c1600640 1 -- 172.21.15.89:0/3985345652 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8b005e670 con 0x7fc8c406f8e0 2024-08-31T04:04:29.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.472+0000 7f748d600640 1 -- 172.21.15.89:0/2932758058 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f748805e690 con 0x7f74900c68f0 2024-08-31T04:04:29.474 INFO:teuthology.orchestra.run.smithi089.stdout:64424509450 2024-08-31T04:04:29.474 INFO:teuthology.orchestra.run.smithi089.stdout:68719476747 2024-08-31T04:04:29.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0640150230 con 0x7f06400740c0 2024-08-31T04:04:29.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc8a40720f0 msgr2=0x7fc8a4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc8a40720f0 0x7fc8a4074600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40ca360 tx=0x7fc8bc00d040 comp rx=0 tx=0).stop 2024-08-31T04:04:29.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8c406f8e0 msgr2=0x7fc8c41f5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8c406f8e0 0x7fc8c41f5060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000c460 tx=0x7fc8b000c920 comp rx=0 tx=0).stop 2024-08-31T04:04:29.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 shutdown_connections 2024-08-31T04:04:29.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc8a40720f0 0x7fc8a4074600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8c415b2f0 0x7fc8c40741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8c4151780 0x7fc8c415a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 --2- 172.21.15.89:0/3985345652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8c406f8e0 0x7fc8c41f5060 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 >> 172.21.15.89:0/3985345652 conn(0x7fc8c40c9b00 msgr2=0x7fc8c4150280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74700724f0 msgr2=0x7f7470074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74700724f0 0x7f7470074a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f74840b2000 tx=0x7f748401bd90 comp rx=0 tx=0).stop 2024-08-31T04:04:29.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74900c68f0 msgr2=0x7f74900c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74900c68f0 0x7f74900c5a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f748800eae0 tx=0x7f748800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 shutdown_connections 2024-08-31T04:04:29.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74700724f0 0x7f7470074a00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74900c9190 0x7f74900c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74901584e0 0x7f74901502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 --2- 172.21.15.89:0/2932758058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74900c68f0 0x7f74900c5a10 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f748800eae0 tx=0x7f748800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 >> 172.21.15.89:0/2932758058 conn(0x7f74900cd1e0 msgr2=0x7f74900b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7f0636000640 1 -- 172.21.15.89:0/981166070 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f063805ef00 con 0x7f06400740c0 2024-08-31T04:04:29.480 INFO:teuthology.orchestra.run.smithi089.stdout:55834574858 2024-08-31T04:04:29.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.476+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 shutdown_connections 2024-08-31T04:04:29.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7fc8ca800640 1 -- 172.21.15.89:0/3985345652 wait complete. 2024-08-31T04:04:29.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 shutdown_connections 2024-08-31T04:04:29.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f7496c00640 1 -- 172.21.15.89:0/2932758058 wait complete. 2024-08-31T04:04:29.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f06200720f0 msgr2=0x7f0620074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f06200720f0 0x7f0620074600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06300b2000 tx=0x7f063001bd90 comp rx=0 tx=0).stop 2024-08-31T04:04:29.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06400740c0 msgr2=0x7f06400c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06400740c0 0x7f06400c4890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f063800ee10 tx=0x7f063800c740 comp rx=0 tx=0).stop 2024-08-31T04:04:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 shutdown_connections 2024-08-31T04:04:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f06200720f0 0x7f0620074600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06400c7520 0x7f064014b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f064014fe20 0x7f0640142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 --2- 172.21.15.89:0/981166070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06400740c0 0x7f06400c4890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 >> 172.21.15.89:0/981166070 conn(0x7f06400cca80 msgr2=0x7f06401e42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 shutdown_connections 2024-08-31T04:04:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.480+0000 7f063f200640 1 -- 172.21.15.89:0/981166070 wait complete. 2024-08-31T04:04:29.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.484+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0b24147bf0 con 0x7f0b240c2ee0 2024-08-31T04:04:29.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.484+0000 7f0b1b400640 1 -- 172.21.15.89:0/366943305 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b14016410 con 0x7f0b240c2ee0 2024-08-31T04:04:29.486 INFO:teuthology.orchestra.run.smithi089.stdout:68719476746 2024-08-31T04:04:29.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0b040720c0 msgr2=0x7f0b040745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0b040720c0 0x7f0b040745d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0b24162e70 tx=0x7f0b10007ea0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b240c2ee0 msgr2=0x7f0b2414fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b240c2ee0 0x7f0b2414fd70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b140b0040 tx=0x7f0b14004040 comp rx=0 tx=0).stop 2024-08-31T04:04:29.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 shutdown_connections 2024-08-31T04:04:29.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0b040720c0 0x7f0b040745d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b241588d0 0x7f0b24149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b240c7df0 0x7f0b24149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 --2- 172.21.15.89:0/366943305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b240c2ee0 0x7f0b2414fd70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 >> 172.21.15.89:0/366943305 conn(0x7f0b240ca9c0 msgr2=0x7f0b240c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 shutdown_connections 2024-08-31T04:04:29.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.488+0000 7f0b2a600640 1 -- 172.21.15.89:0/366943305 wait complete. 2024-08-31T04:04:29.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2024-08-31T04:04:29.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.500+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2a5c145d30 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.500+0000 7f2a59600640 1 -- 172.21.15.89:0/327417086 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2a5405e140 con 0x7f2a5c0c88c0 2024-08-31T04:04:29.503 INFO:teuthology.orchestra.run.smithi089.stdout:68719476746 2024-08-31T04:04:29.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476747 for osd.1 2024-08-31T04:04:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a3c0720f0 msgr2=0x7f2a3c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a3c0720f0 0x7f2a3c074600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2a500046c0 tx=0x7f2a50007f60 comp rx=0 tx=0).stop 2024-08-31T04:04:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a5c0c88c0 msgr2=0x7f2a5c1466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a5c0c88c0 0x7f2a5c1466b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c7e0 tx=0x7f2a5400cca0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 shutdown_connections 2024-08-31T04:04:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a3c0720f0 0x7f2a3c074600 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2a500046c0 tx=0x7f2a50007f60 comp rx=0 tx=0).stop 2024-08-31T04:04:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a5c0c88c0 0x7f2a5c1466b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a5c0c2ee0 0x7f2a5c14ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 --2- 172.21.15.89:0/327417086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5c071540 0x7f2a5c14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 >> 172.21.15.89:0/327417086 conn(0x7f2a5c0ca9c0 msgr2=0x7f2a5c0c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 shutdown_connections 2024-08-31T04:04:29.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.504+0000 7f2a64600640 1 -- 172.21.15.89:0/327417086 wait complete. 2024-08-31T04:04:29.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-08-31T04:04:29.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2024-08-31T04:04:29.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476747 for osd.0 2024-08-31T04:04:29.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476746 for osd.3 2024-08-31T04:04:29.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.536+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2cec0d0760 con 0x7f2cec038e40 2024-08-31T04:04:29.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2ceaa00640 1 -- 172.21.15.89:0/1232470289 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2cf40deb20 con 0x7f2cec038e40 2024-08-31T04:04:29.541 INFO:teuthology.orchestra.run.smithi089.stdout:64424509449 2024-08-31T04:04:29.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476746 for osd.2 2024-08-31T04:04:29.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2cd40722f0 msgr2=0x7f2cd4074800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2cd40722f0 0x7f2cd4074800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40046c0 tx=0x7f2ce4004630 comp rx=0 tx=0).stop 2024-08-31T04:04:29.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cec038e40 msgr2=0x7f2cec0cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cec038e40 0x7f2cec0cca40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4066680 tx=0x7f2cf406a0d0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 shutdown_connections 2024-08-31T04:04:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2cd40722f0 0x7f2cd4074800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cec038e40 0x7f2cec0cca40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cec038990 0x7f2cec17d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 --2- 172.21.15.89:0/1232470289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cec0074a0 0x7f2cec0e5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 >> 172.21.15.89:0/1232470289 conn(0x7f2cec050c20 msgr2=0x7f2cec006670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 shutdown_connections 2024-08-31T04:04:29.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:29.540+0000 7f2cf9a00640 1 -- 172.21.15.89:0/1232470289 wait complete. 2024-08-31T04:04:29.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-08-31T04:04:30.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-31T04:04:30.506 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-31T04:04:30.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-31T04:04:30.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-31T04:04:30.525 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-31T04:04:30.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-31T04:04:30.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-31T04:04:30.564 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-31T04:04:30.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.744+0000 7fe16da00640 1 -- 172.21.15.89:0/633226070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1680ca260 msgr2=0x7fe1680c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.744+0000 7fe16da00640 1 --2- 172.21.15.89:0/633226070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1680ca260 0x7fe1680c36c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe168072420 tx=0x7fe15801eff0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.744+0000 7fe16da00640 1 -- 172.21.15.89:0/633226070 shutdown_connections 2024-08-31T04:04:30.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.744+0000 7fe16da00640 1 --2- 172.21.15.89:0/633226070 >> v2:172.21.15.89:3300/0 conn(0x7fe1680c8770 0x7fe168155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.744+0000 7fe16da00640 1 --2- 172.21.15.89:0/633226070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1680ca260 0x7fe1680c36c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.744+0000 7fe16da00640 1 -- 172.21.15.89:0/633226070 >> 172.21.15.89:0/633226070 conn(0x7fe1680cd1e0 msgr2=0x7fe1680c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.744+0000 7fe16da00640 1 -- 172.21.15.89:0/633226070 shutdown_connections 2024-08-31T04:04:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.744+0000 7fe16da00640 1 -- 172.21.15.89:0/633226070 wait complete. 2024-08-31T04:04:30.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.748+0000 7fe16da00640 1 Processor -- start 2024-08-31T04:04:30.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.748+0000 7fe16da00640 1 -- start start 2024-08-31T04:04:30.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe16da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1680c75e0 0x7fe168151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe16da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1680c8770 0x7fe1681f9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe16da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1680ca260 0x7fe1681556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe16da00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe1680c3d80 con 0x7fe1680c8770 2024-08-31T04:04:30.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe16da00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe1680c3c00 con 0x7fe1680ca260 2024-08-31T04:04:30.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe16da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe1680b2fe0 con 0x7fe1680c75e0 2024-08-31T04:04:30.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1680c75e0 0x7fe168151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1680c75e0 0x7fe168151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45512/0 (socket says 172.21.15.89:45512) 2024-08-31T04:04:30.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166a00640 1 -- 172.21.15.89:0/2289582980 learned_addr learned my addr 172.21.15.89:0/2289582980 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:30.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166000640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1680c8770 0x7fe1681f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166a00640 1 -- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1680ca260 msgr2=0x7fe1681556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166a00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1680ca260 0x7fe1681556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166a00640 1 -- 172.21.15.89:0/2289582980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1680c8770 msgr2=0x7fe1681f9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166a00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1680c8770 0x7fe1681f9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166a00640 1 -- 172.21.15.89:0/2289582980 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1681f9ec0 con 0x7fe1680c75e0 2024-08-31T04:04:30.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.752+0000 7fe166000640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1680c8770 0x7fe1681f9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:04:30.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.756+0000 7fe166a00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1680c75e0 0x7fe168151600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe158009790 tx=0x7fe158005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.756+0000 7fe15ea00640 1 -- 172.21.15.89:0/2289582980 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1580bf070 con 0x7fe1680c75e0 2024-08-31T04:04:30.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.756+0000 7fe15ea00640 1 -- 172.21.15.89:0/2289582980 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1580b08e0 con 0x7fe1680c75e0 2024-08-31T04:04:30.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.756+0000 7fe15ea00640 1 -- 172.21.15.89:0/2289582980 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1580b5040 con 0x7fe1680c75e0 2024-08-31T04:04:30.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.756+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16814eda0 con 0x7fe1680c75e0 2024-08-31T04:04:30.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.756+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe168150b80 con 0x7fe1680c75e0 2024-08-31T04:04:30.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.760+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1680c36c0 con 0x7fe1680c75e0 2024-08-31T04:04:30.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.760+0000 7fe15ea00640 1 -- 172.21.15.89:0/2289582980 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe1580b0c90 con 0x7fe1680c75e0 2024-08-31T04:04:30.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.764+0000 7fe15ea00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe1480720f0 0x7fe148074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.764+0000 7fe15ea00640 1 -- 172.21.15.89:0/2289582980 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe1580f7280 con 0x7fe1680c75e0 2024-08-31T04:04:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.764+0000 7fe166000640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe1480720f0 0x7fe148074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.764+0000 7fe166000640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe1480720f0 0x7fe148074600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe160000f90 tx=0x7fe160009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.780+0000 7fe15ea00640 1 -- 172.21.15.89:0/2289582980 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe158018b50 con 0x7fe1680c75e0 2024-08-31T04:04:30.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.828+0000 7f3b93200640 1 -- 172.21.15.89:0/4225331618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b940c8580 msgr2=0x7f3b940c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.828+0000 7f3b93200640 1 --2- 172.21.15.89:0/4225331618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b940c8580 0x7f3b940c4660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b94071ee0 tx=0x7f3b7c01c8e0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.828+0000 7f3b93200640 1 -- 172.21.15.89:0/4225331618 shutdown_connections 2024-08-31T04:04:30.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.828+0000 7f3b93200640 1 --2- 172.21.15.89:0/4225331618 >> v2:172.21.15.170:3300/0 conn(0x7f3b940b3e70 0x7f3b9415ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.828+0000 7f3b93200640 1 --2- 172.21.15.89:0/4225331618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b940c8580 0x7f3b940c4660 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.828+0000 7f3b93200640 1 -- 172.21.15.89:0/4225331618 >> 172.21.15.89:0/4225331618 conn(0x7f3b94074ab0 msgr2=0x7f3b940cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.828+0000 7f3b93200640 1 -- 172.21.15.89:0/4225331618 shutdown_connections 2024-08-31T04:04:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.828+0000 7f3b93200640 1 -- 172.21.15.89:0/4225331618 wait complete. 2024-08-31T04:04:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f3b93200640 1 Processor -- start 2024-08-31T04:04:30.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f3b93200640 1 -- start start 2024-08-31T04:04:30.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f54d1800640 1 -- 172.21.15.89:0/455210543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0c3200 msgr2=0x7f54cc0c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f54d1800640 1 --2- 172.21.15.89:0/455210543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0c3200 0x7f54cc0c8100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0c6970 tx=0x7f54c40207c0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f54d1800640 1 -- 172.21.15.89:0/455210543 shutdown_connections 2024-08-31T04:04:30.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f54d1800640 1 --2- 172.21.15.89:0/455210543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0c3200 0x7f54cc0c8100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f54d1800640 1 --2- 172.21.15.89:0/455210543 >> v2:172.21.15.170:3300/0 conn(0x7f54cc0c2df0 0x7f54cc0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f54d1800640 1 -- 172.21.15.89:0/455210543 >> 172.21.15.89:0/455210543 conn(0x7f54cc0714f0 msgr2=0x7f54cc0ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:30.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f54d1800640 1 -- 172.21.15.89:0/455210543 shutdown_connections 2024-08-31T04:04:30.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7febb7a00640 1 -- 172.21.15.89:0/3385762982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb9800de50 msgr2=0x7feb98010270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7febb7a00640 1 --2- 172.21.15.89:0/3385762982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb9800de50 0x7feb98010270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7febb00c7590 tx=0x7feba801d000 comp rx=0 tx=0).stop 2024-08-31T04:04:30.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.832+0000 7f54d1800640 1 -- 172.21.15.89:0/455210543 wait complete. 2024-08-31T04:04:30.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7febb7a00640 1 -- 172.21.15.89:0/3385762982 shutdown_connections 2024-08-31T04:04:30.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7febb7a00640 1 --2- 172.21.15.89:0/3385762982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb9800de50 0x7feb98010270 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7febb7a00640 1 -- 172.21.15.89:0/3385762982 >> 172.21.15.89:0/3385762982 conn(0x7febb00ccf20 msgr2=0x7febb00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:30.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f4848c00640 1 -- 172.21.15.89:0/390466850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4844158470 msgr2=0x7f4844151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f4848c00640 1 --2- 172.21.15.89:0/390466850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4844158470 0x7f4844151c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4844071a60 tx=0x7f483c01cd80 comp rx=0 tx=0).stop 2024-08-31T04:04:30.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f4848c00640 1 -- 172.21.15.89:0/390466850 shutdown_connections 2024-08-31T04:04:30.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f4848c00640 1 --2- 172.21.15.89:0/390466850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4844158470 0x7f4844151c30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f4848c00640 1 --2- 172.21.15.89:0/390466850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48440b2fd0 0x7f48440c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f4848c00640 1 --2- 172.21.15.89:0/390466850 >> v2:172.21.15.89:3300/0 conn(0x7f48440c8b00 0x7f48440c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f4848c00640 1 -- 172.21.15.89:0/390466850 >> 172.21.15.89:0/390466850 conn(0x7f48440ccf20 msgr2=0x7f48440cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:30.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f4848c00640 1 -- 172.21.15.89:0/390466850 shutdown_connections 2024-08-31T04:04:30.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7febb7a00640 1 -- 172.21.15.89:0/3385762982 shutdown_connections 2024-08-31T04:04:30.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7febb7a00640 1 -- 172.21.15.89:0/3385762982 wait complete. 2024-08-31T04:04:30.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f4848c00640 1 -- 172.21.15.89:0/390466850 wait complete. 2024-08-31T04:04:30.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f3b93200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b940b3e70 0x7f3b94150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f3b93200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b940c8580 0x7f3b9414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f3b93200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b9415f1a0 0x7f3b9414f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f3b93200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94154160 con 0x7f3b940c8580 2024-08-31T04:04:30.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f3b93200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940c4db0 con 0x7f3b940b3e70 2024-08-31T04:04:30.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f3b93200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3b941542e0 con 0x7f3b9415f1a0 2024-08-31T04:04:30.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f54d1800640 1 Processor -- start 2024-08-31T04:04:30.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7efd81600640 1 -- 172.21.15.89:0/2117680675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd7404b810 msgr2=0x7efd740065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7efd81600640 1 --2- 172.21.15.89:0/2117680675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd7404b810 0x7efd740065a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efd7c075b50 tx=0x7efd7c099fd0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7f54d1800640 1 -- start start 2024-08-31T04:04:30.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7efd81600640 1 -- 172.21.15.89:0/2117680675 shutdown_connections 2024-08-31T04:04:30.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7efd81600640 1 --2- 172.21.15.89:0/2117680675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd7404b810 0x7efd740065a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7efd81600640 1 --2- 172.21.15.89:0/2117680675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd74034fb0 0x7efd74006060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7efd81600640 1 --2- 172.21.15.89:0/2117680675 >> v2:172.21.15.89:3300/0 conn(0x7efd740d5290 0x7efd74045600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.836+0000 7efd81600640 1 -- 172.21.15.89:0/2117680675 >> 172.21.15.89:0/2117680675 conn(0x7efd7404fe40 msgr2=0x7efd74050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:30.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b91e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b940b3e70 0x7f3b94150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7efd81600640 1 -- 172.21.15.89:0/2117680675 shutdown_connections 2024-08-31T04:04:30.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b91e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b940b3e70 0x7f3b94150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38526/0 (socket says 172.21.15.89:38526) 2024-08-31T04:04:30.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b91e00640 1 -- 172.21.15.89:0/2862456312 learned_addr learned my addr 172.21.15.89:0/2862456312 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:30.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b92800640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b9415f1a0 0x7f3b9414f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7efd81600640 1 -- 172.21.15.89:0/2117680675 wait complete. 2024-08-31T04:04:30.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b89400640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b940c8580 0x7f3b9414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b91e00640 1 -- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b9415f1a0 msgr2=0x7f3b9414f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b91e00640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b9415f1a0 0x7f3b9414f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b91e00640 1 -- 172.21.15.89:0/2862456312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b940c8580 msgr2=0x7f3b9414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b91e00640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b940c8580 0x7f3b9414efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b91e00640 1 -- 172.21.15.89:0/2862456312 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b94150ac0 con 0x7f3b940b3e70 2024-08-31T04:04:30.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b91e00640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b940b3e70 0x7f3b94150580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c01cdc0 tx=0x7f3b7c0a5650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54d1800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54cc0c2df0 0x7f54cc1ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54d1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0c3200 0x7f54cc14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54d1800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54cc0c3990 0x7f54cc158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54caa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54cc0c2df0 0x7f54cc1ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54d1800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0c7740 con 0x7f54cc0c3200 2024-08-31T04:04:30.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54d1800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0c2360 con 0x7f54cc0c2df0 2024-08-31T04:04:30.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b8aa00640 1 -- 172.21.15.89:0/2862456312 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0ba020 con 0x7f3b940b3e70 2024-08-31T04:04:30.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b8aa00640 1 -- 172.21.15.89:0/2862456312 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b7c0043b0 con 0x7f3b940b3e70 2024-08-31T04:04:30.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b8aa00640 1 -- 172.21.15.89:0/2862456312 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0b2040 con 0x7f3b940b3e70 2024-08-31T04:04:30.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54caa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54cc0c2df0 0x7f54cc1ee2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38532/0 (socket says 172.21.15.89:38532) 2024-08-31T04:04:30.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54caa00640 1 -- 172.21.15.89:0/3122522425 learned_addr learned my addr 172.21.15.89:0/3122522425 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:30.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc0c7bd0 con 0x7f54cc0c3990 2024-08-31T04:04:30.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7febb7a00640 1 Processor -- start 2024-08-31T04:04:30.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54ca000640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0c3200 0x7f54cc14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7febb7a00640 1 -- start start 2024-08-31T04:04:30.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f4848c00640 1 Processor -- start 2024-08-31T04:04:30.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54cb400640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54cc0c3990 0x7f54cc158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f4848c00640 1 -- start start 2024-08-31T04:04:30.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b940c7050 con 0x7f3b940b3e70 2024-08-31T04:04:30.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b940c7330 con 0x7f3b940b3e70 2024-08-31T04:04:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54caa00640 1 -- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54cc0c3990 msgr2=0x7f54cc158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54caa00640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54cc0c3990 0x7f54cc158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.840+0000 7f54caa00640 1 -- 172.21.15.89:0/3122522425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0c3200 msgr2=0x7f54cc14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f54cb400640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54cc0c3990 0x7f54cc158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f54caa00640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0c3200 0x7f54cc14f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f54caa00640 1 -- 172.21.15.89:0/3122522425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc1ee810 con 0x7f54cc0c2df0 2024-08-31T04:04:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f54ca000640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0c3200 0x7f54cc14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:04:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7efd81600640 1 Processor -- start 2024-08-31T04:04:30.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7efd81600640 1 -- start start 2024-08-31T04:04:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b9415ec60 con 0x7f3b940b3e70 2024-08-31T04:04:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febb7a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb9800de50 0x7febb0202380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febb7a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb015d4e0 0x7febb015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4848c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48440b2fd0 0x7f48441fa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4848c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48440c8b00 0x7f484414aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febb7a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb015c0f0 0x7febb01631d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febafe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb015d4e0 0x7febb015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febafe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb015d4e0 0x7febb015b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38536/0 (socket says 172.21.15.89:38536) 2024-08-31T04:04:30.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4841e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48440b2fd0 0x7f48441fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4841e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48440b2fd0 0x7f48441fa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45604/0 (socket says 172.21.15.89:45604) 2024-08-31T04:04:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febafe00640 1 -- 172.21.15.89:0/2913049877 learned_addr learned my addr 172.21.15.89:0/2913049877 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febb7a00640 1 -- 172.21.15.89:0/2913049877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7febb0071750 con 0x7febb015c0f0 2024-08-31T04:04:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f54caa00640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54cc0c2df0 0x7f54cc1ee2d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00c400 tx=0x7f54bc00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febb7a00640 1 -- 172.21.15.89:0/2913049877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7febb0158880 con 0x7febb015d4e0 2024-08-31T04:04:30.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4848c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4844158470 0x7f48440cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f11ea000640 1 -- 172.21.15.89:0/4061378841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11dc0dd2d0 msgr2=0x7f11dc00c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f11ea000640 1 --2- 172.21.15.89:0/4061378841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11dc0dd2d0 0x7f11dc00c440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009900 tx=0x7f11d001ef30 comp rx=0 tx=0).stop 2024-08-31T04:04:30.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febb5000640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb9800de50 0x7febb0202380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febb7a00640 1 -- 172.21.15.89:0/2913049877 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7febb00c22b0 con 0x7feb9800de50 2024-08-31T04:04:30.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4841e00640 1 -- 172.21.15.89:0/2673884268 learned_addr learned my addr 172.21.15.89:0/2673884268 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:30.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f484415b330 con 0x7f48440c8b00 2024-08-31T04:04:30.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f484415b1b0 con 0x7f4844158470 2024-08-31T04:04:30.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f484415b4b0 con 0x7f48440b2fd0 2024-08-31T04:04:30.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4842800640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4844158470 0x7f48440cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7efd81600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd74034fb0 0x7efd74175fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7febb5a00640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb015c0f0 0x7febb01631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7efd81600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd7404b810 0x7efd740caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f4839400640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48440c8b00 0x7f484414aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7efd81600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd7404c850 0x7efd7404cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7efd81600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efd740451f0 con 0x7efd74034fb0 2024-08-31T04:04:30.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7efd81600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd7404c0f0 con 0x7efd7404b810 2024-08-31T04:04:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7efd81600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efd74045370 con 0x7efd7404c850 2024-08-31T04:04:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f11ea000640 1 -- 172.21.15.89:0/4061378841 shutdown_connections 2024-08-31T04:04:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f11ea000640 1 --2- 172.21.15.89:0/4061378841 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11dc0e5310 0x7f11dc0e7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f11ea000640 1 --2- 172.21.15.89:0/4061378841 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11dc0dd2d0 0x7f11dc00c440 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.844+0000 7f11ea000640 1 -- 172.21.15.89:0/4061378841 >> 172.21.15.89:0/4061378841 conn(0x7f11dc00e390 msgr2=0x7f11dc052030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:30.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd7b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd7404b810 0x7efd740caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd80c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd7404c850 0x7efd7404cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd80c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd7404c850 0x7efd7404cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:45606/0 (socket says 172.21.15.89:45606) 2024-08-31T04:04:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd80c00640 1 -- 172.21.15.89:0/1316870033 learned_addr learned my addr 172.21.15.89:0/1316870033 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7febafe00640 1 -- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb9800de50 msgr2=0x7febb0202380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7febafe00640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb9800de50 0x7febb0202380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7febafe00640 1 -- 172.21.15.89:0/2913049877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb015c0f0 msgr2=0x7febb01631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7febafe00640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb015c0f0 0x7febb01631d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7febafe00640 1 -- 172.21.15.89:0/2913049877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb015bbd0 con 0x7febb015d4e0 2024-08-31T04:04:30.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f4841e00640 1 -- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4844158470 msgr2=0x7f48440cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f4841e00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4844158470 0x7f48440cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f4841e00640 1 -- 172.21.15.89:0/2673884268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48440c8b00 msgr2=0x7f484414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f4841e00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48440c8b00 0x7f484414aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f4841e00640 1 -- 172.21.15.89:0/2673884268 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484414afb0 con 0x7f48440b2fd0 2024-08-31T04:04:30.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd7be00640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd74034fb0 0x7efd74175fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f11ea000640 1 -- 172.21.15.89:0/4061378841 shutdown_connections 2024-08-31T04:04:30.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f11ea000640 1 -- 172.21.15.89:0/4061378841 wait complete. 2024-08-31T04:04:30.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd80c00640 1 -- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd7404b810 msgr2=0x7efd740caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd80c00640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd7404b810 0x7efd740caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd80c00640 1 -- 172.21.15.89:0/1316870033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd74034fb0 msgr2=0x7efd74175fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd80c00640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd74034fb0 0x7efd74175fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd80c00640 1 -- 172.21.15.89:0/1316870033 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd74176520 con 0x7efd7404c850 2024-08-31T04:04:30.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f3b8aa00640 1 -- 172.21.15.89:0/2862456312 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3b7c0bd070 con 0x7f3b940b3e70 2024-08-31T04:04:30.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd7be00640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd74034fb0 0x7efd74175fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:30.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f4841e00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48440b2fd0 0x7f48441fa3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f482c00b440 tx=0x7f482c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7febafe00640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb015d4e0 0x7febb015b690 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e5c0 tx=0x7feb9c00e9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd80c00640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd7404c850 0x7efd7404cc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd7c02e9d0 tx=0x7efd7c09a220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f483aa00640 1 -- 172.21.15.89:0/2673884268 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c015020 con 0x7f48440b2fd0 2024-08-31T04:04:30.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48440c4710 con 0x7f48440b2fd0 2024-08-31T04:04:30.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f48441f9bf0 con 0x7f48440b2fd0 2024-08-31T04:04:30.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd6fe00640 1 -- 172.21.15.89:0/1316870033 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c12f040 con 0x7efd7404c850 2024-08-31T04:04:30.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd6fe00640 1 -- 172.21.15.89:0/1316870033 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd7c12a6e0 con 0x7efd7404c850 2024-08-31T04:04:30.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd6fe00640 1 -- 172.21.15.89:0/1316870033 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c12ab10 con 0x7efd7404c850 2024-08-31T04:04:30.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd81600640 1 -- 172.21.15.89:0/1316870033 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd740cd120 con 0x7efd7404c850 2024-08-31T04:04:30.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd81600640 1 -- 172.21.15.89:0/1316870033 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efd740d56b0 con 0x7efd7404c850 2024-08-31T04:04:30.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7efd6d600640 1 -- 172.21.15.89:0/1316870033 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd580052a0 con 0x7efd7404c850 2024-08-31T04:04:30.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f3b8aa00640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b70072140 0x7f3b70074650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f11ea000640 1 Processor -- start 2024-08-31T04:04:30.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f3b8aa00640 1 -- 172.21.15.89:0/2862456312 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3b7c12c570 con 0x7f3b940b3e70 2024-08-31T04:04:30.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f483aa00640 1 -- 172.21.15.89:0/2673884268 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f482c011980 con 0x7f48440b2fd0 2024-08-31T04:04:30.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f483aa00640 1 -- 172.21.15.89:0/2673884268 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c015020 con 0x7f48440b2fd0 2024-08-31T04:04:30.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.848+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f481c0052a0 con 0x7f48440b2fd0 2024-08-31T04:04:30.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11ea000640 1 -- start start 2024-08-31T04:04:30.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f3b89400640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b70072140 0x7f3b70074650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f3b89400640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b70072140 0x7f3b70074650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b9416c7e0 tx=0x7f3b84005be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11ea000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11dc00c030 0x7f11dc050070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f483aa00640 1 -- 172.21.15.89:0/2673884268 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f482c018020 con 0x7f48440b2fd0 2024-08-31T04:04:30.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11ea000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11dc0dd2d0 0x7f11dc0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11ea000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11dc0e5310 0x7f11dc047990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11ea000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00d2c0 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11ea000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc04afc0 con 0x7f11dc00c030 2024-08-31T04:04:30.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11ea000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f11dc04a350 con 0x7f11dc0e5310 2024-08-31T04:04:30.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7efd6fe00640 1 -- 172.21.15.89:0/1316870033 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7efd7c13a030 con 0x7efd7404c850 2024-08-31T04:04:30.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11e3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11dc0dd2d0 0x7f11dc0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f483aa00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f48200722c0 0x7f48200747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11e8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11dc00c030 0x7f11dc050070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11e9600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11dc0e5310 0x7f11dc047990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11e8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11dc00c030 0x7f11dc050070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:38570/0 (socket says 172.21.15.89:38570) 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11e8c00640 1 -- 172.21.15.89:0/855207623 learned_addr learned my addr 172.21.15.89:0/855207623 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11e3e00640 1 -- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11dc0e5310 msgr2=0x7f11dc047990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11e3e00640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11dc0e5310 0x7f11dc047990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11e3e00640 1 -- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11dc00c030 msgr2=0x7f11dc050070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.852+0000 7f11e3e00640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11dc00c030 0x7f11dc050070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f11e3e00640 1 -- 172.21.15.89:0/855207623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11dc0505b0 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f11e3e00640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11dc0dd2d0 0x7f11dc0cb620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f11d00af000 tx=0x7f11d00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f483aa00640 1 -- 172.21.15.89:0/2673884268 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f482c092e50 con 0x7f48440b2fd0 2024-08-31T04:04:30.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f4839400640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f48200722c0 0x7f48200747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7efd6fe00640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd5c072140 0x7efd5c074650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f11e0c00640 1 -- 172.21.15.89:0/855207623 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d00be070 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7efd6fe00640 1 -- 172.21.15.89:0/1316870033 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efd7c1aa7f0 con 0x7efd7404c850 2024-08-31T04:04:30.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11dc0cd270 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f11e0c00640 1 -- 172.21.15.89:0/855207623 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11d0003ab0 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7efd7be00640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd5c072140 0x7efd5c074650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f11e0c00640 1 -- 172.21.15.89:0/855207623 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d00b5040 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11dc0cfd40 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f4839400640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f48200722c0 0x7f48200747d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48440c7a00 tx=0x7f483400c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7efd7be00640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd5c072140 0x7efd5c074650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efd70009b90 tx=0x7efd700091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f11e0c00640 1 -- 172.21.15.89:0/855207623 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f11d00b0440 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.856+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11dc0d6fb0 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f11e0c00640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11c40720c0 0x7f11c40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f11e0c00640 1 -- 172.21.15.89:0/855207623 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f11d012ffa0 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f11e8c00640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11c40720c0 0x7f11c40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f11e8c00640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11c40720c0 0x7f11c40745d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f11d8001ec0 tx=0x7f11d8001d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f54c2a00640 1 -- 172.21.15.89:0/3122522425 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc011790 con 0x7f54cc0c2df0 2024-08-31T04:04:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7febacc00640 1 -- 172.21.15.89:0/2913049877 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c015020 con 0x7febb015d4e0 2024-08-31T04:04:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7febacc00640 1 -- 172.21.15.89:0/2913049877 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb9c010980 con 0x7febb015d4e0 2024-08-31T04:04:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7febb7a00640 1 -- 172.21.15.89:0/2913049877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb015a5f0 con 0x7febb015d4e0 2024-08-31T04:04:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f3b8aa00640 1 -- 172.21.15.89:0/2862456312 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3b7c0164d0 con 0x7f3b940b3e70 2024-08-31T04:04:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7febacc00640 1 -- 172.21.15.89:0/2913049877 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c010d90 con 0x7febb015d4e0 2024-08-31T04:04:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7febb7a00640 1 -- 172.21.15.89:0/2913049877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb015abb0 con 0x7febb015d4e0 2024-08-31T04:04:30.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc14f8b0 con 0x7f54cc0c2df0 2024-08-31T04:04:30.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc15af70 con 0x7f54cc0c2df0 2024-08-31T04:04:30.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f54c2a00640 1 -- 172.21.15.89:0/3122522425 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54bc017070 con 0x7f54cc0c2df0 2024-08-31T04:04:30.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.860+0000 7f54c2a00640 1 -- 172.21.15.89:0/3122522425 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc011ca0 con 0x7f54cc0c2df0 2024-08-31T04:04:30.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.864+0000 7feba2000640 1 -- 172.21.15.89:0/2913049877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb0151c30 con 0x7febb015d4e0 2024-08-31T04:04:30.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.864+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a40052a0 con 0x7f54cc0c2df0 2024-08-31T04:04:30.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.864+0000 7f11e0c00640 1 -- 172.21.15.89:0/855207623 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f11d0018a90 con 0x7f11dc0dd2d0 2024-08-31T04:04:30.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7febacc00640 1 -- 172.21.15.89:0/2913049877 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7feb9c018020 con 0x7febb015d4e0 2024-08-31T04:04:30.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7f483aa00640 1 -- 172.21.15.89:0/2673884268 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f482c01f020 con 0x7f48440b2fd0 2024-08-31T04:04:30.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7febacc00640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb900720c0 0x7feb900745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7febacc00640 1 -- 172.21.15.89:0/2913049877 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feb9c093b00 con 0x7febb015d4e0 2024-08-31T04:04:30.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7febb5000640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb900720c0 0x7feb900745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7f54c2a00640 1 -- 172.21.15.89:0/3122522425 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f54bc012420 con 0x7f54cc0c2df0 2024-08-31T04:04:30.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7f54c2a00640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ac0720c0 0x7f54ac0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7febb5000640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb900720c0 0x7feb900745d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feba4005fd0 tx=0x7feba4007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7f54c2a00640 1 -- 172.21.15.89:0/3122522425 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f54bc093650 con 0x7f54cc0c2df0 2024-08-31T04:04:30.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.868+0000 7f54ca000640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ac0720c0 0x7f54ac0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.872+0000 7f54ca000640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ac0720c0 0x7f54ac0745d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54cc14da30 tx=0x7f54b80091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7efd6fe00640 1 -- 172.21.15.89:0/1316870033 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7efd7c141020 con 0x7efd7404c850 2024-08-31T04:04:30.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7febacc00640 1 -- 172.21.15.89:0/2913049877 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7feb9c01f020 con 0x7febb015d4e0 2024-08-31T04:04:30.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7fe892200640 1 -- 172.21.15.89:0/3664701153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 msgr2=0x7fe88c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7fe892200640 1 --2- 172.21.15.89:0/3664701153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 0x7fe88c0caa90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe884009be0 tx=0x7fe8840215c0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7fe892200640 1 -- 172.21.15.89:0/3664701153 shutdown_connections 2024-08-31T04:04:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7fe892200640 1 --2- 172.21.15.89:0/3664701153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 0x7fe88c0caa90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7fe892200640 1 --2- 172.21.15.89:0/3664701153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe88c0c85f0 0x7fe88c1585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7fe892200640 1 -- 172.21.15.89:0/3664701153 >> 172.21.15.89:0/3664701153 conn(0x7fe88c070da0 msgr2=0x7fe88c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7fe892200640 1 -- 172.21.15.89:0/3664701153 shutdown_connections 2024-08-31T04:04:30.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.880+0000 7fe892200640 1 -- 172.21.15.89:0/3664701153 wait complete. 2024-08-31T04:04:30.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.884+0000 7fe892200640 1 Processor -- start 2024-08-31T04:04:30.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.884+0000 7fe892200640 1 -- start start 2024-08-31T04:04:30.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe892200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c0c3cf0 0x7fe88c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe892200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe88c0c85f0 0x7fe88c1f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe892200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 0x7fe88c1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe892200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c0cea80 con 0x7fe88c0ca680 2024-08-31T04:04:30.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe892200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c0ce900 con 0x7fe88c0c3cf0 2024-08-31T04:04:30.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe892200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe88c0c7a00 con 0x7fe88c0c85f0 2024-08-31T04:04:30.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe891800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 0x7fe88c1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe891800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 0x7fe88c1f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41994/0 (socket says 172.21.15.89:41994) 2024-08-31T04:04:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe891800640 1 -- 172.21.15.89:0/3089484815 learned_addr learned my addr 172.21.15.89:0/3089484815 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe88be00640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe88c0c85f0 0x7fe88c1f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe891800640 1 -- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe88c0c85f0 msgr2=0x7fe88c1f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe891800640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe88c0c85f0 0x7fe88c1f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe891800640 1 -- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c0c3cf0 msgr2=0x7fe88c0b1e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:04:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe891800640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c0c3cf0 0x7fe88c0b1e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.888+0000 7fe891800640 1 -- 172.21.15.89:0/3089484815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c0b2370 con 0x7fe88c0ca680 2024-08-31T04:04:30.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.892+0000 7fe891800640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 0x7fe88c1f5760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe88401f1f0 tx=0x7fe884005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.896+0000 7fe888c00640 1 -- 172.21.15.89:0/3089484815 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884004a50 con 0x7fe88c0ca680 2024-08-31T04:04:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.896+0000 7fe888c00640 1 -- 172.21.15.89:0/3089484815 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe884004ce0 con 0x7fe88c0ca680 2024-08-31T04:04:30.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.896+0000 7fe888c00640 1 -- 172.21.15.89:0/3089484815 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884004300 con 0x7fe88c0ca680 2024-08-31T04:04:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.896+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88c153ac0 con 0x7fe88c0ca680 2024-08-31T04:04:30.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.896+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88c0b1630 con 0x7fe88c0ca680 2024-08-31T04:04:30.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.896+0000 7f54c2a00640 1 -- 172.21.15.89:0/3122522425 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f54bc05e560 con 0x7f54cc0c2df0 2024-08-31T04:04:30.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.896+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88c0caa90 con 0x7fe88c0ca680 2024-08-31T04:04:30.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.908+0000 7fe888c00640 1 -- 172.21.15.89:0/3089484815 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe8840c2030 con 0x7fe88c0ca680 2024-08-31T04:04:30.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.908+0000 7fe888c00640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe86c072190 0x7fe86c0746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:30.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.908+0000 7fe888c00640 1 -- 172.21.15.89:0/3089484815 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe884131310 con 0x7fe88c0ca680 2024-08-31T04:04:30.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.908+0000 7fe890e00640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe86c072190 0x7fe86c0746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:30.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.908+0000 7fe890e00640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe86c072190 0x7fe86c0746a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe8800099d0 tx=0x7fe8800091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:30.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:30.912+0000 7fe888c00640 1 -- 172.21.15.89:0/3089484815 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe8840c9030 con 0x7fe88c0ca680 2024-08-31T04:04:31.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.096+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe168050da0 con 0x7fe1680c75e0 2024-08-31T04:04:31.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.096+0000 7fe15ea00640 1 -- 172.21.15.89:0/2289582980 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe1580fac90 con 0x7fe1680c75e0 2024-08-31T04:04:31.098 INFO:teuthology.orchestra.run.smithi089.stdout:64424509450 2024-08-31T04:04:31.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe1480720f0 msgr2=0x7fe148074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe1480720f0 0x7fe148074600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe160000f90 tx=0x7fe160009040 comp rx=0 tx=0).stop 2024-08-31T04:04:31.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1680c75e0 msgr2=0x7fe168151600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1680c75e0 0x7fe168151600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe158009790 tx=0x7fe158005dd0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 shutdown_connections 2024-08-31T04:04:31.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe1480720f0 0x7fe148074600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1680c8770 0x7fe1681f9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1680ca260 0x7fe1681556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 --2- 172.21.15.89:0/2289582980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe1680c75e0 0x7fe168151600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 >> 172.21.15.89:0/2289582980 conn(0x7fe1680cd1e0 msgr2=0x7fe16815b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 shutdown_connections 2024-08-31T04:04:31.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.100+0000 7fe16da00640 1 -- 172.21.15.89:0/2289582980 wait complete. 2024-08-31T04:04:31.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.4 2024-08-31T04:04:31.137 DEBUG:teuthology.parallel:result is None 2024-08-31T04:04:31.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.192+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f54a4005860 con 0x7f54cc0c2df0 2024-08-31T04:04:31.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54c2a00640 1 -- 172.21.15.89:0/3122522425 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54bc062d20 con 0x7f54cc0c2df0 2024-08-31T04:04:31.196 INFO:teuthology.orchestra.run.smithi089.stdout:68719476748 2024-08-31T04:04:31.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ac0720c0 msgr2=0x7f54ac0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ac0720c0 0x7f54ac0745d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54cc14da30 tx=0x7f54b80091e0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54cc0c2df0 msgr2=0x7f54cc1ee2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54cc0c2df0 0x7f54cc1ee2d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00c400 tx=0x7f54bc00c8c0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 shutdown_connections 2024-08-31T04:04:31.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ac0720c0 0x7f54ac0745d0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54cc14da30 tx=0x7f54b80091e0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54cc0c3200 0x7f54cc14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54cc0c3990 0x7f54cc158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 --2- 172.21.15.89:0/3122522425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54cc0c2df0 0x7f54cc1ee2d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 >> 172.21.15.89:0/3122522425 conn(0x7f54cc0714f0 msgr2=0x7f54cc153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.196+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 shutdown_connections 2024-08-31T04:04:31.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.200+0000 7f54d1800640 1 -- 172.21.15.89:0/3122522425 wait complete. 2024-08-31T04:04:31.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476748 for osd.1 2024-08-31T04:04:31.221 DEBUG:teuthology.parallel:result is None 2024-08-31T04:04:31.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.220+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f481c005860 con 0x7f48440b2fd0 2024-08-31T04:04:31.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.220+0000 7f483aa00640 1 -- 172.21.15.89:0/2673884268 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f482c00d040 con 0x7f48440b2fd0 2024-08-31T04:04:31.222 INFO:teuthology.orchestra.run.smithi089.stdout:55834574859 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f48200722c0 msgr2=0x7f48200747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f48200722c0 0x7f48200747d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48440c7a00 tx=0x7f483400c040 comp rx=0 tx=0).stop 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48440b2fd0 msgr2=0x7f48441fa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48440b2fd0 0x7f48441fa3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f482c00b440 tx=0x7f482c00b900 comp rx=0 tx=0).stop 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 shutdown_connections 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f48200722c0 0x7f48200747d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48440c8b00 0x7f484414aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4844158470 0x7f48440cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 --2- 172.21.15.89:0/2673884268 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48440b2fd0 0x7f48441fa3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 >> 172.21.15.89:0/2673884268 conn(0x7f48440ccf20 msgr2=0x7f48440765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 shutdown_connections 2024-08-31T04:04:31.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3b940cd000 con 0x7f3b940b3e70 2024-08-31T04:04:31.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f4848c00640 1 -- 172.21.15.89:0/2673884268 wait complete. 2024-08-31T04:04:31.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f3b8aa00640 1 -- 172.21.15.89:0/2862456312 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b7c0f7cf0 con 0x7f3b940b3e70 2024-08-31T04:04:31.227 INFO:teuthology.orchestra.run.smithi089.stdout:68719476747 2024-08-31T04:04:31.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.224+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f11dc036990 con 0x7f11dc0dd2d0 2024-08-31T04:04:31.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f11e0c00640 1 -- 172.21.15.89:0/855207623 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11d00faf50 con 0x7f11dc0dd2d0 2024-08-31T04:04:31.228 INFO:teuthology.orchestra.run.smithi089.stdout:68719476747 2024-08-31T04:04:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7efd6d600640 1 -- 172.21.15.89:0/1316870033 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7efd58005860 con 0x7efd7404c850 2024-08-31T04:04:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b70072140 msgr2=0x7f3b70074650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b70072140 0x7f3b70074650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b9416c7e0 tx=0x7f3b84005be0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b940b3e70 msgr2=0x7f3b94150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b940b3e70 0x7f3b94150580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c01cdc0 tx=0x7f3b7c0a5650 comp rx=0 tx=0).stop 2024-08-31T04:04:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 shutdown_connections 2024-08-31T04:04:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b70072140 0x7f3b70074650 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b940c8580 0x7f3b9414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b9415f1a0 0x7f3b9414f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 --2- 172.21.15.89:0/2862456312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b940b3e70 0x7f3b94150580 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 >> 172.21.15.89:0/2862456312 conn(0x7f3b94074ab0 msgr2=0x7f3b94152920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 shutdown_connections 2024-08-31T04:04:31.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7f3b93200640 1 -- 172.21.15.89:0/2862456312 wait complete. 2024-08-31T04:04:31.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.228+0000 7efd6fe00640 1 -- 172.21.15.89:0/1316870033 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd7c093db0 con 0x7efd7404c850 2024-08-31T04:04:31.231 INFO:teuthology.orchestra.run.smithi089.stdout:68719476748 2024-08-31T04:04:31.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 -- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd5c072140 msgr2=0x7efd5c074650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd5c072140 0x7efd5c074650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efd70009b90 tx=0x7efd700091e0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 -- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd7404c850 msgr2=0x7efd7404cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd7404c850 0x7efd7404cc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd7c02e9d0 tx=0x7efd7c09a220 comp rx=0 tx=0).stop 2024-08-31T04:04:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11c40720c0 msgr2=0x7f11c40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11c40720c0 0x7f11c40745d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f11d8001ec0 tx=0x7f11d8001d70 comp rx=0 tx=0).stop 2024-08-31T04:04:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11dc0dd2d0 msgr2=0x7f11dc0cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11dc0dd2d0 0x7f11dc0cb620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f11d00af000 tx=0x7f11d00056e0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 shutdown_connections 2024-08-31T04:04:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11c40720c0 0x7f11c40745d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11dc0dd2d0 0x7f11dc0cb620 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11dc0e5310 0x7f11dc047990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 --2- 172.21.15.89:0/855207623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11dc00c030 0x7f11dc050070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 >> 172.21.15.89:0/855207623 conn(0x7f11dc00e390 msgr2=0x7f11dc008110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 -- 172.21.15.89:0/1316870033 shutdown_connections 2024-08-31T04:04:31.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd5c072140 0x7efd5c074650 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd7404c850 0x7efd7404cc60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd7404b810 0x7efd740caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 --2- 172.21.15.89:0/1316870033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd74034fb0 0x7efd74175fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 -- 172.21.15.89:0/1316870033 >> 172.21.15.89:0/1316870033 conn(0x7efd7404fe40 msgr2=0x7efd74050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 shutdown_connections 2024-08-31T04:04:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7f11ea000640 1 -- 172.21.15.89:0/855207623 wait complete. 2024-08-31T04:04:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 -- 172.21.15.89:0/1316870033 shutdown_connections 2024-08-31T04:04:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.232+0000 7efd6d600640 1 -- 172.21.15.89:0/1316870033 wait complete. 2024-08-31T04:04:31.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.240+0000 7feba2000640 1 -- 172.21.15.89:0/2913049877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7febb0150ff0 con 0x7febb015d4e0 2024-08-31T04:04:31.243 INFO:teuthology.orchestra.run.smithi089.stdout:64424509452 2024-08-31T04:04:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.240+0000 7febacc00640 1 -- 172.21.15.89:0/2913049877 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb9c05f100 con 0x7febb015d4e0 2024-08-31T04:04:31.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 -- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb900720c0 msgr2=0x7feb900745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb900720c0 0x7feb900745d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feba4005fd0 tx=0x7feba4007040 comp rx=0 tx=0).stop 2024-08-31T04:04:31.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 -- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb015d4e0 msgr2=0x7febb015b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb015d4e0 0x7febb015b690 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e5c0 tx=0x7feb9c00e9c0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 -- 172.21.15.89:0/2913049877 shutdown_connections 2024-08-31T04:04:31.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb900720c0 0x7feb900745d0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feba4005fd0 tx=0x7feba4007040 comp rx=0 tx=0).stop 2024-08-31T04:04:31.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febb015c0f0 0x7febb01631d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb015d4e0 0x7febb015b690 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e5c0 tx=0x7feb9c00e9c0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 --2- 172.21.15.89:0/2913049877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb9800de50 0x7febb0202380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 -- 172.21.15.89:0/2913049877 >> 172.21.15.89:0/2913049877 conn(0x7febb00ccf20 msgr2=0x7febb0074980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 -- 172.21.15.89:0/2913049877 shutdown_connections 2024-08-31T04:04:31.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.244+0000 7feba2000640 1 -- 172.21.15.89:0/2913049877 wait complete. 2024-08-31T04:04:31.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-08-31T04:04:31.254 DEBUG:teuthology.parallel:result is None 2024-08-31T04:04:31.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476747 for osd.3 2024-08-31T04:04:31.263 DEBUG:teuthology.parallel:result is None 2024-08-31T04:04:31.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476747 for osd.2 2024-08-31T04:04:31.268 DEBUG:teuthology.parallel:result is None 2024-08-31T04:04:31.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.268+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe88c0c9170 con 0x7fe88c0ca680 2024-08-31T04:04:31.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.268+0000 7fe888c00640 1 -- 172.21.15.89:0/3089484815 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe88401b120 con 0x7fe88c0ca680 2024-08-31T04:04:31.270 INFO:teuthology.orchestra.run.smithi089.stdout:64424509451 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe86c072190 msgr2=0x7fe86c0746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe86c072190 0x7fe86c0746a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe8800099d0 tx=0x7fe8800091e0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 msgr2=0x7fe88c1f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 0x7fe88c1f5760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe88401f1f0 tx=0x7fe884005ac0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 shutdown_connections 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe86c072190 0x7fe86c0746a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe88c0ca680 0x7fe88c1f5760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe88c0c85f0 0x7fe88c1f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 --2- 172.21.15.89:0/3089484815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe88c0c3cf0 0x7fe88c0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 >> 172.21.15.89:0/3089484815 conn(0x7fe88c070da0 msgr2=0x7fe88c0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 shutdown_connections 2024-08-31T04:04:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.272+0000 7fe892200640 1 -- 172.21.15.89:0/3089484815 wait complete. 2024-08-31T04:04:31.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476748 for osd.0 2024-08-31T04:04:31.276 DEBUG:teuthology.parallel:result is None 2024-08-31T04:04:31.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.5 2024-08-31T04:04:31.278 DEBUG:teuthology.parallel:result is None 2024-08-31T04:04:31.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.6 2024-08-31T04:04:31.294 DEBUG:teuthology.parallel:result is None 2024-08-31T04:04:31.294 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-31T04:04:31.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:04:31.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.484+0000 7fb1c8400640 1 -- 172.21.15.89:0/1377237308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c0159f60 msgr2=0x7fb1c015a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.484+0000 7fb1c8400640 1 --2- 172.21.15.89:0/1377237308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c0159f60 0x7fb1c015a370 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009900 tx=0x7fb1ac01c8e0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 -- 172.21.15.89:0/1377237308 shutdown_connections 2024-08-31T04:04:31.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 --2- 172.21.15.89:0/1377237308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c0159f60 0x7fb1c015a370 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 -- 172.21.15.89:0/1377237308 >> 172.21.15.89:0/1377237308 conn(0x7fb1c0071be0 msgr2=0x7fb1c006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 -- 172.21.15.89:0/1377237308 shutdown_connections 2024-08-31T04:04:31.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 -- 172.21.15.89:0/1377237308 wait complete. 2024-08-31T04:04:31.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 Processor -- start 2024-08-31T04:04:31.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 -- start start 2024-08-31T04:04:31.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c00c97e0 0x7fb1c00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c00cedf0 0x7fb1c01552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c0159f60 0x7fb1c014c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c01596f0 con 0x7fb1c00cedf0 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c00cf610 con 0x7fb1c00c97e0 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.488+0000 7fb1c8400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c00c5160 con 0x7fb1c0159f60 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c00cedf0 0x7fb1c01552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c00cedf0 0x7fb1c01552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42016/0 (socket says 172.21.15.89:42016) 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5000640 1 -- 172.21.15.89:0/1672027228 learned_addr learned my addr 172.21.15.89:0/1672027228 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c6400640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c0159f60 0x7fb1c014c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5a00640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c00c97e0 0x7fb1c00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5000640 1 -- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c0159f60 msgr2=0x7fb1c014c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5000640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c0159f60 0x7fb1c014c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5000640 1 -- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c00c97e0 msgr2=0x7fb1c00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5000640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c00c97e0 0x7fb1c00c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5000640 1 -- 172.21.15.89:0/1672027228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c014d450 con 0x7fb1c00cedf0 2024-08-31T04:04:31.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c5000640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c00cedf0 0x7fb1c01552f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0b0040 tx=0x7fb1ac0a56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:31.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1bd600640 1 -- 172.21.15.89:0/1672027228 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0bd070 con 0x7fb1c00cedf0 2024-08-31T04:04:31.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1bd600640 1 -- 172.21.15.89:0/1672027228 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1ac004430 con 0x7fb1c00cedf0 2024-08-31T04:04:31.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c00c8660 con 0x7fb1c00cedf0 2024-08-31T04:04:31.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1bd600640 1 -- 172.21.15.89:0/1672027228 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0b2040 con 0x7fb1c00cedf0 2024-08-31T04:04:31.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c00c8010 con 0x7fb1c00cedf0 2024-08-31T04:04:31.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c00c5d30 con 0x7fb1c00cedf0 2024-08-31T04:04:31.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.492+0000 7fb1bd600640 1 -- 172.21.15.89:0/1672027228 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb1ac003860 con 0x7fb1c00cedf0 2024-08-31T04:04:31.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.496+0000 7fb1bd600640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb1a00720c0 0x7fb1a00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:31.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.496+0000 7fb1bd600640 1 -- 172.21.15.89:0/1672027228 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb1ac12cdc0 con 0x7fb1c00cedf0 2024-08-31T04:04:31.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.496+0000 7fb1c5a00640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb1a00720c0 0x7fb1a00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.496+0000 7fb1c5a00640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb1a00720c0 0x7fb1a00745d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000f70 tx=0x7fb1b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:31.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.500+0000 7fb1bd600640 1 -- 172.21.15.89:0/1672027228 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb1ac0164d0 con 0x7fb1c00cedf0 2024-08-31T04:04:31.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.660+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1c00c4650 con 0x7fb1a00720c0 2024-08-31T04:04:31.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.676+0000 7fb1bd600640 1 -- 172.21.15.89:0/1672027228 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332516 (secure 0 0 0) 0x7fb1c00c4650 con 0x7fb1a00720c0 2024-08-31T04:04:31.682 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:31.684 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:04:31.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb1a00720c0 msgr2=0x7fb1a00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb1a00720c0 0x7fb1a00745d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000f70 tx=0x7fb1b4009040 comp rx=0 tx=0).stop 2024-08-31T04:04:31.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c00cedf0 msgr2=0x7fb1c01552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c00cedf0 0x7fb1c01552f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0b0040 tx=0x7fb1ac0a56b0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 shutdown_connections 2024-08-31T04:04:31.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb1a00720c0 0x7fb1a00745d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c00cedf0 0x7fb1c01552f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c0159f60 0x7fb1c014c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 --2- 172.21.15.89:0/1672027228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c00c97e0 0x7fb1c00c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 >> 172.21.15.89:0/1672027228 conn(0x7fb1c0071be0 msgr2=0x7fb1c0156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 shutdown_connections 2024-08-31T04:04:31.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.680+0000 7fb1c8400640 1 -- 172.21.15.89:0/1672027228 wait complete. 2024-08-31T04:04:31.703 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-08-31T04:04:30.129078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730220,"statfs":{"total":773094113280,"available":772843745280,"internally_reserved":0,"allocated":3383296,"data_stored":2028208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005855"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905721+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:04:05.905721+0000","last_peered":"2024-08-31T04:04:05.905721+0000","last_clean":"2024-08-31T04:04:05.905721+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:04:05.905721+0000","last_undegraded":"2024-08-31T04:04:05.905721+0000","last_fullsized":"2024-08-31T04:04:05.905721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040713+0000","last_change":"2024-08-31T04:04:00.866522+0000","last_active":"2024-08-31T04:04:06.040713+0000","last_peered":"2024-08-31T04:04:06.040713+0000","last_clean":"2024-08-31T04:04:06.040713+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:04:06.040713+0000","last_undegraded":"2024-08-31T04:04:06.040713+0000","last_fullsized":"2024-08-31T04:04:06.040713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:05.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039577+0000","last_change":"2024-08-31T04:04:04.956192+0000","last_active":"2024-08-31T04:04:06.039577+0000","last_peered":"2024-08-31T04:04:06.039577+0000","last_clean":"2024-08-31T04:04:06.039577+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:04:06.039577+0000","last_undegraded":"2024-08-31T04:04:06.039577+0000","last_fullsized":"2024-08-31T04:04:06.039577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:42.517705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041009+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:04:06.041009+0000","last_peered":"2024-08-31T04:04:06.041009+0000","last_clean":"2024-08-31T04:04:06.041009+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:04:06.041009+0000","last_undegraded":"2024-08-31T04:04:06.041009+0000","last_fullsized":"2024-08-31T04:04:06.041009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040614+0000","last_change":"2024-08-31T04:04:00.880748+0000","last_active":"2024-08-31T04:04:06.040614+0000","last_peered":"2024-08-31T04:04:06.040614+0000","last_clean":"2024-08-31T04:04:06.040614+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:04:06.040614+0000","last_undegraded":"2024-08-31T04:04:06.040614+0000","last_fullsized":"2024-08-31T04:04:06.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:45.564722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904053+0000","last_change":"2024-08-31T04:04:04.951253+0000","last_active":"2024-08-31T04:04:05.904053+0000","last_peered":"2024-08-31T04:04:05.904053+0000","last_clean":"2024-08-31T04:04:05.904053+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:04:05.904053+0000","last_undegraded":"2024-08-31T04:04:05.904053+0000","last_fullsized":"2024-08-31T04:04:05.904053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:06.131485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035168+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:04:06.035168+0000","last_peered":"2024-08-31T04:04:06.035168+0000","last_clean":"2024-08-31T04:04:06.035168+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:04:06.035168+0000","last_undegraded":"2024-08-31T04:04:06.035168+0000","last_fullsized":"2024-08-31T04:04:06.035168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036133+0000","last_change":"2024-08-31T04:04:00.873539+0000","last_active":"2024-08-31T04:04:06.036133+0000","last_peered":"2024-08-31T04:04:06.036133+0000","last_clean":"2024-08-31T04:04:06.036133+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:04:06.036133+0000","last_undegraded":"2024-08-31T04:04:06.036133+0000","last_fullsized":"2024-08-31T04:04:06.036133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:48.946116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904728+0000","last_change":"2024-08-31T04:04:04.972277+0000","last_active":"2024-08-31T04:04:05.904728+0000","last_peered":"2024-08-31T04:04:05.904728+0000","last_clean":"2024-08-31T04:04:05.904728+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:04:05.904728+0000","last_undegraded":"2024-08-31T04:04:05.904728+0000","last_fullsized":"2024-08-31T04:04:05.904728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:25.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035597+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:04:06.035597+0000","last_peered":"2024-08-31T04:04:06.035597+0000","last_clean":"2024-08-31T04:04:06.035597+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:04:06.035597+0000","last_undegraded":"2024-08-31T04:04:06.035597+0000","last_fullsized":"2024-08-31T04:04:06.035597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907747+0000","last_change":"2024-08-31T04:04:00.874519+0000","last_active":"2024-08-31T04:04:05.907747+0000","last_peered":"2024-08-31T04:04:05.907747+0000","last_clean":"2024-08-31T04:04:05.907747+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:04:05.907747+0000","last_undegraded":"2024-08-31T04:04:05.907747+0000","last_fullsized":"2024-08-31T04:04:05.907747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:31.628140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904382+0000","last_change":"2024-08-31T04:04:04.974184+0000","last_active":"2024-08-31T04:04:05.904382+0000","last_peered":"2024-08-31T04:04:05.904382+0000","last_clean":"2024-08-31T04:04:05.904382+0000","last_became_active":"2024-08-31T04:04:04.973794+0000","last_became_peered":"2024-08-31T04:04:04.973794+0000","last_unstale":"2024-08-31T04:04:05.904382+0000","last_undegraded":"2024-08-31T04:04:05.904382+0000","last_fullsized":"2024-08-31T04:04:05.904382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:52.867283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907152+0000","last_change":"2024-08-31T04:04:00.867964+0000","last_active":"2024-08-31T04:04:05.907152+0000","last_peered":"2024-08-31T04:04:05.907152+0000","last_clean":"2024-08-31T04:04:05.907152+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:04:05.907152+0000","last_undegraded":"2024-08-31T04:04:05.907152+0000","last_fullsized":"2024-08-31T04:04:05.907152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:43.911244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906774+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:04:05.906774+0000","last_peered":"2024-08-31T04:04:05.906774+0000","last_clean":"2024-08-31T04:04:05.906774+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:04:05.906774+0000","last_undegraded":"2024-08-31T04:04:05.906774+0000","last_fullsized":"2024-08-31T04:04:05.906774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907485+0000","last_change":"2024-08-31T04:04:04.966791+0000","last_active":"2024-08-31T04:04:05.907485+0000","last_peered":"2024-08-31T04:04:05.907485+0000","last_clean":"2024-08-31T04:04:05.907485+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:04:05.907485+0000","last_undegraded":"2024-08-31T04:04:05.907485+0000","last_fullsized":"2024-08-31T04:04:05.907485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:57.768934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041469+0000","last_change":"2024-08-31T04:04:00.887746+0000","last_active":"2024-08-31T04:04:06.041469+0000","last_peered":"2024-08-31T04:04:06.041469+0000","last_clean":"2024-08-31T04:04:06.041469+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:04:06.041469+0000","last_undegraded":"2024-08-31T04:04:06.041469+0000","last_fullsized":"2024-08-31T04:04:06.041469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:27:35.901081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041029+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:04:06.041029+0000","last_peered":"2024-08-31T04:04:06.041029+0000","last_clean":"2024-08-31T04:04:06.041029+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:04:06.041029+0000","last_undegraded":"2024-08-31T04:04:06.041029+0000","last_fullsized":"2024-08-31T04:04:06.041029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034751+0000","last_change":"2024-08-31T04:04:04.954690+0000","last_active":"2024-08-31T04:04:06.034751+0000","last_peered":"2024-08-31T04:04:06.034751+0000","last_clean":"2024-08-31T04:04:06.034751+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:04:06.034751+0000","last_undegraded":"2024-08-31T04:04:06.034751+0000","last_fullsized":"2024-08-31T04:04:06.034751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:11.009989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904518+0000","last_change":"2024-08-31T04:04:00.896360+0000","last_active":"2024-08-31T04:04:05.904518+0000","last_peered":"2024-08-31T04:04:05.904518+0000","last_clean":"2024-08-31T04:04:05.904518+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:04:05.904518+0000","last_undegraded":"2024-08-31T04:04:05.904518+0000","last_fullsized":"2024-08-31T04:04:05.904518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:04.855778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904586+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:04:05.904586+0000","last_peered":"2024-08-31T04:04:05.904586+0000","last_clean":"2024-08-31T04:04:05.904586+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:04:05.904586+0000","last_undegraded":"2024-08-31T04:04:05.904586+0000","last_fullsized":"2024-08-31T04:04:05.904586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044402+0000","last_change":"2024-08-31T04:04:04.946958+0000","last_active":"2024-08-31T04:04:06.044402+0000","last_peered":"2024-08-31T04:04:06.044402+0000","last_clean":"2024-08-31T04:04:06.044402+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:04:06.044402+0000","last_undegraded":"2024-08-31T04:04:06.044402+0000","last_fullsized":"2024-08-31T04:04:06.044402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:41:42.006072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906335+0000","last_change":"2024-08-31T04:04:00.892688+0000","last_active":"2024-08-31T04:04:05.906335+0000","last_peered":"2024-08-31T04:04:05.906335+0000","last_clean":"2024-08-31T04:04:05.906335+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:04:05.906335+0000","last_undegraded":"2024-08-31T04:04:05.906335+0000","last_fullsized":"2024-08-31T04:04:05.906335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:53.521514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034425+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:04:06.034425+0000","last_peered":"2024-08-31T04:04:06.034425+0000","last_clean":"2024-08-31T04:04:06.034425+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:04:06.034425+0000","last_undegraded":"2024-08-31T04:04:06.034425+0000","last_fullsized":"2024-08-31T04:04:06.034425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905529+0000","last_change":"2024-08-31T04:04:04.936785+0000","last_active":"2024-08-31T04:04:05.905529+0000","last_peered":"2024-08-31T04:04:05.905529+0000","last_clean":"2024-08-31T04:04:05.905529+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:04:05.905529+0000","last_undegraded":"2024-08-31T04:04:05.905529+0000","last_fullsized":"2024-08-31T04:04:05.905529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:28:32.101080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905349+0000","last_change":"2024-08-31T04:04:00.891194+0000","last_active":"2024-08-31T04:04:05.905349+0000","last_peered":"2024-08-31T04:04:05.905349+0000","last_clean":"2024-08-31T04:04:05.905349+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:04:05.905349+0000","last_undegraded":"2024-08-31T04:04:05.905349+0000","last_fullsized":"2024-08-31T04:04:05.905349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:20.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908435+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:04:05.908435+0000","last_peered":"2024-08-31T04:04:05.908435+0000","last_clean":"2024-08-31T04:04:05.908435+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:04:05.908435+0000","last_undegraded":"2024-08-31T04:04:05.908435+0000","last_fullsized":"2024-08-31T04:04:05.908435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904222+0000","last_change":"2024-08-31T04:04:04.947787+0000","last_active":"2024-08-31T04:04:05.904222+0000","last_peered":"2024-08-31T04:04:05.904222+0000","last_clean":"2024-08-31T04:04:05.904222+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:04:05.904222+0000","last_undegraded":"2024-08-31T04:04:05.904222+0000","last_fullsized":"2024-08-31T04:04:05.904222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:40.922656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905481+0000","last_change":"2024-08-31T04:04:00.890893+0000","last_active":"2024-08-31T04:04:05.905481+0000","last_peered":"2024-08-31T04:04:05.905481+0000","last_clean":"2024-08-31T04:04:05.905481+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:04:05.905481+0000","last_undegraded":"2024-08-31T04:04:05.905481+0000","last_fullsized":"2024-08-31T04:04:05.905481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:39:17.163345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905683+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:04:05.905683+0000","last_peered":"2024-08-31T04:04:05.905683+0000","last_clean":"2024-08-31T04:04:05.905683+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:04:05.905683+0000","last_undegraded":"2024-08-31T04:04:05.905683+0000","last_fullsized":"2024-08-31T04:04:05.905683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904211+0000","last_change":"2024-08-31T04:04:04.951050+0000","last_active":"2024-08-31T04:04:05.904211+0000","last_peered":"2024-08-31T04:04:05.904211+0000","last_clean":"2024-08-31T04:04:05.904211+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:04:05.904211+0000","last_undegraded":"2024-08-31T04:04:05.904211+0000","last_fullsized":"2024-08-31T04:04:05.904211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:39.320190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042706+0000","last_change":"2024-08-31T04:04:00.887709+0000","last_active":"2024-08-31T04:04:06.042706+0000","last_peered":"2024-08-31T04:04:06.042706+0000","last_clean":"2024-08-31T04:04:06.042706+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:04:06.042706+0000","last_undegraded":"2024-08-31T04:04:06.042706+0000","last_fullsized":"2024-08-31T04:04:06.042706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:15.464663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908034+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:04:05.908034+0000","last_peered":"2024-08-31T04:04:05.908034+0000","last_clean":"2024-08-31T04:04:05.908034+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:04:05.908034+0000","last_undegraded":"2024-08-31T04:04:05.908034+0000","last_fullsized":"2024-08-31T04:04:05.908034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040767+0000","last_change":"2024-08-31T04:04:04.953273+0000","last_active":"2024-08-31T04:04:06.040767+0000","last_peered":"2024-08-31T04:04:06.040767+0000","last_clean":"2024-08-31T04:04:06.040767+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:04:06.040767+0000","last_undegraded":"2024-08-31T04:04:06.040767+0000","last_fullsized":"2024-08-31T04:04:06.040767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:30.841472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905304+0000","last_change":"2024-08-31T04:04:00.887566+0000","last_active":"2024-08-31T04:04:05.905304+0000","last_peered":"2024-08-31T04:04:05.905304+0000","last_clean":"2024-08-31T04:04:05.905304+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:04:05.905304+0000","last_undegraded":"2024-08-31T04:04:05.905304+0000","last_fullsized":"2024-08-31T04:04:05.905304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:17.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038640+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:04:06.038640+0000","last_peered":"2024-08-31T04:04:06.038640+0000","last_clean":"2024-08-31T04:04:06.038640+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:04:06.038640+0000","last_undegraded":"2024-08-31T04:04:06.038640+0000","last_fullsized":"2024-08-31T04:04:06.038640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040223+0000","last_change":"2024-08-31T04:04:04.975251+0000","last_active":"2024-08-31T04:04:06.040223+0000","last_peered":"2024-08-31T04:04:06.040223+0000","last_clean":"2024-08-31T04:04:06.040223+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:04:06.040223+0000","last_undegraded":"2024-08-31T04:04:06.040223+0000","last_fullsized":"2024-08-31T04:04:06.040223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:12.488672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035080+0000","last_change":"2024-08-31T04:04:00.881311+0000","last_active":"2024-08-31T04:04:06.035080+0000","last_peered":"2024-08-31T04:04:06.035080+0000","last_clean":"2024-08-31T04:04:06.035080+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:04:06.035080+0000","last_undegraded":"2024-08-31T04:04:06.035080+0000","last_fullsized":"2024-08-31T04:04:06.035080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:44.361701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907364+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:04:05.907364+0000","last_peered":"2024-08-31T04:04:05.907364+0000","last_clean":"2024-08-31T04:04:05.907364+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:04:05.907364+0000","last_undegraded":"2024-08-31T04:04:05.907364+0000","last_fullsized":"2024-08-31T04:04:05.907364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042168+0000","last_change":"2024-08-31T04:04:04.954216+0000","last_active":"2024-08-31T04:04:06.042168+0000","last_peered":"2024-08-31T04:04:06.042168+0000","last_clean":"2024-08-31T04:04:06.042168+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:04:06.042168+0000","last_undegraded":"2024-08-31T04:04:06.042168+0000","last_fullsized":"2024-08-31T04:04:06.042168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:04.563322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039679+0000","last_change":"2024-08-31T04:04:00.884692+0000","last_active":"2024-08-31T04:04:06.039679+0000","last_peered":"2024-08-31T04:04:06.039679+0000","last_clean":"2024-08-31T04:04:06.039679+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:04:06.039679+0000","last_undegraded":"2024-08-31T04:04:06.039679+0000","last_fullsized":"2024-08-31T04:04:06.039679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:07:45.274820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037948+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:04:06.037948+0000","last_peered":"2024-08-31T04:04:06.037948+0000","last_clean":"2024-08-31T04:04:06.037948+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:04:06.037948+0000","last_undegraded":"2024-08-31T04:04:06.037948+0000","last_fullsized":"2024-08-31T04:04:06.037948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044165+0000","last_change":"2024-08-31T04:04:04.950642+0000","last_active":"2024-08-31T04:04:06.044165+0000","last_peered":"2024-08-31T04:04:06.044165+0000","last_clean":"2024-08-31T04:04:06.044165+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:04:06.044165+0000","last_undegraded":"2024-08-31T04:04:06.044165+0000","last_fullsized":"2024-08-31T04:04:06.044165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:49.300897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038082+0000","last_change":"2024-08-31T04:04:00.886674+0000","last_active":"2024-08-31T04:04:06.038082+0000","last_peered":"2024-08-31T04:04:06.038082+0000","last_clean":"2024-08-31T04:04:06.038082+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:04:06.038082+0000","last_undegraded":"2024-08-31T04:04:06.038082+0000","last_fullsized":"2024-08-31T04:04:06.038082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:46:28.682868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905953+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:04:05.905953+0000","last_peered":"2024-08-31T04:04:05.905953+0000","last_clean":"2024-08-31T04:04:05.905953+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:04:05.905953+0000","last_undegraded":"2024-08-31T04:04:05.905953+0000","last_fullsized":"2024-08-31T04:04:05.905953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040199+0000","last_change":"2024-08-31T04:04:04.973347+0000","last_active":"2024-08-31T04:04:06.040199+0000","last_peered":"2024-08-31T04:04:06.040199+0000","last_clean":"2024-08-31T04:04:06.040199+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:04:06.040199+0000","last_undegraded":"2024-08-31T04:04:06.040199+0000","last_fullsized":"2024-08-31T04:04:06.040199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:30.204653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904564+0000","last_change":"2024-08-31T04:04:00.896365+0000","last_active":"2024-08-31T04:04:05.904564+0000","last_peered":"2024-08-31T04:04:05.904564+0000","last_clean":"2024-08-31T04:04:05.904564+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:04:05.904564+0000","last_undegraded":"2024-08-31T04:04:05.904564+0000","last_fullsized":"2024-08-31T04:04:05.904564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:39.300217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906837+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:04:05.906837+0000","last_peered":"2024-08-31T04:04:05.906837+0000","last_clean":"2024-08-31T04:04:05.906837+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:04:05.906837+0000","last_undegraded":"2024-08-31T04:04:05.906837+0000","last_fullsized":"2024-08-31T04:04:05.906837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034604+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:04:06.034604+0000","last_peered":"2024-08-31T04:04:06.034604+0000","last_clean":"2024-08-31T04:04:06.034604+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:04:06.034604+0000","last_undegraded":"2024-08-31T04:04:06.034604+0000","last_fullsized":"2024-08-31T04:04:06.034604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907888+0000","last_change":"2024-08-31T04:04:04.922468+0000","last_active":"2024-08-31T04:04:05.907888+0000","last_peered":"2024-08-31T04:04:05.907888+0000","last_clean":"2024-08-31T04:04:05.907888+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:04:05.907888+0000","last_undegraded":"2024-08-31T04:04:05.907888+0000","last_fullsized":"2024-08-31T04:04:05.907888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:15.555948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907801+0000","last_change":"2024-08-31T04:04:00.867024+0000","last_active":"2024-08-31T04:04:05.907801+0000","last_peered":"2024-08-31T04:04:05.907801+0000","last_clean":"2024-08-31T04:04:05.907801+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:04:05.907801+0000","last_undegraded":"2024-08-31T04:04:05.907801+0000","last_fullsized":"2024-08-31T04:04:05.907801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:43.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042885+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:04:06.042885+0000","last_peered":"2024-08-31T04:04:06.042885+0000","last_clean":"2024-08-31T04:04:06.042885+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:04:06.042885+0000","last_undegraded":"2024-08-31T04:04:06.042885+0000","last_fullsized":"2024-08-31T04:04:06.042885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904426+0000","last_change":"2024-08-31T04:04:04.938034+0000","last_active":"2024-08-31T04:04:05.904426+0000","last_peered":"2024-08-31T04:04:05.904426+0000","last_clean":"2024-08-31T04:04:05.904426+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:04:05.904426+0000","last_undegraded":"2024-08-31T04:04:05.904426+0000","last_fullsized":"2024-08-31T04:04:05.904426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:46.961448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035417+0000","last_change":"2024-08-31T04:04:00.883610+0000","last_active":"2024-08-31T04:04:06.035417+0000","last_peered":"2024-08-31T04:04:06.035417+0000","last_clean":"2024-08-31T04:04:06.035417+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:04:06.035417+0000","last_undegraded":"2024-08-31T04:04:06.035417+0000","last_fullsized":"2024-08-31T04:04:06.035417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:29.250924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041581+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:04:06.041581+0000","last_peered":"2024-08-31T04:04:06.041581+0000","last_clean":"2024-08-31T04:04:06.041581+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:04:06.041581+0000","last_undegraded":"2024-08-31T04:04:06.041581+0000","last_fullsized":"2024-08-31T04:04:06.041581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039391+0000","last_change":"2024-08-31T04:04:04.979418+0000","last_active":"2024-08-31T04:04:06.039391+0000","last_peered":"2024-08-31T04:04:06.039391+0000","last_clean":"2024-08-31T04:04:06.039391+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:04:06.039391+0000","last_undegraded":"2024-08-31T04:04:06.039391+0000","last_fullsized":"2024-08-31T04:04:06.039391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:40.023243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035347+0000","last_change":"2024-08-31T04:04:00.874137+0000","last_active":"2024-08-31T04:04:06.035347+0000","last_peered":"2024-08-31T04:04:06.035347+0000","last_clean":"2024-08-31T04:04:06.035347+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:04:06.035347+0000","last_undegraded":"2024-08-31T04:04:06.035347+0000","last_fullsized":"2024-08-31T04:04:06.035347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:44.411622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905534+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:04:05.905534+0000","last_peered":"2024-08-31T04:04:05.905534+0000","last_clean":"2024-08-31T04:04:05.905534+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:04:05.905534+0000","last_undegraded":"2024-08-31T04:04:05.905534+0000","last_fullsized":"2024-08-31T04:04:05.905534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904981+0000","last_change":"2024-08-31T04:04:04.918718+0000","last_active":"2024-08-31T04:04:05.904981+0000","last_peered":"2024-08-31T04:04:05.904981+0000","last_clean":"2024-08-31T04:04:05.904981+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:04:05.904981+0000","last_undegraded":"2024-08-31T04:04:05.904981+0000","last_fullsized":"2024-08-31T04:04:05.904981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:04:40.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905941+0000","last_change":"2024-08-31T04:04:00.877667+0000","last_active":"2024-08-31T04:04:05.905941+0000","last_peered":"2024-08-31T04:04:05.905941+0000","last_clean":"2024-08-31T04:04:05.905941+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:04:05.905941+0000","last_undegraded":"2024-08-31T04:04:05.905941+0000","last_fullsized":"2024-08-31T04:04:05.905941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:06:31.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035613+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:04:06.035613+0000","last_peered":"2024-08-31T04:04:06.035613+0000","last_clean":"2024-08-31T04:04:06.035613+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:04:06.035613+0000","last_undegraded":"2024-08-31T04:04:06.035613+0000","last_fullsized":"2024-08-31T04:04:06.035613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034877+0000","last_change":"2024-08-31T04:04:04.959068+0000","last_active":"2024-08-31T04:04:06.034877+0000","last_peered":"2024-08-31T04:04:06.034877+0000","last_clean":"2024-08-31T04:04:06.034877+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:04:06.034877+0000","last_undegraded":"2024-08-31T04:04:06.034877+0000","last_fullsized":"2024-08-31T04:04:06.034877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:46:16.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906227+0000","last_change":"2024-08-31T04:04:00.864542+0000","last_active":"2024-08-31T04:04:05.906227+0000","last_peered":"2024-08-31T04:04:05.906227+0000","last_clean":"2024-08-31T04:04:05.906227+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:04:05.906227+0000","last_undegraded":"2024-08-31T04:04:05.906227+0000","last_fullsized":"2024-08-31T04:04:05.906227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:47.241152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904710+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:04:05.904710+0000","last_peered":"2024-08-31T04:04:05.904710+0000","last_clean":"2024-08-31T04:04:05.904710+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:04:05.904710+0000","last_undegraded":"2024-08-31T04:04:05.904710+0000","last_fullsized":"2024-08-31T04:04:05.904710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040786+0000","last_change":"2024-08-31T04:04:04.966400+0000","last_active":"2024-08-31T04:04:06.040786+0000","last_peered":"2024-08-31T04:04:06.040786+0000","last_clean":"2024-08-31T04:04:06.040786+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:04:06.040786+0000","last_undegraded":"2024-08-31T04:04:06.040786+0000","last_fullsized":"2024-08-31T04:04:06.040786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:18:16.700443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034482+0000","last_change":"2024-08-31T04:04:00.880127+0000","last_active":"2024-08-31T04:04:06.034482+0000","last_peered":"2024-08-31T04:04:06.034482+0000","last_clean":"2024-08-31T04:04:06.034482+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:04:06.034482+0000","last_undegraded":"2024-08-31T04:04:06.034482+0000","last_fullsized":"2024-08-31T04:04:06.034482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034827+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:04:06.034827+0000","last_peered":"2024-08-31T04:04:06.034827+0000","last_clean":"2024-08-31T04:04:06.034827+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:04:06.034827+0000","last_undegraded":"2024-08-31T04:04:06.034827+0000","last_fullsized":"2024-08-31T04:04:06.034827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040447+0000","last_change":"2024-08-31T04:04:04.971102+0000","last_active":"2024-08-31T04:04:06.040447+0000","last_peered":"2024-08-31T04:04:06.040447+0000","last_clean":"2024-08-31T04:04:06.040447+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:04:06.040447+0000","last_undegraded":"2024-08-31T04:04:06.040447+0000","last_fullsized":"2024-08-31T04:04:06.040447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:40.427017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906629+0000","last_change":"2024-08-31T04:04:00.882328+0000","last_active":"2024-08-31T04:04:05.906629+0000","last_peered":"2024-08-31T04:04:05.906629+0000","last_clean":"2024-08-31T04:04:05.906629+0000","last_became_active":"2024-08-31T04:04:00.882009+0000","last_became_peered":"2024-08-31T04:04:00.882009+0000","last_unstale":"2024-08-31T04:04:05.906629+0000","last_undegraded":"2024-08-31T04:04:05.906629+0000","last_fullsized":"2024-08-31T04:04:05.906629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:10:14.622717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907313+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:04:05.907313+0000","last_peered":"2024-08-31T04:04:05.907313+0000","last_clean":"2024-08-31T04:04:05.907313+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:04:05.907313+0000","last_undegraded":"2024-08-31T04:04:05.907313+0000","last_fullsized":"2024-08-31T04:04:05.907313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041921+0000","last_change":"2024-08-31T04:04:04.964690+0000","last_active":"2024-08-31T04:04:06.041921+0000","last_peered":"2024-08-31T04:04:06.041921+0000","last_clean":"2024-08-31T04:04:06.041921+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:04:06.041921+0000","last_undegraded":"2024-08-31T04:04:06.041921+0000","last_fullsized":"2024-08-31T04:04:06.041921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:23.711105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040884+0000","last_change":"2024-08-31T04:04:00.887168+0000","last_active":"2024-08-31T04:04:06.040884+0000","last_peered":"2024-08-31T04:04:06.040884+0000","last_clean":"2024-08-31T04:04:06.040884+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:04:06.040884+0000","last_undegraded":"2024-08-31T04:04:06.040884+0000","last_fullsized":"2024-08-31T04:04:06.040884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:58.272934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043729+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:04:06.043729+0000","last_peered":"2024-08-31T04:04:06.043729+0000","last_clean":"2024-08-31T04:04:06.043729+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:04:06.043729+0000","last_undegraded":"2024-08-31T04:04:06.043729+0000","last_fullsized":"2024-08-31T04:04:06.043729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907657+0000","last_change":"2024-08-31T04:04:04.967183+0000","last_active":"2024-08-31T04:04:05.907657+0000","last_peered":"2024-08-31T04:04:05.907657+0000","last_clean":"2024-08-31T04:04:05.907657+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:04:05.907657+0000","last_undegraded":"2024-08-31T04:04:05.907657+0000","last_fullsized":"2024-08-31T04:04:05.907657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:54.094714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034962+0000","last_change":"2024-08-31T04:04:00.886779+0000","last_active":"2024-08-31T04:04:06.034962+0000","last_peered":"2024-08-31T04:04:06.034962+0000","last_clean":"2024-08-31T04:04:06.034962+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:04:06.034962+0000","last_undegraded":"2024-08-31T04:04:06.034962+0000","last_fullsized":"2024-08-31T04:04:06.034962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:45:51.487016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:14.844048+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:04:14.844048+0000","last_peered":"2024-08-31T04:04:14.844048+0000","last_clean":"2024-08-31T04:04:14.844048+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:04:14.844048+0000","last_undegraded":"2024-08-31T04:04:14.844048+0000","last_fullsized":"2024-08-31T04:04:14.844048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904234+0000","last_change":"2024-08-31T04:04:04.960945+0000","last_active":"2024-08-31T04:04:05.904234+0000","last_peered":"2024-08-31T04:04:05.904234+0000","last_clean":"2024-08-31T04:04:05.904234+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:04:05.904234+0000","last_undegraded":"2024-08-31T04:04:05.904234+0000","last_fullsized":"2024-08-31T04:04:05.904234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:50.907644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906484+0000","last_change":"2024-08-31T04:04:00.869565+0000","last_active":"2024-08-31T04:04:05.906484+0000","last_peered":"2024-08-31T04:04:05.906484+0000","last_clean":"2024-08-31T04:04:05.906484+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:04:05.906484+0000","last_undegraded":"2024-08-31T04:04:05.906484+0000","last_fullsized":"2024-08-31T04:04:05.906484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:37.334753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043126+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:04:06.043126+0000","last_peered":"2024-08-31T04:04:06.043126+0000","last_clean":"2024-08-31T04:04:06.043126+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:04:06.043126+0000","last_undegraded":"2024-08-31T04:04:06.043126+0000","last_fullsized":"2024-08-31T04:04:06.043126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904892+0000","last_change":"2024-08-31T04:04:04.940655+0000","last_active":"2024-08-31T04:04:05.904892+0000","last_peered":"2024-08-31T04:04:05.904892+0000","last_clean":"2024-08-31T04:04:05.904892+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:04:05.904892+0000","last_undegraded":"2024-08-31T04:04:05.904892+0000","last_fullsized":"2024-08-31T04:04:05.904892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:12:39.145645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040892+0000","last_change":"2024-08-31T04:04:00.881774+0000","last_active":"2024-08-31T04:04:06.040892+0000","last_peered":"2024-08-31T04:04:06.040892+0000","last_clean":"2024-08-31T04:04:06.040892+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:04:06.040892+0000","last_undegraded":"2024-08-31T04:04:06.040892+0000","last_fullsized":"2024-08-31T04:04:06.040892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:19.539642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034980+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:04:06.034980+0000","last_peered":"2024-08-31T04:04:06.034980+0000","last_clean":"2024-08-31T04:04:06.034980+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:04:06.034980+0000","last_undegraded":"2024-08-31T04:04:06.034980+0000","last_fullsized":"2024-08-31T04:04:06.034980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037542+0000","last_change":"2024-08-31T04:04:04.948582+0000","last_active":"2024-08-31T04:04:06.037542+0000","last_peered":"2024-08-31T04:04:06.037542+0000","last_clean":"2024-08-31T04:04:06.037542+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:04:06.037542+0000","last_undegraded":"2024-08-31T04:04:06.037542+0000","last_fullsized":"2024-08-31T04:04:06.037542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:35.294731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905846+0000","last_change":"2024-08-31T04:04:00.863199+0000","last_active":"2024-08-31T04:04:05.905846+0000","last_peered":"2024-08-31T04:04:05.905846+0000","last_clean":"2024-08-31T04:04:05.905846+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:04:05.905846+0000","last_undegraded":"2024-08-31T04:04:05.905846+0000","last_fullsized":"2024-08-31T04:04:05.905846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:52.086202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036024+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:04:06.036024+0000","last_peered":"2024-08-31T04:04:06.036024+0000","last_clean":"2024-08-31T04:04:06.036024+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:04:06.036024+0000","last_undegraded":"2024-08-31T04:04:06.036024+0000","last_fullsized":"2024-08-31T04:04:06.036024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904421+0000","last_change":"2024-08-31T04:04:04.940930+0000","last_active":"2024-08-31T04:04:05.904421+0000","last_peered":"2024-08-31T04:04:05.904421+0000","last_clean":"2024-08-31T04:04:05.904421+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:04:05.904421+0000","last_undegraded":"2024-08-31T04:04:05.904421+0000","last_fullsized":"2024-08-31T04:04:05.904421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:07:30.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905335+0000","last_change":"2024-08-31T04:04:04.970283+0000","last_active":"2024-08-31T04:04:05.905335+0000","last_peered":"2024-08-31T04:04:05.905335+0000","last_clean":"2024-08-31T04:04:05.905335+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:04:05.905335+0000","last_undegraded":"2024-08-31T04:04:05.905335+0000","last_fullsized":"2024-08-31T04:04:05.905335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:37.086560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904353+0000","last_change":"2024-08-31T04:04:00.897277+0000","last_active":"2024-08-31T04:04:05.904353+0000","last_peered":"2024-08-31T04:04:05.904353+0000","last_clean":"2024-08-31T04:04:05.904353+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:04:05.904353+0000","last_undegraded":"2024-08-31T04:04:05.904353+0000","last_fullsized":"2024-08-31T04:04:05.904353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:45:42.808934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905834+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:04:05.905834+0000","last_peered":"2024-08-31T04:04:05.905834+0000","last_clean":"2024-08-31T04:04:05.905834+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:04:05.905834+0000","last_undegraded":"2024-08-31T04:04:05.905834+0000","last_fullsized":"2024-08-31T04:04:05.905834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906316+0000","last_change":"2024-08-31T04:04:04.966233+0000","last_active":"2024-08-31T04:04:05.906316+0000","last_peered":"2024-08-31T04:04:05.906316+0000","last_clean":"2024-08-31T04:04:05.906316+0000","last_became_active":"2024-08-31T04:04:04.965854+0000","last_became_peered":"2024-08-31T04:04:04.965854+0000","last_unstale":"2024-08-31T04:04:05.906316+0000","last_undegraded":"2024-08-31T04:04:05.906316+0000","last_fullsized":"2024-08-31T04:04:05.906316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:16.448331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040110+0000","last_change":"2024-08-31T04:04:00.888009+0000","last_active":"2024-08-31T04:04:06.040110+0000","last_peered":"2024-08-31T04:04:06.040110+0000","last_clean":"2024-08-31T04:04:06.040110+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:04:06.040110+0000","last_undegraded":"2024-08-31T04:04:06.040110+0000","last_fullsized":"2024-08-31T04:04:06.040110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:31.977791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038384+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:04:06.038384+0000","last_peered":"2024-08-31T04:04:06.038384+0000","last_clean":"2024-08-31T04:04:06.038384+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:04:06.038384+0000","last_undegraded":"2024-08-31T04:04:06.038384+0000","last_fullsized":"2024-08-31T04:04:06.038384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907256+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:04:05.907256+0000","last_peered":"2024-08-31T04:04:05.907256+0000","last_clean":"2024-08-31T04:04:05.907256+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:04:05.907256+0000","last_undegraded":"2024-08-31T04:04:05.907256+0000","last_fullsized":"2024-08-31T04:04:05.907256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904794+0000","last_change":"2024-08-31T04:04:00.897537+0000","last_active":"2024-08-31T04:04:05.904794+0000","last_peered":"2024-08-31T04:04:05.904794+0000","last_clean":"2024-08-31T04:04:05.904794+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:04:05.904794+0000","last_undegraded":"2024-08-31T04:04:05.904794+0000","last_fullsized":"2024-08-31T04:04:05.904794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:46.422487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905083+0000","last_change":"2024-08-31T04:04:04.961002+0000","last_active":"2024-08-31T04:04:05.905083+0000","last_peered":"2024-08-31T04:04:05.905083+0000","last_clean":"2024-08-31T04:04:05.905083+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:04:05.905083+0000","last_undegraded":"2024-08-31T04:04:05.905083+0000","last_fullsized":"2024-08-31T04:04:05.905083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:45:04.605970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039694+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:04:06.039694+0000","last_peered":"2024-08-31T04:04:06.039694+0000","last_clean":"2024-08-31T04:04:06.039694+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:04:06.039694+0000","last_undegraded":"2024-08-31T04:04:06.039694+0000","last_fullsized":"2024-08-31T04:04:06.039694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035174+0000","last_change":"2024-08-31T04:04:00.878599+0000","last_active":"2024-08-31T04:04:06.035174+0000","last_peered":"2024-08-31T04:04:06.035174+0000","last_clean":"2024-08-31T04:04:06.035174+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:04:06.035174+0000","last_undegraded":"2024-08-31T04:04:06.035174+0000","last_fullsized":"2024-08-31T04:04:06.035174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:37.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043082+0000","last_change":"2024-08-31T04:04:04.975414+0000","last_active":"2024-08-31T04:04:06.043082+0000","last_peered":"2024-08-31T04:04:06.043082+0000","last_clean":"2024-08-31T04:04:06.043082+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:04:06.043082+0000","last_undegraded":"2024-08-31T04:04:06.043082+0000","last_fullsized":"2024-08-31T04:04:06.043082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:12.992949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904092+0000","last_change":"2024-08-31T04:04:00.887117+0000","last_active":"2024-08-31T04:04:05.904092+0000","last_peered":"2024-08-31T04:04:05.904092+0000","last_clean":"2024-08-31T04:04:05.904092+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:04:05.904092+0000","last_undegraded":"2024-08-31T04:04:05.904092+0000","last_fullsized":"2024-08-31T04:04:05.904092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:18:37.474694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037663+0000","last_change":"2024-08-31T04:04:00.881033+0000","last_active":"2024-08-31T04:04:06.037663+0000","last_peered":"2024-08-31T04:04:06.037663+0000","last_clean":"2024-08-31T04:04:06.037663+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:04:06.037663+0000","last_undegraded":"2024-08-31T04:04:06.037663+0000","last_fullsized":"2024-08-31T04:04:06.037663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:46.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907098+0000","last_change":"2024-08-31T04:04:00.879791+0000","last_active":"2024-08-31T04:04:05.907098+0000","last_peered":"2024-08-31T04:04:05.907098+0000","last_clean":"2024-08-31T04:04:05.907098+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:04:05.907098+0000","last_undegraded":"2024-08-31T04:04:05.907098+0000","last_fullsized":"2024-08-31T04:04:05.907098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:00:26.128387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039321+0000","last_change":"2024-08-31T04:04:00.876487+0000","last_active":"2024-08-31T04:04:06.039321+0000","last_peered":"2024-08-31T04:04:06.039321+0000","last_clean":"2024-08-31T04:04:06.039321+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:04:06.039321+0000","last_undegraded":"2024-08-31T04:04:06.039321+0000","last_fullsized":"2024-08-31T04:04:06.039321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:10.867317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042600+0000","last_change":"2024-08-31T04:04:00.888017+0000","last_active":"2024-08-31T04:04:06.042600+0000","last_peered":"2024-08-31T04:04:06.042600+0000","last_clean":"2024-08-31T04:04:06.042600+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:04:06.042600+0000","last_undegraded":"2024-08-31T04:04:06.042600+0000","last_fullsized":"2024-08-31T04:04:06.042600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:53.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042480+0000","last_change":"2024-08-31T04:04:00.885850+0000","last_active":"2024-08-31T04:04:06.042480+0000","last_peered":"2024-08-31T04:04:06.042480+0000","last_clean":"2024-08-31T04:04:06.042480+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:04:06.042480+0000","last_undegraded":"2024-08-31T04:04:06.042480+0000","last_fullsized":"2024-08-31T04:04:06.042480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:07.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905742+0000","last_change":"2024-08-31T04:04:00.870086+0000","last_active":"2024-08-31T04:04:05.905742+0000","last_peered":"2024-08-31T04:04:05.905742+0000","last_clean":"2024-08-31T04:04:05.905742+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:04:05.905742+0000","last_undegraded":"2024-08-31T04:04:05.905742+0000","last_fullsized":"2024-08-31T04:04:05.905742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:59.724104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040115+0000","last_change":"2024-08-31T04:04:00.881124+0000","last_active":"2024-08-31T04:04:06.040115+0000","last_peered":"2024-08-31T04:04:06.040115+0000","last_clean":"2024-08-31T04:04:06.040115+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:04:06.040115+0000","last_undegraded":"2024-08-31T04:04:06.040115+0000","last_fullsized":"2024-08-31T04:04:06.040115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:40.389131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905727+0000","last_change":"2024-08-31T04:04:00.880040+0000","last_active":"2024-08-31T04:04:05.905727+0000","last_peered":"2024-08-31T04:04:05.905727+0000","last_clean":"2024-08-31T04:04:05.905727+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:04:05.905727+0000","last_undegraded":"2024-08-31T04:04:05.905727+0000","last_fullsized":"2024-08-31T04:04:05.905727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:23.110254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039483+0000","last_change":"2024-08-31T04:04:00.867373+0000","last_active":"2024-08-31T04:04:06.039483+0000","last_peered":"2024-08-31T04:04:06.039483+0000","last_clean":"2024-08-31T04:04:06.039483+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:04:06.039483+0000","last_undegraded":"2024-08-31T04:04:06.039483+0000","last_fullsized":"2024-08-31T04:04:06.039483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:47.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035293+0000","last_change":"2024-08-31T04:04:00.884497+0000","last_active":"2024-08-31T04:04:06.035293+0000","last_peered":"2024-08-31T04:04:06.035293+0000","last_clean":"2024-08-31T04:04:06.035293+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:04:06.035293+0000","last_undegraded":"2024-08-31T04:04:06.035293+0000","last_fullsized":"2024-08-31T04:04:06.035293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:10.005789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904753+0000","last_change":"2024-08-31T04:04:00.899676+0000","last_active":"2024-08-31T04:04:05.904753+0000","last_peered":"2024-08-31T04:04:05.904753+0000","last_clean":"2024-08-31T04:04:05.904753+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:04:05.904753+0000","last_undegraded":"2024-08-31T04:04:05.904753+0000","last_fullsized":"2024-08-31T04:04:05.904753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:46.887325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035316+0000","last_change":"2024-08-31T04:04:00.872910+0000","last_active":"2024-08-31T04:04:06.035316+0000","last_peered":"2024-08-31T04:04:06.035316+0000","last_clean":"2024-08-31T04:04:06.035316+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:04:06.035316+0000","last_undegraded":"2024-08-31T04:04:06.035316+0000","last_fullsized":"2024-08-31T04:04:06.035316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:22.208293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907979+0000","last_change":"2024-08-31T04:04:00.897114+0000","last_active":"2024-08-31T04:04:05.907979+0000","last_peered":"2024-08-31T04:04:05.907979+0000","last_clean":"2024-08-31T04:04:05.907979+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:04:05.907979+0000","last_undegraded":"2024-08-31T04:04:05.907979+0000","last_fullsized":"2024-08-31T04:04:05.907979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:13.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044036+0000","last_change":"2024-08-31T04:04:00.879907+0000","last_active":"2024-08-31T04:04:06.044036+0000","last_peered":"2024-08-31T04:04:06.044036+0000","last_clean":"2024-08-31T04:04:06.044036+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:04:06.044036+0000","last_undegraded":"2024-08-31T04:04:06.044036+0000","last_fullsized":"2024-08-31T04:04:06.044036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:11.042911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908418+0000","last_change":"2024-08-31T04:04:00.874247+0000","last_active":"2024-08-31T04:04:05.908418+0000","last_peered":"2024-08-31T04:04:05.908418+0000","last_clean":"2024-08-31T04:04:05.908418+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:04:05.908418+0000","last_undegraded":"2024-08-31T04:04:05.908418+0000","last_fullsized":"2024-08-31T04:04:05.908418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:00.974919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905612+0000","last_change":"2024-08-31T04:04:00.861922+0000","last_active":"2024-08-31T04:04:05.905612+0000","last_peered":"2024-08-31T04:04:05.905612+0000","last_clean":"2024-08-31T04:04:05.905612+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:04:05.905612+0000","last_undegraded":"2024-08-31T04:04:05.905612+0000","last_fullsized":"2024-08-31T04:04:05.905612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:07.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038950+0000","last_change":"2024-08-31T04:04:00.873986+0000","last_active":"2024-08-31T04:04:06.038950+0000","last_peered":"2024-08-31T04:04:06.038950+0000","last_clean":"2024-08-31T04:04:06.038950+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:04:06.038950+0000","last_undegraded":"2024-08-31T04:04:06.038950+0000","last_fullsized":"2024-08-31T04:04:06.038950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:39.934600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040728+0000","last_change":"2024-08-31T04:04:00.887510+0000","last_active":"2024-08-31T04:04:06.040728+0000","last_peered":"2024-08-31T04:04:06.040728+0000","last_clean":"2024-08-31T04:04:06.040728+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:04:06.040728+0000","last_undegraded":"2024-08-31T04:04:06.040728+0000","last_fullsized":"2024-08-31T04:04:06.040728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:29.689714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041269+0000","last_change":"2024-08-31T04:04:00.886364+0000","last_active":"2024-08-31T04:04:06.041269+0000","last_peered":"2024-08-31T04:04:06.041269+0000","last_clean":"2024-08-31T04:04:06.041269+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:04:06.041269+0000","last_undegraded":"2024-08-31T04:04:06.041269+0000","last_fullsized":"2024-08-31T04:04:06.041269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:17.949115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035208+0000","last_change":"2024-08-31T04:04:00.885452+0000","last_active":"2024-08-31T04:04:06.035208+0000","last_peered":"2024-08-31T04:04:06.035208+0000","last_clean":"2024-08-31T04:04:06.035208+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:04:06.035208+0000","last_undegraded":"2024-08-31T04:04:06.035208+0000","last_fullsized":"2024-08-31T04:04:06.035208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:34:58.727576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035971+0000","last_change":"2024-08-31T04:04:00.876816+0000","last_active":"2024-08-31T04:04:06.035971+0000","last_peered":"2024-08-31T04:04:06.035971+0000","last_clean":"2024-08-31T04:04:06.035971+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:04:06.035971+0000","last_undegraded":"2024-08-31T04:04:06.035971+0000","last_fullsized":"2024-08-31T04:04:06.035971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:38.896525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034790+0000","last_change":"2024-08-31T04:04:00.878584+0000","last_active":"2024-08-31T04:04:06.034790+0000","last_peered":"2024-08-31T04:04:06.034790+0000","last_clean":"2024-08-31T04:04:06.034790+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:04:06.034790+0000","last_undegraded":"2024-08-31T04:04:06.034790+0000","last_fullsized":"2024-08-31T04:04:06.034790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:30.201712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035980+0000","last_change":"2024-08-31T04:04:00.866007+0000","last_active":"2024-08-31T04:04:06.035980+0000","last_peered":"2024-08-31T04:04:06.035980+0000","last_clean":"2024-08-31T04:04:06.035980+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:04:06.035980+0000","last_undegraded":"2024-08-31T04:04:06.035980+0000","last_fullsized":"2024-08-31T04:04:06.035980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:05.236271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039665+0000","last_change":"2024-08-31T04:04:00.882356+0000","last_active":"2024-08-31T04:04:06.039665+0000","last_peered":"2024-08-31T04:04:06.039665+0000","last_clean":"2024-08-31T04:04:06.039665+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:04:06.039665+0000","last_undegraded":"2024-08-31T04:04:06.039665+0000","last_fullsized":"2024-08-31T04:04:06.039665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:44:37.026732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034726+0000","last_change":"2024-08-31T04:04:00.897170+0000","last_active":"2024-08-31T04:04:06.034726+0000","last_peered":"2024-08-31T04:04:06.034726+0000","last_clean":"2024-08-31T04:04:06.034726+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:04:06.034726+0000","last_undegraded":"2024-08-31T04:04:06.034726+0000","last_fullsized":"2024-08-31T04:04:06.034726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:05.673647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904588+0000","last_change":"2024-08-31T04:04:00.897956+0000","last_active":"2024-08-31T04:04:05.904588+0000","last_peered":"2024-08-31T04:04:05.904588+0000","last_clean":"2024-08-31T04:04:05.904588+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:04:05.904588+0000","last_undegraded":"2024-08-31T04:04:05.904588+0000","last_fullsized":"2024-08-31T04:04:05.904588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.686037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035844+0000","last_change":"2024-08-31T04:04:00.883315+0000","last_active":"2024-08-31T04:04:06.035844+0000","last_peered":"2024-08-31T04:04:06.035844+0000","last_clean":"2024-08-31T04:04:06.035844+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:04:06.035844+0000","last_undegraded":"2024-08-31T04:04:06.035844+0000","last_fullsized":"2024-08-31T04:04:06.035844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:41.258604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904958+0000","last_change":"2024-08-31T04:04:00.892502+0000","last_active":"2024-08-31T04:04:05.904958+0000","last_peered":"2024-08-31T04:04:05.904958+0000","last_clean":"2024-08-31T04:04:05.904958+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:04:05.904958+0000","last_undegraded":"2024-08-31T04:04:05.904958+0000","last_fullsized":"2024-08-31T04:04:05.904958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:04:48.381328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041280+0000","last_change":"2024-08-31T04:04:00.892994+0000","last_active":"2024-08-31T04:04:06.041280+0000","last_peered":"2024-08-31T04:04:06.041280+0000","last_clean":"2024-08-31T04:04:06.041280+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:04:06.041280+0000","last_undegraded":"2024-08-31T04:04:06.041280+0000","last_fullsized":"2024-08-31T04:04:06.041280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:00.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040294+0000","last_change":"2024-08-31T04:04:00.887325+0000","last_active":"2024-08-31T04:04:06.040294+0000","last_peered":"2024-08-31T04:04:06.040294+0000","last_clean":"2024-08-31T04:04:06.040294+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:04:06.040294+0000","last_undegraded":"2024-08-31T04:04:06.040294+0000","last_fullsized":"2024-08-31T04:04:06.040294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:15.674452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035235+0000","last_change":"2024-08-31T04:04:00.881745+0000","last_active":"2024-08-31T04:04:06.035235+0000","last_peered":"2024-08-31T04:04:06.035235+0000","last_clean":"2024-08-31T04:04:06.035235+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:04:06.035235+0000","last_undegraded":"2024-08-31T04:04:06.035235+0000","last_fullsized":"2024-08-31T04:04:06.035235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:01.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476747,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":105356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476747,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476748,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476748,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":104830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":868352,"data_stored":695234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35624,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336216,"statfs":{"total":96636764160,"available":96600285184,"internally_reserved":0,"allocated":286720,"data_stored":109288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":104898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:04:31.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:04:31.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.896+0000 7f88ad400640 1 -- 172.21.15.89:0/3051888298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 msgr2=0x7f88a80cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.896+0000 7f88ad400640 1 --2- 172.21.15.89:0/3051888298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 0x7f88a80cf200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f88a80746c0 tx=0x7f88a001cd80 comp rx=0 tx=0).stop 2024-08-31T04:04:31.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.896+0000 7f88ad400640 1 -- 172.21.15.89:0/3051888298 shutdown_connections 2024-08-31T04:04:31.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.896+0000 7f88ad400640 1 --2- 172.21.15.89:0/3051888298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 0x7f88a80cf200 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.896+0000 7f88ad400640 1 --2- 172.21.15.89:0/3051888298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88a8159f60 0x7f88a815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.896+0000 7f88ad400640 1 --2- 172.21.15.89:0/3051888298 >> v2:172.21.15.170:3300/0 conn(0x7f88a80c97e0 0x7f88a8156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.896+0000 7f88ad400640 1 -- 172.21.15.89:0/3051888298 >> 172.21.15.89:0/3051888298 conn(0x7f88a8071be0 msgr2=0x7f88a806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:31.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.896+0000 7f88ad400640 1 -- 172.21.15.89:0/3051888298 shutdown_connections 2024-08-31T04:04:31.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.896+0000 7f88ad400640 1 -- 172.21.15.89:0/3051888298 wait complete. 2024-08-31T04:04:31.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 Processor -- start 2024-08-31T04:04:31.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 -- start start 2024-08-31T04:04:31.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88a80c97e0 0x7f88a8162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:31.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 0x7f88a815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a8159f60 0x7f88a80ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f88a81596f0 con 0x7f88a80cedf0 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f88a81570b0 con 0x7f88a8159f60 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f88a80c5160 con 0x7f88a80c97e0 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 0x7f88a815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 0x7f88a815a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50352/0 (socket says 172.21.15.89:50352) 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889de00640 1 -- 172.21.15.89:0/3535354475 learned_addr learned my addr 172.21.15.89:0/3535354475 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88a7200640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a8159f60 0x7f88a80ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88a6800640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88a80c97e0 0x7f88a8162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:31.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889de00640 1 -- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88a80c97e0 msgr2=0x7f88a8162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889de00640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88a80c97e0 0x7f88a8162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889de00640 1 -- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a8159f60 msgr2=0x7f88a80ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889de00640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a8159f60 0x7f88a80ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889de00640 1 -- 172.21.15.89:0/3535354475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a8162840 con 0x7f88a80cedf0 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88a7200640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a8159f60 0x7f88a80ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889de00640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 0x7f88a815a370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f889000d6b0 tx=0x7f889000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889f400640 1 -- 172.21.15.89:0/3535354475 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890017030 con 0x7f88a80cedf0 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889f400640 1 -- 172.21.15.89:0/3535354475 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8890004140 con 0x7f88a80cedf0 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a8162b20 con 0x7f88a80cedf0 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f889f400640 1 -- 172.21.15.89:0/3535354475 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890005020 con 0x7f88a80cedf0 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.900+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a80cf200 con 0x7f88a80cedf0 2024-08-31T04:04:31.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.904+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a80c5d30 con 0x7f88a80cedf0 2024-08-31T04:04:31.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.904+0000 7f889f400640 1 -- 172.21.15.89:0/3535354475 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f889001a070 con 0x7f88a80cedf0 2024-08-31T04:04:31.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.904+0000 7f889f400640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88840720c0 0x7f88840745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:31.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.904+0000 7f889f400640 1 -- 172.21.15.89:0/3535354475 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8890092d40 con 0x7f88a80cedf0 2024-08-31T04:04:31.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.904+0000 7f88a6800640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88840720c0 0x7f88840745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:31.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.908+0000 7f88a6800640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88840720c0 0x7f88840745d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f88980058d0 tx=0x7f8898005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:31.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:31.908+0000 7f889f400640 1 -- 172.21.15.89:0/3535354475 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f889005e330 con 0x7f88a80cedf0 2024-08-31T04:04:32.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.072+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88a806e410 con 0x7f88840720c0 2024-08-31T04:04:32.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.088+0000 7f889f400640 1 -- 172.21.15.89:0/3535354475 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332516 (secure 0 0 0) 0x7f88a806e410 con 0x7f88840720c0 2024-08-31T04:04:32.093 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:32.095 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:04:32.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88840720c0 msgr2=0x7f88840745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88840720c0 0x7f88840745d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f88980058d0 tx=0x7f8898005860 comp rx=0 tx=0).stop 2024-08-31T04:04:32.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 msgr2=0x7f88a815a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 0x7f88a815a370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f889000d6b0 tx=0x7f889000db70 comp rx=0 tx=0).stop 2024-08-31T04:04:32.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 shutdown_connections 2024-08-31T04:04:32.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88840720c0 0x7f88840745d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a80cedf0 0x7f88a815a370 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88a8159f60 0x7f88a80ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 --2- 172.21.15.89:0/3535354475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88a80c97e0 0x7f88a8162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 >> 172.21.15.89:0/3535354475 conn(0x7f88a8071be0 msgr2=0x7f88a8157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:32.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 shutdown_connections 2024-08-31T04:04:32.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.092+0000 7f88ad400640 1 -- 172.21.15.89:0/3535354475 wait complete. 2024-08-31T04:04:32.117 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-08-31T04:04:30.129078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730220,"statfs":{"total":773094113280,"available":772843745280,"internally_reserved":0,"allocated":3383296,"data_stored":2028208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005855"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905721+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:04:05.905721+0000","last_peered":"2024-08-31T04:04:05.905721+0000","last_clean":"2024-08-31T04:04:05.905721+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:04:05.905721+0000","last_undegraded":"2024-08-31T04:04:05.905721+0000","last_fullsized":"2024-08-31T04:04:05.905721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040713+0000","last_change":"2024-08-31T04:04:00.866522+0000","last_active":"2024-08-31T04:04:06.040713+0000","last_peered":"2024-08-31T04:04:06.040713+0000","last_clean":"2024-08-31T04:04:06.040713+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:04:06.040713+0000","last_undegraded":"2024-08-31T04:04:06.040713+0000","last_fullsized":"2024-08-31T04:04:06.040713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:05.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039577+0000","last_change":"2024-08-31T04:04:04.956192+0000","last_active":"2024-08-31T04:04:06.039577+0000","last_peered":"2024-08-31T04:04:06.039577+0000","last_clean":"2024-08-31T04:04:06.039577+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:04:06.039577+0000","last_undegraded":"2024-08-31T04:04:06.039577+0000","last_fullsized":"2024-08-31T04:04:06.039577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:42.517705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041009+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:04:06.041009+0000","last_peered":"2024-08-31T04:04:06.041009+0000","last_clean":"2024-08-31T04:04:06.041009+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:04:06.041009+0000","last_undegraded":"2024-08-31T04:04:06.041009+0000","last_fullsized":"2024-08-31T04:04:06.041009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040614+0000","last_change":"2024-08-31T04:04:00.880748+0000","last_active":"2024-08-31T04:04:06.040614+0000","last_peered":"2024-08-31T04:04:06.040614+0000","last_clean":"2024-08-31T04:04:06.040614+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:04:06.040614+0000","last_undegraded":"2024-08-31T04:04:06.040614+0000","last_fullsized":"2024-08-31T04:04:06.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:45.564722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904053+0000","last_change":"2024-08-31T04:04:04.951253+0000","last_active":"2024-08-31T04:04:05.904053+0000","last_peered":"2024-08-31T04:04:05.904053+0000","last_clean":"2024-08-31T04:04:05.904053+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:04:05.904053+0000","last_undegraded":"2024-08-31T04:04:05.904053+0000","last_fullsized":"2024-08-31T04:04:05.904053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:06.131485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035168+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:04:06.035168+0000","last_peered":"2024-08-31T04:04:06.035168+0000","last_clean":"2024-08-31T04:04:06.035168+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:04:06.035168+0000","last_undegraded":"2024-08-31T04:04:06.035168+0000","last_fullsized":"2024-08-31T04:04:06.035168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036133+0000","last_change":"2024-08-31T04:04:00.873539+0000","last_active":"2024-08-31T04:04:06.036133+0000","last_peered":"2024-08-31T04:04:06.036133+0000","last_clean":"2024-08-31T04:04:06.036133+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:04:06.036133+0000","last_undegraded":"2024-08-31T04:04:06.036133+0000","last_fullsized":"2024-08-31T04:04:06.036133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:48.946116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904728+0000","last_change":"2024-08-31T04:04:04.972277+0000","last_active":"2024-08-31T04:04:05.904728+0000","last_peered":"2024-08-31T04:04:05.904728+0000","last_clean":"2024-08-31T04:04:05.904728+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:04:05.904728+0000","last_undegraded":"2024-08-31T04:04:05.904728+0000","last_fullsized":"2024-08-31T04:04:05.904728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:25.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035597+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:04:06.035597+0000","last_peered":"2024-08-31T04:04:06.035597+0000","last_clean":"2024-08-31T04:04:06.035597+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:04:06.035597+0000","last_undegraded":"2024-08-31T04:04:06.035597+0000","last_fullsized":"2024-08-31T04:04:06.035597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907747+0000","last_change":"2024-08-31T04:04:00.874519+0000","last_active":"2024-08-31T04:04:05.907747+0000","last_peered":"2024-08-31T04:04:05.907747+0000","last_clean":"2024-08-31T04:04:05.907747+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:04:05.907747+0000","last_undegraded":"2024-08-31T04:04:05.907747+0000","last_fullsized":"2024-08-31T04:04:05.907747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:31.628140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904382+0000","last_change":"2024-08-31T04:04:04.974184+0000","last_active":"2024-08-31T04:04:05.904382+0000","last_peered":"2024-08-31T04:04:05.904382+0000","last_clean":"2024-08-31T04:04:05.904382+0000","last_became_active":"2024-08-31T04:04:04.973794+0000","last_became_peered":"2024-08-31T04:04:04.973794+0000","last_unstale":"2024-08-31T04:04:05.904382+0000","last_undegraded":"2024-08-31T04:04:05.904382+0000","last_fullsized":"2024-08-31T04:04:05.904382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:52.867283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907152+0000","last_change":"2024-08-31T04:04:00.867964+0000","last_active":"2024-08-31T04:04:05.907152+0000","last_peered":"2024-08-31T04:04:05.907152+0000","last_clean":"2024-08-31T04:04:05.907152+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:04:05.907152+0000","last_undegraded":"2024-08-31T04:04:05.907152+0000","last_fullsized":"2024-08-31T04:04:05.907152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:43.911244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906774+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:04:05.906774+0000","last_peered":"2024-08-31T04:04:05.906774+0000","last_clean":"2024-08-31T04:04:05.906774+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:04:05.906774+0000","last_undegraded":"2024-08-31T04:04:05.906774+0000","last_fullsized":"2024-08-31T04:04:05.906774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907485+0000","last_change":"2024-08-31T04:04:04.966791+0000","last_active":"2024-08-31T04:04:05.907485+0000","last_peered":"2024-08-31T04:04:05.907485+0000","last_clean":"2024-08-31T04:04:05.907485+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:04:05.907485+0000","last_undegraded":"2024-08-31T04:04:05.907485+0000","last_fullsized":"2024-08-31T04:04:05.907485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:57.768934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041469+0000","last_change":"2024-08-31T04:04:00.887746+0000","last_active":"2024-08-31T04:04:06.041469+0000","last_peered":"2024-08-31T04:04:06.041469+0000","last_clean":"2024-08-31T04:04:06.041469+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:04:06.041469+0000","last_undegraded":"2024-08-31T04:04:06.041469+0000","last_fullsized":"2024-08-31T04:04:06.041469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:27:35.901081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041029+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:04:06.041029+0000","last_peered":"2024-08-31T04:04:06.041029+0000","last_clean":"2024-08-31T04:04:06.041029+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:04:06.041029+0000","last_undegraded":"2024-08-31T04:04:06.041029+0000","last_fullsized":"2024-08-31T04:04:06.041029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034751+0000","last_change":"2024-08-31T04:04:04.954690+0000","last_active":"2024-08-31T04:04:06.034751+0000","last_peered":"2024-08-31T04:04:06.034751+0000","last_clean":"2024-08-31T04:04:06.034751+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:04:06.034751+0000","last_undegraded":"2024-08-31T04:04:06.034751+0000","last_fullsized":"2024-08-31T04:04:06.034751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:11.009989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904518+0000","last_change":"2024-08-31T04:04:00.896360+0000","last_active":"2024-08-31T04:04:05.904518+0000","last_peered":"2024-08-31T04:04:05.904518+0000","last_clean":"2024-08-31T04:04:05.904518+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:04:05.904518+0000","last_undegraded":"2024-08-31T04:04:05.904518+0000","last_fullsized":"2024-08-31T04:04:05.904518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:04.855778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904586+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:04:05.904586+0000","last_peered":"2024-08-31T04:04:05.904586+0000","last_clean":"2024-08-31T04:04:05.904586+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:04:05.904586+0000","last_undegraded":"2024-08-31T04:04:05.904586+0000","last_fullsized":"2024-08-31T04:04:05.904586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044402+0000","last_change":"2024-08-31T04:04:04.946958+0000","last_active":"2024-08-31T04:04:06.044402+0000","last_peered":"2024-08-31T04:04:06.044402+0000","last_clean":"2024-08-31T04:04:06.044402+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:04:06.044402+0000","last_undegraded":"2024-08-31T04:04:06.044402+0000","last_fullsized":"2024-08-31T04:04:06.044402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:41:42.006072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906335+0000","last_change":"2024-08-31T04:04:00.892688+0000","last_active":"2024-08-31T04:04:05.906335+0000","last_peered":"2024-08-31T04:04:05.906335+0000","last_clean":"2024-08-31T04:04:05.906335+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:04:05.906335+0000","last_undegraded":"2024-08-31T04:04:05.906335+0000","last_fullsized":"2024-08-31T04:04:05.906335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:53.521514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034425+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:04:06.034425+0000","last_peered":"2024-08-31T04:04:06.034425+0000","last_clean":"2024-08-31T04:04:06.034425+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:04:06.034425+0000","last_undegraded":"2024-08-31T04:04:06.034425+0000","last_fullsized":"2024-08-31T04:04:06.034425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905529+0000","last_change":"2024-08-31T04:04:04.936785+0000","last_active":"2024-08-31T04:04:05.905529+0000","last_peered":"2024-08-31T04:04:05.905529+0000","last_clean":"2024-08-31T04:04:05.905529+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:04:05.905529+0000","last_undegraded":"2024-08-31T04:04:05.905529+0000","last_fullsized":"2024-08-31T04:04:05.905529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:28:32.101080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905349+0000","last_change":"2024-08-31T04:04:00.891194+0000","last_active":"2024-08-31T04:04:05.905349+0000","last_peered":"2024-08-31T04:04:05.905349+0000","last_clean":"2024-08-31T04:04:05.905349+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:04:05.905349+0000","last_undegraded":"2024-08-31T04:04:05.905349+0000","last_fullsized":"2024-08-31T04:04:05.905349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:20.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908435+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:04:05.908435+0000","last_peered":"2024-08-31T04:04:05.908435+0000","last_clean":"2024-08-31T04:04:05.908435+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:04:05.908435+0000","last_undegraded":"2024-08-31T04:04:05.908435+0000","last_fullsized":"2024-08-31T04:04:05.908435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904222+0000","last_change":"2024-08-31T04:04:04.947787+0000","last_active":"2024-08-31T04:04:05.904222+0000","last_peered":"2024-08-31T04:04:05.904222+0000","last_clean":"2024-08-31T04:04:05.904222+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:04:05.904222+0000","last_undegraded":"2024-08-31T04:04:05.904222+0000","last_fullsized":"2024-08-31T04:04:05.904222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:40.922656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905481+0000","last_change":"2024-08-31T04:04:00.890893+0000","last_active":"2024-08-31T04:04:05.905481+0000","last_peered":"2024-08-31T04:04:05.905481+0000","last_clean":"2024-08-31T04:04:05.905481+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:04:05.905481+0000","last_undegraded":"2024-08-31T04:04:05.905481+0000","last_fullsized":"2024-08-31T04:04:05.905481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:39:17.163345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905683+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:04:05.905683+0000","last_peered":"2024-08-31T04:04:05.905683+0000","last_clean":"2024-08-31T04:04:05.905683+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:04:05.905683+0000","last_undegraded":"2024-08-31T04:04:05.905683+0000","last_fullsized":"2024-08-31T04:04:05.905683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904211+0000","last_change":"2024-08-31T04:04:04.951050+0000","last_active":"2024-08-31T04:04:05.904211+0000","last_peered":"2024-08-31T04:04:05.904211+0000","last_clean":"2024-08-31T04:04:05.904211+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:04:05.904211+0000","last_undegraded":"2024-08-31T04:04:05.904211+0000","last_fullsized":"2024-08-31T04:04:05.904211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:39.320190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042706+0000","last_change":"2024-08-31T04:04:00.887709+0000","last_active":"2024-08-31T04:04:06.042706+0000","last_peered":"2024-08-31T04:04:06.042706+0000","last_clean":"2024-08-31T04:04:06.042706+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:04:06.042706+0000","last_undegraded":"2024-08-31T04:04:06.042706+0000","last_fullsized":"2024-08-31T04:04:06.042706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:15.464663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908034+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:04:05.908034+0000","last_peered":"2024-08-31T04:04:05.908034+0000","last_clean":"2024-08-31T04:04:05.908034+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:04:05.908034+0000","last_undegraded":"2024-08-31T04:04:05.908034+0000","last_fullsized":"2024-08-31T04:04:05.908034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040767+0000","last_change":"2024-08-31T04:04:04.953273+0000","last_active":"2024-08-31T04:04:06.040767+0000","last_peered":"2024-08-31T04:04:06.040767+0000","last_clean":"2024-08-31T04:04:06.040767+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:04:06.040767+0000","last_undegraded":"2024-08-31T04:04:06.040767+0000","last_fullsized":"2024-08-31T04:04:06.040767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:30.841472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905304+0000","last_change":"2024-08-31T04:04:00.887566+0000","last_active":"2024-08-31T04:04:05.905304+0000","last_peered":"2024-08-31T04:04:05.905304+0000","last_clean":"2024-08-31T04:04:05.905304+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:04:05.905304+0000","last_undegraded":"2024-08-31T04:04:05.905304+0000","last_fullsized":"2024-08-31T04:04:05.905304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:17.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038640+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:04:06.038640+0000","last_peered":"2024-08-31T04:04:06.038640+0000","last_clean":"2024-08-31T04:04:06.038640+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:04:06.038640+0000","last_undegraded":"2024-08-31T04:04:06.038640+0000","last_fullsized":"2024-08-31T04:04:06.038640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040223+0000","last_change":"2024-08-31T04:04:04.975251+0000","last_active":"2024-08-31T04:04:06.040223+0000","last_peered":"2024-08-31T04:04:06.040223+0000","last_clean":"2024-08-31T04:04:06.040223+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:04:06.040223+0000","last_undegraded":"2024-08-31T04:04:06.040223+0000","last_fullsized":"2024-08-31T04:04:06.040223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:12.488672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035080+0000","last_change":"2024-08-31T04:04:00.881311+0000","last_active":"2024-08-31T04:04:06.035080+0000","last_peered":"2024-08-31T04:04:06.035080+0000","last_clean":"2024-08-31T04:04:06.035080+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:04:06.035080+0000","last_undegraded":"2024-08-31T04:04:06.035080+0000","last_fullsized":"2024-08-31T04:04:06.035080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:44.361701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907364+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:04:05.907364+0000","last_peered":"2024-08-31T04:04:05.907364+0000","last_clean":"2024-08-31T04:04:05.907364+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:04:05.907364+0000","last_undegraded":"2024-08-31T04:04:05.907364+0000","last_fullsized":"2024-08-31T04:04:05.907364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042168+0000","last_change":"2024-08-31T04:04:04.954216+0000","last_active":"2024-08-31T04:04:06.042168+0000","last_peered":"2024-08-31T04:04:06.042168+0000","last_clean":"2024-08-31T04:04:06.042168+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:04:06.042168+0000","last_undegraded":"2024-08-31T04:04:06.042168+0000","last_fullsized":"2024-08-31T04:04:06.042168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:04.563322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039679+0000","last_change":"2024-08-31T04:04:00.884692+0000","last_active":"2024-08-31T04:04:06.039679+0000","last_peered":"2024-08-31T04:04:06.039679+0000","last_clean":"2024-08-31T04:04:06.039679+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:04:06.039679+0000","last_undegraded":"2024-08-31T04:04:06.039679+0000","last_fullsized":"2024-08-31T04:04:06.039679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:07:45.274820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037948+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:04:06.037948+0000","last_peered":"2024-08-31T04:04:06.037948+0000","last_clean":"2024-08-31T04:04:06.037948+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:04:06.037948+0000","last_undegraded":"2024-08-31T04:04:06.037948+0000","last_fullsized":"2024-08-31T04:04:06.037948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044165+0000","last_change":"2024-08-31T04:04:04.950642+0000","last_active":"2024-08-31T04:04:06.044165+0000","last_peered":"2024-08-31T04:04:06.044165+0000","last_clean":"2024-08-31T04:04:06.044165+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:04:06.044165+0000","last_undegraded":"2024-08-31T04:04:06.044165+0000","last_fullsized":"2024-08-31T04:04:06.044165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:49.300897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038082+0000","last_change":"2024-08-31T04:04:00.886674+0000","last_active":"2024-08-31T04:04:06.038082+0000","last_peered":"2024-08-31T04:04:06.038082+0000","last_clean":"2024-08-31T04:04:06.038082+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:04:06.038082+0000","last_undegraded":"2024-08-31T04:04:06.038082+0000","last_fullsized":"2024-08-31T04:04:06.038082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:46:28.682868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905953+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:04:05.905953+0000","last_peered":"2024-08-31T04:04:05.905953+0000","last_clean":"2024-08-31T04:04:05.905953+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:04:05.905953+0000","last_undegraded":"2024-08-31T04:04:05.905953+0000","last_fullsized":"2024-08-31T04:04:05.905953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040199+0000","last_change":"2024-08-31T04:04:04.973347+0000","last_active":"2024-08-31T04:04:06.040199+0000","last_peered":"2024-08-31T04:04:06.040199+0000","last_clean":"2024-08-31T04:04:06.040199+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:04:06.040199+0000","last_undegraded":"2024-08-31T04:04:06.040199+0000","last_fullsized":"2024-08-31T04:04:06.040199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:30.204653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904564+0000","last_change":"2024-08-31T04:04:00.896365+0000","last_active":"2024-08-31T04:04:05.904564+0000","last_peered":"2024-08-31T04:04:05.904564+0000","last_clean":"2024-08-31T04:04:05.904564+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:04:05.904564+0000","last_undegraded":"2024-08-31T04:04:05.904564+0000","last_fullsized":"2024-08-31T04:04:05.904564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:39.300217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906837+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:04:05.906837+0000","last_peered":"2024-08-31T04:04:05.906837+0000","last_clean":"2024-08-31T04:04:05.906837+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:04:05.906837+0000","last_undegraded":"2024-08-31T04:04:05.906837+0000","last_fullsized":"2024-08-31T04:04:05.906837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034604+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:04:06.034604+0000","last_peered":"2024-08-31T04:04:06.034604+0000","last_clean":"2024-08-31T04:04:06.034604+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:04:06.034604+0000","last_undegraded":"2024-08-31T04:04:06.034604+0000","last_fullsized":"2024-08-31T04:04:06.034604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907888+0000","last_change":"2024-08-31T04:04:04.922468+0000","last_active":"2024-08-31T04:04:05.907888+0000","last_peered":"2024-08-31T04:04:05.907888+0000","last_clean":"2024-08-31T04:04:05.907888+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:04:05.907888+0000","last_undegraded":"2024-08-31T04:04:05.907888+0000","last_fullsized":"2024-08-31T04:04:05.907888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:15.555948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907801+0000","last_change":"2024-08-31T04:04:00.867024+0000","last_active":"2024-08-31T04:04:05.907801+0000","last_peered":"2024-08-31T04:04:05.907801+0000","last_clean":"2024-08-31T04:04:05.907801+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:04:05.907801+0000","last_undegraded":"2024-08-31T04:04:05.907801+0000","last_fullsized":"2024-08-31T04:04:05.907801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:43.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042885+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:04:06.042885+0000","last_peered":"2024-08-31T04:04:06.042885+0000","last_clean":"2024-08-31T04:04:06.042885+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:04:06.042885+0000","last_undegraded":"2024-08-31T04:04:06.042885+0000","last_fullsized":"2024-08-31T04:04:06.042885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904426+0000","last_change":"2024-08-31T04:04:04.938034+0000","last_active":"2024-08-31T04:04:05.904426+0000","last_peered":"2024-08-31T04:04:05.904426+0000","last_clean":"2024-08-31T04:04:05.904426+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:04:05.904426+0000","last_undegraded":"2024-08-31T04:04:05.904426+0000","last_fullsized":"2024-08-31T04:04:05.904426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:46.961448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035417+0000","last_change":"2024-08-31T04:04:00.883610+0000","last_active":"2024-08-31T04:04:06.035417+0000","last_peered":"2024-08-31T04:04:06.035417+0000","last_clean":"2024-08-31T04:04:06.035417+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:04:06.035417+0000","last_undegraded":"2024-08-31T04:04:06.035417+0000","last_fullsized":"2024-08-31T04:04:06.035417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:29.250924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041581+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:04:06.041581+0000","last_peered":"2024-08-31T04:04:06.041581+0000","last_clean":"2024-08-31T04:04:06.041581+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:04:06.041581+0000","last_undegraded":"2024-08-31T04:04:06.041581+0000","last_fullsized":"2024-08-31T04:04:06.041581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039391+0000","last_change":"2024-08-31T04:04:04.979418+0000","last_active":"2024-08-31T04:04:06.039391+0000","last_peered":"2024-08-31T04:04:06.039391+0000","last_clean":"2024-08-31T04:04:06.039391+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:04:06.039391+0000","last_undegraded":"2024-08-31T04:04:06.039391+0000","last_fullsized":"2024-08-31T04:04:06.039391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:40.023243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035347+0000","last_change":"2024-08-31T04:04:00.874137+0000","last_active":"2024-08-31T04:04:06.035347+0000","last_peered":"2024-08-31T04:04:06.035347+0000","last_clean":"2024-08-31T04:04:06.035347+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:04:06.035347+0000","last_undegraded":"2024-08-31T04:04:06.035347+0000","last_fullsized":"2024-08-31T04:04:06.035347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:44.411622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905534+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:04:05.905534+0000","last_peered":"2024-08-31T04:04:05.905534+0000","last_clean":"2024-08-31T04:04:05.905534+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:04:05.905534+0000","last_undegraded":"2024-08-31T04:04:05.905534+0000","last_fullsized":"2024-08-31T04:04:05.905534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904981+0000","last_change":"2024-08-31T04:04:04.918718+0000","last_active":"2024-08-31T04:04:05.904981+0000","last_peered":"2024-08-31T04:04:05.904981+0000","last_clean":"2024-08-31T04:04:05.904981+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:04:05.904981+0000","last_undegraded":"2024-08-31T04:04:05.904981+0000","last_fullsized":"2024-08-31T04:04:05.904981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:04:40.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905941+0000","last_change":"2024-08-31T04:04:00.877667+0000","last_active":"2024-08-31T04:04:05.905941+0000","last_peered":"2024-08-31T04:04:05.905941+0000","last_clean":"2024-08-31T04:04:05.905941+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:04:05.905941+0000","last_undegraded":"2024-08-31T04:04:05.905941+0000","last_fullsized":"2024-08-31T04:04:05.905941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:06:31.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035613+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:04:06.035613+0000","last_peered":"2024-08-31T04:04:06.035613+0000","last_clean":"2024-08-31T04:04:06.035613+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:04:06.035613+0000","last_undegraded":"2024-08-31T04:04:06.035613+0000","last_fullsized":"2024-08-31T04:04:06.035613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034877+0000","last_change":"2024-08-31T04:04:04.959068+0000","last_active":"2024-08-31T04:04:06.034877+0000","last_peered":"2024-08-31T04:04:06.034877+0000","last_clean":"2024-08-31T04:04:06.034877+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:04:06.034877+0000","last_undegraded":"2024-08-31T04:04:06.034877+0000","last_fullsized":"2024-08-31T04:04:06.034877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:46:16.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906227+0000","last_change":"2024-08-31T04:04:00.864542+0000","last_active":"2024-08-31T04:04:05.906227+0000","last_peered":"2024-08-31T04:04:05.906227+0000","last_clean":"2024-08-31T04:04:05.906227+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:04:05.906227+0000","last_undegraded":"2024-08-31T04:04:05.906227+0000","last_fullsized":"2024-08-31T04:04:05.906227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:47.241152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904710+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:04:05.904710+0000","last_peered":"2024-08-31T04:04:05.904710+0000","last_clean":"2024-08-31T04:04:05.904710+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:04:05.904710+0000","last_undegraded":"2024-08-31T04:04:05.904710+0000","last_fullsized":"2024-08-31T04:04:05.904710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040786+0000","last_change":"2024-08-31T04:04:04.966400+0000","last_active":"2024-08-31T04:04:06.040786+0000","last_peered":"2024-08-31T04:04:06.040786+0000","last_clean":"2024-08-31T04:04:06.040786+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:04:06.040786+0000","last_undegraded":"2024-08-31T04:04:06.040786+0000","last_fullsized":"2024-08-31T04:04:06.040786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:18:16.700443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034482+0000","last_change":"2024-08-31T04:04:00.880127+0000","last_active":"2024-08-31T04:04:06.034482+0000","last_peered":"2024-08-31T04:04:06.034482+0000","last_clean":"2024-08-31T04:04:06.034482+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:04:06.034482+0000","last_undegraded":"2024-08-31T04:04:06.034482+0000","last_fullsized":"2024-08-31T04:04:06.034482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034827+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:04:06.034827+0000","last_peered":"2024-08-31T04:04:06.034827+0000","last_clean":"2024-08-31T04:04:06.034827+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:04:06.034827+0000","last_undegraded":"2024-08-31T04:04:06.034827+0000","last_fullsized":"2024-08-31T04:04:06.034827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040447+0000","last_change":"2024-08-31T04:04:04.971102+0000","last_active":"2024-08-31T04:04:06.040447+0000","last_peered":"2024-08-31T04:04:06.040447+0000","last_clean":"2024-08-31T04:04:06.040447+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:04:06.040447+0000","last_undegraded":"2024-08-31T04:04:06.040447+0000","last_fullsized":"2024-08-31T04:04:06.040447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:40.427017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906629+0000","last_change":"2024-08-31T04:04:00.882328+0000","last_active":"2024-08-31T04:04:05.906629+0000","last_peered":"2024-08-31T04:04:05.906629+0000","last_clean":"2024-08-31T04:04:05.906629+0000","last_became_active":"2024-08-31T04:04:00.882009+0000","last_became_peered":"2024-08-31T04:04:00.882009+0000","last_unstale":"2024-08-31T04:04:05.906629+0000","last_undegraded":"2024-08-31T04:04:05.906629+0000","last_fullsized":"2024-08-31T04:04:05.906629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:10:14.622717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907313+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:04:05.907313+0000","last_peered":"2024-08-31T04:04:05.907313+0000","last_clean":"2024-08-31T04:04:05.907313+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:04:05.907313+0000","last_undegraded":"2024-08-31T04:04:05.907313+0000","last_fullsized":"2024-08-31T04:04:05.907313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041921+0000","last_change":"2024-08-31T04:04:04.964690+0000","last_active":"2024-08-31T04:04:06.041921+0000","last_peered":"2024-08-31T04:04:06.041921+0000","last_clean":"2024-08-31T04:04:06.041921+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:04:06.041921+0000","last_undegraded":"2024-08-31T04:04:06.041921+0000","last_fullsized":"2024-08-31T04:04:06.041921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:23.711105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040884+0000","last_change":"2024-08-31T04:04:00.887168+0000","last_active":"2024-08-31T04:04:06.040884+0000","last_peered":"2024-08-31T04:04:06.040884+0000","last_clean":"2024-08-31T04:04:06.040884+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:04:06.040884+0000","last_undegraded":"2024-08-31T04:04:06.040884+0000","last_fullsized":"2024-08-31T04:04:06.040884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:58.272934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043729+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:04:06.043729+0000","last_peered":"2024-08-31T04:04:06.043729+0000","last_clean":"2024-08-31T04:04:06.043729+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:04:06.043729+0000","last_undegraded":"2024-08-31T04:04:06.043729+0000","last_fullsized":"2024-08-31T04:04:06.043729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907657+0000","last_change":"2024-08-31T04:04:04.967183+0000","last_active":"2024-08-31T04:04:05.907657+0000","last_peered":"2024-08-31T04:04:05.907657+0000","last_clean":"2024-08-31T04:04:05.907657+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:04:05.907657+0000","last_undegraded":"2024-08-31T04:04:05.907657+0000","last_fullsized":"2024-08-31T04:04:05.907657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:54.094714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034962+0000","last_change":"2024-08-31T04:04:00.886779+0000","last_active":"2024-08-31T04:04:06.034962+0000","last_peered":"2024-08-31T04:04:06.034962+0000","last_clean":"2024-08-31T04:04:06.034962+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:04:06.034962+0000","last_undegraded":"2024-08-31T04:04:06.034962+0000","last_fullsized":"2024-08-31T04:04:06.034962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:45:51.487016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:14.844048+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:04:14.844048+0000","last_peered":"2024-08-31T04:04:14.844048+0000","last_clean":"2024-08-31T04:04:14.844048+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:04:14.844048+0000","last_undegraded":"2024-08-31T04:04:14.844048+0000","last_fullsized":"2024-08-31T04:04:14.844048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904234+0000","last_change":"2024-08-31T04:04:04.960945+0000","last_active":"2024-08-31T04:04:05.904234+0000","last_peered":"2024-08-31T04:04:05.904234+0000","last_clean":"2024-08-31T04:04:05.904234+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:04:05.904234+0000","last_undegraded":"2024-08-31T04:04:05.904234+0000","last_fullsized":"2024-08-31T04:04:05.904234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:50.907644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906484+0000","last_change":"2024-08-31T04:04:00.869565+0000","last_active":"2024-08-31T04:04:05.906484+0000","last_peered":"2024-08-31T04:04:05.906484+0000","last_clean":"2024-08-31T04:04:05.906484+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:04:05.906484+0000","last_undegraded":"2024-08-31T04:04:05.906484+0000","last_fullsized":"2024-08-31T04:04:05.906484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:37.334753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043126+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:04:06.043126+0000","last_peered":"2024-08-31T04:04:06.043126+0000","last_clean":"2024-08-31T04:04:06.043126+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:04:06.043126+0000","last_undegraded":"2024-08-31T04:04:06.043126+0000","last_fullsized":"2024-08-31T04:04:06.043126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904892+0000","last_change":"2024-08-31T04:04:04.940655+0000","last_active":"2024-08-31T04:04:05.904892+0000","last_peered":"2024-08-31T04:04:05.904892+0000","last_clean":"2024-08-31T04:04:05.904892+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:04:05.904892+0000","last_undegraded":"2024-08-31T04:04:05.904892+0000","last_fullsized":"2024-08-31T04:04:05.904892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:12:39.145645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040892+0000","last_change":"2024-08-31T04:04:00.881774+0000","last_active":"2024-08-31T04:04:06.040892+0000","last_peered":"2024-08-31T04:04:06.040892+0000","last_clean":"2024-08-31T04:04:06.040892+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:04:06.040892+0000","last_undegraded":"2024-08-31T04:04:06.040892+0000","last_fullsized":"2024-08-31T04:04:06.040892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:19.539642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034980+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:04:06.034980+0000","last_peered":"2024-08-31T04:04:06.034980+0000","last_clean":"2024-08-31T04:04:06.034980+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:04:06.034980+0000","last_undegraded":"2024-08-31T04:04:06.034980+0000","last_fullsized":"2024-08-31T04:04:06.034980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037542+0000","last_change":"2024-08-31T04:04:04.948582+0000","last_active":"2024-08-31T04:04:06.037542+0000","last_peered":"2024-08-31T04:04:06.037542+0000","last_clean":"2024-08-31T04:04:06.037542+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:04:06.037542+0000","last_undegraded":"2024-08-31T04:04:06.037542+0000","last_fullsized":"2024-08-31T04:04:06.037542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:35.294731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905846+0000","last_change":"2024-08-31T04:04:00.863199+0000","last_active":"2024-08-31T04:04:05.905846+0000","last_peered":"2024-08-31T04:04:05.905846+0000","last_clean":"2024-08-31T04:04:05.905846+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:04:05.905846+0000","last_undegraded":"2024-08-31T04:04:05.905846+0000","last_fullsized":"2024-08-31T04:04:05.905846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:52.086202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036024+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:04:06.036024+0000","last_peered":"2024-08-31T04:04:06.036024+0000","last_clean":"2024-08-31T04:04:06.036024+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:04:06.036024+0000","last_undegraded":"2024-08-31T04:04:06.036024+0000","last_fullsized":"2024-08-31T04:04:06.036024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904421+0000","last_change":"2024-08-31T04:04:04.940930+0000","last_active":"2024-08-31T04:04:05.904421+0000","last_peered":"2024-08-31T04:04:05.904421+0000","last_clean":"2024-08-31T04:04:05.904421+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:04:05.904421+0000","last_undegraded":"2024-08-31T04:04:05.904421+0000","last_fullsized":"2024-08-31T04:04:05.904421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:07:30.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905335+0000","last_change":"2024-08-31T04:04:04.970283+0000","last_active":"2024-08-31T04:04:05.905335+0000","last_peered":"2024-08-31T04:04:05.905335+0000","last_clean":"2024-08-31T04:04:05.905335+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:04:05.905335+0000","last_undegraded":"2024-08-31T04:04:05.905335+0000","last_fullsized":"2024-08-31T04:04:05.905335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:37.086560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904353+0000","last_change":"2024-08-31T04:04:00.897277+0000","last_active":"2024-08-31T04:04:05.904353+0000","last_peered":"2024-08-31T04:04:05.904353+0000","last_clean":"2024-08-31T04:04:05.904353+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:04:05.904353+0000","last_undegraded":"2024-08-31T04:04:05.904353+0000","last_fullsized":"2024-08-31T04:04:05.904353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:45:42.808934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905834+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:04:05.905834+0000","last_peered":"2024-08-31T04:04:05.905834+0000","last_clean":"2024-08-31T04:04:05.905834+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:04:05.905834+0000","last_undegraded":"2024-08-31T04:04:05.905834+0000","last_fullsized":"2024-08-31T04:04:05.905834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906316+0000","last_change":"2024-08-31T04:04:04.966233+0000","last_active":"2024-08-31T04:04:05.906316+0000","last_peered":"2024-08-31T04:04:05.906316+0000","last_clean":"2024-08-31T04:04:05.906316+0000","last_became_active":"2024-08-31T04:04:04.965854+0000","last_became_peered":"2024-08-31T04:04:04.965854+0000","last_unstale":"2024-08-31T04:04:05.906316+0000","last_undegraded":"2024-08-31T04:04:05.906316+0000","last_fullsized":"2024-08-31T04:04:05.906316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:16.448331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040110+0000","last_change":"2024-08-31T04:04:00.888009+0000","last_active":"2024-08-31T04:04:06.040110+0000","last_peered":"2024-08-31T04:04:06.040110+0000","last_clean":"2024-08-31T04:04:06.040110+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:04:06.040110+0000","last_undegraded":"2024-08-31T04:04:06.040110+0000","last_fullsized":"2024-08-31T04:04:06.040110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:31.977791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038384+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:04:06.038384+0000","last_peered":"2024-08-31T04:04:06.038384+0000","last_clean":"2024-08-31T04:04:06.038384+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:04:06.038384+0000","last_undegraded":"2024-08-31T04:04:06.038384+0000","last_fullsized":"2024-08-31T04:04:06.038384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907256+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:04:05.907256+0000","last_peered":"2024-08-31T04:04:05.907256+0000","last_clean":"2024-08-31T04:04:05.907256+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:04:05.907256+0000","last_undegraded":"2024-08-31T04:04:05.907256+0000","last_fullsized":"2024-08-31T04:04:05.907256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904794+0000","last_change":"2024-08-31T04:04:00.897537+0000","last_active":"2024-08-31T04:04:05.904794+0000","last_peered":"2024-08-31T04:04:05.904794+0000","last_clean":"2024-08-31T04:04:05.904794+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:04:05.904794+0000","last_undegraded":"2024-08-31T04:04:05.904794+0000","last_fullsized":"2024-08-31T04:04:05.904794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:46.422487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905083+0000","last_change":"2024-08-31T04:04:04.961002+0000","last_active":"2024-08-31T04:04:05.905083+0000","last_peered":"2024-08-31T04:04:05.905083+0000","last_clean":"2024-08-31T04:04:05.905083+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:04:05.905083+0000","last_undegraded":"2024-08-31T04:04:05.905083+0000","last_fullsized":"2024-08-31T04:04:05.905083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:45:04.605970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039694+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:04:06.039694+0000","last_peered":"2024-08-31T04:04:06.039694+0000","last_clean":"2024-08-31T04:04:06.039694+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:04:06.039694+0000","last_undegraded":"2024-08-31T04:04:06.039694+0000","last_fullsized":"2024-08-31T04:04:06.039694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035174+0000","last_change":"2024-08-31T04:04:00.878599+0000","last_active":"2024-08-31T04:04:06.035174+0000","last_peered":"2024-08-31T04:04:06.035174+0000","last_clean":"2024-08-31T04:04:06.035174+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:04:06.035174+0000","last_undegraded":"2024-08-31T04:04:06.035174+0000","last_fullsized":"2024-08-31T04:04:06.035174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:37.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043082+0000","last_change":"2024-08-31T04:04:04.975414+0000","last_active":"2024-08-31T04:04:06.043082+0000","last_peered":"2024-08-31T04:04:06.043082+0000","last_clean":"2024-08-31T04:04:06.043082+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:04:06.043082+0000","last_undegraded":"2024-08-31T04:04:06.043082+0000","last_fullsized":"2024-08-31T04:04:06.043082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:12.992949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904092+0000","last_change":"2024-08-31T04:04:00.887117+0000","last_active":"2024-08-31T04:04:05.904092+0000","last_peered":"2024-08-31T04:04:05.904092+0000","last_clean":"2024-08-31T04:04:05.904092+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:04:05.904092+0000","last_undegraded":"2024-08-31T04:04:05.904092+0000","last_fullsized":"2024-08-31T04:04:05.904092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:18:37.474694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037663+0000","last_change":"2024-08-31T04:04:00.881033+0000","last_active":"2024-08-31T04:04:06.037663+0000","last_peered":"2024-08-31T04:04:06.037663+0000","last_clean":"2024-08-31T04:04:06.037663+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:04:06.037663+0000","last_undegraded":"2024-08-31T04:04:06.037663+0000","last_fullsized":"2024-08-31T04:04:06.037663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:46.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907098+0000","last_change":"2024-08-31T04:04:00.879791+0000","last_active":"2024-08-31T04:04:05.907098+0000","last_peered":"2024-08-31T04:04:05.907098+0000","last_clean":"2024-08-31T04:04:05.907098+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:04:05.907098+0000","last_undegraded":"2024-08-31T04:04:05.907098+0000","last_fullsized":"2024-08-31T04:04:05.907098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:00:26.128387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039321+0000","last_change":"2024-08-31T04:04:00.876487+0000","last_active":"2024-08-31T04:04:06.039321+0000","last_peered":"2024-08-31T04:04:06.039321+0000","last_clean":"2024-08-31T04:04:06.039321+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:04:06.039321+0000","last_undegraded":"2024-08-31T04:04:06.039321+0000","last_fullsized":"2024-08-31T04:04:06.039321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:10.867317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042600+0000","last_change":"2024-08-31T04:04:00.888017+0000","last_active":"2024-08-31T04:04:06.042600+0000","last_peered":"2024-08-31T04:04:06.042600+0000","last_clean":"2024-08-31T04:04:06.042600+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:04:06.042600+0000","last_undegraded":"2024-08-31T04:04:06.042600+0000","last_fullsized":"2024-08-31T04:04:06.042600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:53.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042480+0000","last_change":"2024-08-31T04:04:00.885850+0000","last_active":"2024-08-31T04:04:06.042480+0000","last_peered":"2024-08-31T04:04:06.042480+0000","last_clean":"2024-08-31T04:04:06.042480+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:04:06.042480+0000","last_undegraded":"2024-08-31T04:04:06.042480+0000","last_fullsized":"2024-08-31T04:04:06.042480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:07.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905742+0000","last_change":"2024-08-31T04:04:00.870086+0000","last_active":"2024-08-31T04:04:05.905742+0000","last_peered":"2024-08-31T04:04:05.905742+0000","last_clean":"2024-08-31T04:04:05.905742+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:04:05.905742+0000","last_undegraded":"2024-08-31T04:04:05.905742+0000","last_fullsized":"2024-08-31T04:04:05.905742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:59.724104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040115+0000","last_change":"2024-08-31T04:04:00.881124+0000","last_active":"2024-08-31T04:04:06.040115+0000","last_peered":"2024-08-31T04:04:06.040115+0000","last_clean":"2024-08-31T04:04:06.040115+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:04:06.040115+0000","last_undegraded":"2024-08-31T04:04:06.040115+0000","last_fullsized":"2024-08-31T04:04:06.040115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:40.389131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905727+0000","last_change":"2024-08-31T04:04:00.880040+0000","last_active":"2024-08-31T04:04:05.905727+0000","last_peered":"2024-08-31T04:04:05.905727+0000","last_clean":"2024-08-31T04:04:05.905727+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:04:05.905727+0000","last_undegraded":"2024-08-31T04:04:05.905727+0000","last_fullsized":"2024-08-31T04:04:05.905727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:23.110254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039483+0000","last_change":"2024-08-31T04:04:00.867373+0000","last_active":"2024-08-31T04:04:06.039483+0000","last_peered":"2024-08-31T04:04:06.039483+0000","last_clean":"2024-08-31T04:04:06.039483+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:04:06.039483+0000","last_undegraded":"2024-08-31T04:04:06.039483+0000","last_fullsized":"2024-08-31T04:04:06.039483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:47.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035293+0000","last_change":"2024-08-31T04:04:00.884497+0000","last_active":"2024-08-31T04:04:06.035293+0000","last_peered":"2024-08-31T04:04:06.035293+0000","last_clean":"2024-08-31T04:04:06.035293+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:04:06.035293+0000","last_undegraded":"2024-08-31T04:04:06.035293+0000","last_fullsized":"2024-08-31T04:04:06.035293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:10.005789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904753+0000","last_change":"2024-08-31T04:04:00.899676+0000","last_active":"2024-08-31T04:04:05.904753+0000","last_peered":"2024-08-31T04:04:05.904753+0000","last_clean":"2024-08-31T04:04:05.904753+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:04:05.904753+0000","last_undegraded":"2024-08-31T04:04:05.904753+0000","last_fullsized":"2024-08-31T04:04:05.904753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:46.887325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035316+0000","last_change":"2024-08-31T04:04:00.872910+0000","last_active":"2024-08-31T04:04:06.035316+0000","last_peered":"2024-08-31T04:04:06.035316+0000","last_clean":"2024-08-31T04:04:06.035316+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:04:06.035316+0000","last_undegraded":"2024-08-31T04:04:06.035316+0000","last_fullsized":"2024-08-31T04:04:06.035316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:22.208293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907979+0000","last_change":"2024-08-31T04:04:00.897114+0000","last_active":"2024-08-31T04:04:05.907979+0000","last_peered":"2024-08-31T04:04:05.907979+0000","last_clean":"2024-08-31T04:04:05.907979+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:04:05.907979+0000","last_undegraded":"2024-08-31T04:04:05.907979+0000","last_fullsized":"2024-08-31T04:04:05.907979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:13.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044036+0000","last_change":"2024-08-31T04:04:00.879907+0000","last_active":"2024-08-31T04:04:06.044036+0000","last_peered":"2024-08-31T04:04:06.044036+0000","last_clean":"2024-08-31T04:04:06.044036+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:04:06.044036+0000","last_undegraded":"2024-08-31T04:04:06.044036+0000","last_fullsized":"2024-08-31T04:04:06.044036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:11.042911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908418+0000","last_change":"2024-08-31T04:04:00.874247+0000","last_active":"2024-08-31T04:04:05.908418+0000","last_peered":"2024-08-31T04:04:05.908418+0000","last_clean":"2024-08-31T04:04:05.908418+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:04:05.908418+0000","last_undegraded":"2024-08-31T04:04:05.908418+0000","last_fullsized":"2024-08-31T04:04:05.908418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:00.974919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905612+0000","last_change":"2024-08-31T04:04:00.861922+0000","last_active":"2024-08-31T04:04:05.905612+0000","last_peered":"2024-08-31T04:04:05.905612+0000","last_clean":"2024-08-31T04:04:05.905612+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:04:05.905612+0000","last_undegraded":"2024-08-31T04:04:05.905612+0000","last_fullsized":"2024-08-31T04:04:05.905612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:07.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038950+0000","last_change":"2024-08-31T04:04:00.873986+0000","last_active":"2024-08-31T04:04:06.038950+0000","last_peered":"2024-08-31T04:04:06.038950+0000","last_clean":"2024-08-31T04:04:06.038950+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:04:06.038950+0000","last_undegraded":"2024-08-31T04:04:06.038950+0000","last_fullsized":"2024-08-31T04:04:06.038950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:39.934600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040728+0000","last_change":"2024-08-31T04:04:00.887510+0000","last_active":"2024-08-31T04:04:06.040728+0000","last_peered":"2024-08-31T04:04:06.040728+0000","last_clean":"2024-08-31T04:04:06.040728+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:04:06.040728+0000","last_undegraded":"2024-08-31T04:04:06.040728+0000","last_fullsized":"2024-08-31T04:04:06.040728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:29.689714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041269+0000","last_change":"2024-08-31T04:04:00.886364+0000","last_active":"2024-08-31T04:04:06.041269+0000","last_peered":"2024-08-31T04:04:06.041269+0000","last_clean":"2024-08-31T04:04:06.041269+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:04:06.041269+0000","last_undegraded":"2024-08-31T04:04:06.041269+0000","last_fullsized":"2024-08-31T04:04:06.041269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:17.949115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035208+0000","last_change":"2024-08-31T04:04:00.885452+0000","last_active":"2024-08-31T04:04:06.035208+0000","last_peered":"2024-08-31T04:04:06.035208+0000","last_clean":"2024-08-31T04:04:06.035208+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:04:06.035208+0000","last_undegraded":"2024-08-31T04:04:06.035208+0000","last_fullsized":"2024-08-31T04:04:06.035208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:34:58.727576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035971+0000","last_change":"2024-08-31T04:04:00.876816+0000","last_active":"2024-08-31T04:04:06.035971+0000","last_peered":"2024-08-31T04:04:06.035971+0000","last_clean":"2024-08-31T04:04:06.035971+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:04:06.035971+0000","last_undegraded":"2024-08-31T04:04:06.035971+0000","last_fullsized":"2024-08-31T04:04:06.035971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:38.896525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034790+0000","last_change":"2024-08-31T04:04:00.878584+0000","last_active":"2024-08-31T04:04:06.034790+0000","last_peered":"2024-08-31T04:04:06.034790+0000","last_clean":"2024-08-31T04:04:06.034790+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:04:06.034790+0000","last_undegraded":"2024-08-31T04:04:06.034790+0000","last_fullsized":"2024-08-31T04:04:06.034790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:30.201712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035980+0000","last_change":"2024-08-31T04:04:00.866007+0000","last_active":"2024-08-31T04:04:06.035980+0000","last_peered":"2024-08-31T04:04:06.035980+0000","last_clean":"2024-08-31T04:04:06.035980+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:04:06.035980+0000","last_undegraded":"2024-08-31T04:04:06.035980+0000","last_fullsized":"2024-08-31T04:04:06.035980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:05.236271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039665+0000","last_change":"2024-08-31T04:04:00.882356+0000","last_active":"2024-08-31T04:04:06.039665+0000","last_peered":"2024-08-31T04:04:06.039665+0000","last_clean":"2024-08-31T04:04:06.039665+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:04:06.039665+0000","last_undegraded":"2024-08-31T04:04:06.039665+0000","last_fullsized":"2024-08-31T04:04:06.039665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:44:37.026732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034726+0000","last_change":"2024-08-31T04:04:00.897170+0000","last_active":"2024-08-31T04:04:06.034726+0000","last_peered":"2024-08-31T04:04:06.034726+0000","last_clean":"2024-08-31T04:04:06.034726+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:04:06.034726+0000","last_undegraded":"2024-08-31T04:04:06.034726+0000","last_fullsized":"2024-08-31T04:04:06.034726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:05.673647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904588+0000","last_change":"2024-08-31T04:04:00.897956+0000","last_active":"2024-08-31T04:04:05.904588+0000","last_peered":"2024-08-31T04:04:05.904588+0000","last_clean":"2024-08-31T04:04:05.904588+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:04:05.904588+0000","last_undegraded":"2024-08-31T04:04:05.904588+0000","last_fullsized":"2024-08-31T04:04:05.904588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.686037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035844+0000","last_change":"2024-08-31T04:04:00.883315+0000","last_active":"2024-08-31T04:04:06.035844+0000","last_peered":"2024-08-31T04:04:06.035844+0000","last_clean":"2024-08-31T04:04:06.035844+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:04:06.035844+0000","last_undegraded":"2024-08-31T04:04:06.035844+0000","last_fullsized":"2024-08-31T04:04:06.035844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:41.258604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904958+0000","last_change":"2024-08-31T04:04:00.892502+0000","last_active":"2024-08-31T04:04:05.904958+0000","last_peered":"2024-08-31T04:04:05.904958+0000","last_clean":"2024-08-31T04:04:05.904958+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:04:05.904958+0000","last_undegraded":"2024-08-31T04:04:05.904958+0000","last_fullsized":"2024-08-31T04:04:05.904958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:04:48.381328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041280+0000","last_change":"2024-08-31T04:04:00.892994+0000","last_active":"2024-08-31T04:04:06.041280+0000","last_peered":"2024-08-31T04:04:06.041280+0000","last_clean":"2024-08-31T04:04:06.041280+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:04:06.041280+0000","last_undegraded":"2024-08-31T04:04:06.041280+0000","last_fullsized":"2024-08-31T04:04:06.041280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:00.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040294+0000","last_change":"2024-08-31T04:04:00.887325+0000","last_active":"2024-08-31T04:04:06.040294+0000","last_peered":"2024-08-31T04:04:06.040294+0000","last_clean":"2024-08-31T04:04:06.040294+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:04:06.040294+0000","last_undegraded":"2024-08-31T04:04:06.040294+0000","last_fullsized":"2024-08-31T04:04:06.040294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:15.674452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035235+0000","last_change":"2024-08-31T04:04:00.881745+0000","last_active":"2024-08-31T04:04:06.035235+0000","last_peered":"2024-08-31T04:04:06.035235+0000","last_clean":"2024-08-31T04:04:06.035235+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:04:06.035235+0000","last_undegraded":"2024-08-31T04:04:06.035235+0000","last_fullsized":"2024-08-31T04:04:06.035235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:01.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476747,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":105356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476747,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476748,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476748,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":104830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":868352,"data_stored":695234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35624,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336216,"statfs":{"total":96636764160,"available":96600285184,"internally_reserved":0,"allocated":286720,"data_stored":109288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":104898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:04:32.122 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-31T04:04:32.122 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T04:04:32.122 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-31T04:04:32.123 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.312+0000 7f8d1e600640 1 -- 172.21.15.89:0/4045212652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d180c97e0 msgr2=0x7f8d18156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.312+0000 7f8d1e600640 1 --2- 172.21.15.89:0/4045212652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d180c97e0 0x7f8d18156b70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009900 tx=0x7f8d0801c8e0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.312+0000 7f8d1e600640 1 -- 172.21.15.89:0/4045212652 shutdown_connections 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.312+0000 7f8d1e600640 1 --2- 172.21.15.89:0/4045212652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d180c97e0 0x7f8d18156b70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.312+0000 7f8d1e600640 1 -- 172.21.15.89:0/4045212652 >> 172.21.15.89:0/4045212652 conn(0x7f8d18071be0 msgr2=0x7f8d1806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.312+0000 7f8d1e600640 1 -- 172.21.15.89:0/4045212652 shutdown_connections 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.312+0000 7f8d1e600640 1 -- 172.21.15.89:0/4045212652 wait complete. 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.312+0000 7f8d1e600640 1 Processor -- start 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.312+0000 7f8d1e600640 1 -- start start 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d1e600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d180c97e0 0x7f8d18151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d1e600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d18159f60 0x7f8d18158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d1e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1815a370 0x7f8d18153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d1e600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8d181570b0 con 0x7f8d18159f60 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d1e600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d18159ad0 con 0x7f8d1815a370 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d1e600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8d181596f0 con 0x7f8d180c97e0 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0ea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d18159f60 0x7f8d18158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0ea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d18159f60 0x7f8d18158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50376/0 (socket says 172.21.15.89:50376) 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0ea00640 1 -- 172.21.15.89:0/2088744754 learned_addr learned my addr 172.21.15.89:0/2088744754 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d17e00640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1815a370 0x7f8d18153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d17400640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d180c97e0 0x7f8d18151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0ea00640 1 -- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d180c97e0 msgr2=0x7f8d18151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0ea00640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d180c97e0 0x7f8d18151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0ea00640 1 -- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1815a370 msgr2=0x7f8d18153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0ea00640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1815a370 0x7f8d18153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0ea00640 1 -- 172.21.15.89:0/2088744754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d181f9000 con 0x7f8d18159f60 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0ea00640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d18159f60 0x7f8d18158d70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000c3c0 tx=0x7f8d0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0fe00640 1 -- 172.21.15.89:0/2088744754 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00017070 con 0x7f8d18159f60 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0fe00640 1 -- 172.21.15.89:0/2088744754 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d000053c0 con 0x7f8d18159f60 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d0fe00640 1 -- 172.21.15.89:0/2088744754 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00003860 con 0x7f8d18159f60 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1806e610 con 0x7f8d18159f60 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1806f5d0 con 0x7f8d18159f60 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.316+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d180c5d30 con 0x7f8d18159f60 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.320+0000 7f8d0fe00640 1 -- 172.21.15.89:0/2088744754 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8d0001a070 con 0x7f8d18159f60 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.320+0000 7f8d0fe00640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8cf40720f0 0x7f8cf4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.320+0000 7f8d0fe00640 1 -- 172.21.15.89:0/2088744754 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8d000921b0 con 0x7f8d18159f60 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.320+0000 7f8d17400640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8cf40720f0 0x7f8cf4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.320+0000 7f8d17400640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8cf40720f0 0x7f8cf4074600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d080af000 tx=0x7f8d0801b120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.324+0000 7f8d0fe00640 1 -- 172.21.15.89:0/2088744754 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8d0005d7b0 con 0x7f8d18159f60 2024-08-31T04:04:32.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.524+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8d180cbdd0 con 0x7f8d18159f60 2024-08-31T04:04:32.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.524+0000 7f8d0fe00640 1 -- 172.21.15.89:0/2088744754 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8d0005d0b0 con 0x7f8d18159f60 2024-08-31T04:04:32.527 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:32.527 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T04:04:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8cf40720f0 msgr2=0x7f8cf4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8cf40720f0 0x7f8cf4074600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8d080af000 tx=0x7f8d0801b120 comp rx=0 tx=0).stop 2024-08-31T04:04:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d18159f60 msgr2=0x7f8d18158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d18159f60 0x7f8d18158d70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000c3c0 tx=0x7f8d0000c880 comp rx=0 tx=0).stop 2024-08-31T04:04:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 shutdown_connections 2024-08-31T04:04:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8cf40720f0 0x7f8cf4074600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d18159f60 0x7f8d18158d70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1815a370 0x7f8d18153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 --2- 172.21.15.89:0/2088744754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d180c97e0 0x7f8d18151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 >> 172.21.15.89:0/2088744754 conn(0x7f8d18071be0 msgr2=0x7f8d18155870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:32.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 shutdown_connections 2024-08-31T04:04:32.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.528+0000 7f8d1e600640 1 -- 172.21.15.89:0/2088744754 wait complete. 2024-08-31T04:04:32.549 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-31T04:04:32.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.700+0000 7efd65400640 1 -- 172.21.15.89:0/3037534232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd44003a10 msgr2=0x7efd44003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.700+0000 7efd65400640 1 --2- 172.21.15.89:0/3037534232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd44003a10 0x7efd44003e80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c640 tx=0x7efd5001faf0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.700+0000 7efd5f200640 1 -- 172.21.15.89:0/3037534232 reap_dead start 2024-08-31T04:04:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.700+0000 7efd65400640 1 -- 172.21.15.89:0/3037534232 shutdown_connections 2024-08-31T04:04:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.700+0000 7efd65400640 1 -- 172.21.15.89:0/3037534232 >> 172.21.15.89:0/3037534232 conn(0x7efd600ccf20 msgr2=0x7efd600cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.700+0000 7efd65400640 1 -- 172.21.15.89:0/3037534232 shutdown_connections 2024-08-31T04:04:32.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.700+0000 7efd65400640 1 -- 172.21.15.89:0/3037534232 wait complete. 2024-08-31T04:04:32.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 Processor -- start 2024-08-31T04:04:32.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 -- start start 2024-08-31T04:04:32.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd44003a10 0x7efd601f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd600c4b50 0x7efd6015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd601e4ee0 0x7efd6014f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efd600c8030 con 0x7efd600c4b50 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efd600c3150 con 0x7efd601e4ee0 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efd60152a10 con 0x7efd44003a10 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd600c4b50 0x7efd6015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd600c4b50 0x7efd6015a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50404/0 (socket says 172.21.15.89:50404) 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5de00640 1 -- 172.21.15.89:0/140439426 learned_addr learned my addr 172.21.15.89:0/140439426 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5e800640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd44003a10 0x7efd601f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5f200640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd601e4ee0 0x7efd6014f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:32.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5de00640 1 -- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd44003a10 msgr2=0x7efd601f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5de00640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd44003a10 0x7efd601f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5de00640 1 -- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd601e4ee0 msgr2=0x7efd6014f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5de00640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd601e4ee0 0x7efd6014f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5de00640 1 -- 172.21.15.89:0/140439426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd600c9740 con 0x7efd600c4b50 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5e800640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd44003a10 0x7efd601f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd5de00640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd600c4b50 0x7efd6015a180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efd4c011810 tx=0x7efd4c011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd56a00640 1 -- 172.21.15.89:0/140439426 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c004460 con 0x7efd600c4b50 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd56a00640 1 -- 172.21.15.89:0/140439426 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd4c016070 con 0x7efd600c4b50 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd600c4f60 con 0x7efd600c4b50 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd56a00640 1 -- 172.21.15.89:0/140439426 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c00fba0 con 0x7efd600c4b50 2024-08-31T04:04:32.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.704+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd6015b900 con 0x7efd600c4b50 2024-08-31T04:04:32.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.708+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd601f5110 con 0x7efd600c4b50 2024-08-31T04:04:32.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.708+0000 7efd56a00640 1 -- 172.21.15.89:0/140439426 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7efd4c018030 con 0x7efd600c4b50 2024-08-31T04:04:32.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.708+0000 7efd56a00640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd400720c0 0x7efd400745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:32.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.708+0000 7efd56a00640 1 -- 172.21.15.89:0/140439426 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efd4c093850 con 0x7efd600c4b50 2024-08-31T04:04:32.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.708+0000 7efd5e800640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd400720c0 0x7efd400745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:32.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.712+0000 7efd5e800640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd400720c0 0x7efd400745d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd500af000 tx=0x7efd5001c930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:32.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.716+0000 7efd56a00640 1 -- 172.21.15.89:0/140439426 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7efd600c4f60 con 0x7efd600c4b50 2024-08-31T04:04:32.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd600c7920 con 0x7efd600c4b50 2024-08-31T04:04:32.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd56a00640 1 -- 172.21.15.89:0/140439426 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7efd4c05ed30 con 0x7efd600c4b50 2024-08-31T04:04:32.922 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:32.922 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:32.922 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd400720c0 msgr2=0x7efd400745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd400720c0 0x7efd400745d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd500af000 tx=0x7efd5001c930 comp rx=0 tx=0).stop 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd600c4b50 msgr2=0x7efd6015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd600c4b50 0x7efd6015a180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efd4c011810 tx=0x7efd4c011cd0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 shutdown_connections 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efd400720c0 0x7efd400745d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd600c4b50 0x7efd6015a180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd601e4ee0 0x7efd6014f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 --2- 172.21.15.89:0/140439426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efd44003a10 0x7efd601f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:32.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 >> 172.21.15.89:0/140439426 conn(0x7efd600ccf20 msgr2=0x7efd600cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:32.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 shutdown_connections 2024-08-31T04:04:32.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:32.920+0000 7efd65400640 1 -- 172.21.15.89:0/140439426 wait complete. 2024-08-31T04:04:32.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:33.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.096+0000 7f67e5a00640 1 -- 172.21.15.89:0/2615104061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 msgr2=0x7f67e0152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.096+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2615104061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 0x7f67e0152a10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67e0073250 tx=0x7f67d001f0b0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.096+0000 7f67e5a00640 1 -- 172.21.15.89:0/2615104061 shutdown_connections 2024-08-31T04:04:33.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.096+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2615104061 >> v2:172.21.15.170:3300/0 conn(0x7f67e00c7920 0x7f67e00c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.096+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2615104061 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67e00c1f40 0x7f67e00c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.096+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2615104061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 0x7f67e0152a10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.096+0000 7f67e5a00640 1 -- 172.21.15.89:0/2615104061 >> 172.21.15.89:0/2615104061 conn(0x7f67e00ccf20 msgr2=0x7f67e00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:33.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.096+0000 7f67e5a00640 1 -- 172.21.15.89:0/2615104061 shutdown_connections 2024-08-31T04:04:33.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.096+0000 7f67e5a00640 1 -- 172.21.15.89:0/2615104061 wait complete. 2024-08-31T04:04:33.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 Processor -- start 2024-08-31T04:04:33.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 -- start start 2024-08-31T04:04:33.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67e00c1f40 0x7f67e0156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67e00c7920 0x7f67e00b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 0x7f67e0150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67e00748a0 con 0x7f67e015bc70 2024-08-31T04:04:33.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f67e0074720 con 0x7f67e00c1f40 2024-08-31T04:04:33.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f67e0074a20 con 0x7f67e00c7920 2024-08-31T04:04:33.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67df400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 0x7f67e0150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67df400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 0x7f67e0150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50416/0 (socket says 172.21.15.89:50416) 2024-08-31T04:04:33.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67df400640 1 -- 172.21.15.89:0/2995619856 learned_addr learned my addr 172.21.15.89:0/2995619856 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:33.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67d6000640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67e00c7920 0x7f67e00b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67dea00640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67e00c1f40 0x7f67e0156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67df400640 1 -- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67e00c7920 msgr2=0x7f67e00b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67df400640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67e00c7920 0x7f67e00b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67df400640 1 -- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67e00c1f40 msgr2=0x7f67e0156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67df400640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67e00c1f40 0x7f67e0156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67df400640 1 -- 172.21.15.89:0/2995619856 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e00b1760 con 0x7f67e015bc70 2024-08-31T04:04:33.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67df400640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 0x7f67e0150fe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f67d800d9a0 tx=0x7f67d800de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:33.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67d7400640 1 -- 172.21.15.89:0/2995619856 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8017070 con 0x7f67e015bc70 2024-08-31T04:04:33.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67d7400640 1 -- 172.21.15.89:0/2995619856 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67d800be00 con 0x7f67e015bc70 2024-08-31T04:04:33.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67d7400640 1 -- 172.21.15.89:0/2995619856 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8003be0 con 0x7f67e015bc70 2024-08-31T04:04:33.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e00b0780 con 0x7f67e015bc70 2024-08-31T04:04:33.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.100+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e0155a70 con 0x7f67e015bc70 2024-08-31T04:04:33.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.104+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e0074ea0 con 0x7f67e015bc70 2024-08-31T04:04:33.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.104+0000 7f67d7400640 1 -- 172.21.15.89:0/2995619856 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f67d8010460 con 0x7f67e015bc70 2024-08-31T04:04:33.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.104+0000 7f67d7400640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f67bc0720c0 0x7f67bc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.104+0000 7f67d7400640 1 -- 172.21.15.89:0/2995619856 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f67d80931a0 con 0x7f67e015bc70 2024-08-31T04:04:33.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.104+0000 7f67dea00640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f67bc0720c0 0x7f67bc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.104+0000 7f67dea00640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f67bc0720c0 0x7f67bc0745d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f67d00b2000 tx=0x7f67d001d8f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:33.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.108+0000 7f67d7400640 1 -- 172.21.15.89:0/2995619856 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f67d805e150 con 0x7f67e015bc70 2024-08-31T04:04:33.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67e00c82f0 con 0x7f67e015bc70 2024-08-31T04:04:33.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67d7400640 1 -- 172.21.15.89:0/2995619856 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f67d8062910 con 0x7f67e015bc70 2024-08-31T04:04:33.313 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:33.313 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:33.313 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:04:33.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f67bc0720c0 msgr2=0x7f67bc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f67bc0720c0 0x7f67bc0745d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f67d00b2000 tx=0x7f67d001d8f0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 msgr2=0x7f67e0150fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 0x7f67e0150fe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f67d800d9a0 tx=0x7f67d800de60 comp rx=0 tx=0).stop 2024-08-31T04:04:33.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 shutdown_connections 2024-08-31T04:04:33.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f67bc0720c0 0x7f67bc0745d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e015bc70 0x7f67e0150fe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67e00c7920 0x7f67e00b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 --2- 172.21.15.89:0/2995619856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67e00c1f40 0x7f67e0156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 >> 172.21.15.89:0/2995619856 conn(0x7f67e00ccf20 msgr2=0x7f67e015c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:33.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 shutdown_connections 2024-08-31T04:04:33.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.312+0000 7f67e5a00640 1 -- 172.21.15.89:0/2995619856 wait complete. 2024-08-31T04:04:33.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:33.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.488+0000 7f55a9200640 1 -- 172.21.15.89:0/1974385344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a4152a10 msgr2=0x7f55a40c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.488+0000 7f55a9200640 1 --2- 172.21.15.89:0/1974385344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a4152a10 0x7f55a40c9330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f559c009c80 tx=0x7f559c01f5a0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.488+0000 7f55a9200640 1 -- 172.21.15.89:0/1974385344 shutdown_connections 2024-08-31T04:04:33.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.488+0000 7f55a9200640 1 --2- 172.21.15.89:0/1974385344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a4152a10 0x7f55a40c9330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.488+0000 7f55a9200640 1 -- 172.21.15.89:0/1974385344 >> 172.21.15.89:0/1974385344 conn(0x7f55a40ccf20 msgr2=0x7f55a40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:33.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.488+0000 7f55a9200640 1 -- 172.21.15.89:0/1974385344 shutdown_connections 2024-08-31T04:04:33.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.488+0000 7f55a9200640 1 -- 172.21.15.89:0/1974385344 wait complete. 2024-08-31T04:04:33.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.488+0000 7f55a9200640 1 Processor -- start 2024-08-31T04:04:33.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.488+0000 7f55a9200640 1 -- start start 2024-08-31T04:04:33.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55a40c1f40 0x7f55a41f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a9200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55a4152a10 0x7f55a414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a9200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415bc70 0x7f55a41578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a9200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f55a4074e30 con 0x7f55a415bc70 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a9200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f55a40c8030 con 0x7f55a40c1f40 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a9200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f55a4074fb0 con 0x7f55a4152a10 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a2800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415bc70 0x7f55a41578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a2800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415bc70 0x7f55a41578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50426/0 (socket says 172.21.15.89:50426) 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a2800640 1 -- 172.21.15.89:0/3652943262 learned_addr learned my addr 172.21.15.89:0/3652943262 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a1e00640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55a40c1f40 0x7f55a41f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f5599400640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55a4152a10 0x7f55a414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a2800640 1 -- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55a4152a10 msgr2=0x7f55a414f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a2800640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55a4152a10 0x7f55a414f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a2800640 1 -- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55a40c1f40 msgr2=0x7f55a41f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a2800640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55a40c1f40 0x7f55a41f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a2800640 1 -- 172.21.15.89:0/3652943262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a4150010 con 0x7f55a415bc70 2024-08-31T04:04:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a1e00640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55a40c1f40 0x7f55a41f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a2800640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415bc70 0x7f55a41578e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f559c01fe40 tx=0x7f559c0af410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f559aa00640 1 -- 172.21.15.89:0/3652943262 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c004e60 con 0x7f55a415bc70 2024-08-31T04:04:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f559aa00640 1 -- 172.21.15.89:0/3652943262 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f559c0be070 con 0x7f55a415bc70 2024-08-31T04:04:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f559aa00640 1 -- 172.21.15.89:0/3652943262 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c0afb00 con 0x7f55a415bc70 2024-08-31T04:04:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a41e2d00 con 0x7f55a415bc70 2024-08-31T04:04:33.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a41f0b40 con 0x7f55a415bc70 2024-08-31T04:04:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a40c9330 con 0x7f55a415bc70 2024-08-31T04:04:33.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.492+0000 7f559aa00640 1 -- 172.21.15.89:0/3652943262 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f559c0afca0 con 0x7f55a415bc70 2024-08-31T04:04:33.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.496+0000 7f559aa00640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55800720c0 0x7f55800745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.496+0000 7f559aa00640 1 -- 172.21.15.89:0/3652943262 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f559c1321e0 con 0x7f55a415bc70 2024-08-31T04:04:33.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.496+0000 7f55a1e00640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55800720c0 0x7f55800745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.496+0000 7f55a1e00640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55800720c0 0x7f55800745d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55940016b0 tx=0x7f5594009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:33.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.500+0000 7f559aa00640 1 -- 172.21.15.89:0/3652943262 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f559c0ac050 con 0x7f55a415bc70 2024-08-31T04:04:33.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.668+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55a41560a0 con 0x7f55a415bc70 2024-08-31T04:04:33.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.668+0000 7f559aa00640 1 -- 172.21.15.89:0/3652943262 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18602 (secure 0 0 0) 0x7f559c019100 con 0x7f55a415bc70 2024-08-31T04:04:33.673 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:33.673 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:05.324706+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:33.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55800720c0 msgr2=0x7f55800745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55800720c0 0x7f55800745d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55940016b0 tx=0x7f5594009040 comp rx=0 tx=0).stop 2024-08-31T04:04:33.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415bc70 msgr2=0x7f55a41578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415bc70 0x7f55a41578e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f559c01fe40 tx=0x7f559c0af410 comp rx=0 tx=0).stop 2024-08-31T04:04:33.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 shutdown_connections 2024-08-31T04:04:33.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55800720c0 0x7f55800745d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415bc70 0x7f55a41578e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55a4152a10 0x7f55a414f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 --2- 172.21.15.89:0/3652943262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55a40c1f40 0x7f55a41f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 >> 172.21.15.89:0/3652943262 conn(0x7f55a40ccf20 msgr2=0x7f55a41505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:33.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 shutdown_connections 2024-08-31T04:04:33.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.672+0000 7f55a9200640 1 -- 172.21.15.89:0/3652943262 wait complete. 2024-08-31T04:04:33.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.844+0000 7f3a5a400640 1 -- 172.21.15.89:0/1617897045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a3c004810 msgr2=0x7f3a3c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.844+0000 7f3a5a400640 1 --2- 172.21.15.89:0/1617897045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a3c004810 0x7f3a3c004c20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3a40001760 tx=0x7f3a4001efd0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.844+0000 7f3a59a00640 1 -- 172.21.15.89:0/1617897045 reap_dead start 2024-08-31T04:04:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.844+0000 7f3a5a400640 1 -- 172.21.15.89:0/1617897045 shutdown_connections 2024-08-31T04:04:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.844+0000 7f3a5a400640 1 -- 172.21.15.89:0/1617897045 >> 172.21.15.89:0/1617897045 conn(0x7f3a54071f20 msgr2=0x7f3a54072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.844+0000 7f3a5a400640 1 -- 172.21.15.89:0/1617897045 shutdown_connections 2024-08-31T04:04:33.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.844+0000 7f3a5a400640 1 -- 172.21.15.89:0/1617897045 wait complete. 2024-08-31T04:04:33.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a5a400640 1 Processor -- start 2024-08-31T04:04:33.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a5a400640 1 -- start start 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a5a400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a3c004810 0x7f3a5414a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a5a400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a5415be20 0x7f3a541ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a5a400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a54150ed0 0x7f3a54147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a5a400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54070980 con 0x7f3a5415be20 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a5a400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a540706a0 con 0x7f3a54150ed0 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a5a400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a540b9230 con 0x7f3a3c004810 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a53e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a5415be20 0x7f3a541ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a53e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a5415be20 0x7f3a541ef8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50450/0 (socket says 172.21.15.89:50450) 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a53e00640 1 -- 172.21.15.89:0/879531894 learned_addr learned my addr 172.21.15.89:0/879531894 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:33.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a59000640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a3c004810 0x7f3a5414a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a59a00640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a54150ed0 0x7f3a54147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a53e00640 1 -- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a3c004810 msgr2=0x7f3a5414a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a53e00640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a3c004810 0x7f3a5414a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a53e00640 1 -- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a54150ed0 msgr2=0x7f3a54147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:33.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a53e00640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a54150ed0 0x7f3a54147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:33.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a53e00640 1 -- 172.21.15.89:0/879531894 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a541efe30 con 0x7f3a5415be20 2024-08-31T04:04:33.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.848+0000 7f3a59a00640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a54150ed0 0x7f3a54147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:33.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a53e00640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a5415be20 0x7f3a541ef8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a40001850 tx=0x7f3a40006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:33.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a50c00640 1 -- 172.21.15.89:0/879531894 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400a8b00 con 0x7f3a5415be20 2024-08-31T04:04:33.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a50c00640 1 -- 172.21.15.89:0/879531894 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a400a8d90 con 0x7f3a5415be20 2024-08-31T04:04:33.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a50c00640 1 -- 172.21.15.89:0/879531894 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40006360 con 0x7f3a5415be20 2024-08-31T04:04:33.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a54156cd0 con 0x7f3a5415be20 2024-08-31T04:04:33.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a541f3370 con 0x7f3a5415be20 2024-08-31T04:04:33.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a54153930 con 0x7f3a5415be20 2024-08-31T04:04:33.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a50c00640 1 -- 172.21.15.89:0/879531894 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3a40003600 con 0x7f3a5415be20 2024-08-31T04:04:33.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a50c00640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a340720f0 0x7f3a34074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:33.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.852+0000 7f3a50c00640 1 -- 172.21.15.89:0/879531894 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3a4012fc50 con 0x7f3a5415be20 2024-08-31T04:04:33.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.856+0000 7f3a59000640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a340720f0 0x7f3a34074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:33.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.856+0000 7f3a59000640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a340720f0 0x7f3a34074600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3a48000c10 tx=0x7f3a48001640 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:33.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:33.860+0000 7f3a50c00640 1 -- 172.21.15.89:0/879531894 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3a40018ce0 con 0x7f3a5415be20 2024-08-31T04:04:34.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.060+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a540766d0 con 0x7f3a5415be20 2024-08-31T04:04:34.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.060+0000 7f3a50c00640 1 -- 172.21.15.89:0/879531894 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f3a400fab70 con 0x7f3a5415be20 2024-08-31T04:04:34.063 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:34.063 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:34.063 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:04:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a340720f0 msgr2=0x7f3a34074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a340720f0 0x7f3a34074600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3a48000c10 tx=0x7f3a48001640 comp rx=0 tx=0).stop 2024-08-31T04:04:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a5415be20 msgr2=0x7f3a541ef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a5415be20 0x7f3a541ef8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a40001850 tx=0x7f3a40006950 comp rx=0 tx=0).stop 2024-08-31T04:04:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 shutdown_connections 2024-08-31T04:04:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a340720f0 0x7f3a34074600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a5415be20 0x7f3a541ef8f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a54150ed0 0x7f3a54147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 --2- 172.21.15.89:0/879531894 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a3c004810 0x7f3a5414a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 >> 172.21.15.89:0/879531894 conn(0x7f3a54071f20 msgr2=0x7f3a540c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 shutdown_connections 2024-08-31T04:04:34.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.064+0000 7f3a5a400640 1 -- 172.21.15.89:0/879531894 wait complete. 2024-08-31T04:04:34.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-31T04:04:00.242319+0000', 'modified': '2024-08-31T04:04:24.589391+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4420}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4420': {'gid': 4420, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.170:6835/890662790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6834', 'nonce': 890662790}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 890662790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4420, 'qdb_cluster': [4420]} 2024-08-31T04:04:34.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-31T04:04:34.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-31T04:04:34.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 -- 172.21.15.89:0/1008766294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80b2900 msgr2=0x7f38f81520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 --2- 172.21.15.89:0/1008766294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80b2900 0x7f38f81520f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f38e0009900 tx=0x7f38e001c590 comp rx=0 tx=0).stop 2024-08-31T04:04:34.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 -- 172.21.15.89:0/1008766294 shutdown_connections 2024-08-31T04:04:34.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 --2- 172.21.15.89:0/1008766294 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f80c8810 0x7f38f80c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 --2- 172.21.15.89:0/1008766294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80b2900 0x7f38f81520f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 -- 172.21.15.89:0/1008766294 >> 172.21.15.89:0/1008766294 conn(0x7f38f80ccf20 msgr2=0x7f38f80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:34.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 -- 172.21.15.89:0/1008766294 shutdown_connections 2024-08-31T04:04:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 -- 172.21.15.89:0/1008766294 wait complete. 2024-08-31T04:04:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 Processor -- start 2024-08-31T04:04:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.848+0000 7f38ffa00640 1 -- start start 2024-08-31T04:04:34.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38ffa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f80b2900 0x7f38f81f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38ffa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f80b2fe0 0x7f38f8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38ffa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80c8810 0x7f38f81492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38ffa00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f38f8158980 con 0x7f38f80c8810 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38ffa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38f8158800 con 0x7f38f80b2900 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38ffa00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f38f8162750 con 0x7f38f80b2fe0 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80c8810 0x7f38f81492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80c8810 0x7f38f81492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50456/0 (socket says 172.21.15.89:50456) 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fda00640 1 -- 172.21.15.89:0/40555451 learned_addr learned my addr 172.21.15.89:0/40555451 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38efe00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f80b2fe0 0x7f38f8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fd000640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f80b2900 0x7f38f81f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fda00640 1 -- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f80b2fe0 msgr2=0x7f38f8154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fda00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f80b2fe0 0x7f38f8154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fda00640 1 -- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f80b2900 msgr2=0x7f38f81f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fda00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f80b2900 0x7f38f81f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fda00640 1 -- 172.21.15.89:0/40555451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f81f5d20 con 0x7f38f80c8810 2024-08-31T04:04:34.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38fda00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80c8810 0x7f38f81492d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f38f000e8e0 tx=0x7f38f000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:34.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38f5600640 1 -- 172.21.15.89:0/40555451 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0004d30 con 0x7f38f80c8810 2024-08-31T04:04:34.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38f5600640 1 -- 172.21.15.89:0/40555451 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38f000cb20 con 0x7f38f80c8810 2024-08-31T04:04:34.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38ffa00640 1 -- 172.21.15.89:0/40555451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f814e1b0 con 0x7f38f80c8810 2024-08-31T04:04:34.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38f5600640 1 -- 172.21.15.89:0/40555451 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0005020 con 0x7f38f80c8810 2024-08-31T04:04:34.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.852+0000 7f38ffa00640 1 -- 172.21.15.89:0/40555451 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f81f4fe0 con 0x7f38f80c8810 2024-08-31T04:04:34.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38f5600640 1 -- 172.21.15.89:0/40555451 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f38f00051c0 con 0x7f38f80c8810 2024-08-31T04:04:34.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38f5600640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d40720c0 0x7f38d40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38f5600640 1 -- 172.21.15.89:0/40555451 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f38f0093710 con 0x7f38f80c8810 2024-08-31T04:04:34.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f390725a000 1 Processor -- start 2024-08-31T04:04:34.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38fd000640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d40720c0 0x7f38d40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f390725a000 1 -- start start 2024-08-31T04:04:34.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38fd000640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d40720c0 0x7f38d40745d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38e8007fd0 tx=0x7f38e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:34.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f390725a000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 0x5632bfb95eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f390725a000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb99b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f390725a000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfb9a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f390725a000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5632bf9b5360 con 0x5632bfa52d90 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f390725a000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5632bf9a48f0 con 0x5632bfa3c860 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f390725a000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5632bf9a88a0 con 0x5632bf663460 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38efe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb99b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38efe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb99b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50470/0 (socket says 172.21.15.89:50470) 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38efe00640 1 -- 172.21.15.89:0/3752032479 learned_addr learned my addr 172.21.15.89:0/3752032479 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38fd000640 1 --2- 172.21.15.89:0/3752032479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 0x5632bfb95eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38fda00640 1 --2- 172.21.15.89:0/3752032479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfb9a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38efe00640 1 -- 172.21.15.89:0/3752032479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 msgr2=0x5632bfb95eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:34.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38efe00640 1 --2- 172.21.15.89:0/3752032479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 0x5632bfb95eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38efe00640 1 -- 172.21.15.89:0/3752032479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 msgr2=0x5632bfb9a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38efe00640 1 --2- 172.21.15.89:0/3752032479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfb9a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.856+0000 7f38efe00640 1 -- 172.21.15.89:0/3752032479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632bf944190 con 0x5632bfa52d90 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f38efe00640 1 --2- 172.21.15.89:0/3752032479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb99b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f38e00ac040 tx=0x7f38e0019330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b82cf1a83cc23af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f38ed600640 1 -- 172.21.15.89:0/3752032479 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0004230 con 0x5632bfa52d90 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f38ed600640 1 -- 172.21.15.89:0/3752032479 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38e00af040 con 0x5632bfa52d90 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f38ed600640 1 -- 172.21.15.89:0/3752032479 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e00aaaf0 con 0x5632bfa52d90 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 -- 172.21.15.89:0/3752032479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 msgr2=0x5632bfb99b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 --2- 172.21.15.89:0/3752032479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb99b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f38e00ac040 tx=0x7f38e0019330 comp rx=0 tx=0).stop 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 -- 172.21.15.89:0/3752032479 shutdown_connections 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 --2- 172.21.15.89:0/3752032479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb99b40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 --2- 172.21.15.89:0/3752032479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfb9a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 --2- 172.21.15.89:0/3752032479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 0x5632bfb95eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 -- 172.21.15.89:0/3752032479 >> 172.21.15.89:0/3752032479 conn(0x5632bfb28ae0 msgr2=0x5632bfb98910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:34.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 -- 172.21.15.89:0/3752032479 shutdown_connections 2024-08-31T04:04:34.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 -- 172.21.15.89:0/3752032479 wait complete. 2024-08-31T04:04:34.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 -- start start 2024-08-31T04:04:34.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 Processor -- start 2024-08-31T04:04:34.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bf663460 0x5632bfb94c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.860+0000 7f390725a000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfb951d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa52d90 0x5632bfb95710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5632bf971500 con 0x5632bf663460 2024-08-31T04:04:34.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5632bf972190 con 0x5632bfa3c860 2024-08-31T04:04:34.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5632bf9a7bb0 con 0x5632bfa52d90 2024-08-31T04:04:34.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 10 client.0 _ll_register_callbacks cb 0x5632bfb45100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:04:34.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fd000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bf663460 0x5632bfb94c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fd000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bf663460 0x5632bfb94c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50480/0 (socket says 172.21.15.89:50480) 2024-08-31T04:04:34.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fd000640 1 -- 172.21.15.89:0/4121581863 learned_addr learned my addr 172.21.15.89:0/4121581863 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:34.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38efe00640 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfb951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fda00640 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa52d90 0x5632bfb95710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fd000640 1 -- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa52d90 msgr2=0x5632bfb95710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fd000640 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa52d90 0x5632bfb95710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fd000640 1 -- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 msgr2=0x5632bfb951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fd000640 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfb951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fd000640 1 -- 172.21.15.89:0/4121581863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632bf93f530 con 0x5632bf663460 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38fd000640 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bf663460 0x5632bfb94c90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f38e8014700 tx=0x7f38e8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63abb6c82e2cdc4b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38e6000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38e6000640 1 -- 172.21.15.89:0/4121581863 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e80135c0 con 0x5632bf663460 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38e6000640 1 -- 172.21.15.89:0/4121581863 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f38e8013760 con 0x5632bf663460 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 1 -- 172.21.15.89:0/4121581863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5632bf93e110 con 0x5632bf663460 2024-08-31T04:04:34.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38e6000640 1 -- 172.21.15.89:0/4121581863 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f38e802e050 con 0x5632bf663460 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 10 client.4740 fetch_fsmap learned FSMap version 9 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 1 -- 172.21.15.89:0/4121581863 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5632bfa29ff0 con 0x5632bf663460 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38e6000640 1 -- 172.21.15.89:0/4121581863 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5632bf93e110 con 0x5632bf663460 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38e6000640 1 -- 172.21.15.89:0/4121581863 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f38e8031020 con 0x5632bf663460 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 10 client.4740 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 10 client.4740 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 20 client.4740 populate_metadata read hostname 'smithi089' 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5632bf6487d0 0x5632bfbaffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 4 client.4740 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:04:34.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f390725a000 1 -- 172.21.15.89:0/4121581863 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632bf9b72b0 con 0x5632bf6487d0 2024-08-31T04:04:34.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38efe00640 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5632bf6487d0 0x5632bfbaffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38efe00640 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5632bf6487d0 0x5632bfbaffe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44006d1b5ff5a727 server_cookie=2245cc599fbf84d3 in_seq=0 out_seq=0 2024-08-31T04:04:34.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.864+0000 7f38e6000640 10 client.4740 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:34.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f38e6000640 1 -- 172.21.15.89:0/4121581863 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632bf9b72b0 con 0x5632bf6487d0 2024-08-31T04:04:34.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f38e6000640 10 client.4740 handle_command_reply: tid=0 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 client.4740 shutdown 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 -- 172.21.15.89:0/4121581863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bf663460 msgr2=0x5632bfb94c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bf663460 0x5632bfb94c90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f38e8014700 tx=0x7f38e8000ee0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 -- 172.21.15.89:0/4121581863 shutdown_connections 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5632bf6487d0 0x5632bfbaffe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa52d90 0x5632bfb95710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfb951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f38e6000640 0 client.4740 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 --2- 172.21.15.89:0/4121581863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bf663460 0x5632bfb94c90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 -- 172.21.15.89:0/4121581863 >> 172.21.15.89:0/4121581863 conn(0x5632bfb28ae0 msgr2=0x5632bfb972c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:34.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 -- 172.21.15.89:0/4121581863 shutdown_connections 2024-08-31T04:04:34.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 1 -- 172.21.15.89:0/4121581863 wait complete. 2024-08-31T04:04:34.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.868+0000 7f390725a000 20 client.4740 trim_cache size 0 max 16384 2024-08-31T04:04:34.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 Processor -- start 2024-08-31T04:04:34.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 -- start start 2024-08-31T04:04:34.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bf663460 0x5632bfb5e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa3c860 0x5632bfb5dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb5e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f38f82025c0 con 0x5632bfa52d90 2024-08-31T04:04:34.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38f8201900 con 0x5632bf663460 2024-08-31T04:04:34.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f38f8201f50 con 0x5632bfa3c860 2024-08-31T04:04:34.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb5e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb5e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50496/0 (socket says 172.21.15.89:50496) 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fda00640 1 -- 172.21.15.89:0/3222251369 learned_addr learned my addr 172.21.15.89:0/3222251369 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fd000640 1 --2- 172.21.15.89:0/3222251369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bf663460 0x5632bfb5e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38efe00640 1 --2- 172.21.15.89:0/3222251369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa3c860 0x5632bfb5dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fda00640 1 -- 172.21.15.89:0/3222251369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa3c860 msgr2=0x5632bfb5dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fda00640 1 --2- 172.21.15.89:0/3222251369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa3c860 0x5632bfb5dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fda00640 1 -- 172.21.15.89:0/3222251369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bf663460 msgr2=0x5632bfb5e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fda00640 1 --2- 172.21.15.89:0/3222251369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bf663460 0x5632bfb5e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fda00640 1 -- 172.21.15.89:0/3222251369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632bfa014b0 con 0x5632bfa52d90 2024-08-31T04:04:34.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38fda00640 1 --2- 172.21.15.89:0/3222251369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb5e230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f38f005e640 tx=0x7f38f0093040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a07ec51545683 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:34.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38ecc00640 1 -- 172.21.15.89:0/3222251369 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0083020 con 0x5632bfa52d90 2024-08-31T04:04:34.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38ecc00640 1 -- 172.21.15.89:0/3222251369 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38f005e6b0 con 0x5632bfa52d90 2024-08-31T04:04:34.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f38ecc00640 1 -- 172.21.15.89:0/3222251369 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f001f070 con 0x5632bfa52d90 2024-08-31T04:04:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 -- 172.21.15.89:0/3222251369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 msgr2=0x5632bfb5e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 --2- 172.21.15.89:0/3222251369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb5e230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f38f005e640 tx=0x7f38f0093040 comp rx=0 tx=0).stop 2024-08-31T04:04:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 -- 172.21.15.89:0/3222251369 shutdown_connections 2024-08-31T04:04:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 --2- 172.21.15.89:0/3222251369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfb5e230 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 --2- 172.21.15.89:0/3222251369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bfa3c860 0x5632bfb5dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 --2- 172.21.15.89:0/3222251369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bf663460 0x5632bfb5e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 -- 172.21.15.89:0/3222251369 >> 172.21.15.89:0/3222251369 conn(0x5632bfb28ae0 msgr2=0x5632bfbac2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 -- 172.21.15.89:0/3222251369 shutdown_connections 2024-08-31T04:04:34.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.888+0000 7f390725a000 1 -- 172.21.15.89:0/3222251369 wait complete. 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 -- start start 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 Processor -- start 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 0x5632bfbb2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfbb2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfbb3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5632bf95c340 con 0x5632bfa52d90 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5632bf9aced0 con 0x5632bfa3c860 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5632bf964de0 con 0x5632bf663460 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 10 client.0 _ll_register_callbacks cb 0x7f38e8017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfbb3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfbb3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50502/0 (socket says 172.21.15.89:50502) 2024-08-31T04:04:34.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fda00640 1 -- 172.21.15.89:0/2910744995 learned_addr learned my addr 172.21.15.89:0/2910744995 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fd000640 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 0x5632bfbb2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38efe00640 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfbb2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fda00640 1 -- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 msgr2=0x5632bfbb2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fda00640 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 0x5632bfbb2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fda00640 1 -- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 msgr2=0x5632bfbb2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fda00640 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfbb2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fda00640 1 -- 172.21.15.89:0/2910744995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632bf95ef30 con 0x5632bfa52d90 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38efe00640 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfbb2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38fda00640 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfbb3090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f38f00918b0 tx=0x7f38f0062fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890ba04590623cb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:34.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38e6000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:04:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38e6000640 1 -- 172.21.15.89:0/2910744995 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f001f050 con 0x5632bfa52d90 2024-08-31T04:04:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38e6000640 1 -- 172.21.15.89:0/2910744995 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f38f00650b0 con 0x5632bfa52d90 2024-08-31T04:04:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 -- 172.21.15.89:0/2910744995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38f005e6b0 con 0x5632bfa52d90 2024-08-31T04:04:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38e6000640 1 -- 172.21.15.89:0/2910744995 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f38f0083040 con 0x5632bfa52d90 2024-08-31T04:04:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 10 client.4746 fetch_fsmap learned FSMap version 9 2024-08-31T04:04:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 1 -- 172.21.15.89:0/2910744995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5632bf94a590 con 0x5632bfa52d90 2024-08-31T04:04:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38e6000640 1 -- 172.21.15.89:0/2910744995 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38f005e6b0 con 0x5632bfa52d90 2024-08-31T04:04:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f38e6000640 1 -- 172.21.15.89:0/2910744995 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f38f000f040 con 0x5632bfa52d90 2024-08-31T04:04:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.892+0000 7f390725a000 10 client.4746 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 10 client.4746 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 20 client.4746 populate_metadata read hostname 'smithi089' 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5632bf636830 0x5632bfbb39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 4 client.4746 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 -- 172.21.15.89:0/2910744995 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "status"}) -- 0x5632bf9b2d50 con 0x5632bf636830 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38fd000640 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5632bf636830 0x5632bfbb39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38fd000640 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5632bf636830 0x5632bfbb39f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb9ab330e46db362 server_cookie=510e0e0a1f4086a1 in_seq=0 out_seq=0 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38e6000640 10 client.4746 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38e6000640 1 -- 172.21.15.89:0/2910744995 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5632bf9b2d50 con 0x5632bf636830 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38e6000640 10 client.4746 handle_command_reply: tid=0 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 client.4746 shutdown 2024-08-31T04:04:34.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 -- 172.21.15.89:0/2910744995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 msgr2=0x5632bfbb3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfbb3090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f38f00918b0 tx=0x7f38f0062fd0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 -- 172.21.15.89:0/2910744995 shutdown_connections 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5632bf636830 0x5632bfbb39f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5632bfa52d90 0x5632bfbb3090 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632bfa3c860 0x5632bfbb2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38e6000640 0 client.4746 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 --2- 172.21.15.89:0/2910744995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632bf663460 0x5632bfbb2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 -- 172.21.15.89:0/2910744995 >> 172.21.15.89:0/2910744995 conn(0x5632bfb28ae0 msgr2=0x5632bfb581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 -- 172.21.15.89:0/2910744995 shutdown_connections 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 1 -- 172.21.15.89:0/2910744995 wait complete. 2024-08-31T04:04:34.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f390725a000 20 client.4746 trim_cache size 0 max 16384 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "4a16b848-e6b2-47d6-97cd-edff59841cb1", 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4420, 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 34.028121472999999, 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 9, 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 26, 2024-08-31T04:04:34.903 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 26, 2024-08-31T04:04:34.904 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 39.442883240999997 2024-08-31T04:04:34.904 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:04:34.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 -- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d40720c0 msgr2=0x7f38d40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d40720c0 0x7f38d40745d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38e8007fd0 tx=0x7f38e8009040 comp rx=0 tx=0).stop 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 -- 172.21.15.89:0/40555451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80c8810 msgr2=0x7f38f81492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80c8810 0x7f38f81492d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f38f000e8e0 tx=0x7f38f000eda0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 -- 172.21.15.89:0/40555451 shutdown_connections 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d40720c0 0x7f38d40745d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f80c8810 0x7f38f81492d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f80b2fe0 0x7f38f8154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 --2- 172.21.15.89:0/40555451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f80b2900 0x7f38f81f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 -- 172.21.15.89:0/40555451 >> 172.21.15.89:0/40555451 conn(0x7f38f80ccf20 msgr2=0x7f38f8163220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 -- 172.21.15.89:0/40555451 shutdown_connections 2024-08-31T04:04:34.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:34.896+0000 7f38ffa00640 1 -- 172.21.15.89:0/40555451 wait complete. 2024-08-31T04:04:34.918 INFO:teuthology.run_tasks:Running task kclient... 2024-08-31T04:04:34.933 INFO:tasks.kclient:Mounting kernel clients... 2024-08-31T04:04:34.933 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-31T04:04:34.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:34.933 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-08-31T04:04:34.942 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-31T04:04:34.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:34.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T04:04:35.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:35.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-08-31T04:04:35.487 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-08-31T04:04:35.487 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T04:04:35.487 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T04:04:35.487 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-31T04:04:35.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 -- 172.21.15.89:0/3050171546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc15bc70 msgr2=0x7f81dc152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:35.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 --2- 172.21.15.89:0/3050171546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc15bc70 0x7f81dc152a10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f81dc070b70 tx=0x7f81cc01f0b0 comp rx=0 tx=0).stop 2024-08-31T04:04:35.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 -- 172.21.15.89:0/3050171546 shutdown_connections 2024-08-31T04:04:35.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 --2- 172.21.15.89:0/3050171546 >> v2:172.21.15.170:3300/0 conn(0x7f81dc0c1f40 0x7f81dc0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:35.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 --2- 172.21.15.89:0/3050171546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc15bc70 0x7f81dc152a10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 -- 172.21.15.89:0/3050171546 >> 172.21.15.89:0/3050171546 conn(0x7f81dc0ccf20 msgr2=0x7f81dc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 -- 172.21.15.89:0/3050171546 shutdown_connections 2024-08-31T04:04:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 -- 172.21.15.89:0/3050171546 wait complete. 2024-08-31T04:04:35.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 Processor -- start 2024-08-31T04:04:35.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.640+0000 7f81e2200640 1 -- start start 2024-08-31T04:04:35.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81e2200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc0c1f40 0x7f81dc0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:35.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81e2200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81dc0c7920 0x7f81dc153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:35.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81e2200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81dc15bc70 0x7f81dc14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:35.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81e2200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc074fb0 con 0x7f81dc0c1f40 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81e2200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc074e30 con 0x7f81dc15bc70 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81e2200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81dc0c7d30 con 0x7f81dc0c7920 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81db400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc0c1f40 0x7f81dc0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81db400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc0c1f40 0x7f81dc0c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50508/0 (socket says 172.21.15.89:50508) 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81db400640 1 -- 172.21.15.89:0/3148757720 learned_addr learned my addr 172.21.15.89:0/3148757720 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81daa00640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81dc0c7920 0x7f81dc153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81dbe00640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81dc15bc70 0x7f81dc14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81db400640 1 -- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81dc0c7920 msgr2=0x7f81dc153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81db400640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81dc0c7920 0x7f81dc153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81db400640 1 -- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81dc15bc70 msgr2=0x7f81dc14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81db400640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81dc15bc70 0x7f81dc14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81db400640 1 -- 172.21.15.89:0/3148757720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81dc0c6810 con 0x7f81dc0c1f40 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81dbe00640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81dc15bc70 0x7f81dc14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81daa00640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81dc0c7920 0x7f81dc153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:35.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81db400640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc0c1f40 0x7f81dc0c62d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0b3040 tx=0x7f81cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:35.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81d3400640 1 -- 172.21.15.89:0/3148757720 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0be070 con 0x7f81dc0c1f40 2024-08-31T04:04:35.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81d3400640 1 -- 172.21.15.89:0/3148757720 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81cc0053e0 con 0x7f81dc0c1f40 2024-08-31T04:04:35.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81dc155a30 con 0x7f81dc0c1f40 2024-08-31T04:04:35.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81d3400640 1 -- 172.21.15.89:0/3148757720 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0b5040 con 0x7f81dc0c1f40 2024-08-31T04:04:35.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81dc15b8a0 con 0x7f81dc0c1f40 2024-08-31T04:04:35.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.644+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81dc0c9330 con 0x7f81dc0c1f40 2024-08-31T04:04:35.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.648+0000 7f81d3400640 1 -- 172.21.15.89:0/3148757720 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f81cc0c1070 con 0x7f81dc0c1f40 2024-08-31T04:04:35.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.648+0000 7f81d3400640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f81bc0720f0 0x7f81bc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:35.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.648+0000 7f81d3400640 1 -- 172.21.15.89:0/3148757720 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f81cc12fd60 con 0x7f81dc0c1f40 2024-08-31T04:04:35.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.648+0000 7f81daa00640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f81bc0720f0 0x7f81bc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.648+0000 7f81daa00640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f81bc0720f0 0x7f81bc074600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f81c8005fd0 tx=0x7f81c8005f20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:35.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.652+0000 7f81d3400640 1 -- 172.21.15.89:0/3148757720 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f81cc018c10 con 0x7f81dc0c1f40 2024-08-31T04:04:35.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f81dc0c6e30 con 0x7f81dc0c1f40 2024-08-31T04:04:35.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81d3400640 1 -- 172.21.15.89:0/3148757720 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f81cc0fb2d0 con 0x7f81dc0c1f40 2024-08-31T04:04:35.855 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-31T04:04:35.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f81bc0720f0 msgr2=0x7f81bc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:35.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f81bc0720f0 0x7f81bc074600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f81c8005fd0 tx=0x7f81c8005f20 comp rx=0 tx=0).stop 2024-08-31T04:04:35.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc0c1f40 msgr2=0x7f81dc0c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:35.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc0c1f40 0x7f81dc0c62d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0b3040 tx=0x7f81cc004600 comp rx=0 tx=0).stop 2024-08-31T04:04:35.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 shutdown_connections 2024-08-31T04:04:35.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f81bc0720f0 0x7f81bc074600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:35.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81dc15bc70 0x7f81dc14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:35.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81dc0c7920 0x7f81dc153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:35.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 --2- 172.21.15.89:0/3148757720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81dc0c1f40 0x7f81dc0c62d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:35.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 >> 172.21.15.89:0/3148757720 conn(0x7f81dc0ccf20 msgr2=0x7f81dc157170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:35.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 shutdown_connections 2024-08-31T04:04:35.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35.852+0000 7f81e2200640 1 -- 172.21.15.89:0/3148757720 wait complete. 2024-08-31T04:04:35.876 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T04:04:35.876 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T04:04:35.876 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2024-08-31T04:04:35.876 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-31T04:04:35.877 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T04:04:35.877 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T04:04:35.877 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T04:04:35.877 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T04:04:35.877 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-31T04:04:35.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:35.877 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2024-08-31T04:04:35.886 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T04:04:35.886 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T04:04:35.886 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T04:04:35.886 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:04:35.886 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-08-31T04:04:35.886 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:04:35.886 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T04:04:35.887 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:35.887 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2024-08-31T04:04:35.887 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T04:04:35.887 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:35.887 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2024-08-31T04:04:35.887 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-31T04:04:35.887 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:35.887 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T04:04:35.887 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:35.888 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-31T04:04:35.888 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42431sec preferred_lft 42431sec 2024-08-31T04:04:35.888 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2024-08-31T04:04:35.888 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:04:35.888 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-31T04:04:35.888 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:75:71:bb:f8 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:04:35.888 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-31T04:04:35.888 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:04:35.889 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T04:04:35.889 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:35.889 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:35.889 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2024-08-31T04:04:35.889 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2024-08-31T04:04:35.889 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2024-08-31T04:04:35.889 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T04:04:35.890 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:35.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:36.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:36.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:36.042 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T04:04:36.061 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-08-31T04:04:36.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:36.063 DEBUG:teuthology.orchestra.run.smithi089:> route 2024-08-31T04:04:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2024-08-31T04:04:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T04:04:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-31T04:04:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-31T04:04:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-08-31T04:04:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-31T04:04:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-31T04:04:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T04:04:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T04:04:36.121 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-31T04:04:36.121 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T04:04:36.121 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:36.121 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:36.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-31T04:04:36.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-31T04:04:36.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-31T04:04:36.121 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:36.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:36.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:36.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:36.256 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-08-31T04:04:36.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:36.266 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2024-08-31T04:04:36.320 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:36.320 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:36.320 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T04:04:36.320 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-31T04:04:36.321 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:36.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:36.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:36.449 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-31T04:04:36.449 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:36.450 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:36.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-31T04:04:36.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T04:04:36.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-31T04:04:36.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-31T04:04:36.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-31T04:04:36.450 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:36.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:36.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:36.589 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:04:36.589 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-08-31T04:04:36.589 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2024-08-31T04:04:36.589 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T04:04:36.589 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-08-31T04:04:36.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:36.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:36.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:04:36.675 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-31T04:04:36.683 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-31T04:04:36.683 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:04:36.683 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-31T04:04:36.731 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-31T04:04:36.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:36.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-31T04:04:36.832 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-31T04:04:36.832 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-31T04:04:36.832 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2024-08-31T04:04:37.498 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-31T04:04:37.498 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-31T04:04:37.499 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2024-08-31T04:04:37.499 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-08-31T04:04:37.499 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-31T04:04:37.515 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-31T04:04:37.515 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-31T04:04:37.515 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2024-08-31T04:04:37.515 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-08-31T04:04:37.515 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-31T04:04:37.516 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:6789,172.21.15.170:6789,172.21.15.170:6790" 2024-08-31T04:04:37.516 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.89:6789,172.21.15.170:6789,172.21.15.170:6790:/ 2024-08-31T04:04:37.516 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4a16b848-e6b2-47d6-97cd-edff59841cb1" will pass to kernel 2024-08-31T04:04:37.520 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-31T04:04:37.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:04:37.520 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-31T04:04:37.540 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T04:04:37.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:04:37.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:37.649 INFO:teuthology.orchestra.run.smithi089.stdout:client4849 2024-08-31T04:04:37.649 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:04:37.649 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:04:37.658 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T04:04:37.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:04:37.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:37.755 INFO:teuthology.orchestra.run.smithi089.stdout:client4849 2024-08-31T04:04:37.755 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T04:04:37.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:04:37.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:37.811 INFO:teuthology.orchestra.run.smithi089.stdout:client4849 2024-08-31T04:04:37.811 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4a16b848-e6b2-47d6-97cd-edff59841cb1.client4849/status') 2024-08-31T04:04:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:04:37.869 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.4849 (3)172.21.15.89:0/3293002015 2024-08-31T04:04:37.869 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2024-08-31T04:04:37.870 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2024-08-31T04:04:37.870 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2024-08-31T04:04:37.870 INFO:teuthology.orchestra.run.smithi089.stderr:70 bytes copied, 6.7565e-05 s, 1.0 MB/s 2024-08-31T04:04:37.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:04:37.878 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-31T04:04:37.893 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-31T04:04:37.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:04:38.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.044+0000 7faa8de00640 1 -- 172.21.15.89:0/412419237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa88156e10 msgr2=0x7faa880c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.044+0000 7faa8de00640 1 --2- 172.21.15.89:0/412419237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa88156e10 0x7faa880c8d70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa70009930 tx=0x7faa7001f0d0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.044+0000 7faa8de00640 1 -- 172.21.15.89:0/412419237 shutdown_connections 2024-08-31T04:04:38.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.044+0000 7faa8de00640 1 --2- 172.21.15.89:0/412419237 >> v2:172.21.15.170:3300/0 conn(0x7faa880c92b0 0x7faa88164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.044+0000 7faa8de00640 1 --2- 172.21.15.89:0/412419237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa88156e10 0x7faa880c8d70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.044+0000 7faa8de00640 1 -- 172.21.15.89:0/412419237 >> 172.21.15.89:0/412419237 conn(0x7faa880ccf20 msgr2=0x7faa880cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:38.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.044+0000 7faa8de00640 1 -- 172.21.15.89:0/412419237 shutdown_connections 2024-08-31T04:04:38.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.044+0000 7faa8de00640 1 -- 172.21.15.89:0/412419237 wait complete. 2024-08-31T04:04:38.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 Processor -- start 2024-08-31T04:04:38.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 -- start start 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa88074e20 0x7faa880b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa880c92b0 0x7faa88152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa88156e10 0x7faa880ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7faa881599b0 con 0x7faa88156e10 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faa88069fc0 con 0x7faa880c92b0 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faa88159c90 con 0x7faa88074e20 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa87400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa88156e10 0x7faa880ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa7e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa880c92b0 0x7faa88152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa87400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa88156e10 0x7faa880ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50512/0 (socket says 172.21.15.89:50512) 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa87400640 1 -- 172.21.15.89:0/3500281490 learned_addr learned my addr 172.21.15.89:0/3500281490 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:38.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa86a00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa88074e20 0x7faa880b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa87400640 1 -- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa88074e20 msgr2=0x7faa880b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa87400640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa88074e20 0x7faa880b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa87400640 1 -- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa880c92b0 msgr2=0x7faa88152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa87400640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa880c92b0 0x7faa88152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa87400640 1 -- 172.21.15.89:0/3500281490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa880c2070 con 0x7faa88156e10 2024-08-31T04:04:38.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa87400640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa88156e10 0x7faa880ae8d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e740 tx=0x7faa8000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:38.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa7fe00640 1 -- 172.21.15.89:0/3500281490 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8000cc60 con 0x7faa88156e10 2024-08-31T04:04:38.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa7fe00640 1 -- 172.21.15.89:0/3500281490 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa8000ce20 con 0x7faa88156e10 2024-08-31T04:04:38.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa7fe00640 1 -- 172.21.15.89:0/3500281490 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80005280 con 0x7faa88156e10 2024-08-31T04:04:38.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa880b15d0 con 0x7faa88156e10 2024-08-31T04:04:38.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.048+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa880b0630 con 0x7faa88156e10 2024-08-31T04:04:38.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.052+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa88157220 con 0x7faa88156e10 2024-08-31T04:04:38.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.052+0000 7faa7fe00640 1 -- 172.21.15.89:0/3500281490 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7faa80005420 con 0x7faa88156e10 2024-08-31T04:04:38.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.052+0000 7faa7fe00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faa640720c0 0x7faa640745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.052+0000 7faa7fe00640 1 -- 172.21.15.89:0/3500281490 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faa800935e0 con 0x7faa88156e10 2024-08-31T04:04:38.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.052+0000 7faa86a00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faa640720c0 0x7faa640745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.056+0000 7faa86a00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faa640720c0 0x7faa640745d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa78001e40 tx=0x7faa78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:38.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.056+0000 7faa7fe00640 1 -- 172.21.15.89:0/3500281490 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7faa8005e590 con 0x7faa88156e10 2024-08-31T04:04:38.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.224+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa880c2350 con 0x7faa640720c0 2024-08-31T04:04:38.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.240+0000 7faa7fe00640 1 -- 172.21.15.89:0/3500281490 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332516 (secure 0 0 0) 0x7faa880c2350 con 0x7faa640720c0 2024-08-31T04:04:38.245 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:38.247 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:04:38.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faa640720c0 msgr2=0x7faa640745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faa640720c0 0x7faa640745d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa78001e40 tx=0x7faa78009040 comp rx=0 tx=0).stop 2024-08-31T04:04:38.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa88156e10 msgr2=0x7faa880ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa88156e10 0x7faa880ae8d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa8000e740 tx=0x7faa8000ec00 comp rx=0 tx=0).stop 2024-08-31T04:04:38.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 shutdown_connections 2024-08-31T04:04:38.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faa640720c0 0x7faa640745d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa88156e10 0x7faa880ae8d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa880c92b0 0x7faa88152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 --2- 172.21.15.89:0/3500281490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa88074e20 0x7faa880b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 >> 172.21.15.89:0/3500281490 conn(0x7faa880ccf20 msgr2=0x7faa880c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:38.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 shutdown_connections 2024-08-31T04:04:38.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.244+0000 7faa8de00640 1 -- 172.21.15.89:0/3500281490 wait complete. 2024-08-31T04:04:38.265 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-08-31T04:04:38.133530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730220,"statfs":{"total":773094113280,"available":772843745280,"internally_reserved":0,"allocated":3383296,"data_stored":2028208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006589"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905721+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:04:05.905721+0000","last_peered":"2024-08-31T04:04:05.905721+0000","last_clean":"2024-08-31T04:04:05.905721+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:04:05.905721+0000","last_undegraded":"2024-08-31T04:04:05.905721+0000","last_fullsized":"2024-08-31T04:04:05.905721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040713+0000","last_change":"2024-08-31T04:04:00.866522+0000","last_active":"2024-08-31T04:04:06.040713+0000","last_peered":"2024-08-31T04:04:06.040713+0000","last_clean":"2024-08-31T04:04:06.040713+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:04:06.040713+0000","last_undegraded":"2024-08-31T04:04:06.040713+0000","last_fullsized":"2024-08-31T04:04:06.040713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:05.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039577+0000","last_change":"2024-08-31T04:04:04.956192+0000","last_active":"2024-08-31T04:04:06.039577+0000","last_peered":"2024-08-31T04:04:06.039577+0000","last_clean":"2024-08-31T04:04:06.039577+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:04:06.039577+0000","last_undegraded":"2024-08-31T04:04:06.039577+0000","last_fullsized":"2024-08-31T04:04:06.039577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:42.517705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041009+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:04:06.041009+0000","last_peered":"2024-08-31T04:04:06.041009+0000","last_clean":"2024-08-31T04:04:06.041009+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:04:06.041009+0000","last_undegraded":"2024-08-31T04:04:06.041009+0000","last_fullsized":"2024-08-31T04:04:06.041009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040614+0000","last_change":"2024-08-31T04:04:00.880748+0000","last_active":"2024-08-31T04:04:06.040614+0000","last_peered":"2024-08-31T04:04:06.040614+0000","last_clean":"2024-08-31T04:04:06.040614+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:04:06.040614+0000","last_undegraded":"2024-08-31T04:04:06.040614+0000","last_fullsized":"2024-08-31T04:04:06.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:45.564722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904053+0000","last_change":"2024-08-31T04:04:04.951253+0000","last_active":"2024-08-31T04:04:05.904053+0000","last_peered":"2024-08-31T04:04:05.904053+0000","last_clean":"2024-08-31T04:04:05.904053+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:04:05.904053+0000","last_undegraded":"2024-08-31T04:04:05.904053+0000","last_fullsized":"2024-08-31T04:04:05.904053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:06.131485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035168+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:04:06.035168+0000","last_peered":"2024-08-31T04:04:06.035168+0000","last_clean":"2024-08-31T04:04:06.035168+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:04:06.035168+0000","last_undegraded":"2024-08-31T04:04:06.035168+0000","last_fullsized":"2024-08-31T04:04:06.035168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036133+0000","last_change":"2024-08-31T04:04:00.873539+0000","last_active":"2024-08-31T04:04:06.036133+0000","last_peered":"2024-08-31T04:04:06.036133+0000","last_clean":"2024-08-31T04:04:06.036133+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:04:06.036133+0000","last_undegraded":"2024-08-31T04:04:06.036133+0000","last_fullsized":"2024-08-31T04:04:06.036133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:48.946116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904728+0000","last_change":"2024-08-31T04:04:04.972277+0000","last_active":"2024-08-31T04:04:05.904728+0000","last_peered":"2024-08-31T04:04:05.904728+0000","last_clean":"2024-08-31T04:04:05.904728+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:04:05.904728+0000","last_undegraded":"2024-08-31T04:04:05.904728+0000","last_fullsized":"2024-08-31T04:04:05.904728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:25.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035597+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:04:06.035597+0000","last_peered":"2024-08-31T04:04:06.035597+0000","last_clean":"2024-08-31T04:04:06.035597+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:04:06.035597+0000","last_undegraded":"2024-08-31T04:04:06.035597+0000","last_fullsized":"2024-08-31T04:04:06.035597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907747+0000","last_change":"2024-08-31T04:04:00.874519+0000","last_active":"2024-08-31T04:04:05.907747+0000","last_peered":"2024-08-31T04:04:05.907747+0000","last_clean":"2024-08-31T04:04:05.907747+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:04:05.907747+0000","last_undegraded":"2024-08-31T04:04:05.907747+0000","last_fullsized":"2024-08-31T04:04:05.907747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:31.628140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904382+0000","last_change":"2024-08-31T04:04:04.974184+0000","last_active":"2024-08-31T04:04:05.904382+0000","last_peered":"2024-08-31T04:04:05.904382+0000","last_clean":"2024-08-31T04:04:05.904382+0000","last_became_active":"2024-08-31T04:04:04.973794+0000","last_became_peered":"2024-08-31T04:04:04.973794+0000","last_unstale":"2024-08-31T04:04:05.904382+0000","last_undegraded":"2024-08-31T04:04:05.904382+0000","last_fullsized":"2024-08-31T04:04:05.904382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:52.867283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907152+0000","last_change":"2024-08-31T04:04:00.867964+0000","last_active":"2024-08-31T04:04:05.907152+0000","last_peered":"2024-08-31T04:04:05.907152+0000","last_clean":"2024-08-31T04:04:05.907152+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:04:05.907152+0000","last_undegraded":"2024-08-31T04:04:05.907152+0000","last_fullsized":"2024-08-31T04:04:05.907152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:43.911244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906774+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:04:05.906774+0000","last_peered":"2024-08-31T04:04:05.906774+0000","last_clean":"2024-08-31T04:04:05.906774+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:04:05.906774+0000","last_undegraded":"2024-08-31T04:04:05.906774+0000","last_fullsized":"2024-08-31T04:04:05.906774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907485+0000","last_change":"2024-08-31T04:04:04.966791+0000","last_active":"2024-08-31T04:04:05.907485+0000","last_peered":"2024-08-31T04:04:05.907485+0000","last_clean":"2024-08-31T04:04:05.907485+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:04:05.907485+0000","last_undegraded":"2024-08-31T04:04:05.907485+0000","last_fullsized":"2024-08-31T04:04:05.907485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:57.768934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041469+0000","last_change":"2024-08-31T04:04:00.887746+0000","last_active":"2024-08-31T04:04:06.041469+0000","last_peered":"2024-08-31T04:04:06.041469+0000","last_clean":"2024-08-31T04:04:06.041469+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:04:06.041469+0000","last_undegraded":"2024-08-31T04:04:06.041469+0000","last_fullsized":"2024-08-31T04:04:06.041469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:27:35.901081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041029+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:04:06.041029+0000","last_peered":"2024-08-31T04:04:06.041029+0000","last_clean":"2024-08-31T04:04:06.041029+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:04:06.041029+0000","last_undegraded":"2024-08-31T04:04:06.041029+0000","last_fullsized":"2024-08-31T04:04:06.041029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034751+0000","last_change":"2024-08-31T04:04:04.954690+0000","last_active":"2024-08-31T04:04:06.034751+0000","last_peered":"2024-08-31T04:04:06.034751+0000","last_clean":"2024-08-31T04:04:06.034751+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:04:06.034751+0000","last_undegraded":"2024-08-31T04:04:06.034751+0000","last_fullsized":"2024-08-31T04:04:06.034751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:11.009989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904518+0000","last_change":"2024-08-31T04:04:00.896360+0000","last_active":"2024-08-31T04:04:05.904518+0000","last_peered":"2024-08-31T04:04:05.904518+0000","last_clean":"2024-08-31T04:04:05.904518+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:04:05.904518+0000","last_undegraded":"2024-08-31T04:04:05.904518+0000","last_fullsized":"2024-08-31T04:04:05.904518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:04.855778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904586+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:04:05.904586+0000","last_peered":"2024-08-31T04:04:05.904586+0000","last_clean":"2024-08-31T04:04:05.904586+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:04:05.904586+0000","last_undegraded":"2024-08-31T04:04:05.904586+0000","last_fullsized":"2024-08-31T04:04:05.904586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044402+0000","last_change":"2024-08-31T04:04:04.946958+0000","last_active":"2024-08-31T04:04:06.044402+0000","last_peered":"2024-08-31T04:04:06.044402+0000","last_clean":"2024-08-31T04:04:06.044402+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:04:06.044402+0000","last_undegraded":"2024-08-31T04:04:06.044402+0000","last_fullsized":"2024-08-31T04:04:06.044402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:41:42.006072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906335+0000","last_change":"2024-08-31T04:04:00.892688+0000","last_active":"2024-08-31T04:04:05.906335+0000","last_peered":"2024-08-31T04:04:05.906335+0000","last_clean":"2024-08-31T04:04:05.906335+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:04:05.906335+0000","last_undegraded":"2024-08-31T04:04:05.906335+0000","last_fullsized":"2024-08-31T04:04:05.906335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:53.521514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034425+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:04:06.034425+0000","last_peered":"2024-08-31T04:04:06.034425+0000","last_clean":"2024-08-31T04:04:06.034425+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:04:06.034425+0000","last_undegraded":"2024-08-31T04:04:06.034425+0000","last_fullsized":"2024-08-31T04:04:06.034425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905529+0000","last_change":"2024-08-31T04:04:04.936785+0000","last_active":"2024-08-31T04:04:05.905529+0000","last_peered":"2024-08-31T04:04:05.905529+0000","last_clean":"2024-08-31T04:04:05.905529+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:04:05.905529+0000","last_undegraded":"2024-08-31T04:04:05.905529+0000","last_fullsized":"2024-08-31T04:04:05.905529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:28:32.101080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905349+0000","last_change":"2024-08-31T04:04:00.891194+0000","last_active":"2024-08-31T04:04:05.905349+0000","last_peered":"2024-08-31T04:04:05.905349+0000","last_clean":"2024-08-31T04:04:05.905349+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:04:05.905349+0000","last_undegraded":"2024-08-31T04:04:05.905349+0000","last_fullsized":"2024-08-31T04:04:05.905349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:20.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908435+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:04:05.908435+0000","last_peered":"2024-08-31T04:04:05.908435+0000","last_clean":"2024-08-31T04:04:05.908435+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:04:05.908435+0000","last_undegraded":"2024-08-31T04:04:05.908435+0000","last_fullsized":"2024-08-31T04:04:05.908435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904222+0000","last_change":"2024-08-31T04:04:04.947787+0000","last_active":"2024-08-31T04:04:05.904222+0000","last_peered":"2024-08-31T04:04:05.904222+0000","last_clean":"2024-08-31T04:04:05.904222+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:04:05.904222+0000","last_undegraded":"2024-08-31T04:04:05.904222+0000","last_fullsized":"2024-08-31T04:04:05.904222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:40.922656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905481+0000","last_change":"2024-08-31T04:04:00.890893+0000","last_active":"2024-08-31T04:04:05.905481+0000","last_peered":"2024-08-31T04:04:05.905481+0000","last_clean":"2024-08-31T04:04:05.905481+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:04:05.905481+0000","last_undegraded":"2024-08-31T04:04:05.905481+0000","last_fullsized":"2024-08-31T04:04:05.905481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:39:17.163345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905683+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:04:05.905683+0000","last_peered":"2024-08-31T04:04:05.905683+0000","last_clean":"2024-08-31T04:04:05.905683+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:04:05.905683+0000","last_undegraded":"2024-08-31T04:04:05.905683+0000","last_fullsized":"2024-08-31T04:04:05.905683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904211+0000","last_change":"2024-08-31T04:04:04.951050+0000","last_active":"2024-08-31T04:04:05.904211+0000","last_peered":"2024-08-31T04:04:05.904211+0000","last_clean":"2024-08-31T04:04:05.904211+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:04:05.904211+0000","last_undegraded":"2024-08-31T04:04:05.904211+0000","last_fullsized":"2024-08-31T04:04:05.904211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:39.320190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042706+0000","last_change":"2024-08-31T04:04:00.887709+0000","last_active":"2024-08-31T04:04:06.042706+0000","last_peered":"2024-08-31T04:04:06.042706+0000","last_clean":"2024-08-31T04:04:06.042706+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:04:06.042706+0000","last_undegraded":"2024-08-31T04:04:06.042706+0000","last_fullsized":"2024-08-31T04:04:06.042706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:15.464663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908034+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:04:05.908034+0000","last_peered":"2024-08-31T04:04:05.908034+0000","last_clean":"2024-08-31T04:04:05.908034+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:04:05.908034+0000","last_undegraded":"2024-08-31T04:04:05.908034+0000","last_fullsized":"2024-08-31T04:04:05.908034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040767+0000","last_change":"2024-08-31T04:04:04.953273+0000","last_active":"2024-08-31T04:04:06.040767+0000","last_peered":"2024-08-31T04:04:06.040767+0000","last_clean":"2024-08-31T04:04:06.040767+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:04:06.040767+0000","last_undegraded":"2024-08-31T04:04:06.040767+0000","last_fullsized":"2024-08-31T04:04:06.040767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:30.841472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905304+0000","last_change":"2024-08-31T04:04:00.887566+0000","last_active":"2024-08-31T04:04:05.905304+0000","last_peered":"2024-08-31T04:04:05.905304+0000","last_clean":"2024-08-31T04:04:05.905304+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:04:05.905304+0000","last_undegraded":"2024-08-31T04:04:05.905304+0000","last_fullsized":"2024-08-31T04:04:05.905304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:17.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038640+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:04:06.038640+0000","last_peered":"2024-08-31T04:04:06.038640+0000","last_clean":"2024-08-31T04:04:06.038640+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:04:06.038640+0000","last_undegraded":"2024-08-31T04:04:06.038640+0000","last_fullsized":"2024-08-31T04:04:06.038640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040223+0000","last_change":"2024-08-31T04:04:04.975251+0000","last_active":"2024-08-31T04:04:06.040223+0000","last_peered":"2024-08-31T04:04:06.040223+0000","last_clean":"2024-08-31T04:04:06.040223+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:04:06.040223+0000","last_undegraded":"2024-08-31T04:04:06.040223+0000","last_fullsized":"2024-08-31T04:04:06.040223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:12.488672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035080+0000","last_change":"2024-08-31T04:04:00.881311+0000","last_active":"2024-08-31T04:04:06.035080+0000","last_peered":"2024-08-31T04:04:06.035080+0000","last_clean":"2024-08-31T04:04:06.035080+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:04:06.035080+0000","last_undegraded":"2024-08-31T04:04:06.035080+0000","last_fullsized":"2024-08-31T04:04:06.035080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:44.361701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907364+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:04:05.907364+0000","last_peered":"2024-08-31T04:04:05.907364+0000","last_clean":"2024-08-31T04:04:05.907364+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:04:05.907364+0000","last_undegraded":"2024-08-31T04:04:05.907364+0000","last_fullsized":"2024-08-31T04:04:05.907364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042168+0000","last_change":"2024-08-31T04:04:04.954216+0000","last_active":"2024-08-31T04:04:06.042168+0000","last_peered":"2024-08-31T04:04:06.042168+0000","last_clean":"2024-08-31T04:04:06.042168+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:04:06.042168+0000","last_undegraded":"2024-08-31T04:04:06.042168+0000","last_fullsized":"2024-08-31T04:04:06.042168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:04.563322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039679+0000","last_change":"2024-08-31T04:04:00.884692+0000","last_active":"2024-08-31T04:04:06.039679+0000","last_peered":"2024-08-31T04:04:06.039679+0000","last_clean":"2024-08-31T04:04:06.039679+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:04:06.039679+0000","last_undegraded":"2024-08-31T04:04:06.039679+0000","last_fullsized":"2024-08-31T04:04:06.039679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:07:45.274820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037948+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:04:06.037948+0000","last_peered":"2024-08-31T04:04:06.037948+0000","last_clean":"2024-08-31T04:04:06.037948+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:04:06.037948+0000","last_undegraded":"2024-08-31T04:04:06.037948+0000","last_fullsized":"2024-08-31T04:04:06.037948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044165+0000","last_change":"2024-08-31T04:04:04.950642+0000","last_active":"2024-08-31T04:04:06.044165+0000","last_peered":"2024-08-31T04:04:06.044165+0000","last_clean":"2024-08-31T04:04:06.044165+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:04:06.044165+0000","last_undegraded":"2024-08-31T04:04:06.044165+0000","last_fullsized":"2024-08-31T04:04:06.044165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:49.300897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038082+0000","last_change":"2024-08-31T04:04:00.886674+0000","last_active":"2024-08-31T04:04:06.038082+0000","last_peered":"2024-08-31T04:04:06.038082+0000","last_clean":"2024-08-31T04:04:06.038082+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:04:06.038082+0000","last_undegraded":"2024-08-31T04:04:06.038082+0000","last_fullsized":"2024-08-31T04:04:06.038082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:46:28.682868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905953+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:04:05.905953+0000","last_peered":"2024-08-31T04:04:05.905953+0000","last_clean":"2024-08-31T04:04:05.905953+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:04:05.905953+0000","last_undegraded":"2024-08-31T04:04:05.905953+0000","last_fullsized":"2024-08-31T04:04:05.905953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040199+0000","last_change":"2024-08-31T04:04:04.973347+0000","last_active":"2024-08-31T04:04:06.040199+0000","last_peered":"2024-08-31T04:04:06.040199+0000","last_clean":"2024-08-31T04:04:06.040199+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:04:06.040199+0000","last_undegraded":"2024-08-31T04:04:06.040199+0000","last_fullsized":"2024-08-31T04:04:06.040199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:30.204653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904564+0000","last_change":"2024-08-31T04:04:00.896365+0000","last_active":"2024-08-31T04:04:05.904564+0000","last_peered":"2024-08-31T04:04:05.904564+0000","last_clean":"2024-08-31T04:04:05.904564+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:04:05.904564+0000","last_undegraded":"2024-08-31T04:04:05.904564+0000","last_fullsized":"2024-08-31T04:04:05.904564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:39.300217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906837+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:04:05.906837+0000","last_peered":"2024-08-31T04:04:05.906837+0000","last_clean":"2024-08-31T04:04:05.906837+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:04:05.906837+0000","last_undegraded":"2024-08-31T04:04:05.906837+0000","last_fullsized":"2024-08-31T04:04:05.906837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034604+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:04:06.034604+0000","last_peered":"2024-08-31T04:04:06.034604+0000","last_clean":"2024-08-31T04:04:06.034604+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:04:06.034604+0000","last_undegraded":"2024-08-31T04:04:06.034604+0000","last_fullsized":"2024-08-31T04:04:06.034604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907888+0000","last_change":"2024-08-31T04:04:04.922468+0000","last_active":"2024-08-31T04:04:05.907888+0000","last_peered":"2024-08-31T04:04:05.907888+0000","last_clean":"2024-08-31T04:04:05.907888+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:04:05.907888+0000","last_undegraded":"2024-08-31T04:04:05.907888+0000","last_fullsized":"2024-08-31T04:04:05.907888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:15.555948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907801+0000","last_change":"2024-08-31T04:04:00.867024+0000","last_active":"2024-08-31T04:04:05.907801+0000","last_peered":"2024-08-31T04:04:05.907801+0000","last_clean":"2024-08-31T04:04:05.907801+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:04:05.907801+0000","last_undegraded":"2024-08-31T04:04:05.907801+0000","last_fullsized":"2024-08-31T04:04:05.907801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:43.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042885+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:04:06.042885+0000","last_peered":"2024-08-31T04:04:06.042885+0000","last_clean":"2024-08-31T04:04:06.042885+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:04:06.042885+0000","last_undegraded":"2024-08-31T04:04:06.042885+0000","last_fullsized":"2024-08-31T04:04:06.042885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904426+0000","last_change":"2024-08-31T04:04:04.938034+0000","last_active":"2024-08-31T04:04:05.904426+0000","last_peered":"2024-08-31T04:04:05.904426+0000","last_clean":"2024-08-31T04:04:05.904426+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:04:05.904426+0000","last_undegraded":"2024-08-31T04:04:05.904426+0000","last_fullsized":"2024-08-31T04:04:05.904426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:46.961448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035417+0000","last_change":"2024-08-31T04:04:00.883610+0000","last_active":"2024-08-31T04:04:06.035417+0000","last_peered":"2024-08-31T04:04:06.035417+0000","last_clean":"2024-08-31T04:04:06.035417+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:04:06.035417+0000","last_undegraded":"2024-08-31T04:04:06.035417+0000","last_fullsized":"2024-08-31T04:04:06.035417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:29.250924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041581+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:04:06.041581+0000","last_peered":"2024-08-31T04:04:06.041581+0000","last_clean":"2024-08-31T04:04:06.041581+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:04:06.041581+0000","last_undegraded":"2024-08-31T04:04:06.041581+0000","last_fullsized":"2024-08-31T04:04:06.041581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039391+0000","last_change":"2024-08-31T04:04:04.979418+0000","last_active":"2024-08-31T04:04:06.039391+0000","last_peered":"2024-08-31T04:04:06.039391+0000","last_clean":"2024-08-31T04:04:06.039391+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:04:06.039391+0000","last_undegraded":"2024-08-31T04:04:06.039391+0000","last_fullsized":"2024-08-31T04:04:06.039391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:40.023243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035347+0000","last_change":"2024-08-31T04:04:00.874137+0000","last_active":"2024-08-31T04:04:06.035347+0000","last_peered":"2024-08-31T04:04:06.035347+0000","last_clean":"2024-08-31T04:04:06.035347+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:04:06.035347+0000","last_undegraded":"2024-08-31T04:04:06.035347+0000","last_fullsized":"2024-08-31T04:04:06.035347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:44.411622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905534+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:04:05.905534+0000","last_peered":"2024-08-31T04:04:05.905534+0000","last_clean":"2024-08-31T04:04:05.905534+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:04:05.905534+0000","last_undegraded":"2024-08-31T04:04:05.905534+0000","last_fullsized":"2024-08-31T04:04:05.905534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904981+0000","last_change":"2024-08-31T04:04:04.918718+0000","last_active":"2024-08-31T04:04:05.904981+0000","last_peered":"2024-08-31T04:04:05.904981+0000","last_clean":"2024-08-31T04:04:05.904981+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:04:05.904981+0000","last_undegraded":"2024-08-31T04:04:05.904981+0000","last_fullsized":"2024-08-31T04:04:05.904981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:04:40.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905941+0000","last_change":"2024-08-31T04:04:00.877667+0000","last_active":"2024-08-31T04:04:05.905941+0000","last_peered":"2024-08-31T04:04:05.905941+0000","last_clean":"2024-08-31T04:04:05.905941+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:04:05.905941+0000","last_undegraded":"2024-08-31T04:04:05.905941+0000","last_fullsized":"2024-08-31T04:04:05.905941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:06:31.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035613+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:04:06.035613+0000","last_peered":"2024-08-31T04:04:06.035613+0000","last_clean":"2024-08-31T04:04:06.035613+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:04:06.035613+0000","last_undegraded":"2024-08-31T04:04:06.035613+0000","last_fullsized":"2024-08-31T04:04:06.035613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034877+0000","last_change":"2024-08-31T04:04:04.959068+0000","last_active":"2024-08-31T04:04:06.034877+0000","last_peered":"2024-08-31T04:04:06.034877+0000","last_clean":"2024-08-31T04:04:06.034877+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:04:06.034877+0000","last_undegraded":"2024-08-31T04:04:06.034877+0000","last_fullsized":"2024-08-31T04:04:06.034877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:46:16.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906227+0000","last_change":"2024-08-31T04:04:00.864542+0000","last_active":"2024-08-31T04:04:05.906227+0000","last_peered":"2024-08-31T04:04:05.906227+0000","last_clean":"2024-08-31T04:04:05.906227+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:04:05.906227+0000","last_undegraded":"2024-08-31T04:04:05.906227+0000","last_fullsized":"2024-08-31T04:04:05.906227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:47.241152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904710+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:04:05.904710+0000","last_peered":"2024-08-31T04:04:05.904710+0000","last_clean":"2024-08-31T04:04:05.904710+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:04:05.904710+0000","last_undegraded":"2024-08-31T04:04:05.904710+0000","last_fullsized":"2024-08-31T04:04:05.904710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040786+0000","last_change":"2024-08-31T04:04:04.966400+0000","last_active":"2024-08-31T04:04:06.040786+0000","last_peered":"2024-08-31T04:04:06.040786+0000","last_clean":"2024-08-31T04:04:06.040786+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:04:06.040786+0000","last_undegraded":"2024-08-31T04:04:06.040786+0000","last_fullsized":"2024-08-31T04:04:06.040786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:18:16.700443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034482+0000","last_change":"2024-08-31T04:04:00.880127+0000","last_active":"2024-08-31T04:04:06.034482+0000","last_peered":"2024-08-31T04:04:06.034482+0000","last_clean":"2024-08-31T04:04:06.034482+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:04:06.034482+0000","last_undegraded":"2024-08-31T04:04:06.034482+0000","last_fullsized":"2024-08-31T04:04:06.034482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034827+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:04:06.034827+0000","last_peered":"2024-08-31T04:04:06.034827+0000","last_clean":"2024-08-31T04:04:06.034827+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:04:06.034827+0000","last_undegraded":"2024-08-31T04:04:06.034827+0000","last_fullsized":"2024-08-31T04:04:06.034827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040447+0000","last_change":"2024-08-31T04:04:04.971102+0000","last_active":"2024-08-31T04:04:06.040447+0000","last_peered":"2024-08-31T04:04:06.040447+0000","last_clean":"2024-08-31T04:04:06.040447+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:04:06.040447+0000","last_undegraded":"2024-08-31T04:04:06.040447+0000","last_fullsized":"2024-08-31T04:04:06.040447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:40.427017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906629+0000","last_change":"2024-08-31T04:04:00.882328+0000","last_active":"2024-08-31T04:04:05.906629+0000","last_peered":"2024-08-31T04:04:05.906629+0000","last_clean":"2024-08-31T04:04:05.906629+0000","last_became_active":"2024-08-31T04:04:00.882009+0000","last_became_peered":"2024-08-31T04:04:00.882009+0000","last_unstale":"2024-08-31T04:04:05.906629+0000","last_undegraded":"2024-08-31T04:04:05.906629+0000","last_fullsized":"2024-08-31T04:04:05.906629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:10:14.622717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907313+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:04:05.907313+0000","last_peered":"2024-08-31T04:04:05.907313+0000","last_clean":"2024-08-31T04:04:05.907313+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:04:05.907313+0000","last_undegraded":"2024-08-31T04:04:05.907313+0000","last_fullsized":"2024-08-31T04:04:05.907313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041921+0000","last_change":"2024-08-31T04:04:04.964690+0000","last_active":"2024-08-31T04:04:06.041921+0000","last_peered":"2024-08-31T04:04:06.041921+0000","last_clean":"2024-08-31T04:04:06.041921+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:04:06.041921+0000","last_undegraded":"2024-08-31T04:04:06.041921+0000","last_fullsized":"2024-08-31T04:04:06.041921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:23.711105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040884+0000","last_change":"2024-08-31T04:04:00.887168+0000","last_active":"2024-08-31T04:04:06.040884+0000","last_peered":"2024-08-31T04:04:06.040884+0000","last_clean":"2024-08-31T04:04:06.040884+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:04:06.040884+0000","last_undegraded":"2024-08-31T04:04:06.040884+0000","last_fullsized":"2024-08-31T04:04:06.040884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:58.272934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043729+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:04:06.043729+0000","last_peered":"2024-08-31T04:04:06.043729+0000","last_clean":"2024-08-31T04:04:06.043729+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:04:06.043729+0000","last_undegraded":"2024-08-31T04:04:06.043729+0000","last_fullsized":"2024-08-31T04:04:06.043729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907657+0000","last_change":"2024-08-31T04:04:04.967183+0000","last_active":"2024-08-31T04:04:05.907657+0000","last_peered":"2024-08-31T04:04:05.907657+0000","last_clean":"2024-08-31T04:04:05.907657+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:04:05.907657+0000","last_undegraded":"2024-08-31T04:04:05.907657+0000","last_fullsized":"2024-08-31T04:04:05.907657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:54.094714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034962+0000","last_change":"2024-08-31T04:04:00.886779+0000","last_active":"2024-08-31T04:04:06.034962+0000","last_peered":"2024-08-31T04:04:06.034962+0000","last_clean":"2024-08-31T04:04:06.034962+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:04:06.034962+0000","last_undegraded":"2024-08-31T04:04:06.034962+0000","last_fullsized":"2024-08-31T04:04:06.034962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:45:51.487016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:14.844048+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:04:14.844048+0000","last_peered":"2024-08-31T04:04:14.844048+0000","last_clean":"2024-08-31T04:04:14.844048+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:04:14.844048+0000","last_undegraded":"2024-08-31T04:04:14.844048+0000","last_fullsized":"2024-08-31T04:04:14.844048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904234+0000","last_change":"2024-08-31T04:04:04.960945+0000","last_active":"2024-08-31T04:04:05.904234+0000","last_peered":"2024-08-31T04:04:05.904234+0000","last_clean":"2024-08-31T04:04:05.904234+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:04:05.904234+0000","last_undegraded":"2024-08-31T04:04:05.904234+0000","last_fullsized":"2024-08-31T04:04:05.904234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:50.907644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906484+0000","last_change":"2024-08-31T04:04:00.869565+0000","last_active":"2024-08-31T04:04:05.906484+0000","last_peered":"2024-08-31T04:04:05.906484+0000","last_clean":"2024-08-31T04:04:05.906484+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:04:05.906484+0000","last_undegraded":"2024-08-31T04:04:05.906484+0000","last_fullsized":"2024-08-31T04:04:05.906484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:37.334753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043126+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:04:06.043126+0000","last_peered":"2024-08-31T04:04:06.043126+0000","last_clean":"2024-08-31T04:04:06.043126+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:04:06.043126+0000","last_undegraded":"2024-08-31T04:04:06.043126+0000","last_fullsized":"2024-08-31T04:04:06.043126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904892+0000","last_change":"2024-08-31T04:04:04.940655+0000","last_active":"2024-08-31T04:04:05.904892+0000","last_peered":"2024-08-31T04:04:05.904892+0000","last_clean":"2024-08-31T04:04:05.904892+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:04:05.904892+0000","last_undegraded":"2024-08-31T04:04:05.904892+0000","last_fullsized":"2024-08-31T04:04:05.904892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:12:39.145645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040892+0000","last_change":"2024-08-31T04:04:00.881774+0000","last_active":"2024-08-31T04:04:06.040892+0000","last_peered":"2024-08-31T04:04:06.040892+0000","last_clean":"2024-08-31T04:04:06.040892+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:04:06.040892+0000","last_undegraded":"2024-08-31T04:04:06.040892+0000","last_fullsized":"2024-08-31T04:04:06.040892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:19.539642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034980+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:04:06.034980+0000","last_peered":"2024-08-31T04:04:06.034980+0000","last_clean":"2024-08-31T04:04:06.034980+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:04:06.034980+0000","last_undegraded":"2024-08-31T04:04:06.034980+0000","last_fullsized":"2024-08-31T04:04:06.034980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037542+0000","last_change":"2024-08-31T04:04:04.948582+0000","last_active":"2024-08-31T04:04:06.037542+0000","last_peered":"2024-08-31T04:04:06.037542+0000","last_clean":"2024-08-31T04:04:06.037542+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:04:06.037542+0000","last_undegraded":"2024-08-31T04:04:06.037542+0000","last_fullsized":"2024-08-31T04:04:06.037542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:35.294731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905846+0000","last_change":"2024-08-31T04:04:00.863199+0000","last_active":"2024-08-31T04:04:05.905846+0000","last_peered":"2024-08-31T04:04:05.905846+0000","last_clean":"2024-08-31T04:04:05.905846+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:04:05.905846+0000","last_undegraded":"2024-08-31T04:04:05.905846+0000","last_fullsized":"2024-08-31T04:04:05.905846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:52.086202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036024+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:04:06.036024+0000","last_peered":"2024-08-31T04:04:06.036024+0000","last_clean":"2024-08-31T04:04:06.036024+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:04:06.036024+0000","last_undegraded":"2024-08-31T04:04:06.036024+0000","last_fullsized":"2024-08-31T04:04:06.036024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904421+0000","last_change":"2024-08-31T04:04:04.940930+0000","last_active":"2024-08-31T04:04:05.904421+0000","last_peered":"2024-08-31T04:04:05.904421+0000","last_clean":"2024-08-31T04:04:05.904421+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:04:05.904421+0000","last_undegraded":"2024-08-31T04:04:05.904421+0000","last_fullsized":"2024-08-31T04:04:05.904421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:07:30.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905335+0000","last_change":"2024-08-31T04:04:04.970283+0000","last_active":"2024-08-31T04:04:05.905335+0000","last_peered":"2024-08-31T04:04:05.905335+0000","last_clean":"2024-08-31T04:04:05.905335+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:04:05.905335+0000","last_undegraded":"2024-08-31T04:04:05.905335+0000","last_fullsized":"2024-08-31T04:04:05.905335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:37.086560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904353+0000","last_change":"2024-08-31T04:04:00.897277+0000","last_active":"2024-08-31T04:04:05.904353+0000","last_peered":"2024-08-31T04:04:05.904353+0000","last_clean":"2024-08-31T04:04:05.904353+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:04:05.904353+0000","last_undegraded":"2024-08-31T04:04:05.904353+0000","last_fullsized":"2024-08-31T04:04:05.904353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:45:42.808934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905834+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:04:05.905834+0000","last_peered":"2024-08-31T04:04:05.905834+0000","last_clean":"2024-08-31T04:04:05.905834+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:04:05.905834+0000","last_undegraded":"2024-08-31T04:04:05.905834+0000","last_fullsized":"2024-08-31T04:04:05.905834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906316+0000","last_change":"2024-08-31T04:04:04.966233+0000","last_active":"2024-08-31T04:04:05.906316+0000","last_peered":"2024-08-31T04:04:05.906316+0000","last_clean":"2024-08-31T04:04:05.906316+0000","last_became_active":"2024-08-31T04:04:04.965854+0000","last_became_peered":"2024-08-31T04:04:04.965854+0000","last_unstale":"2024-08-31T04:04:05.906316+0000","last_undegraded":"2024-08-31T04:04:05.906316+0000","last_fullsized":"2024-08-31T04:04:05.906316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:16.448331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040110+0000","last_change":"2024-08-31T04:04:00.888009+0000","last_active":"2024-08-31T04:04:06.040110+0000","last_peered":"2024-08-31T04:04:06.040110+0000","last_clean":"2024-08-31T04:04:06.040110+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:04:06.040110+0000","last_undegraded":"2024-08-31T04:04:06.040110+0000","last_fullsized":"2024-08-31T04:04:06.040110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:31.977791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038384+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:04:06.038384+0000","last_peered":"2024-08-31T04:04:06.038384+0000","last_clean":"2024-08-31T04:04:06.038384+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:04:06.038384+0000","last_undegraded":"2024-08-31T04:04:06.038384+0000","last_fullsized":"2024-08-31T04:04:06.038384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907256+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:04:05.907256+0000","last_peered":"2024-08-31T04:04:05.907256+0000","last_clean":"2024-08-31T04:04:05.907256+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:04:05.907256+0000","last_undegraded":"2024-08-31T04:04:05.907256+0000","last_fullsized":"2024-08-31T04:04:05.907256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904794+0000","last_change":"2024-08-31T04:04:00.897537+0000","last_active":"2024-08-31T04:04:05.904794+0000","last_peered":"2024-08-31T04:04:05.904794+0000","last_clean":"2024-08-31T04:04:05.904794+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:04:05.904794+0000","last_undegraded":"2024-08-31T04:04:05.904794+0000","last_fullsized":"2024-08-31T04:04:05.904794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:46.422487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905083+0000","last_change":"2024-08-31T04:04:04.961002+0000","last_active":"2024-08-31T04:04:05.905083+0000","last_peered":"2024-08-31T04:04:05.905083+0000","last_clean":"2024-08-31T04:04:05.905083+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:04:05.905083+0000","last_undegraded":"2024-08-31T04:04:05.905083+0000","last_fullsized":"2024-08-31T04:04:05.905083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:45:04.605970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039694+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:04:06.039694+0000","last_peered":"2024-08-31T04:04:06.039694+0000","last_clean":"2024-08-31T04:04:06.039694+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:04:06.039694+0000","last_undegraded":"2024-08-31T04:04:06.039694+0000","last_fullsized":"2024-08-31T04:04:06.039694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035174+0000","last_change":"2024-08-31T04:04:00.878599+0000","last_active":"2024-08-31T04:04:06.035174+0000","last_peered":"2024-08-31T04:04:06.035174+0000","last_clean":"2024-08-31T04:04:06.035174+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:04:06.035174+0000","last_undegraded":"2024-08-31T04:04:06.035174+0000","last_fullsized":"2024-08-31T04:04:06.035174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:37.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043082+0000","last_change":"2024-08-31T04:04:04.975414+0000","last_active":"2024-08-31T04:04:06.043082+0000","last_peered":"2024-08-31T04:04:06.043082+0000","last_clean":"2024-08-31T04:04:06.043082+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:04:06.043082+0000","last_undegraded":"2024-08-31T04:04:06.043082+0000","last_fullsized":"2024-08-31T04:04:06.043082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:12.992949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904092+0000","last_change":"2024-08-31T04:04:00.887117+0000","last_active":"2024-08-31T04:04:05.904092+0000","last_peered":"2024-08-31T04:04:05.904092+0000","last_clean":"2024-08-31T04:04:05.904092+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:04:05.904092+0000","last_undegraded":"2024-08-31T04:04:05.904092+0000","last_fullsized":"2024-08-31T04:04:05.904092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:18:37.474694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037663+0000","last_change":"2024-08-31T04:04:00.881033+0000","last_active":"2024-08-31T04:04:06.037663+0000","last_peered":"2024-08-31T04:04:06.037663+0000","last_clean":"2024-08-31T04:04:06.037663+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:04:06.037663+0000","last_undegraded":"2024-08-31T04:04:06.037663+0000","last_fullsized":"2024-08-31T04:04:06.037663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:46.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907098+0000","last_change":"2024-08-31T04:04:00.879791+0000","last_active":"2024-08-31T04:04:05.907098+0000","last_peered":"2024-08-31T04:04:05.907098+0000","last_clean":"2024-08-31T04:04:05.907098+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:04:05.907098+0000","last_undegraded":"2024-08-31T04:04:05.907098+0000","last_fullsized":"2024-08-31T04:04:05.907098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:00:26.128387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039321+0000","last_change":"2024-08-31T04:04:00.876487+0000","last_active":"2024-08-31T04:04:06.039321+0000","last_peered":"2024-08-31T04:04:06.039321+0000","last_clean":"2024-08-31T04:04:06.039321+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:04:06.039321+0000","last_undegraded":"2024-08-31T04:04:06.039321+0000","last_fullsized":"2024-08-31T04:04:06.039321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:10.867317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042600+0000","last_change":"2024-08-31T04:04:00.888017+0000","last_active":"2024-08-31T04:04:06.042600+0000","last_peered":"2024-08-31T04:04:06.042600+0000","last_clean":"2024-08-31T04:04:06.042600+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:04:06.042600+0000","last_undegraded":"2024-08-31T04:04:06.042600+0000","last_fullsized":"2024-08-31T04:04:06.042600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:53.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042480+0000","last_change":"2024-08-31T04:04:00.885850+0000","last_active":"2024-08-31T04:04:06.042480+0000","last_peered":"2024-08-31T04:04:06.042480+0000","last_clean":"2024-08-31T04:04:06.042480+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:04:06.042480+0000","last_undegraded":"2024-08-31T04:04:06.042480+0000","last_fullsized":"2024-08-31T04:04:06.042480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:07.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905742+0000","last_change":"2024-08-31T04:04:00.870086+0000","last_active":"2024-08-31T04:04:05.905742+0000","last_peered":"2024-08-31T04:04:05.905742+0000","last_clean":"2024-08-31T04:04:05.905742+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:04:05.905742+0000","last_undegraded":"2024-08-31T04:04:05.905742+0000","last_fullsized":"2024-08-31T04:04:05.905742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:59.724104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040115+0000","last_change":"2024-08-31T04:04:00.881124+0000","last_active":"2024-08-31T04:04:06.040115+0000","last_peered":"2024-08-31T04:04:06.040115+0000","last_clean":"2024-08-31T04:04:06.040115+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:04:06.040115+0000","last_undegraded":"2024-08-31T04:04:06.040115+0000","last_fullsized":"2024-08-31T04:04:06.040115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:40.389131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905727+0000","last_change":"2024-08-31T04:04:00.880040+0000","last_active":"2024-08-31T04:04:05.905727+0000","last_peered":"2024-08-31T04:04:05.905727+0000","last_clean":"2024-08-31T04:04:05.905727+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:04:05.905727+0000","last_undegraded":"2024-08-31T04:04:05.905727+0000","last_fullsized":"2024-08-31T04:04:05.905727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:23.110254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039483+0000","last_change":"2024-08-31T04:04:00.867373+0000","last_active":"2024-08-31T04:04:06.039483+0000","last_peered":"2024-08-31T04:04:06.039483+0000","last_clean":"2024-08-31T04:04:06.039483+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:04:06.039483+0000","last_undegraded":"2024-08-31T04:04:06.039483+0000","last_fullsized":"2024-08-31T04:04:06.039483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:47.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035293+0000","last_change":"2024-08-31T04:04:00.884497+0000","last_active":"2024-08-31T04:04:06.035293+0000","last_peered":"2024-08-31T04:04:06.035293+0000","last_clean":"2024-08-31T04:04:06.035293+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:04:06.035293+0000","last_undegraded":"2024-08-31T04:04:06.035293+0000","last_fullsized":"2024-08-31T04:04:06.035293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:10.005789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904753+0000","last_change":"2024-08-31T04:04:00.899676+0000","last_active":"2024-08-31T04:04:05.904753+0000","last_peered":"2024-08-31T04:04:05.904753+0000","last_clean":"2024-08-31T04:04:05.904753+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:04:05.904753+0000","last_undegraded":"2024-08-31T04:04:05.904753+0000","last_fullsized":"2024-08-31T04:04:05.904753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:46.887325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035316+0000","last_change":"2024-08-31T04:04:00.872910+0000","last_active":"2024-08-31T04:04:06.035316+0000","last_peered":"2024-08-31T04:04:06.035316+0000","last_clean":"2024-08-31T04:04:06.035316+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:04:06.035316+0000","last_undegraded":"2024-08-31T04:04:06.035316+0000","last_fullsized":"2024-08-31T04:04:06.035316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:22.208293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907979+0000","last_change":"2024-08-31T04:04:00.897114+0000","last_active":"2024-08-31T04:04:05.907979+0000","last_peered":"2024-08-31T04:04:05.907979+0000","last_clean":"2024-08-31T04:04:05.907979+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:04:05.907979+0000","last_undegraded":"2024-08-31T04:04:05.907979+0000","last_fullsized":"2024-08-31T04:04:05.907979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:13.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044036+0000","last_change":"2024-08-31T04:04:00.879907+0000","last_active":"2024-08-31T04:04:06.044036+0000","last_peered":"2024-08-31T04:04:06.044036+0000","last_clean":"2024-08-31T04:04:06.044036+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:04:06.044036+0000","last_undegraded":"2024-08-31T04:04:06.044036+0000","last_fullsized":"2024-08-31T04:04:06.044036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:11.042911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908418+0000","last_change":"2024-08-31T04:04:00.874247+0000","last_active":"2024-08-31T04:04:05.908418+0000","last_peered":"2024-08-31T04:04:05.908418+0000","last_clean":"2024-08-31T04:04:05.908418+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:04:05.908418+0000","last_undegraded":"2024-08-31T04:04:05.908418+0000","last_fullsized":"2024-08-31T04:04:05.908418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:00.974919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905612+0000","last_change":"2024-08-31T04:04:00.861922+0000","last_active":"2024-08-31T04:04:05.905612+0000","last_peered":"2024-08-31T04:04:05.905612+0000","last_clean":"2024-08-31T04:04:05.905612+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:04:05.905612+0000","last_undegraded":"2024-08-31T04:04:05.905612+0000","last_fullsized":"2024-08-31T04:04:05.905612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:07.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038950+0000","last_change":"2024-08-31T04:04:00.873986+0000","last_active":"2024-08-31T04:04:06.038950+0000","last_peered":"2024-08-31T04:04:06.038950+0000","last_clean":"2024-08-31T04:04:06.038950+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:04:06.038950+0000","last_undegraded":"2024-08-31T04:04:06.038950+0000","last_fullsized":"2024-08-31T04:04:06.038950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:39.934600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040728+0000","last_change":"2024-08-31T04:04:00.887510+0000","last_active":"2024-08-31T04:04:06.040728+0000","last_peered":"2024-08-31T04:04:06.040728+0000","last_clean":"2024-08-31T04:04:06.040728+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:04:06.040728+0000","last_undegraded":"2024-08-31T04:04:06.040728+0000","last_fullsized":"2024-08-31T04:04:06.040728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:29.689714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041269+0000","last_change":"2024-08-31T04:04:00.886364+0000","last_active":"2024-08-31T04:04:06.041269+0000","last_peered":"2024-08-31T04:04:06.041269+0000","last_clean":"2024-08-31T04:04:06.041269+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:04:06.041269+0000","last_undegraded":"2024-08-31T04:04:06.041269+0000","last_fullsized":"2024-08-31T04:04:06.041269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:17.949115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035208+0000","last_change":"2024-08-31T04:04:00.885452+0000","last_active":"2024-08-31T04:04:06.035208+0000","last_peered":"2024-08-31T04:04:06.035208+0000","last_clean":"2024-08-31T04:04:06.035208+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:04:06.035208+0000","last_undegraded":"2024-08-31T04:04:06.035208+0000","last_fullsized":"2024-08-31T04:04:06.035208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:34:58.727576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035971+0000","last_change":"2024-08-31T04:04:00.876816+0000","last_active":"2024-08-31T04:04:06.035971+0000","last_peered":"2024-08-31T04:04:06.035971+0000","last_clean":"2024-08-31T04:04:06.035971+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:04:06.035971+0000","last_undegraded":"2024-08-31T04:04:06.035971+0000","last_fullsized":"2024-08-31T04:04:06.035971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:38.896525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034790+0000","last_change":"2024-08-31T04:04:00.878584+0000","last_active":"2024-08-31T04:04:06.034790+0000","last_peered":"2024-08-31T04:04:06.034790+0000","last_clean":"2024-08-31T04:04:06.034790+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:04:06.034790+0000","last_undegraded":"2024-08-31T04:04:06.034790+0000","last_fullsized":"2024-08-31T04:04:06.034790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:30.201712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035980+0000","last_change":"2024-08-31T04:04:00.866007+0000","last_active":"2024-08-31T04:04:06.035980+0000","last_peered":"2024-08-31T04:04:06.035980+0000","last_clean":"2024-08-31T04:04:06.035980+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:04:06.035980+0000","last_undegraded":"2024-08-31T04:04:06.035980+0000","last_fullsized":"2024-08-31T04:04:06.035980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:05.236271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039665+0000","last_change":"2024-08-31T04:04:00.882356+0000","last_active":"2024-08-31T04:04:06.039665+0000","last_peered":"2024-08-31T04:04:06.039665+0000","last_clean":"2024-08-31T04:04:06.039665+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:04:06.039665+0000","last_undegraded":"2024-08-31T04:04:06.039665+0000","last_fullsized":"2024-08-31T04:04:06.039665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:44:37.026732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034726+0000","last_change":"2024-08-31T04:04:00.897170+0000","last_active":"2024-08-31T04:04:06.034726+0000","last_peered":"2024-08-31T04:04:06.034726+0000","last_clean":"2024-08-31T04:04:06.034726+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:04:06.034726+0000","last_undegraded":"2024-08-31T04:04:06.034726+0000","last_fullsized":"2024-08-31T04:04:06.034726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:05.673647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904588+0000","last_change":"2024-08-31T04:04:00.897956+0000","last_active":"2024-08-31T04:04:05.904588+0000","last_peered":"2024-08-31T04:04:05.904588+0000","last_clean":"2024-08-31T04:04:05.904588+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:04:05.904588+0000","last_undegraded":"2024-08-31T04:04:05.904588+0000","last_fullsized":"2024-08-31T04:04:05.904588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.686037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035844+0000","last_change":"2024-08-31T04:04:00.883315+0000","last_active":"2024-08-31T04:04:06.035844+0000","last_peered":"2024-08-31T04:04:06.035844+0000","last_clean":"2024-08-31T04:04:06.035844+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:04:06.035844+0000","last_undegraded":"2024-08-31T04:04:06.035844+0000","last_fullsized":"2024-08-31T04:04:06.035844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:41.258604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904958+0000","last_change":"2024-08-31T04:04:00.892502+0000","last_active":"2024-08-31T04:04:05.904958+0000","last_peered":"2024-08-31T04:04:05.904958+0000","last_clean":"2024-08-31T04:04:05.904958+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:04:05.904958+0000","last_undegraded":"2024-08-31T04:04:05.904958+0000","last_fullsized":"2024-08-31T04:04:05.904958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:04:48.381328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041280+0000","last_change":"2024-08-31T04:04:00.892994+0000","last_active":"2024-08-31T04:04:06.041280+0000","last_peered":"2024-08-31T04:04:06.041280+0000","last_clean":"2024-08-31T04:04:06.041280+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:04:06.041280+0000","last_undegraded":"2024-08-31T04:04:06.041280+0000","last_fullsized":"2024-08-31T04:04:06.041280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:00.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040294+0000","last_change":"2024-08-31T04:04:00.887325+0000","last_active":"2024-08-31T04:04:06.040294+0000","last_peered":"2024-08-31T04:04:06.040294+0000","last_clean":"2024-08-31T04:04:06.040294+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:04:06.040294+0000","last_undegraded":"2024-08-31T04:04:06.040294+0000","last_fullsized":"2024-08-31T04:04:06.040294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:15.674452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035235+0000","last_change":"2024-08-31T04:04:00.881745+0000","last_active":"2024-08-31T04:04:06.035235+0000","last_peered":"2024-08-31T04:04:06.035235+0000","last_clean":"2024-08-31T04:04:06.035235+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:04:06.035235+0000","last_undegraded":"2024-08-31T04:04:06.035235+0000","last_fullsized":"2024-08-31T04:04:06.035235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:01.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476749,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":105356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476749,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476750,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476750,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":104830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":868352,"data_stored":695234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35624,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336216,"statfs":{"total":96636764160,"available":96600285184,"internally_reserved":0,"allocated":286720,"data_stored":109288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":104898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:04:38.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:04:38.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 -- 172.21.15.89:0/3485154326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc14efb0 msgr2=0x7f7bdc15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 --2- 172.21.15.89:0/3485154326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc14efb0 0x7f7bdc15bed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc06e730 tx=0x7f7bcc01cd60 comp rx=0 tx=0).stop 2024-08-31T04:04:38.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 -- 172.21.15.89:0/3485154326 shutdown_connections 2024-08-31T04:04:38.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 --2- 172.21.15.89:0/3485154326 >> v2:172.21.15.170:3300/0 conn(0x7f7bdc15c410 0x7f7bdc0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 --2- 172.21.15.89:0/3485154326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc14efb0 0x7f7bdc15bed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 -- 172.21.15.89:0/3485154326 >> 172.21.15.89:0/3485154326 conn(0x7f7bdc072590 msgr2=0x7f7bdc0cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:38.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 -- 172.21.15.89:0/3485154326 shutdown_connections 2024-08-31T04:04:38.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 -- 172.21.15.89:0/3485154326 wait complete. 2024-08-31T04:04:38.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 Processor -- start 2024-08-31T04:04:38.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.460+0000 7f7be1400640 1 -- start start 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7be1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc0c9800 0x7f7bdc161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7be1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bdc14efb0 0x7f7bdc1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7be1400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bdc15c410 0x7f7bdc147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7be1400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc0c7820 con 0x7f7bdc0c9800 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7be1400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc0c4b60 con 0x7f7bdc14efb0 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7be1400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc0c79a0 con 0x7f7bdc15c410 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bda800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc0c9800 0x7f7bdc161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bda800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc0c9800 0x7f7bdc161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50522/0 (socket says 172.21.15.89:50522) 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bda800640 1 -- 172.21.15.89:0/803636869 learned_addr learned my addr 172.21.15.89:0/803636869 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:38.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bd1e00640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bdc14efb0 0x7f7bdc1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bdb200640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bdc15c410 0x7f7bdc147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bda800640 1 -- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bdc15c410 msgr2=0x7f7bdc147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bda800640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bdc15c410 0x7f7bdc147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bda800640 1 -- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bdc14efb0 msgr2=0x7f7bdc1f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bda800640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bdc14efb0 0x7f7bdc1f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bda800640 1 -- 172.21.15.89:0/803636869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc1624f0 con 0x7f7bdc0c9800 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bd1e00640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bdc14efb0 0x7f7bdc1f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bda800640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc0c9800 0x7f7bdc161fb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc01b410 tx=0x7f7bcc009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bd3400640 1 -- 172.21.15.89:0/803636869 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0bb070 con 0x7f7bdc0c9800 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bd3400640 1 -- 172.21.15.89:0/803636869 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bcc004d40 con 0x7f7bdc0c9800 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc157a40 con 0x7f7bdc0c9800 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7bd3400640 1 -- 172.21.15.89:0/803636869 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0b2040 con 0x7f7bdc0c9800 2024-08-31T04:04:38.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc161760 con 0x7f7bdc0c9800 2024-08-31T04:04:38.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.464+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc1619a0 con 0x7f7bdc0c9800 2024-08-31T04:04:38.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.468+0000 7f7bd3400640 1 -- 172.21.15.89:0/803636869 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f7bcc0be070 con 0x7f7bdc0c9800 2024-08-31T04:04:38.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.468+0000 7f7bd3400640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7bb80720f0 0x7f7bb8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.468+0000 7f7bd3400640 1 -- 172.21.15.89:0/803636869 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7bcc12ccb0 con 0x7f7bdc0c9800 2024-08-31T04:04:38.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.468+0000 7f7bd1e00640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7bb80720f0 0x7f7bb8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.468+0000 7f7bd1e00640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7bb80720f0 0x7f7bb8074600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4005fd0 tx=0x7f7bc4005f20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:38.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.472+0000 7f7bd3400640 1 -- 172.21.15.89:0/803636869 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7bdc1619a0 con 0x7f7bdc0c9800 2024-08-31T04:04:38.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.636+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7bdc0c81f0 con 0x7f7bb80720f0 2024-08-31T04:04:38.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.652+0000 7f7bd3400640 1 -- 172.21.15.89:0/803636869 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332516 (secure 0 0 0) 0x7f7bdc0c81f0 con 0x7f7bb80720f0 2024-08-31T04:04:38.656 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:04:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7bb80720f0 msgr2=0x7f7bb8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7bb80720f0 0x7f7bb8074600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4005fd0 tx=0x7f7bc4005f20 comp rx=0 tx=0).stop 2024-08-31T04:04:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc0c9800 msgr2=0x7f7bdc161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc0c9800 0x7f7bdc161fb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc01b410 tx=0x7f7bcc009340 comp rx=0 tx=0).stop 2024-08-31T04:04:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 shutdown_connections 2024-08-31T04:04:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7bb80720f0 0x7f7bb8074600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bdc15c410 0x7f7bdc147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bdc14efb0 0x7f7bdc1f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 --2- 172.21.15.89:0/803636869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bdc0c9800 0x7f7bdc161fb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 >> 172.21.15.89:0/803636869 conn(0x7f7bdc072590 msgr2=0x7f7bdc073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 shutdown_connections 2024-08-31T04:04:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.656+0000 7f7be1400640 1 -- 172.21.15.89:0/803636869 wait complete. 2024-08-31T04:04:38.677 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-08-31T04:04:38.133530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730220,"statfs":{"total":773094113280,"available":772843745280,"internally_reserved":0,"allocated":3383296,"data_stored":2028208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006589"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905721+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:04:05.905721+0000","last_peered":"2024-08-31T04:04:05.905721+0000","last_clean":"2024-08-31T04:04:05.905721+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:04:05.905721+0000","last_undegraded":"2024-08-31T04:04:05.905721+0000","last_fullsized":"2024-08-31T04:04:05.905721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040713+0000","last_change":"2024-08-31T04:04:00.866522+0000","last_active":"2024-08-31T04:04:06.040713+0000","last_peered":"2024-08-31T04:04:06.040713+0000","last_clean":"2024-08-31T04:04:06.040713+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:04:06.040713+0000","last_undegraded":"2024-08-31T04:04:06.040713+0000","last_fullsized":"2024-08-31T04:04:06.040713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:05.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039577+0000","last_change":"2024-08-31T04:04:04.956192+0000","last_active":"2024-08-31T04:04:06.039577+0000","last_peered":"2024-08-31T04:04:06.039577+0000","last_clean":"2024-08-31T04:04:06.039577+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:04:06.039577+0000","last_undegraded":"2024-08-31T04:04:06.039577+0000","last_fullsized":"2024-08-31T04:04:06.039577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:42.517705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041009+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:04:06.041009+0000","last_peered":"2024-08-31T04:04:06.041009+0000","last_clean":"2024-08-31T04:04:06.041009+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:04:06.041009+0000","last_undegraded":"2024-08-31T04:04:06.041009+0000","last_fullsized":"2024-08-31T04:04:06.041009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040614+0000","last_change":"2024-08-31T04:04:00.880748+0000","last_active":"2024-08-31T04:04:06.040614+0000","last_peered":"2024-08-31T04:04:06.040614+0000","last_clean":"2024-08-31T04:04:06.040614+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:04:06.040614+0000","last_undegraded":"2024-08-31T04:04:06.040614+0000","last_fullsized":"2024-08-31T04:04:06.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:45.564722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904053+0000","last_change":"2024-08-31T04:04:04.951253+0000","last_active":"2024-08-31T04:04:05.904053+0000","last_peered":"2024-08-31T04:04:05.904053+0000","last_clean":"2024-08-31T04:04:05.904053+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:04:05.904053+0000","last_undegraded":"2024-08-31T04:04:05.904053+0000","last_fullsized":"2024-08-31T04:04:05.904053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:06.131485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035168+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:04:06.035168+0000","last_peered":"2024-08-31T04:04:06.035168+0000","last_clean":"2024-08-31T04:04:06.035168+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:04:06.035168+0000","last_undegraded":"2024-08-31T04:04:06.035168+0000","last_fullsized":"2024-08-31T04:04:06.035168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036133+0000","last_change":"2024-08-31T04:04:00.873539+0000","last_active":"2024-08-31T04:04:06.036133+0000","last_peered":"2024-08-31T04:04:06.036133+0000","last_clean":"2024-08-31T04:04:06.036133+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:04:06.036133+0000","last_undegraded":"2024-08-31T04:04:06.036133+0000","last_fullsized":"2024-08-31T04:04:06.036133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:48.946116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904728+0000","last_change":"2024-08-31T04:04:04.972277+0000","last_active":"2024-08-31T04:04:05.904728+0000","last_peered":"2024-08-31T04:04:05.904728+0000","last_clean":"2024-08-31T04:04:05.904728+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:04:05.904728+0000","last_undegraded":"2024-08-31T04:04:05.904728+0000","last_fullsized":"2024-08-31T04:04:05.904728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:25.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035597+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:04:06.035597+0000","last_peered":"2024-08-31T04:04:06.035597+0000","last_clean":"2024-08-31T04:04:06.035597+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:04:06.035597+0000","last_undegraded":"2024-08-31T04:04:06.035597+0000","last_fullsized":"2024-08-31T04:04:06.035597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907747+0000","last_change":"2024-08-31T04:04:00.874519+0000","last_active":"2024-08-31T04:04:05.907747+0000","last_peered":"2024-08-31T04:04:05.907747+0000","last_clean":"2024-08-31T04:04:05.907747+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:04:05.907747+0000","last_undegraded":"2024-08-31T04:04:05.907747+0000","last_fullsized":"2024-08-31T04:04:05.907747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:31.628140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904382+0000","last_change":"2024-08-31T04:04:04.974184+0000","last_active":"2024-08-31T04:04:05.904382+0000","last_peered":"2024-08-31T04:04:05.904382+0000","last_clean":"2024-08-31T04:04:05.904382+0000","last_became_active":"2024-08-31T04:04:04.973794+0000","last_became_peered":"2024-08-31T04:04:04.973794+0000","last_unstale":"2024-08-31T04:04:05.904382+0000","last_undegraded":"2024-08-31T04:04:05.904382+0000","last_fullsized":"2024-08-31T04:04:05.904382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:52.867283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907152+0000","last_change":"2024-08-31T04:04:00.867964+0000","last_active":"2024-08-31T04:04:05.907152+0000","last_peered":"2024-08-31T04:04:05.907152+0000","last_clean":"2024-08-31T04:04:05.907152+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:04:05.907152+0000","last_undegraded":"2024-08-31T04:04:05.907152+0000","last_fullsized":"2024-08-31T04:04:05.907152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:43.911244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906774+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:04:05.906774+0000","last_peered":"2024-08-31T04:04:05.906774+0000","last_clean":"2024-08-31T04:04:05.906774+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:04:05.906774+0000","last_undegraded":"2024-08-31T04:04:05.906774+0000","last_fullsized":"2024-08-31T04:04:05.906774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907485+0000","last_change":"2024-08-31T04:04:04.966791+0000","last_active":"2024-08-31T04:04:05.907485+0000","last_peered":"2024-08-31T04:04:05.907485+0000","last_clean":"2024-08-31T04:04:05.907485+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:04:05.907485+0000","last_undegraded":"2024-08-31T04:04:05.907485+0000","last_fullsized":"2024-08-31T04:04:05.907485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:57.768934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041469+0000","last_change":"2024-08-31T04:04:00.887746+0000","last_active":"2024-08-31T04:04:06.041469+0000","last_peered":"2024-08-31T04:04:06.041469+0000","last_clean":"2024-08-31T04:04:06.041469+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:04:06.041469+0000","last_undegraded":"2024-08-31T04:04:06.041469+0000","last_fullsized":"2024-08-31T04:04:06.041469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:27:35.901081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041029+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:04:06.041029+0000","last_peered":"2024-08-31T04:04:06.041029+0000","last_clean":"2024-08-31T04:04:06.041029+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:04:06.041029+0000","last_undegraded":"2024-08-31T04:04:06.041029+0000","last_fullsized":"2024-08-31T04:04:06.041029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034751+0000","last_change":"2024-08-31T04:04:04.954690+0000","last_active":"2024-08-31T04:04:06.034751+0000","last_peered":"2024-08-31T04:04:06.034751+0000","last_clean":"2024-08-31T04:04:06.034751+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:04:06.034751+0000","last_undegraded":"2024-08-31T04:04:06.034751+0000","last_fullsized":"2024-08-31T04:04:06.034751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:11.009989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904518+0000","last_change":"2024-08-31T04:04:00.896360+0000","last_active":"2024-08-31T04:04:05.904518+0000","last_peered":"2024-08-31T04:04:05.904518+0000","last_clean":"2024-08-31T04:04:05.904518+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:04:05.904518+0000","last_undegraded":"2024-08-31T04:04:05.904518+0000","last_fullsized":"2024-08-31T04:04:05.904518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:04.855778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904586+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:04:05.904586+0000","last_peered":"2024-08-31T04:04:05.904586+0000","last_clean":"2024-08-31T04:04:05.904586+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:04:05.904586+0000","last_undegraded":"2024-08-31T04:04:05.904586+0000","last_fullsized":"2024-08-31T04:04:05.904586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044402+0000","last_change":"2024-08-31T04:04:04.946958+0000","last_active":"2024-08-31T04:04:06.044402+0000","last_peered":"2024-08-31T04:04:06.044402+0000","last_clean":"2024-08-31T04:04:06.044402+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:04:06.044402+0000","last_undegraded":"2024-08-31T04:04:06.044402+0000","last_fullsized":"2024-08-31T04:04:06.044402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:41:42.006072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906335+0000","last_change":"2024-08-31T04:04:00.892688+0000","last_active":"2024-08-31T04:04:05.906335+0000","last_peered":"2024-08-31T04:04:05.906335+0000","last_clean":"2024-08-31T04:04:05.906335+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:04:05.906335+0000","last_undegraded":"2024-08-31T04:04:05.906335+0000","last_fullsized":"2024-08-31T04:04:05.906335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:53.521514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034425+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:04:06.034425+0000","last_peered":"2024-08-31T04:04:06.034425+0000","last_clean":"2024-08-31T04:04:06.034425+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:04:06.034425+0000","last_undegraded":"2024-08-31T04:04:06.034425+0000","last_fullsized":"2024-08-31T04:04:06.034425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905529+0000","last_change":"2024-08-31T04:04:04.936785+0000","last_active":"2024-08-31T04:04:05.905529+0000","last_peered":"2024-08-31T04:04:05.905529+0000","last_clean":"2024-08-31T04:04:05.905529+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:04:05.905529+0000","last_undegraded":"2024-08-31T04:04:05.905529+0000","last_fullsized":"2024-08-31T04:04:05.905529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:28:32.101080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905349+0000","last_change":"2024-08-31T04:04:00.891194+0000","last_active":"2024-08-31T04:04:05.905349+0000","last_peered":"2024-08-31T04:04:05.905349+0000","last_clean":"2024-08-31T04:04:05.905349+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:04:05.905349+0000","last_undegraded":"2024-08-31T04:04:05.905349+0000","last_fullsized":"2024-08-31T04:04:05.905349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:20.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908435+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:04:05.908435+0000","last_peered":"2024-08-31T04:04:05.908435+0000","last_clean":"2024-08-31T04:04:05.908435+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:04:05.908435+0000","last_undegraded":"2024-08-31T04:04:05.908435+0000","last_fullsized":"2024-08-31T04:04:05.908435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904222+0000","last_change":"2024-08-31T04:04:04.947787+0000","last_active":"2024-08-31T04:04:05.904222+0000","last_peered":"2024-08-31T04:04:05.904222+0000","last_clean":"2024-08-31T04:04:05.904222+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:04:05.904222+0000","last_undegraded":"2024-08-31T04:04:05.904222+0000","last_fullsized":"2024-08-31T04:04:05.904222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:40.922656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905481+0000","last_change":"2024-08-31T04:04:00.890893+0000","last_active":"2024-08-31T04:04:05.905481+0000","last_peered":"2024-08-31T04:04:05.905481+0000","last_clean":"2024-08-31T04:04:05.905481+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:04:05.905481+0000","last_undegraded":"2024-08-31T04:04:05.905481+0000","last_fullsized":"2024-08-31T04:04:05.905481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:39:17.163345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905683+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:04:05.905683+0000","last_peered":"2024-08-31T04:04:05.905683+0000","last_clean":"2024-08-31T04:04:05.905683+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:04:05.905683+0000","last_undegraded":"2024-08-31T04:04:05.905683+0000","last_fullsized":"2024-08-31T04:04:05.905683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904211+0000","last_change":"2024-08-31T04:04:04.951050+0000","last_active":"2024-08-31T04:04:05.904211+0000","last_peered":"2024-08-31T04:04:05.904211+0000","last_clean":"2024-08-31T04:04:05.904211+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:04:05.904211+0000","last_undegraded":"2024-08-31T04:04:05.904211+0000","last_fullsized":"2024-08-31T04:04:05.904211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:39.320190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042706+0000","last_change":"2024-08-31T04:04:00.887709+0000","last_active":"2024-08-31T04:04:06.042706+0000","last_peered":"2024-08-31T04:04:06.042706+0000","last_clean":"2024-08-31T04:04:06.042706+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:04:06.042706+0000","last_undegraded":"2024-08-31T04:04:06.042706+0000","last_fullsized":"2024-08-31T04:04:06.042706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:15.464663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908034+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:04:05.908034+0000","last_peered":"2024-08-31T04:04:05.908034+0000","last_clean":"2024-08-31T04:04:05.908034+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:04:05.908034+0000","last_undegraded":"2024-08-31T04:04:05.908034+0000","last_fullsized":"2024-08-31T04:04:05.908034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040767+0000","last_change":"2024-08-31T04:04:04.953273+0000","last_active":"2024-08-31T04:04:06.040767+0000","last_peered":"2024-08-31T04:04:06.040767+0000","last_clean":"2024-08-31T04:04:06.040767+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:04:06.040767+0000","last_undegraded":"2024-08-31T04:04:06.040767+0000","last_fullsized":"2024-08-31T04:04:06.040767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:30.841472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905304+0000","last_change":"2024-08-31T04:04:00.887566+0000","last_active":"2024-08-31T04:04:05.905304+0000","last_peered":"2024-08-31T04:04:05.905304+0000","last_clean":"2024-08-31T04:04:05.905304+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:04:05.905304+0000","last_undegraded":"2024-08-31T04:04:05.905304+0000","last_fullsized":"2024-08-31T04:04:05.905304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:17.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038640+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:04:06.038640+0000","last_peered":"2024-08-31T04:04:06.038640+0000","last_clean":"2024-08-31T04:04:06.038640+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:04:06.038640+0000","last_undegraded":"2024-08-31T04:04:06.038640+0000","last_fullsized":"2024-08-31T04:04:06.038640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040223+0000","last_change":"2024-08-31T04:04:04.975251+0000","last_active":"2024-08-31T04:04:06.040223+0000","last_peered":"2024-08-31T04:04:06.040223+0000","last_clean":"2024-08-31T04:04:06.040223+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:04:06.040223+0000","last_undegraded":"2024-08-31T04:04:06.040223+0000","last_fullsized":"2024-08-31T04:04:06.040223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:12.488672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035080+0000","last_change":"2024-08-31T04:04:00.881311+0000","last_active":"2024-08-31T04:04:06.035080+0000","last_peered":"2024-08-31T04:04:06.035080+0000","last_clean":"2024-08-31T04:04:06.035080+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:04:06.035080+0000","last_undegraded":"2024-08-31T04:04:06.035080+0000","last_fullsized":"2024-08-31T04:04:06.035080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:44.361701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907364+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:04:05.907364+0000","last_peered":"2024-08-31T04:04:05.907364+0000","last_clean":"2024-08-31T04:04:05.907364+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:04:05.907364+0000","last_undegraded":"2024-08-31T04:04:05.907364+0000","last_fullsized":"2024-08-31T04:04:05.907364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042168+0000","last_change":"2024-08-31T04:04:04.954216+0000","last_active":"2024-08-31T04:04:06.042168+0000","last_peered":"2024-08-31T04:04:06.042168+0000","last_clean":"2024-08-31T04:04:06.042168+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:04:06.042168+0000","last_undegraded":"2024-08-31T04:04:06.042168+0000","last_fullsized":"2024-08-31T04:04:06.042168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:04.563322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039679+0000","last_change":"2024-08-31T04:04:00.884692+0000","last_active":"2024-08-31T04:04:06.039679+0000","last_peered":"2024-08-31T04:04:06.039679+0000","last_clean":"2024-08-31T04:04:06.039679+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:04:06.039679+0000","last_undegraded":"2024-08-31T04:04:06.039679+0000","last_fullsized":"2024-08-31T04:04:06.039679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:07:45.274820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037948+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:04:06.037948+0000","last_peered":"2024-08-31T04:04:06.037948+0000","last_clean":"2024-08-31T04:04:06.037948+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:04:06.037948+0000","last_undegraded":"2024-08-31T04:04:06.037948+0000","last_fullsized":"2024-08-31T04:04:06.037948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044165+0000","last_change":"2024-08-31T04:04:04.950642+0000","last_active":"2024-08-31T04:04:06.044165+0000","last_peered":"2024-08-31T04:04:06.044165+0000","last_clean":"2024-08-31T04:04:06.044165+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:04:06.044165+0000","last_undegraded":"2024-08-31T04:04:06.044165+0000","last_fullsized":"2024-08-31T04:04:06.044165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:49.300897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038082+0000","last_change":"2024-08-31T04:04:00.886674+0000","last_active":"2024-08-31T04:04:06.038082+0000","last_peered":"2024-08-31T04:04:06.038082+0000","last_clean":"2024-08-31T04:04:06.038082+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:04:06.038082+0000","last_undegraded":"2024-08-31T04:04:06.038082+0000","last_fullsized":"2024-08-31T04:04:06.038082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:46:28.682868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905953+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:04:05.905953+0000","last_peered":"2024-08-31T04:04:05.905953+0000","last_clean":"2024-08-31T04:04:05.905953+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:04:05.905953+0000","last_undegraded":"2024-08-31T04:04:05.905953+0000","last_fullsized":"2024-08-31T04:04:05.905953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040199+0000","last_change":"2024-08-31T04:04:04.973347+0000","last_active":"2024-08-31T04:04:06.040199+0000","last_peered":"2024-08-31T04:04:06.040199+0000","last_clean":"2024-08-31T04:04:06.040199+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:04:06.040199+0000","last_undegraded":"2024-08-31T04:04:06.040199+0000","last_fullsized":"2024-08-31T04:04:06.040199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:30.204653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904564+0000","last_change":"2024-08-31T04:04:00.896365+0000","last_active":"2024-08-31T04:04:05.904564+0000","last_peered":"2024-08-31T04:04:05.904564+0000","last_clean":"2024-08-31T04:04:05.904564+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:04:05.904564+0000","last_undegraded":"2024-08-31T04:04:05.904564+0000","last_fullsized":"2024-08-31T04:04:05.904564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:39.300217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906837+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:04:05.906837+0000","last_peered":"2024-08-31T04:04:05.906837+0000","last_clean":"2024-08-31T04:04:05.906837+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:04:05.906837+0000","last_undegraded":"2024-08-31T04:04:05.906837+0000","last_fullsized":"2024-08-31T04:04:05.906837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034604+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:04:06.034604+0000","last_peered":"2024-08-31T04:04:06.034604+0000","last_clean":"2024-08-31T04:04:06.034604+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:04:06.034604+0000","last_undegraded":"2024-08-31T04:04:06.034604+0000","last_fullsized":"2024-08-31T04:04:06.034604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907888+0000","last_change":"2024-08-31T04:04:04.922468+0000","last_active":"2024-08-31T04:04:05.907888+0000","last_peered":"2024-08-31T04:04:05.907888+0000","last_clean":"2024-08-31T04:04:05.907888+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:04:05.907888+0000","last_undegraded":"2024-08-31T04:04:05.907888+0000","last_fullsized":"2024-08-31T04:04:05.907888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:15.555948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907801+0000","last_change":"2024-08-31T04:04:00.867024+0000","last_active":"2024-08-31T04:04:05.907801+0000","last_peered":"2024-08-31T04:04:05.907801+0000","last_clean":"2024-08-31T04:04:05.907801+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:04:05.907801+0000","last_undegraded":"2024-08-31T04:04:05.907801+0000","last_fullsized":"2024-08-31T04:04:05.907801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:43.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042885+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:04:06.042885+0000","last_peered":"2024-08-31T04:04:06.042885+0000","last_clean":"2024-08-31T04:04:06.042885+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:04:06.042885+0000","last_undegraded":"2024-08-31T04:04:06.042885+0000","last_fullsized":"2024-08-31T04:04:06.042885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904426+0000","last_change":"2024-08-31T04:04:04.938034+0000","last_active":"2024-08-31T04:04:05.904426+0000","last_peered":"2024-08-31T04:04:05.904426+0000","last_clean":"2024-08-31T04:04:05.904426+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:04:05.904426+0000","last_undegraded":"2024-08-31T04:04:05.904426+0000","last_fullsized":"2024-08-31T04:04:05.904426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:46.961448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035417+0000","last_change":"2024-08-31T04:04:00.883610+0000","last_active":"2024-08-31T04:04:06.035417+0000","last_peered":"2024-08-31T04:04:06.035417+0000","last_clean":"2024-08-31T04:04:06.035417+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:04:06.035417+0000","last_undegraded":"2024-08-31T04:04:06.035417+0000","last_fullsized":"2024-08-31T04:04:06.035417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:29.250924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041581+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:04:06.041581+0000","last_peered":"2024-08-31T04:04:06.041581+0000","last_clean":"2024-08-31T04:04:06.041581+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:04:06.041581+0000","last_undegraded":"2024-08-31T04:04:06.041581+0000","last_fullsized":"2024-08-31T04:04:06.041581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039391+0000","last_change":"2024-08-31T04:04:04.979418+0000","last_active":"2024-08-31T04:04:06.039391+0000","last_peered":"2024-08-31T04:04:06.039391+0000","last_clean":"2024-08-31T04:04:06.039391+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:04:06.039391+0000","last_undegraded":"2024-08-31T04:04:06.039391+0000","last_fullsized":"2024-08-31T04:04:06.039391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:40.023243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035347+0000","last_change":"2024-08-31T04:04:00.874137+0000","last_active":"2024-08-31T04:04:06.035347+0000","last_peered":"2024-08-31T04:04:06.035347+0000","last_clean":"2024-08-31T04:04:06.035347+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:04:06.035347+0000","last_undegraded":"2024-08-31T04:04:06.035347+0000","last_fullsized":"2024-08-31T04:04:06.035347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:44.411622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905534+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:04:05.905534+0000","last_peered":"2024-08-31T04:04:05.905534+0000","last_clean":"2024-08-31T04:04:05.905534+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:04:05.905534+0000","last_undegraded":"2024-08-31T04:04:05.905534+0000","last_fullsized":"2024-08-31T04:04:05.905534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904981+0000","last_change":"2024-08-31T04:04:04.918718+0000","last_active":"2024-08-31T04:04:05.904981+0000","last_peered":"2024-08-31T04:04:05.904981+0000","last_clean":"2024-08-31T04:04:05.904981+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:04:05.904981+0000","last_undegraded":"2024-08-31T04:04:05.904981+0000","last_fullsized":"2024-08-31T04:04:05.904981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:04:40.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905941+0000","last_change":"2024-08-31T04:04:00.877667+0000","last_active":"2024-08-31T04:04:05.905941+0000","last_peered":"2024-08-31T04:04:05.905941+0000","last_clean":"2024-08-31T04:04:05.905941+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:04:05.905941+0000","last_undegraded":"2024-08-31T04:04:05.905941+0000","last_fullsized":"2024-08-31T04:04:05.905941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:06:31.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035613+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:04:06.035613+0000","last_peered":"2024-08-31T04:04:06.035613+0000","last_clean":"2024-08-31T04:04:06.035613+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:04:06.035613+0000","last_undegraded":"2024-08-31T04:04:06.035613+0000","last_fullsized":"2024-08-31T04:04:06.035613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034877+0000","last_change":"2024-08-31T04:04:04.959068+0000","last_active":"2024-08-31T04:04:06.034877+0000","last_peered":"2024-08-31T04:04:06.034877+0000","last_clean":"2024-08-31T04:04:06.034877+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:04:06.034877+0000","last_undegraded":"2024-08-31T04:04:06.034877+0000","last_fullsized":"2024-08-31T04:04:06.034877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:46:16.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906227+0000","last_change":"2024-08-31T04:04:00.864542+0000","last_active":"2024-08-31T04:04:05.906227+0000","last_peered":"2024-08-31T04:04:05.906227+0000","last_clean":"2024-08-31T04:04:05.906227+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:04:05.906227+0000","last_undegraded":"2024-08-31T04:04:05.906227+0000","last_fullsized":"2024-08-31T04:04:05.906227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:47.241152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904710+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:04:05.904710+0000","last_peered":"2024-08-31T04:04:05.904710+0000","last_clean":"2024-08-31T04:04:05.904710+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:04:05.904710+0000","last_undegraded":"2024-08-31T04:04:05.904710+0000","last_fullsized":"2024-08-31T04:04:05.904710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040786+0000","last_change":"2024-08-31T04:04:04.966400+0000","last_active":"2024-08-31T04:04:06.040786+0000","last_peered":"2024-08-31T04:04:06.040786+0000","last_clean":"2024-08-31T04:04:06.040786+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:04:06.040786+0000","last_undegraded":"2024-08-31T04:04:06.040786+0000","last_fullsized":"2024-08-31T04:04:06.040786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:18:16.700443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034482+0000","last_change":"2024-08-31T04:04:00.880127+0000","last_active":"2024-08-31T04:04:06.034482+0000","last_peered":"2024-08-31T04:04:06.034482+0000","last_clean":"2024-08-31T04:04:06.034482+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:04:06.034482+0000","last_undegraded":"2024-08-31T04:04:06.034482+0000","last_fullsized":"2024-08-31T04:04:06.034482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034827+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:04:06.034827+0000","last_peered":"2024-08-31T04:04:06.034827+0000","last_clean":"2024-08-31T04:04:06.034827+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:04:06.034827+0000","last_undegraded":"2024-08-31T04:04:06.034827+0000","last_fullsized":"2024-08-31T04:04:06.034827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040447+0000","last_change":"2024-08-31T04:04:04.971102+0000","last_active":"2024-08-31T04:04:06.040447+0000","last_peered":"2024-08-31T04:04:06.040447+0000","last_clean":"2024-08-31T04:04:06.040447+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:04:06.040447+0000","last_undegraded":"2024-08-31T04:04:06.040447+0000","last_fullsized":"2024-08-31T04:04:06.040447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:40.427017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906629+0000","last_change":"2024-08-31T04:04:00.882328+0000","last_active":"2024-08-31T04:04:05.906629+0000","last_peered":"2024-08-31T04:04:05.906629+0000","last_clean":"2024-08-31T04:04:05.906629+0000","last_became_active":"2024-08-31T04:04:00.882009+0000","last_became_peered":"2024-08-31T04:04:00.882009+0000","last_unstale":"2024-08-31T04:04:05.906629+0000","last_undegraded":"2024-08-31T04:04:05.906629+0000","last_fullsized":"2024-08-31T04:04:05.906629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:10:14.622717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907313+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:04:05.907313+0000","last_peered":"2024-08-31T04:04:05.907313+0000","last_clean":"2024-08-31T04:04:05.907313+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:04:05.907313+0000","last_undegraded":"2024-08-31T04:04:05.907313+0000","last_fullsized":"2024-08-31T04:04:05.907313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041921+0000","last_change":"2024-08-31T04:04:04.964690+0000","last_active":"2024-08-31T04:04:06.041921+0000","last_peered":"2024-08-31T04:04:06.041921+0000","last_clean":"2024-08-31T04:04:06.041921+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:04:06.041921+0000","last_undegraded":"2024-08-31T04:04:06.041921+0000","last_fullsized":"2024-08-31T04:04:06.041921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:23.711105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040884+0000","last_change":"2024-08-31T04:04:00.887168+0000","last_active":"2024-08-31T04:04:06.040884+0000","last_peered":"2024-08-31T04:04:06.040884+0000","last_clean":"2024-08-31T04:04:06.040884+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:04:06.040884+0000","last_undegraded":"2024-08-31T04:04:06.040884+0000","last_fullsized":"2024-08-31T04:04:06.040884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:58.272934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043729+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:04:06.043729+0000","last_peered":"2024-08-31T04:04:06.043729+0000","last_clean":"2024-08-31T04:04:06.043729+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:04:06.043729+0000","last_undegraded":"2024-08-31T04:04:06.043729+0000","last_fullsized":"2024-08-31T04:04:06.043729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907657+0000","last_change":"2024-08-31T04:04:04.967183+0000","last_active":"2024-08-31T04:04:05.907657+0000","last_peered":"2024-08-31T04:04:05.907657+0000","last_clean":"2024-08-31T04:04:05.907657+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:04:05.907657+0000","last_undegraded":"2024-08-31T04:04:05.907657+0000","last_fullsized":"2024-08-31T04:04:05.907657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:54.094714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034962+0000","last_change":"2024-08-31T04:04:00.886779+0000","last_active":"2024-08-31T04:04:06.034962+0000","last_peered":"2024-08-31T04:04:06.034962+0000","last_clean":"2024-08-31T04:04:06.034962+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:04:06.034962+0000","last_undegraded":"2024-08-31T04:04:06.034962+0000","last_fullsized":"2024-08-31T04:04:06.034962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:45:51.487016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:14.844048+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:04:14.844048+0000","last_peered":"2024-08-31T04:04:14.844048+0000","last_clean":"2024-08-31T04:04:14.844048+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:04:14.844048+0000","last_undegraded":"2024-08-31T04:04:14.844048+0000","last_fullsized":"2024-08-31T04:04:14.844048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904234+0000","last_change":"2024-08-31T04:04:04.960945+0000","last_active":"2024-08-31T04:04:05.904234+0000","last_peered":"2024-08-31T04:04:05.904234+0000","last_clean":"2024-08-31T04:04:05.904234+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:04:05.904234+0000","last_undegraded":"2024-08-31T04:04:05.904234+0000","last_fullsized":"2024-08-31T04:04:05.904234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:50.907644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906484+0000","last_change":"2024-08-31T04:04:00.869565+0000","last_active":"2024-08-31T04:04:05.906484+0000","last_peered":"2024-08-31T04:04:05.906484+0000","last_clean":"2024-08-31T04:04:05.906484+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:04:05.906484+0000","last_undegraded":"2024-08-31T04:04:05.906484+0000","last_fullsized":"2024-08-31T04:04:05.906484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:37.334753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043126+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:04:06.043126+0000","last_peered":"2024-08-31T04:04:06.043126+0000","last_clean":"2024-08-31T04:04:06.043126+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:04:06.043126+0000","last_undegraded":"2024-08-31T04:04:06.043126+0000","last_fullsized":"2024-08-31T04:04:06.043126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904892+0000","last_change":"2024-08-31T04:04:04.940655+0000","last_active":"2024-08-31T04:04:05.904892+0000","last_peered":"2024-08-31T04:04:05.904892+0000","last_clean":"2024-08-31T04:04:05.904892+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:04:05.904892+0000","last_undegraded":"2024-08-31T04:04:05.904892+0000","last_fullsized":"2024-08-31T04:04:05.904892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:12:39.145645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040892+0000","last_change":"2024-08-31T04:04:00.881774+0000","last_active":"2024-08-31T04:04:06.040892+0000","last_peered":"2024-08-31T04:04:06.040892+0000","last_clean":"2024-08-31T04:04:06.040892+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:04:06.040892+0000","last_undegraded":"2024-08-31T04:04:06.040892+0000","last_fullsized":"2024-08-31T04:04:06.040892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:19.539642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034980+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:04:06.034980+0000","last_peered":"2024-08-31T04:04:06.034980+0000","last_clean":"2024-08-31T04:04:06.034980+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:04:06.034980+0000","last_undegraded":"2024-08-31T04:04:06.034980+0000","last_fullsized":"2024-08-31T04:04:06.034980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037542+0000","last_change":"2024-08-31T04:04:04.948582+0000","last_active":"2024-08-31T04:04:06.037542+0000","last_peered":"2024-08-31T04:04:06.037542+0000","last_clean":"2024-08-31T04:04:06.037542+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:04:06.037542+0000","last_undegraded":"2024-08-31T04:04:06.037542+0000","last_fullsized":"2024-08-31T04:04:06.037542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:35.294731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905846+0000","last_change":"2024-08-31T04:04:00.863199+0000","last_active":"2024-08-31T04:04:05.905846+0000","last_peered":"2024-08-31T04:04:05.905846+0000","last_clean":"2024-08-31T04:04:05.905846+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:04:05.905846+0000","last_undegraded":"2024-08-31T04:04:05.905846+0000","last_fullsized":"2024-08-31T04:04:05.905846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:52.086202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036024+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:04:06.036024+0000","last_peered":"2024-08-31T04:04:06.036024+0000","last_clean":"2024-08-31T04:04:06.036024+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:04:06.036024+0000","last_undegraded":"2024-08-31T04:04:06.036024+0000","last_fullsized":"2024-08-31T04:04:06.036024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904421+0000","last_change":"2024-08-31T04:04:04.940930+0000","last_active":"2024-08-31T04:04:05.904421+0000","last_peered":"2024-08-31T04:04:05.904421+0000","last_clean":"2024-08-31T04:04:05.904421+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:04:05.904421+0000","last_undegraded":"2024-08-31T04:04:05.904421+0000","last_fullsized":"2024-08-31T04:04:05.904421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:07:30.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905335+0000","last_change":"2024-08-31T04:04:04.970283+0000","last_active":"2024-08-31T04:04:05.905335+0000","last_peered":"2024-08-31T04:04:05.905335+0000","last_clean":"2024-08-31T04:04:05.905335+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:04:05.905335+0000","last_undegraded":"2024-08-31T04:04:05.905335+0000","last_fullsized":"2024-08-31T04:04:05.905335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:37.086560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904353+0000","last_change":"2024-08-31T04:04:00.897277+0000","last_active":"2024-08-31T04:04:05.904353+0000","last_peered":"2024-08-31T04:04:05.904353+0000","last_clean":"2024-08-31T04:04:05.904353+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:04:05.904353+0000","last_undegraded":"2024-08-31T04:04:05.904353+0000","last_fullsized":"2024-08-31T04:04:05.904353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:45:42.808934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905834+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:04:05.905834+0000","last_peered":"2024-08-31T04:04:05.905834+0000","last_clean":"2024-08-31T04:04:05.905834+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:04:05.905834+0000","last_undegraded":"2024-08-31T04:04:05.905834+0000","last_fullsized":"2024-08-31T04:04:05.905834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906316+0000","last_change":"2024-08-31T04:04:04.966233+0000","last_active":"2024-08-31T04:04:05.906316+0000","last_peered":"2024-08-31T04:04:05.906316+0000","last_clean":"2024-08-31T04:04:05.906316+0000","last_became_active":"2024-08-31T04:04:04.965854+0000","last_became_peered":"2024-08-31T04:04:04.965854+0000","last_unstale":"2024-08-31T04:04:05.906316+0000","last_undegraded":"2024-08-31T04:04:05.906316+0000","last_fullsized":"2024-08-31T04:04:05.906316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:16.448331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040110+0000","last_change":"2024-08-31T04:04:00.888009+0000","last_active":"2024-08-31T04:04:06.040110+0000","last_peered":"2024-08-31T04:04:06.040110+0000","last_clean":"2024-08-31T04:04:06.040110+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:04:06.040110+0000","last_undegraded":"2024-08-31T04:04:06.040110+0000","last_fullsized":"2024-08-31T04:04:06.040110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:31.977791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038384+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:04:06.038384+0000","last_peered":"2024-08-31T04:04:06.038384+0000","last_clean":"2024-08-31T04:04:06.038384+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:04:06.038384+0000","last_undegraded":"2024-08-31T04:04:06.038384+0000","last_fullsized":"2024-08-31T04:04:06.038384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907256+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:04:05.907256+0000","last_peered":"2024-08-31T04:04:05.907256+0000","last_clean":"2024-08-31T04:04:05.907256+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:04:05.907256+0000","last_undegraded":"2024-08-31T04:04:05.907256+0000","last_fullsized":"2024-08-31T04:04:05.907256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904794+0000","last_change":"2024-08-31T04:04:00.897537+0000","last_active":"2024-08-31T04:04:05.904794+0000","last_peered":"2024-08-31T04:04:05.904794+0000","last_clean":"2024-08-31T04:04:05.904794+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:04:05.904794+0000","last_undegraded":"2024-08-31T04:04:05.904794+0000","last_fullsized":"2024-08-31T04:04:05.904794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:46.422487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905083+0000","last_change":"2024-08-31T04:04:04.961002+0000","last_active":"2024-08-31T04:04:05.905083+0000","last_peered":"2024-08-31T04:04:05.905083+0000","last_clean":"2024-08-31T04:04:05.905083+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:04:05.905083+0000","last_undegraded":"2024-08-31T04:04:05.905083+0000","last_fullsized":"2024-08-31T04:04:05.905083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:45:04.605970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039694+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:04:06.039694+0000","last_peered":"2024-08-31T04:04:06.039694+0000","last_clean":"2024-08-31T04:04:06.039694+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:04:06.039694+0000","last_undegraded":"2024-08-31T04:04:06.039694+0000","last_fullsized":"2024-08-31T04:04:06.039694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035174+0000","last_change":"2024-08-31T04:04:00.878599+0000","last_active":"2024-08-31T04:04:06.035174+0000","last_peered":"2024-08-31T04:04:06.035174+0000","last_clean":"2024-08-31T04:04:06.035174+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:04:06.035174+0000","last_undegraded":"2024-08-31T04:04:06.035174+0000","last_fullsized":"2024-08-31T04:04:06.035174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:37.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043082+0000","last_change":"2024-08-31T04:04:04.975414+0000","last_active":"2024-08-31T04:04:06.043082+0000","last_peered":"2024-08-31T04:04:06.043082+0000","last_clean":"2024-08-31T04:04:06.043082+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:04:06.043082+0000","last_undegraded":"2024-08-31T04:04:06.043082+0000","last_fullsized":"2024-08-31T04:04:06.043082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:12.992949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904092+0000","last_change":"2024-08-31T04:04:00.887117+0000","last_active":"2024-08-31T04:04:05.904092+0000","last_peered":"2024-08-31T04:04:05.904092+0000","last_clean":"2024-08-31T04:04:05.904092+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:04:05.904092+0000","last_undegraded":"2024-08-31T04:04:05.904092+0000","last_fullsized":"2024-08-31T04:04:05.904092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:18:37.474694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037663+0000","last_change":"2024-08-31T04:04:00.881033+0000","last_active":"2024-08-31T04:04:06.037663+0000","last_peered":"2024-08-31T04:04:06.037663+0000","last_clean":"2024-08-31T04:04:06.037663+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:04:06.037663+0000","last_undegraded":"2024-08-31T04:04:06.037663+0000","last_fullsized":"2024-08-31T04:04:06.037663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:46.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907098+0000","last_change":"2024-08-31T04:04:00.879791+0000","last_active":"2024-08-31T04:04:05.907098+0000","last_peered":"2024-08-31T04:04:05.907098+0000","last_clean":"2024-08-31T04:04:05.907098+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:04:05.907098+0000","last_undegraded":"2024-08-31T04:04:05.907098+0000","last_fullsized":"2024-08-31T04:04:05.907098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:00:26.128387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039321+0000","last_change":"2024-08-31T04:04:00.876487+0000","last_active":"2024-08-31T04:04:06.039321+0000","last_peered":"2024-08-31T04:04:06.039321+0000","last_clean":"2024-08-31T04:04:06.039321+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:04:06.039321+0000","last_undegraded":"2024-08-31T04:04:06.039321+0000","last_fullsized":"2024-08-31T04:04:06.039321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:10.867317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042600+0000","last_change":"2024-08-31T04:04:00.888017+0000","last_active":"2024-08-31T04:04:06.042600+0000","last_peered":"2024-08-31T04:04:06.042600+0000","last_clean":"2024-08-31T04:04:06.042600+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:04:06.042600+0000","last_undegraded":"2024-08-31T04:04:06.042600+0000","last_fullsized":"2024-08-31T04:04:06.042600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:53.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042480+0000","last_change":"2024-08-31T04:04:00.885850+0000","last_active":"2024-08-31T04:04:06.042480+0000","last_peered":"2024-08-31T04:04:06.042480+0000","last_clean":"2024-08-31T04:04:06.042480+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:04:06.042480+0000","last_undegraded":"2024-08-31T04:04:06.042480+0000","last_fullsized":"2024-08-31T04:04:06.042480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:07.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905742+0000","last_change":"2024-08-31T04:04:00.870086+0000","last_active":"2024-08-31T04:04:05.905742+0000","last_peered":"2024-08-31T04:04:05.905742+0000","last_clean":"2024-08-31T04:04:05.905742+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:04:05.905742+0000","last_undegraded":"2024-08-31T04:04:05.905742+0000","last_fullsized":"2024-08-31T04:04:05.905742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:59.724104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040115+0000","last_change":"2024-08-31T04:04:00.881124+0000","last_active":"2024-08-31T04:04:06.040115+0000","last_peered":"2024-08-31T04:04:06.040115+0000","last_clean":"2024-08-31T04:04:06.040115+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:04:06.040115+0000","last_undegraded":"2024-08-31T04:04:06.040115+0000","last_fullsized":"2024-08-31T04:04:06.040115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:40.389131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905727+0000","last_change":"2024-08-31T04:04:00.880040+0000","last_active":"2024-08-31T04:04:05.905727+0000","last_peered":"2024-08-31T04:04:05.905727+0000","last_clean":"2024-08-31T04:04:05.905727+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:04:05.905727+0000","last_undegraded":"2024-08-31T04:04:05.905727+0000","last_fullsized":"2024-08-31T04:04:05.905727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:23.110254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039483+0000","last_change":"2024-08-31T04:04:00.867373+0000","last_active":"2024-08-31T04:04:06.039483+0000","last_peered":"2024-08-31T04:04:06.039483+0000","last_clean":"2024-08-31T04:04:06.039483+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:04:06.039483+0000","last_undegraded":"2024-08-31T04:04:06.039483+0000","last_fullsized":"2024-08-31T04:04:06.039483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:47.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035293+0000","last_change":"2024-08-31T04:04:00.884497+0000","last_active":"2024-08-31T04:04:06.035293+0000","last_peered":"2024-08-31T04:04:06.035293+0000","last_clean":"2024-08-31T04:04:06.035293+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:04:06.035293+0000","last_undegraded":"2024-08-31T04:04:06.035293+0000","last_fullsized":"2024-08-31T04:04:06.035293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:10.005789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904753+0000","last_change":"2024-08-31T04:04:00.899676+0000","last_active":"2024-08-31T04:04:05.904753+0000","last_peered":"2024-08-31T04:04:05.904753+0000","last_clean":"2024-08-31T04:04:05.904753+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:04:05.904753+0000","last_undegraded":"2024-08-31T04:04:05.904753+0000","last_fullsized":"2024-08-31T04:04:05.904753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:46.887325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035316+0000","last_change":"2024-08-31T04:04:00.872910+0000","last_active":"2024-08-31T04:04:06.035316+0000","last_peered":"2024-08-31T04:04:06.035316+0000","last_clean":"2024-08-31T04:04:06.035316+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:04:06.035316+0000","last_undegraded":"2024-08-31T04:04:06.035316+0000","last_fullsized":"2024-08-31T04:04:06.035316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:22.208293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907979+0000","last_change":"2024-08-31T04:04:00.897114+0000","last_active":"2024-08-31T04:04:05.907979+0000","last_peered":"2024-08-31T04:04:05.907979+0000","last_clean":"2024-08-31T04:04:05.907979+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:04:05.907979+0000","last_undegraded":"2024-08-31T04:04:05.907979+0000","last_fullsized":"2024-08-31T04:04:05.907979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:13.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044036+0000","last_change":"2024-08-31T04:04:00.879907+0000","last_active":"2024-08-31T04:04:06.044036+0000","last_peered":"2024-08-31T04:04:06.044036+0000","last_clean":"2024-08-31T04:04:06.044036+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:04:06.044036+0000","last_undegraded":"2024-08-31T04:04:06.044036+0000","last_fullsized":"2024-08-31T04:04:06.044036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:11.042911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908418+0000","last_change":"2024-08-31T04:04:00.874247+0000","last_active":"2024-08-31T04:04:05.908418+0000","last_peered":"2024-08-31T04:04:05.908418+0000","last_clean":"2024-08-31T04:04:05.908418+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:04:05.908418+0000","last_undegraded":"2024-08-31T04:04:05.908418+0000","last_fullsized":"2024-08-31T04:04:05.908418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:00.974919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905612+0000","last_change":"2024-08-31T04:04:00.861922+0000","last_active":"2024-08-31T04:04:05.905612+0000","last_peered":"2024-08-31T04:04:05.905612+0000","last_clean":"2024-08-31T04:04:05.905612+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:04:05.905612+0000","last_undegraded":"2024-08-31T04:04:05.905612+0000","last_fullsized":"2024-08-31T04:04:05.905612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:07.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038950+0000","last_change":"2024-08-31T04:04:00.873986+0000","last_active":"2024-08-31T04:04:06.038950+0000","last_peered":"2024-08-31T04:04:06.038950+0000","last_clean":"2024-08-31T04:04:06.038950+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:04:06.038950+0000","last_undegraded":"2024-08-31T04:04:06.038950+0000","last_fullsized":"2024-08-31T04:04:06.038950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:39.934600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040728+0000","last_change":"2024-08-31T04:04:00.887510+0000","last_active":"2024-08-31T04:04:06.040728+0000","last_peered":"2024-08-31T04:04:06.040728+0000","last_clean":"2024-08-31T04:04:06.040728+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:04:06.040728+0000","last_undegraded":"2024-08-31T04:04:06.040728+0000","last_fullsized":"2024-08-31T04:04:06.040728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:29.689714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041269+0000","last_change":"2024-08-31T04:04:00.886364+0000","last_active":"2024-08-31T04:04:06.041269+0000","last_peered":"2024-08-31T04:04:06.041269+0000","last_clean":"2024-08-31T04:04:06.041269+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:04:06.041269+0000","last_undegraded":"2024-08-31T04:04:06.041269+0000","last_fullsized":"2024-08-31T04:04:06.041269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:17.949115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035208+0000","last_change":"2024-08-31T04:04:00.885452+0000","last_active":"2024-08-31T04:04:06.035208+0000","last_peered":"2024-08-31T04:04:06.035208+0000","last_clean":"2024-08-31T04:04:06.035208+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:04:06.035208+0000","last_undegraded":"2024-08-31T04:04:06.035208+0000","last_fullsized":"2024-08-31T04:04:06.035208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:34:58.727576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035971+0000","last_change":"2024-08-31T04:04:00.876816+0000","last_active":"2024-08-31T04:04:06.035971+0000","last_peered":"2024-08-31T04:04:06.035971+0000","last_clean":"2024-08-31T04:04:06.035971+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:04:06.035971+0000","last_undegraded":"2024-08-31T04:04:06.035971+0000","last_fullsized":"2024-08-31T04:04:06.035971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:38.896525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034790+0000","last_change":"2024-08-31T04:04:00.878584+0000","last_active":"2024-08-31T04:04:06.034790+0000","last_peered":"2024-08-31T04:04:06.034790+0000","last_clean":"2024-08-31T04:04:06.034790+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:04:06.034790+0000","last_undegraded":"2024-08-31T04:04:06.034790+0000","last_fullsized":"2024-08-31T04:04:06.034790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:30.201712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035980+0000","last_change":"2024-08-31T04:04:00.866007+0000","last_active":"2024-08-31T04:04:06.035980+0000","last_peered":"2024-08-31T04:04:06.035980+0000","last_clean":"2024-08-31T04:04:06.035980+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:04:06.035980+0000","last_undegraded":"2024-08-31T04:04:06.035980+0000","last_fullsized":"2024-08-31T04:04:06.035980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:05.236271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039665+0000","last_change":"2024-08-31T04:04:00.882356+0000","last_active":"2024-08-31T04:04:06.039665+0000","last_peered":"2024-08-31T04:04:06.039665+0000","last_clean":"2024-08-31T04:04:06.039665+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:04:06.039665+0000","last_undegraded":"2024-08-31T04:04:06.039665+0000","last_fullsized":"2024-08-31T04:04:06.039665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:44:37.026732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034726+0000","last_change":"2024-08-31T04:04:00.897170+0000","last_active":"2024-08-31T04:04:06.034726+0000","last_peered":"2024-08-31T04:04:06.034726+0000","last_clean":"2024-08-31T04:04:06.034726+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:04:06.034726+0000","last_undegraded":"2024-08-31T04:04:06.034726+0000","last_fullsized":"2024-08-31T04:04:06.034726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:05.673647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904588+0000","last_change":"2024-08-31T04:04:00.897956+0000","last_active":"2024-08-31T04:04:05.904588+0000","last_peered":"2024-08-31T04:04:05.904588+0000","last_clean":"2024-08-31T04:04:05.904588+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:04:05.904588+0000","last_undegraded":"2024-08-31T04:04:05.904588+0000","last_fullsized":"2024-08-31T04:04:05.904588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.686037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035844+0000","last_change":"2024-08-31T04:04:00.883315+0000","last_active":"2024-08-31T04:04:06.035844+0000","last_peered":"2024-08-31T04:04:06.035844+0000","last_clean":"2024-08-31T04:04:06.035844+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:04:06.035844+0000","last_undegraded":"2024-08-31T04:04:06.035844+0000","last_fullsized":"2024-08-31T04:04:06.035844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:41.258604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904958+0000","last_change":"2024-08-31T04:04:00.892502+0000","last_active":"2024-08-31T04:04:05.904958+0000","last_peered":"2024-08-31T04:04:05.904958+0000","last_clean":"2024-08-31T04:04:05.904958+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:04:05.904958+0000","last_undegraded":"2024-08-31T04:04:05.904958+0000","last_fullsized":"2024-08-31T04:04:05.904958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:04:48.381328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041280+0000","last_change":"2024-08-31T04:04:00.892994+0000","last_active":"2024-08-31T04:04:06.041280+0000","last_peered":"2024-08-31T04:04:06.041280+0000","last_clean":"2024-08-31T04:04:06.041280+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:04:06.041280+0000","last_undegraded":"2024-08-31T04:04:06.041280+0000","last_fullsized":"2024-08-31T04:04:06.041280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:00.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040294+0000","last_change":"2024-08-31T04:04:00.887325+0000","last_active":"2024-08-31T04:04:06.040294+0000","last_peered":"2024-08-31T04:04:06.040294+0000","last_clean":"2024-08-31T04:04:06.040294+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:04:06.040294+0000","last_undegraded":"2024-08-31T04:04:06.040294+0000","last_fullsized":"2024-08-31T04:04:06.040294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:15.674452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035235+0000","last_change":"2024-08-31T04:04:00.881745+0000","last_active":"2024-08-31T04:04:06.035235+0000","last_peered":"2024-08-31T04:04:06.035235+0000","last_clean":"2024-08-31T04:04:06.035235+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:04:06.035235+0000","last_undegraded":"2024-08-31T04:04:06.035235+0000","last_fullsized":"2024-08-31T04:04:06.035235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:01.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476749,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":105356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476749,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476750,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476750,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":104830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":868352,"data_stored":695234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35624,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336216,"statfs":{"total":96636764160,"available":96600285184,"internally_reserved":0,"allocated":286720,"data_stored":109288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":104898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:04:38.682 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-31T04:04:38.683 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:04:38.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.872+0000 7f2f14a00640 1 -- 172.21.15.89:0/2123529389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f10074e20 msgr2=0x7f2f10156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.872+0000 7f2f14a00640 1 --2- 172.21.15.89:0/2123529389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f10074e20 0x7f2f10156e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f10073410 tx=0x7f2f0001f580 comp rx=0 tx=0).stop 2024-08-31T04:04:38.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.872+0000 7f2f14a00640 1 -- 172.21.15.89:0/2123529389 shutdown_connections 2024-08-31T04:04:38.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.872+0000 7f2f14a00640 1 --2- 172.21.15.89:0/2123529389 >> v2:172.21.15.170:3300/0 conn(0x7f2f1015ce10 0x7f2f100c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.872+0000 7f2f14a00640 1 --2- 172.21.15.89:0/2123529389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f10074e20 0x7f2f10156e10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.872+0000 7f2f14a00640 1 -- 172.21.15.89:0/2123529389 >> 172.21.15.89:0/2123529389 conn(0x7f2f100ccf20 msgr2=0x7f2f100cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:38.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.872+0000 7f2f14a00640 1 -- 172.21.15.89:0/2123529389 shutdown_connections 2024-08-31T04:04:38.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.872+0000 7f2f14a00640 1 -- 172.21.15.89:0/2123529389 wait complete. 2024-08-31T04:04:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f14a00640 1 Processor -- start 2024-08-31T04:04:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f14a00640 1 -- start start 2024-08-31T04:04:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f14a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f10074e20 0x7f2f10156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f14a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f1015ce10 0x7f2f1015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f14a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f1015d220 0x7f2f101e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f14a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10159c90 con 0x7f2f1015ce10 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f14a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101599b0 con 0x7f2f1015d220 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f14a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2f10159f70 con 0x7f2f10074e20 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f0d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f1015ce10 0x7f2f1015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f0d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f1015ce10 0x7f2f1015b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50532/0 (socket says 172.21.15.89:50532) 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.876+0000 7f2f0d400640 1 -- 172.21.15.89:0/1357929332 learned_addr learned my addr 172.21.15.89:0/1357929332 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f0de00640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f10074e20 0x7f2f10156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f0e800640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f1015d220 0x7f2f101e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f0d400640 1 -- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f10074e20 msgr2=0x7f2f10156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f0d400640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f10074e20 0x7f2f10156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f0d400640 1 -- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f1015d220 msgr2=0x7f2f101e6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f0d400640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f1015d220 0x7f2f101e6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f0d400640 1 -- 172.21.15.89:0/1357929332 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f10156690 con 0x7f2f1015ce10 2024-08-31T04:04:38.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f0d400640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f1015ce10 0x7f2f1015b9f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00e7c0 tx=0x7f2efc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:38.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f06000640 1 -- 172.21.15.89:0/1357929332 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00ccc0 con 0x7f2f1015ce10 2024-08-31T04:04:38.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f06000640 1 -- 172.21.15.89:0/1357929332 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2efc00ce80 con 0x7f2f1015ce10 2024-08-31T04:04:38.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f06000640 1 -- 172.21.15.89:0/1357929332 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc005280 con 0x7f2f1015ce10 2024-08-31T04:04:38.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1015ab10 con 0x7f2f1015ce10 2024-08-31T04:04:38.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f10155380 con 0x7f2f1015ce10 2024-08-31T04:04:38.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1015c5f0 con 0x7f2f1015ce10 2024-08-31T04:04:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.880+0000 7f2f06000640 1 -- 172.21.15.89:0/1357929332 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2efc005420 con 0x7f2f1015ce10 2024-08-31T04:04:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.884+0000 7f2f06000640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2ef00720f0 0x7f2ef0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.884+0000 7f2f06000640 1 -- 172.21.15.89:0/1357929332 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2efc0938a0 con 0x7f2f1015ce10 2024-08-31T04:04:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.884+0000 7f2f0de00640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2ef00720f0 0x7f2ef0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:38.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.884+0000 7f2f0de00640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2ef00720f0 0x7f2ef0074600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2f000b3000 tx=0x7f2f0001ddc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:38.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:38.888+0000 7f2f06000640 1 -- 172.21.15.89:0/1357929332 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2efc05ee10 con 0x7f2f1015ce10 2024-08-31T04:04:39.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.048+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f10071e40 con 0x7f2ef00720f0 2024-08-31T04:04:39.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.064+0000 7f2f06000640 1 -- 172.21.15.89:0/1357929332 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332516 (secure 0 0 0) 0x7f2f10071e40 con 0x7f2ef00720f0 2024-08-31T04:04:39.071 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:39.073 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:04:39.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2ef00720f0 msgr2=0x7f2ef0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2ef00720f0 0x7f2ef0074600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2f000b3000 tx=0x7f2f0001ddc0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f1015ce10 msgr2=0x7f2f1015b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f1015ce10 0x7f2f1015b9f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00e7c0 tx=0x7f2efc00ec80 comp rx=0 tx=0).stop 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 shutdown_connections 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2ef00720f0 0x7f2ef0074600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f1015ce10 0x7f2f1015b9f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f1015d220 0x7f2f101e6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 --2- 172.21.15.89:0/1357929332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f10074e20 0x7f2f10156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 >> 172.21.15.89:0/1357929332 conn(0x7f2f100ccf20 msgr2=0x7f2f100b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 shutdown_connections 2024-08-31T04:04:39.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.068+0000 7f2f14a00640 1 -- 172.21.15.89:0/1357929332 wait complete. 2024-08-31T04:04:39.092 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-08-31T04:04:38.133530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244500,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730220,"statfs":{"total":773094113280,"available":772843745280,"internally_reserved":0,"allocated":3383296,"data_stored":2028208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006589"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905721+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:04:05.905721+0000","last_peered":"2024-08-31T04:04:05.905721+0000","last_clean":"2024-08-31T04:04:05.905721+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:04:05.905721+0000","last_undegraded":"2024-08-31T04:04:05.905721+0000","last_fullsized":"2024-08-31T04:04:05.905721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040713+0000","last_change":"2024-08-31T04:04:00.866522+0000","last_active":"2024-08-31T04:04:06.040713+0000","last_peered":"2024-08-31T04:04:06.040713+0000","last_clean":"2024-08-31T04:04:06.040713+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:04:06.040713+0000","last_undegraded":"2024-08-31T04:04:06.040713+0000","last_fullsized":"2024-08-31T04:04:06.040713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:05.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039577+0000","last_change":"2024-08-31T04:04:04.956192+0000","last_active":"2024-08-31T04:04:06.039577+0000","last_peered":"2024-08-31T04:04:06.039577+0000","last_clean":"2024-08-31T04:04:06.039577+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:04:06.039577+0000","last_undegraded":"2024-08-31T04:04:06.039577+0000","last_fullsized":"2024-08-31T04:04:06.039577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:47:42.517705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041009+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:04:06.041009+0000","last_peered":"2024-08-31T04:04:06.041009+0000","last_clean":"2024-08-31T04:04:06.041009+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:04:06.041009+0000","last_undegraded":"2024-08-31T04:04:06.041009+0000","last_fullsized":"2024-08-31T04:04:06.041009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040614+0000","last_change":"2024-08-31T04:04:00.880748+0000","last_active":"2024-08-31T04:04:06.040614+0000","last_peered":"2024-08-31T04:04:06.040614+0000","last_clean":"2024-08-31T04:04:06.040614+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:04:06.040614+0000","last_undegraded":"2024-08-31T04:04:06.040614+0000","last_fullsized":"2024-08-31T04:04:06.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:45.564722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904053+0000","last_change":"2024-08-31T04:04:04.951253+0000","last_active":"2024-08-31T04:04:05.904053+0000","last_peered":"2024-08-31T04:04:05.904053+0000","last_clean":"2024-08-31T04:04:05.904053+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:04:05.904053+0000","last_undegraded":"2024-08-31T04:04:05.904053+0000","last_fullsized":"2024-08-31T04:04:05.904053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:06.131485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035168+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:04:06.035168+0000","last_peered":"2024-08-31T04:04:06.035168+0000","last_clean":"2024-08-31T04:04:06.035168+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:04:06.035168+0000","last_undegraded":"2024-08-31T04:04:06.035168+0000","last_fullsized":"2024-08-31T04:04:06.035168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036133+0000","last_change":"2024-08-31T04:04:00.873539+0000","last_active":"2024-08-31T04:04:06.036133+0000","last_peered":"2024-08-31T04:04:06.036133+0000","last_clean":"2024-08-31T04:04:06.036133+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:04:06.036133+0000","last_undegraded":"2024-08-31T04:04:06.036133+0000","last_fullsized":"2024-08-31T04:04:06.036133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:48.946116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904728+0000","last_change":"2024-08-31T04:04:04.972277+0000","last_active":"2024-08-31T04:04:05.904728+0000","last_peered":"2024-08-31T04:04:05.904728+0000","last_clean":"2024-08-31T04:04:05.904728+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:04:05.904728+0000","last_undegraded":"2024-08-31T04:04:05.904728+0000","last_fullsized":"2024-08-31T04:04:05.904728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:25.959288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035597+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:04:06.035597+0000","last_peered":"2024-08-31T04:04:06.035597+0000","last_clean":"2024-08-31T04:04:06.035597+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:04:06.035597+0000","last_undegraded":"2024-08-31T04:04:06.035597+0000","last_fullsized":"2024-08-31T04:04:06.035597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907747+0000","last_change":"2024-08-31T04:04:00.874519+0000","last_active":"2024-08-31T04:04:05.907747+0000","last_peered":"2024-08-31T04:04:05.907747+0000","last_clean":"2024-08-31T04:04:05.907747+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:04:05.907747+0000","last_undegraded":"2024-08-31T04:04:05.907747+0000","last_fullsized":"2024-08-31T04:04:05.907747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:31.628140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904382+0000","last_change":"2024-08-31T04:04:04.974184+0000","last_active":"2024-08-31T04:04:05.904382+0000","last_peered":"2024-08-31T04:04:05.904382+0000","last_clean":"2024-08-31T04:04:05.904382+0000","last_became_active":"2024-08-31T04:04:04.973794+0000","last_became_peered":"2024-08-31T04:04:04.973794+0000","last_unstale":"2024-08-31T04:04:05.904382+0000","last_undegraded":"2024-08-31T04:04:05.904382+0000","last_fullsized":"2024-08-31T04:04:05.904382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:52.867283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907152+0000","last_change":"2024-08-31T04:04:00.867964+0000","last_active":"2024-08-31T04:04:05.907152+0000","last_peered":"2024-08-31T04:04:05.907152+0000","last_clean":"2024-08-31T04:04:05.907152+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:04:05.907152+0000","last_undegraded":"2024-08-31T04:04:05.907152+0000","last_fullsized":"2024-08-31T04:04:05.907152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:43.911244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906774+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:04:05.906774+0000","last_peered":"2024-08-31T04:04:05.906774+0000","last_clean":"2024-08-31T04:04:05.906774+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:04:05.906774+0000","last_undegraded":"2024-08-31T04:04:05.906774+0000","last_fullsized":"2024-08-31T04:04:05.906774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907485+0000","last_change":"2024-08-31T04:04:04.966791+0000","last_active":"2024-08-31T04:04:05.907485+0000","last_peered":"2024-08-31T04:04:05.907485+0000","last_clean":"2024-08-31T04:04:05.907485+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:04:05.907485+0000","last_undegraded":"2024-08-31T04:04:05.907485+0000","last_fullsized":"2024-08-31T04:04:05.907485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:57.768934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041469+0000","last_change":"2024-08-31T04:04:00.887746+0000","last_active":"2024-08-31T04:04:06.041469+0000","last_peered":"2024-08-31T04:04:06.041469+0000","last_clean":"2024-08-31T04:04:06.041469+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:04:06.041469+0000","last_undegraded":"2024-08-31T04:04:06.041469+0000","last_fullsized":"2024-08-31T04:04:06.041469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:27:35.901081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041029+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:04:06.041029+0000","last_peered":"2024-08-31T04:04:06.041029+0000","last_clean":"2024-08-31T04:04:06.041029+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:04:06.041029+0000","last_undegraded":"2024-08-31T04:04:06.041029+0000","last_fullsized":"2024-08-31T04:04:06.041029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034751+0000","last_change":"2024-08-31T04:04:04.954690+0000","last_active":"2024-08-31T04:04:06.034751+0000","last_peered":"2024-08-31T04:04:06.034751+0000","last_clean":"2024-08-31T04:04:06.034751+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:04:06.034751+0000","last_undegraded":"2024-08-31T04:04:06.034751+0000","last_fullsized":"2024-08-31T04:04:06.034751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:11.009989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904518+0000","last_change":"2024-08-31T04:04:00.896360+0000","last_active":"2024-08-31T04:04:05.904518+0000","last_peered":"2024-08-31T04:04:05.904518+0000","last_clean":"2024-08-31T04:04:05.904518+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:04:05.904518+0000","last_undegraded":"2024-08-31T04:04:05.904518+0000","last_fullsized":"2024-08-31T04:04:05.904518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:04.855778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904586+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:04:05.904586+0000","last_peered":"2024-08-31T04:04:05.904586+0000","last_clean":"2024-08-31T04:04:05.904586+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:04:05.904586+0000","last_undegraded":"2024-08-31T04:04:05.904586+0000","last_fullsized":"2024-08-31T04:04:05.904586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044402+0000","last_change":"2024-08-31T04:04:04.946958+0000","last_active":"2024-08-31T04:04:06.044402+0000","last_peered":"2024-08-31T04:04:06.044402+0000","last_clean":"2024-08-31T04:04:06.044402+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:04:06.044402+0000","last_undegraded":"2024-08-31T04:04:06.044402+0000","last_fullsized":"2024-08-31T04:04:06.044402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:41:42.006072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906335+0000","last_change":"2024-08-31T04:04:00.892688+0000","last_active":"2024-08-31T04:04:05.906335+0000","last_peered":"2024-08-31T04:04:05.906335+0000","last_clean":"2024-08-31T04:04:05.906335+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:04:05.906335+0000","last_undegraded":"2024-08-31T04:04:05.906335+0000","last_fullsized":"2024-08-31T04:04:05.906335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:53.521514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034425+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:04:06.034425+0000","last_peered":"2024-08-31T04:04:06.034425+0000","last_clean":"2024-08-31T04:04:06.034425+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:04:06.034425+0000","last_undegraded":"2024-08-31T04:04:06.034425+0000","last_fullsized":"2024-08-31T04:04:06.034425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905529+0000","last_change":"2024-08-31T04:04:04.936785+0000","last_active":"2024-08-31T04:04:05.905529+0000","last_peered":"2024-08-31T04:04:05.905529+0000","last_clean":"2024-08-31T04:04:05.905529+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:04:05.905529+0000","last_undegraded":"2024-08-31T04:04:05.905529+0000","last_fullsized":"2024-08-31T04:04:05.905529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:28:32.101080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905349+0000","last_change":"2024-08-31T04:04:00.891194+0000","last_active":"2024-08-31T04:04:05.905349+0000","last_peered":"2024-08-31T04:04:05.905349+0000","last_clean":"2024-08-31T04:04:05.905349+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:04:05.905349+0000","last_undegraded":"2024-08-31T04:04:05.905349+0000","last_fullsized":"2024-08-31T04:04:05.905349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:20.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908435+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:04:05.908435+0000","last_peered":"2024-08-31T04:04:05.908435+0000","last_clean":"2024-08-31T04:04:05.908435+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:04:05.908435+0000","last_undegraded":"2024-08-31T04:04:05.908435+0000","last_fullsized":"2024-08-31T04:04:05.908435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904222+0000","last_change":"2024-08-31T04:04:04.947787+0000","last_active":"2024-08-31T04:04:05.904222+0000","last_peered":"2024-08-31T04:04:05.904222+0000","last_clean":"2024-08-31T04:04:05.904222+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:04:05.904222+0000","last_undegraded":"2024-08-31T04:04:05.904222+0000","last_fullsized":"2024-08-31T04:04:05.904222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:40.922656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905481+0000","last_change":"2024-08-31T04:04:00.890893+0000","last_active":"2024-08-31T04:04:05.905481+0000","last_peered":"2024-08-31T04:04:05.905481+0000","last_clean":"2024-08-31T04:04:05.905481+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:04:05.905481+0000","last_undegraded":"2024-08-31T04:04:05.905481+0000","last_fullsized":"2024-08-31T04:04:05.905481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:39:17.163345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905683+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:04:05.905683+0000","last_peered":"2024-08-31T04:04:05.905683+0000","last_clean":"2024-08-31T04:04:05.905683+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:04:05.905683+0000","last_undegraded":"2024-08-31T04:04:05.905683+0000","last_fullsized":"2024-08-31T04:04:05.905683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904211+0000","last_change":"2024-08-31T04:04:04.951050+0000","last_active":"2024-08-31T04:04:05.904211+0000","last_peered":"2024-08-31T04:04:05.904211+0000","last_clean":"2024-08-31T04:04:05.904211+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:04:05.904211+0000","last_undegraded":"2024-08-31T04:04:05.904211+0000","last_fullsized":"2024-08-31T04:04:05.904211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:39.320190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042706+0000","last_change":"2024-08-31T04:04:00.887709+0000","last_active":"2024-08-31T04:04:06.042706+0000","last_peered":"2024-08-31T04:04:06.042706+0000","last_clean":"2024-08-31T04:04:06.042706+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:04:06.042706+0000","last_undegraded":"2024-08-31T04:04:06.042706+0000","last_fullsized":"2024-08-31T04:04:06.042706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:53:15.464663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908034+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:04:05.908034+0000","last_peered":"2024-08-31T04:04:05.908034+0000","last_clean":"2024-08-31T04:04:05.908034+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:04:05.908034+0000","last_undegraded":"2024-08-31T04:04:05.908034+0000","last_fullsized":"2024-08-31T04:04:05.908034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040767+0000","last_change":"2024-08-31T04:04:04.953273+0000","last_active":"2024-08-31T04:04:06.040767+0000","last_peered":"2024-08-31T04:04:06.040767+0000","last_clean":"2024-08-31T04:04:06.040767+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:04:06.040767+0000","last_undegraded":"2024-08-31T04:04:06.040767+0000","last_fullsized":"2024-08-31T04:04:06.040767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:33:30.841472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905304+0000","last_change":"2024-08-31T04:04:00.887566+0000","last_active":"2024-08-31T04:04:05.905304+0000","last_peered":"2024-08-31T04:04:05.905304+0000","last_clean":"2024-08-31T04:04:05.905304+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:04:05.905304+0000","last_undegraded":"2024-08-31T04:04:05.905304+0000","last_fullsized":"2024-08-31T04:04:05.905304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:08:17.523624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038640+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:04:06.038640+0000","last_peered":"2024-08-31T04:04:06.038640+0000","last_clean":"2024-08-31T04:04:06.038640+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:04:06.038640+0000","last_undegraded":"2024-08-31T04:04:06.038640+0000","last_fullsized":"2024-08-31T04:04:06.038640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040223+0000","last_change":"2024-08-31T04:04:04.975251+0000","last_active":"2024-08-31T04:04:06.040223+0000","last_peered":"2024-08-31T04:04:06.040223+0000","last_clean":"2024-08-31T04:04:06.040223+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:04:06.040223+0000","last_undegraded":"2024-08-31T04:04:06.040223+0000","last_fullsized":"2024-08-31T04:04:06.040223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:12.488672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035080+0000","last_change":"2024-08-31T04:04:00.881311+0000","last_active":"2024-08-31T04:04:06.035080+0000","last_peered":"2024-08-31T04:04:06.035080+0000","last_clean":"2024-08-31T04:04:06.035080+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:04:06.035080+0000","last_undegraded":"2024-08-31T04:04:06.035080+0000","last_fullsized":"2024-08-31T04:04:06.035080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:23:44.361701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907364+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:04:05.907364+0000","last_peered":"2024-08-31T04:04:05.907364+0000","last_clean":"2024-08-31T04:04:05.907364+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:04:05.907364+0000","last_undegraded":"2024-08-31T04:04:05.907364+0000","last_fullsized":"2024-08-31T04:04:05.907364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042168+0000","last_change":"2024-08-31T04:04:04.954216+0000","last_active":"2024-08-31T04:04:06.042168+0000","last_peered":"2024-08-31T04:04:06.042168+0000","last_clean":"2024-08-31T04:04:06.042168+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:04:06.042168+0000","last_undegraded":"2024-08-31T04:04:06.042168+0000","last_fullsized":"2024-08-31T04:04:06.042168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:04.563322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039679+0000","last_change":"2024-08-31T04:04:00.884692+0000","last_active":"2024-08-31T04:04:06.039679+0000","last_peered":"2024-08-31T04:04:06.039679+0000","last_clean":"2024-08-31T04:04:06.039679+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:04:06.039679+0000","last_undegraded":"2024-08-31T04:04:06.039679+0000","last_fullsized":"2024-08-31T04:04:06.039679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:07:45.274820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037948+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:04:06.037948+0000","last_peered":"2024-08-31T04:04:06.037948+0000","last_clean":"2024-08-31T04:04:06.037948+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:04:06.037948+0000","last_undegraded":"2024-08-31T04:04:06.037948+0000","last_fullsized":"2024-08-31T04:04:06.037948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044165+0000","last_change":"2024-08-31T04:04:04.950642+0000","last_active":"2024-08-31T04:04:06.044165+0000","last_peered":"2024-08-31T04:04:06.044165+0000","last_clean":"2024-08-31T04:04:06.044165+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:04:06.044165+0000","last_undegraded":"2024-08-31T04:04:06.044165+0000","last_fullsized":"2024-08-31T04:04:06.044165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:49.300897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038082+0000","last_change":"2024-08-31T04:04:00.886674+0000","last_active":"2024-08-31T04:04:06.038082+0000","last_peered":"2024-08-31T04:04:06.038082+0000","last_clean":"2024-08-31T04:04:06.038082+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:04:06.038082+0000","last_undegraded":"2024-08-31T04:04:06.038082+0000","last_fullsized":"2024-08-31T04:04:06.038082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:46:28.682868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905953+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:04:05.905953+0000","last_peered":"2024-08-31T04:04:05.905953+0000","last_clean":"2024-08-31T04:04:05.905953+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:04:05.905953+0000","last_undegraded":"2024-08-31T04:04:05.905953+0000","last_fullsized":"2024-08-31T04:04:05.905953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040199+0000","last_change":"2024-08-31T04:04:04.973347+0000","last_active":"2024-08-31T04:04:06.040199+0000","last_peered":"2024-08-31T04:04:06.040199+0000","last_clean":"2024-08-31T04:04:06.040199+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:04:06.040199+0000","last_undegraded":"2024-08-31T04:04:06.040199+0000","last_fullsized":"2024-08-31T04:04:06.040199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:30.204653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904564+0000","last_change":"2024-08-31T04:04:00.896365+0000","last_active":"2024-08-31T04:04:05.904564+0000","last_peered":"2024-08-31T04:04:05.904564+0000","last_clean":"2024-08-31T04:04:05.904564+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:04:05.904564+0000","last_undegraded":"2024-08-31T04:04:05.904564+0000","last_fullsized":"2024-08-31T04:04:05.904564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:39.300217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906837+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:04:05.906837+0000","last_peered":"2024-08-31T04:04:05.906837+0000","last_clean":"2024-08-31T04:04:05.906837+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:04:05.906837+0000","last_undegraded":"2024-08-31T04:04:05.906837+0000","last_fullsized":"2024-08-31T04:04:05.906837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034604+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:04:06.034604+0000","last_peered":"2024-08-31T04:04:06.034604+0000","last_clean":"2024-08-31T04:04:06.034604+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:04:06.034604+0000","last_undegraded":"2024-08-31T04:04:06.034604+0000","last_fullsized":"2024-08-31T04:04:06.034604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907888+0000","last_change":"2024-08-31T04:04:04.922468+0000","last_active":"2024-08-31T04:04:05.907888+0000","last_peered":"2024-08-31T04:04:05.907888+0000","last_clean":"2024-08-31T04:04:05.907888+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:04:05.907888+0000","last_undegraded":"2024-08-31T04:04:05.907888+0000","last_fullsized":"2024-08-31T04:04:05.907888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:15.555948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907801+0000","last_change":"2024-08-31T04:04:00.867024+0000","last_active":"2024-08-31T04:04:05.907801+0000","last_peered":"2024-08-31T04:04:05.907801+0000","last_clean":"2024-08-31T04:04:05.907801+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:04:05.907801+0000","last_undegraded":"2024-08-31T04:04:05.907801+0000","last_fullsized":"2024-08-31T04:04:05.907801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:43.640217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042885+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:04:06.042885+0000","last_peered":"2024-08-31T04:04:06.042885+0000","last_clean":"2024-08-31T04:04:06.042885+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:04:06.042885+0000","last_undegraded":"2024-08-31T04:04:06.042885+0000","last_fullsized":"2024-08-31T04:04:06.042885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904426+0000","last_change":"2024-08-31T04:04:04.938034+0000","last_active":"2024-08-31T04:04:05.904426+0000","last_peered":"2024-08-31T04:04:05.904426+0000","last_clean":"2024-08-31T04:04:05.904426+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:04:05.904426+0000","last_undegraded":"2024-08-31T04:04:05.904426+0000","last_fullsized":"2024-08-31T04:04:05.904426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:46.961448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035417+0000","last_change":"2024-08-31T04:04:00.883610+0000","last_active":"2024-08-31T04:04:06.035417+0000","last_peered":"2024-08-31T04:04:06.035417+0000","last_clean":"2024-08-31T04:04:06.035417+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:04:06.035417+0000","last_undegraded":"2024-08-31T04:04:06.035417+0000","last_fullsized":"2024-08-31T04:04:06.035417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:29.250924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041581+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:04:06.041581+0000","last_peered":"2024-08-31T04:04:06.041581+0000","last_clean":"2024-08-31T04:04:06.041581+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:04:06.041581+0000","last_undegraded":"2024-08-31T04:04:06.041581+0000","last_fullsized":"2024-08-31T04:04:06.041581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039391+0000","last_change":"2024-08-31T04:04:04.979418+0000","last_active":"2024-08-31T04:04:06.039391+0000","last_peered":"2024-08-31T04:04:06.039391+0000","last_clean":"2024-08-31T04:04:06.039391+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:04:06.039391+0000","last_undegraded":"2024-08-31T04:04:06.039391+0000","last_fullsized":"2024-08-31T04:04:06.039391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:40.023243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035347+0000","last_change":"2024-08-31T04:04:00.874137+0000","last_active":"2024-08-31T04:04:06.035347+0000","last_peered":"2024-08-31T04:04:06.035347+0000","last_clean":"2024-08-31T04:04:06.035347+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:04:06.035347+0000","last_undegraded":"2024-08-31T04:04:06.035347+0000","last_fullsized":"2024-08-31T04:04:06.035347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:44.411622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905534+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:04:05.905534+0000","last_peered":"2024-08-31T04:04:05.905534+0000","last_clean":"2024-08-31T04:04:05.905534+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:04:05.905534+0000","last_undegraded":"2024-08-31T04:04:05.905534+0000","last_fullsized":"2024-08-31T04:04:05.905534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904981+0000","last_change":"2024-08-31T04:04:04.918718+0000","last_active":"2024-08-31T04:04:05.904981+0000","last_peered":"2024-08-31T04:04:05.904981+0000","last_clean":"2024-08-31T04:04:05.904981+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:04:05.904981+0000","last_undegraded":"2024-08-31T04:04:05.904981+0000","last_fullsized":"2024-08-31T04:04:05.904981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:04:40.641208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905941+0000","last_change":"2024-08-31T04:04:00.877667+0000","last_active":"2024-08-31T04:04:05.905941+0000","last_peered":"2024-08-31T04:04:05.905941+0000","last_clean":"2024-08-31T04:04:05.905941+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:04:05.905941+0000","last_undegraded":"2024-08-31T04:04:05.905941+0000","last_fullsized":"2024-08-31T04:04:05.905941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:06:31.670255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035613+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:04:06.035613+0000","last_peered":"2024-08-31T04:04:06.035613+0000","last_clean":"2024-08-31T04:04:06.035613+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:04:06.035613+0000","last_undegraded":"2024-08-31T04:04:06.035613+0000","last_fullsized":"2024-08-31T04:04:06.035613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034877+0000","last_change":"2024-08-31T04:04:04.959068+0000","last_active":"2024-08-31T04:04:06.034877+0000","last_peered":"2024-08-31T04:04:06.034877+0000","last_clean":"2024-08-31T04:04:06.034877+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:04:06.034877+0000","last_undegraded":"2024-08-31T04:04:06.034877+0000","last_fullsized":"2024-08-31T04:04:06.034877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:46:16.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906227+0000","last_change":"2024-08-31T04:04:00.864542+0000","last_active":"2024-08-31T04:04:05.906227+0000","last_peered":"2024-08-31T04:04:05.906227+0000","last_clean":"2024-08-31T04:04:05.906227+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:04:05.906227+0000","last_undegraded":"2024-08-31T04:04:05.906227+0000","last_fullsized":"2024-08-31T04:04:05.906227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:59:47.241152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904710+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:04:05.904710+0000","last_peered":"2024-08-31T04:04:05.904710+0000","last_clean":"2024-08-31T04:04:05.904710+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:04:05.904710+0000","last_undegraded":"2024-08-31T04:04:05.904710+0000","last_fullsized":"2024-08-31T04:04:05.904710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040786+0000","last_change":"2024-08-31T04:04:04.966400+0000","last_active":"2024-08-31T04:04:06.040786+0000","last_peered":"2024-08-31T04:04:06.040786+0000","last_clean":"2024-08-31T04:04:06.040786+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:04:06.040786+0000","last_undegraded":"2024-08-31T04:04:06.040786+0000","last_fullsized":"2024-08-31T04:04:06.040786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:18:16.700443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034482+0000","last_change":"2024-08-31T04:04:00.880127+0000","last_active":"2024-08-31T04:04:06.034482+0000","last_peered":"2024-08-31T04:04:06.034482+0000","last_clean":"2024-08-31T04:04:06.034482+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:04:06.034482+0000","last_undegraded":"2024-08-31T04:04:06.034482+0000","last_fullsized":"2024-08-31T04:04:06.034482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:27.561607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034827+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:04:06.034827+0000","last_peered":"2024-08-31T04:04:06.034827+0000","last_clean":"2024-08-31T04:04:06.034827+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:04:06.034827+0000","last_undegraded":"2024-08-31T04:04:06.034827+0000","last_fullsized":"2024-08-31T04:04:06.034827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040447+0000","last_change":"2024-08-31T04:04:04.971102+0000","last_active":"2024-08-31T04:04:06.040447+0000","last_peered":"2024-08-31T04:04:06.040447+0000","last_clean":"2024-08-31T04:04:06.040447+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:04:06.040447+0000","last_undegraded":"2024-08-31T04:04:06.040447+0000","last_fullsized":"2024-08-31T04:04:06.040447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:40.427017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906629+0000","last_change":"2024-08-31T04:04:00.882328+0000","last_active":"2024-08-31T04:04:05.906629+0000","last_peered":"2024-08-31T04:04:05.906629+0000","last_clean":"2024-08-31T04:04:05.906629+0000","last_became_active":"2024-08-31T04:04:00.882009+0000","last_became_peered":"2024-08-31T04:04:00.882009+0000","last_unstale":"2024-08-31T04:04:05.906629+0000","last_undegraded":"2024-08-31T04:04:05.906629+0000","last_fullsized":"2024-08-31T04:04:05.906629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:10:14.622717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907313+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:04:05.907313+0000","last_peered":"2024-08-31T04:04:05.907313+0000","last_clean":"2024-08-31T04:04:05.907313+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:04:05.907313+0000","last_undegraded":"2024-08-31T04:04:05.907313+0000","last_fullsized":"2024-08-31T04:04:05.907313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041921+0000","last_change":"2024-08-31T04:04:04.964690+0000","last_active":"2024-08-31T04:04:06.041921+0000","last_peered":"2024-08-31T04:04:06.041921+0000","last_clean":"2024-08-31T04:04:06.041921+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:04:06.041921+0000","last_undegraded":"2024-08-31T04:04:06.041921+0000","last_fullsized":"2024-08-31T04:04:06.041921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:23.711105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040884+0000","last_change":"2024-08-31T04:04:00.887168+0000","last_active":"2024-08-31T04:04:06.040884+0000","last_peered":"2024-08-31T04:04:06.040884+0000","last_clean":"2024-08-31T04:04:06.040884+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:04:06.040884+0000","last_undegraded":"2024-08-31T04:04:06.040884+0000","last_fullsized":"2024-08-31T04:04:06.040884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:58.272934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043729+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:04:06.043729+0000","last_peered":"2024-08-31T04:04:06.043729+0000","last_clean":"2024-08-31T04:04:06.043729+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:04:06.043729+0000","last_undegraded":"2024-08-31T04:04:06.043729+0000","last_fullsized":"2024-08-31T04:04:06.043729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907657+0000","last_change":"2024-08-31T04:04:04.967183+0000","last_active":"2024-08-31T04:04:05.907657+0000","last_peered":"2024-08-31T04:04:05.907657+0000","last_clean":"2024-08-31T04:04:05.907657+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:04:05.907657+0000","last_undegraded":"2024-08-31T04:04:05.907657+0000","last_fullsized":"2024-08-31T04:04:05.907657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:54.094714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034962+0000","last_change":"2024-08-31T04:04:00.886779+0000","last_active":"2024-08-31T04:04:06.034962+0000","last_peered":"2024-08-31T04:04:06.034962+0000","last_clean":"2024-08-31T04:04:06.034962+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:04:06.034962+0000","last_undegraded":"2024-08-31T04:04:06.034962+0000","last_fullsized":"2024-08-31T04:04:06.034962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:45:51.487016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:14.844048+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:04:14.844048+0000","last_peered":"2024-08-31T04:04:14.844048+0000","last_clean":"2024-08-31T04:04:14.844048+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:04:14.844048+0000","last_undegraded":"2024-08-31T04:04:14.844048+0000","last_fullsized":"2024-08-31T04:04:14.844048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904234+0000","last_change":"2024-08-31T04:04:04.960945+0000","last_active":"2024-08-31T04:04:05.904234+0000","last_peered":"2024-08-31T04:04:05.904234+0000","last_clean":"2024-08-31T04:04:05.904234+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:04:05.904234+0000","last_undegraded":"2024-08-31T04:04:05.904234+0000","last_fullsized":"2024-08-31T04:04:05.904234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:50.907644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906484+0000","last_change":"2024-08-31T04:04:00.869565+0000","last_active":"2024-08-31T04:04:05.906484+0000","last_peered":"2024-08-31T04:04:05.906484+0000","last_clean":"2024-08-31T04:04:05.906484+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:04:05.906484+0000","last_undegraded":"2024-08-31T04:04:05.906484+0000","last_fullsized":"2024-08-31T04:04:05.906484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:37.334753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043126+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:04:06.043126+0000","last_peered":"2024-08-31T04:04:06.043126+0000","last_clean":"2024-08-31T04:04:06.043126+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:04:06.043126+0000","last_undegraded":"2024-08-31T04:04:06.043126+0000","last_fullsized":"2024-08-31T04:04:06.043126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904892+0000","last_change":"2024-08-31T04:04:04.940655+0000","last_active":"2024-08-31T04:04:05.904892+0000","last_peered":"2024-08-31T04:04:05.904892+0000","last_clean":"2024-08-31T04:04:05.904892+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:04:05.904892+0000","last_undegraded":"2024-08-31T04:04:05.904892+0000","last_fullsized":"2024-08-31T04:04:05.904892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:12:39.145645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040892+0000","last_change":"2024-08-31T04:04:00.881774+0000","last_active":"2024-08-31T04:04:06.040892+0000","last_peered":"2024-08-31T04:04:06.040892+0000","last_clean":"2024-08-31T04:04:06.040892+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:04:06.040892+0000","last_undegraded":"2024-08-31T04:04:06.040892+0000","last_fullsized":"2024-08-31T04:04:06.040892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:19.539642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034980+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:04:06.034980+0000","last_peered":"2024-08-31T04:04:06.034980+0000","last_clean":"2024-08-31T04:04:06.034980+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:04:06.034980+0000","last_undegraded":"2024-08-31T04:04:06.034980+0000","last_fullsized":"2024-08-31T04:04:06.034980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037542+0000","last_change":"2024-08-31T04:04:04.948582+0000","last_active":"2024-08-31T04:04:06.037542+0000","last_peered":"2024-08-31T04:04:06.037542+0000","last_clean":"2024-08-31T04:04:06.037542+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:04:06.037542+0000","last_undegraded":"2024-08-31T04:04:06.037542+0000","last_fullsized":"2024-08-31T04:04:06.037542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:35.294731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905846+0000","last_change":"2024-08-31T04:04:00.863199+0000","last_active":"2024-08-31T04:04:05.905846+0000","last_peered":"2024-08-31T04:04:05.905846+0000","last_clean":"2024-08-31T04:04:05.905846+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:04:05.905846+0000","last_undegraded":"2024-08-31T04:04:05.905846+0000","last_fullsized":"2024-08-31T04:04:05.905846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:52.086202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.036024+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:04:06.036024+0000","last_peered":"2024-08-31T04:04:06.036024+0000","last_clean":"2024-08-31T04:04:06.036024+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:04:06.036024+0000","last_undegraded":"2024-08-31T04:04:06.036024+0000","last_fullsized":"2024-08-31T04:04:06.036024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904421+0000","last_change":"2024-08-31T04:04:04.940930+0000","last_active":"2024-08-31T04:04:05.904421+0000","last_peered":"2024-08-31T04:04:05.904421+0000","last_clean":"2024-08-31T04:04:05.904421+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:04:05.904421+0000","last_undegraded":"2024-08-31T04:04:05.904421+0000","last_fullsized":"2024-08-31T04:04:05.904421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:07:30.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905335+0000","last_change":"2024-08-31T04:04:04.970283+0000","last_active":"2024-08-31T04:04:05.905335+0000","last_peered":"2024-08-31T04:04:05.905335+0000","last_clean":"2024-08-31T04:04:05.905335+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:04:05.905335+0000","last_undegraded":"2024-08-31T04:04:05.905335+0000","last_fullsized":"2024-08-31T04:04:05.905335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:37.086560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904353+0000","last_change":"2024-08-31T04:04:00.897277+0000","last_active":"2024-08-31T04:04:05.904353+0000","last_peered":"2024-08-31T04:04:05.904353+0000","last_clean":"2024-08-31T04:04:05.904353+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:04:05.904353+0000","last_undegraded":"2024-08-31T04:04:05.904353+0000","last_fullsized":"2024-08-31T04:04:05.904353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:45:42.808934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905834+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:04:05.905834+0000","last_peered":"2024-08-31T04:04:05.905834+0000","last_clean":"2024-08-31T04:04:05.905834+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:04:05.905834+0000","last_undegraded":"2024-08-31T04:04:05.905834+0000","last_fullsized":"2024-08-31T04:04:05.905834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.906316+0000","last_change":"2024-08-31T04:04:04.966233+0000","last_active":"2024-08-31T04:04:05.906316+0000","last_peered":"2024-08-31T04:04:05.906316+0000","last_clean":"2024-08-31T04:04:05.906316+0000","last_became_active":"2024-08-31T04:04:04.965854+0000","last_became_peered":"2024-08-31T04:04:04.965854+0000","last_unstale":"2024-08-31T04:04:05.906316+0000","last_undegraded":"2024-08-31T04:04:05.906316+0000","last_fullsized":"2024-08-31T04:04:05.906316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:16.448331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040110+0000","last_change":"2024-08-31T04:04:00.888009+0000","last_active":"2024-08-31T04:04:06.040110+0000","last_peered":"2024-08-31T04:04:06.040110+0000","last_clean":"2024-08-31T04:04:06.040110+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:04:06.040110+0000","last_undegraded":"2024-08-31T04:04:06.040110+0000","last_fullsized":"2024-08-31T04:04:06.040110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:15:31.977791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038384+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:04:06.038384+0000","last_peered":"2024-08-31T04:04:06.038384+0000","last_clean":"2024-08-31T04:04:06.038384+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:04:06.038384+0000","last_undegraded":"2024-08-31T04:04:06.038384+0000","last_fullsized":"2024-08-31T04:04:06.038384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907256+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:04:05.907256+0000","last_peered":"2024-08-31T04:04:05.907256+0000","last_clean":"2024-08-31T04:04:05.907256+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:04:05.907256+0000","last_undegraded":"2024-08-31T04:04:05.907256+0000","last_fullsized":"2024-08-31T04:04:05.907256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904794+0000","last_change":"2024-08-31T04:04:00.897537+0000","last_active":"2024-08-31T04:04:05.904794+0000","last_peered":"2024-08-31T04:04:05.904794+0000","last_clean":"2024-08-31T04:04:05.904794+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:04:05.904794+0000","last_undegraded":"2024-08-31T04:04:05.904794+0000","last_fullsized":"2024-08-31T04:04:05.904794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:46.422487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905083+0000","last_change":"2024-08-31T04:04:04.961002+0000","last_active":"2024-08-31T04:04:05.905083+0000","last_peered":"2024-08-31T04:04:05.905083+0000","last_clean":"2024-08-31T04:04:05.905083+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:04:05.905083+0000","last_undegraded":"2024-08-31T04:04:05.905083+0000","last_fullsized":"2024-08-31T04:04:05.905083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:45:04.605970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039694+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:04:06.039694+0000","last_peered":"2024-08-31T04:04:06.039694+0000","last_clean":"2024-08-31T04:04:06.039694+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:04:06.039694+0000","last_undegraded":"2024-08-31T04:04:06.039694+0000","last_fullsized":"2024-08-31T04:04:06.039694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035174+0000","last_change":"2024-08-31T04:04:00.878599+0000","last_active":"2024-08-31T04:04:06.035174+0000","last_peered":"2024-08-31T04:04:06.035174+0000","last_clean":"2024-08-31T04:04:06.035174+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:04:06.035174+0000","last_undegraded":"2024-08-31T04:04:06.035174+0000","last_fullsized":"2024-08-31T04:04:06.035174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:37.274576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.043082+0000","last_change":"2024-08-31T04:04:04.975414+0000","last_active":"2024-08-31T04:04:06.043082+0000","last_peered":"2024-08-31T04:04:06.043082+0000","last_clean":"2024-08-31T04:04:06.043082+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:04:06.043082+0000","last_undegraded":"2024-08-31T04:04:06.043082+0000","last_fullsized":"2024-08-31T04:04:06.043082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:12.992949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904092+0000","last_change":"2024-08-31T04:04:00.887117+0000","last_active":"2024-08-31T04:04:05.904092+0000","last_peered":"2024-08-31T04:04:05.904092+0000","last_clean":"2024-08-31T04:04:05.904092+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:04:05.904092+0000","last_undegraded":"2024-08-31T04:04:05.904092+0000","last_fullsized":"2024-08-31T04:04:05.904092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:18:37.474694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.037663+0000","last_change":"2024-08-31T04:04:00.881033+0000","last_active":"2024-08-31T04:04:06.037663+0000","last_peered":"2024-08-31T04:04:06.037663+0000","last_clean":"2024-08-31T04:04:06.037663+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:04:06.037663+0000","last_undegraded":"2024-08-31T04:04:06.037663+0000","last_fullsized":"2024-08-31T04:04:06.037663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:39:46.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907098+0000","last_change":"2024-08-31T04:04:00.879791+0000","last_active":"2024-08-31T04:04:05.907098+0000","last_peered":"2024-08-31T04:04:05.907098+0000","last_clean":"2024-08-31T04:04:05.907098+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:04:05.907098+0000","last_undegraded":"2024-08-31T04:04:05.907098+0000","last_fullsized":"2024-08-31T04:04:05.907098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:00:26.128387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039321+0000","last_change":"2024-08-31T04:04:00.876487+0000","last_active":"2024-08-31T04:04:06.039321+0000","last_peered":"2024-08-31T04:04:06.039321+0000","last_clean":"2024-08-31T04:04:06.039321+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:04:06.039321+0000","last_undegraded":"2024-08-31T04:04:06.039321+0000","last_fullsized":"2024-08-31T04:04:06.039321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:10.867317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042600+0000","last_change":"2024-08-31T04:04:00.888017+0000","last_active":"2024-08-31T04:04:06.042600+0000","last_peered":"2024-08-31T04:04:06.042600+0000","last_clean":"2024-08-31T04:04:06.042600+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:04:06.042600+0000","last_undegraded":"2024-08-31T04:04:06.042600+0000","last_fullsized":"2024-08-31T04:04:06.042600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:52:53.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.042480+0000","last_change":"2024-08-31T04:04:00.885850+0000","last_active":"2024-08-31T04:04:06.042480+0000","last_peered":"2024-08-31T04:04:06.042480+0000","last_clean":"2024-08-31T04:04:06.042480+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:04:06.042480+0000","last_undegraded":"2024-08-31T04:04:06.042480+0000","last_fullsized":"2024-08-31T04:04:06.042480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:07.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905742+0000","last_change":"2024-08-31T04:04:00.870086+0000","last_active":"2024-08-31T04:04:05.905742+0000","last_peered":"2024-08-31T04:04:05.905742+0000","last_clean":"2024-08-31T04:04:05.905742+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:04:05.905742+0000","last_undegraded":"2024-08-31T04:04:05.905742+0000","last_fullsized":"2024-08-31T04:04:05.905742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:36:59.724104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040115+0000","last_change":"2024-08-31T04:04:00.881124+0000","last_active":"2024-08-31T04:04:06.040115+0000","last_peered":"2024-08-31T04:04:06.040115+0000","last_clean":"2024-08-31T04:04:06.040115+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:04:06.040115+0000","last_undegraded":"2024-08-31T04:04:06.040115+0000","last_fullsized":"2024-08-31T04:04:06.040115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:59:40.389131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905727+0000","last_change":"2024-08-31T04:04:00.880040+0000","last_active":"2024-08-31T04:04:05.905727+0000","last_peered":"2024-08-31T04:04:05.905727+0000","last_clean":"2024-08-31T04:04:05.905727+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:04:05.905727+0000","last_undegraded":"2024-08-31T04:04:05.905727+0000","last_fullsized":"2024-08-31T04:04:05.905727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:23.110254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039483+0000","last_change":"2024-08-31T04:04:00.867373+0000","last_active":"2024-08-31T04:04:06.039483+0000","last_peered":"2024-08-31T04:04:06.039483+0000","last_clean":"2024-08-31T04:04:06.039483+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:04:06.039483+0000","last_undegraded":"2024-08-31T04:04:06.039483+0000","last_fullsized":"2024-08-31T04:04:06.039483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:54:47.851207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035293+0000","last_change":"2024-08-31T04:04:00.884497+0000","last_active":"2024-08-31T04:04:06.035293+0000","last_peered":"2024-08-31T04:04:06.035293+0000","last_clean":"2024-08-31T04:04:06.035293+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:04:06.035293+0000","last_undegraded":"2024-08-31T04:04:06.035293+0000","last_fullsized":"2024-08-31T04:04:06.035293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:10.005789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904753+0000","last_change":"2024-08-31T04:04:00.899676+0000","last_active":"2024-08-31T04:04:05.904753+0000","last_peered":"2024-08-31T04:04:05.904753+0000","last_clean":"2024-08-31T04:04:05.904753+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:04:05.904753+0000","last_undegraded":"2024-08-31T04:04:05.904753+0000","last_fullsized":"2024-08-31T04:04:05.904753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:46.887325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035316+0000","last_change":"2024-08-31T04:04:00.872910+0000","last_active":"2024-08-31T04:04:06.035316+0000","last_peered":"2024-08-31T04:04:06.035316+0000","last_clean":"2024-08-31T04:04:06.035316+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:04:06.035316+0000","last_undegraded":"2024-08-31T04:04:06.035316+0000","last_fullsized":"2024-08-31T04:04:06.035316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:22.208293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.907979+0000","last_change":"2024-08-31T04:04:00.897114+0000","last_active":"2024-08-31T04:04:05.907979+0000","last_peered":"2024-08-31T04:04:05.907979+0000","last_clean":"2024-08-31T04:04:05.907979+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:04:05.907979+0000","last_undegraded":"2024-08-31T04:04:05.907979+0000","last_fullsized":"2024-08-31T04:04:05.907979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:13:13.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.044036+0000","last_change":"2024-08-31T04:04:00.879907+0000","last_active":"2024-08-31T04:04:06.044036+0000","last_peered":"2024-08-31T04:04:06.044036+0000","last_clean":"2024-08-31T04:04:06.044036+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:04:06.044036+0000","last_undegraded":"2024-08-31T04:04:06.044036+0000","last_fullsized":"2024-08-31T04:04:06.044036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:11.042911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.908418+0000","last_change":"2024-08-31T04:04:00.874247+0000","last_active":"2024-08-31T04:04:05.908418+0000","last_peered":"2024-08-31T04:04:05.908418+0000","last_clean":"2024-08-31T04:04:05.908418+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:04:05.908418+0000","last_undegraded":"2024-08-31T04:04:05.908418+0000","last_fullsized":"2024-08-31T04:04:05.908418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:00.974919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.905612+0000","last_change":"2024-08-31T04:04:00.861922+0000","last_active":"2024-08-31T04:04:05.905612+0000","last_peered":"2024-08-31T04:04:05.905612+0000","last_clean":"2024-08-31T04:04:05.905612+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:04:05.905612+0000","last_undegraded":"2024-08-31T04:04:05.905612+0000","last_fullsized":"2024-08-31T04:04:05.905612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:07.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.038950+0000","last_change":"2024-08-31T04:04:00.873986+0000","last_active":"2024-08-31T04:04:06.038950+0000","last_peered":"2024-08-31T04:04:06.038950+0000","last_clean":"2024-08-31T04:04:06.038950+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:04:06.038950+0000","last_undegraded":"2024-08-31T04:04:06.038950+0000","last_fullsized":"2024-08-31T04:04:06.038950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:39.934600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040728+0000","last_change":"2024-08-31T04:04:00.887510+0000","last_active":"2024-08-31T04:04:06.040728+0000","last_peered":"2024-08-31T04:04:06.040728+0000","last_clean":"2024-08-31T04:04:06.040728+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:04:06.040728+0000","last_undegraded":"2024-08-31T04:04:06.040728+0000","last_fullsized":"2024-08-31T04:04:06.040728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:29.689714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041269+0000","last_change":"2024-08-31T04:04:00.886364+0000","last_active":"2024-08-31T04:04:06.041269+0000","last_peered":"2024-08-31T04:04:06.041269+0000","last_clean":"2024-08-31T04:04:06.041269+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:04:06.041269+0000","last_undegraded":"2024-08-31T04:04:06.041269+0000","last_fullsized":"2024-08-31T04:04:06.041269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:17.949115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035208+0000","last_change":"2024-08-31T04:04:00.885452+0000","last_active":"2024-08-31T04:04:06.035208+0000","last_peered":"2024-08-31T04:04:06.035208+0000","last_clean":"2024-08-31T04:04:06.035208+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:04:06.035208+0000","last_undegraded":"2024-08-31T04:04:06.035208+0000","last_fullsized":"2024-08-31T04:04:06.035208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:34:58.727576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035971+0000","last_change":"2024-08-31T04:04:00.876816+0000","last_active":"2024-08-31T04:04:06.035971+0000","last_peered":"2024-08-31T04:04:06.035971+0000","last_clean":"2024-08-31T04:04:06.035971+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:04:06.035971+0000","last_undegraded":"2024-08-31T04:04:06.035971+0000","last_fullsized":"2024-08-31T04:04:06.035971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:38.896525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034790+0000","last_change":"2024-08-31T04:04:00.878584+0000","last_active":"2024-08-31T04:04:06.034790+0000","last_peered":"2024-08-31T04:04:06.034790+0000","last_clean":"2024-08-31T04:04:06.034790+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:04:06.034790+0000","last_undegraded":"2024-08-31T04:04:06.034790+0000","last_fullsized":"2024-08-31T04:04:06.034790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:57:30.201712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035980+0000","last_change":"2024-08-31T04:04:00.866007+0000","last_active":"2024-08-31T04:04:06.035980+0000","last_peered":"2024-08-31T04:04:06.035980+0000","last_clean":"2024-08-31T04:04:06.035980+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:04:06.035980+0000","last_undegraded":"2024-08-31T04:04:06.035980+0000","last_fullsized":"2024-08-31T04:04:06.035980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:48:05.236271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.039665+0000","last_change":"2024-08-31T04:04:00.882356+0000","last_active":"2024-08-31T04:04:06.039665+0000","last_peered":"2024-08-31T04:04:06.039665+0000","last_clean":"2024-08-31T04:04:06.039665+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:04:06.039665+0000","last_undegraded":"2024-08-31T04:04:06.039665+0000","last_fullsized":"2024-08-31T04:04:06.039665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:44:37.026732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.034726+0000","last_change":"2024-08-31T04:04:00.897170+0000","last_active":"2024-08-31T04:04:06.034726+0000","last_peered":"2024-08-31T04:04:06.034726+0000","last_clean":"2024-08-31T04:04:06.034726+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:04:06.034726+0000","last_undegraded":"2024-08-31T04:04:06.034726+0000","last_fullsized":"2024-08-31T04:04:06.034726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:24:05.673647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904588+0000","last_change":"2024-08-31T04:04:00.897956+0000","last_active":"2024-08-31T04:04:05.904588+0000","last_peered":"2024-08-31T04:04:05.904588+0000","last_clean":"2024-08-31T04:04:05.904588+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:04:05.904588+0000","last_undegraded":"2024-08-31T04:04:05.904588+0000","last_fullsized":"2024-08-31T04:04:05.904588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:06.686037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035844+0000","last_change":"2024-08-31T04:04:00.883315+0000","last_active":"2024-08-31T04:04:06.035844+0000","last_peered":"2024-08-31T04:04:06.035844+0000","last_clean":"2024-08-31T04:04:06.035844+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:04:06.035844+0000","last_undegraded":"2024-08-31T04:04:06.035844+0000","last_fullsized":"2024-08-31T04:04:06.035844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:41.258604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:05.904958+0000","last_change":"2024-08-31T04:04:00.892502+0000","last_active":"2024-08-31T04:04:05.904958+0000","last_peered":"2024-08-31T04:04:05.904958+0000","last_clean":"2024-08-31T04:04:05.904958+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:04:05.904958+0000","last_undegraded":"2024-08-31T04:04:05.904958+0000","last_fullsized":"2024-08-31T04:04:05.904958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:04:48.381328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.041280+0000","last_change":"2024-08-31T04:04:00.892994+0000","last_active":"2024-08-31T04:04:06.041280+0000","last_peered":"2024-08-31T04:04:06.041280+0000","last_clean":"2024-08-31T04:04:06.041280+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:04:06.041280+0000","last_undegraded":"2024-08-31T04:04:06.041280+0000","last_fullsized":"2024-08-31T04:04:06.041280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:00.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.040294+0000","last_change":"2024-08-31T04:04:00.887325+0000","last_active":"2024-08-31T04:04:06.040294+0000","last_peered":"2024-08-31T04:04:06.040294+0000","last_clean":"2024-08-31T04:04:06.040294+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:04:06.040294+0000","last_undegraded":"2024-08-31T04:04:06.040294+0000","last_fullsized":"2024-08-31T04:04:06.040294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:15.674452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-08-31T04:04:06.035235+0000","last_change":"2024-08-31T04:04:00.881745+0000","last_active":"2024-08-31T04:04:06.035235+0000","last_peered":"2024-08-31T04:04:06.035235+0000","last_clean":"2024-08-31T04:04:06.035235+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:04:06.035235+0000","last_undegraded":"2024-08-31T04:04:06.035235+0000","last_fullsized":"2024-08-31T04:04:06.035235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:01.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476749,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":270336,"data_stored":105356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476749,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476750,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476750,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":104830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":104774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":868352,"data_stored":695234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35624,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336216,"statfs":{"total":96636764160,"available":96600285184,"internally_reserved":0,"allocated":286720,"data_stored":109288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":274432,"data_stored":104898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:04:39.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:39.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.292+0000 7f318fc00640 1 -- 172.21.15.89:0/1274003646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880b2fe0 msgr2=0x7f31881520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.292+0000 7f318fc00640 1 --2- 172.21.15.89:0/1274003646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880b2fe0 0x7f31881520f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3178009900 tx=0x7f317801c590 comp rx=0 tx=0).stop 2024-08-31T04:04:39.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.292+0000 7f318fc00640 1 -- 172.21.15.89:0/1274003646 shutdown_connections 2024-08-31T04:04:39.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.292+0000 7f318fc00640 1 --2- 172.21.15.89:0/1274003646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31880c8810 0x7f31880c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.292+0000 7f318fc00640 1 --2- 172.21.15.89:0/1274003646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880b2fe0 0x7f31881520f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.292+0000 7f318fc00640 1 -- 172.21.15.89:0/1274003646 >> 172.21.15.89:0/1274003646 conn(0x7f31880ccf20 msgr2=0x7f31880cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:39.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.292+0000 7f318fc00640 1 -- 172.21.15.89:0/1274003646 shutdown_connections 2024-08-31T04:04:39.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.292+0000 7f318fc00640 1 -- 172.21.15.89:0/1274003646 wait complete. 2024-08-31T04:04:39.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318fc00640 1 Processor -- start 2024-08-31T04:04:39.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318fc00640 1 -- start start 2024-08-31T04:04:39.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318fc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31880b2900 0x7f31881f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:39.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318fc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31880b2fe0 0x7f3188156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:39.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318fc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880c8810 0x7f3188144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:39.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318fc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3188158980 con 0x7f31880c8810 2024-08-31T04:04:39.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318fc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3188158800 con 0x7f31880b2fe0 2024-08-31T04:04:39.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318fc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3188164760 con 0x7f31880b2900 2024-08-31T04:04:39.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880c8810 0x7f3188144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:39.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880c8810 0x7f3188144990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50542/0 (socket says 172.21.15.89:50542) 2024-08-31T04:04:39.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318dc00640 1 -- 172.21.15.89:0/2414286590 learned_addr learned my addr 172.21.15.89:0/2414286590 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318d200640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31880b2900 0x7f31881f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f317fe00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31880b2fe0 0x7f3188156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318dc00640 1 -- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31880b2900 msgr2=0x7f31881f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318dc00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31880b2900 0x7f31881f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318dc00640 1 -- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31880b2fe0 msgr2=0x7f3188156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318dc00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31880b2fe0 0x7f3188156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318dc00640 1 -- 172.21.15.89:0/2414286590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31881f5570 con 0x7f31880c8810 2024-08-31T04:04:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.296+0000 7f318dc00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880c8810 0x7f3188144990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f318000ddc0 tx=0x7f318000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:39.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f3185600640 1 -- 172.21.15.89:0/2414286590 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180004d30 con 0x7f31880c8810 2024-08-31T04:04:39.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f3185600640 1 -- 172.21.15.89:0/2414286590 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f318000be40 con 0x7f31880c8810 2024-08-31T04:04:39.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31881f8ea0 con 0x7f31880c8810 2024-08-31T04:04:39.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f3185600640 1 -- 172.21.15.89:0/2414286590 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318000e8a0 con 0x7f31880c8810 2024-08-31T04:04:39.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31880c4380 con 0x7f31880c8810 2024-08-31T04:04:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31880c4a40 con 0x7f31880c8810 2024-08-31T04:04:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f3185600640 1 -- 172.21.15.89:0/2414286590 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f318000ea40 con 0x7f31880c8810 2024-08-31T04:04:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f3185600640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31640720c0 0x7f31640745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:39.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f3185600640 1 -- 172.21.15.89:0/2414286590 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3180093fe0 con 0x7f31880c8810 2024-08-31T04:04:39.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.300+0000 7f318d200640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31640720c0 0x7f31640745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:39.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.304+0000 7f318d200640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31640720c0 0x7f31640745d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f31780ae000 tx=0x7f317801add0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:39.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.304+0000 7f3185600640 1 -- 172.21.15.89:0/2414286590 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f31880c4a40 con 0x7f31880c8810 2024-08-31T04:04:39.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31881520f0 con 0x7f31880c8810 2024-08-31T04:04:39.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f3185600640 1 -- 172.21.15.89:0/2414286590 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f318005eef0 con 0x7f31880c8810 2024-08-31T04:04:39.506 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:39.506 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:39.506 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:04:39.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31640720c0 msgr2=0x7f31640745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31640720c0 0x7f31640745d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f31780ae000 tx=0x7f317801add0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880c8810 msgr2=0x7f3188144990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880c8810 0x7f3188144990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f318000ddc0 tx=0x7f318000b730 comp rx=0 tx=0).stop 2024-08-31T04:04:39.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 shutdown_connections 2024-08-31T04:04:39.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f31640720c0 0x7f31640745d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31880c8810 0x7f3188144990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31880b2fe0 0x7f3188156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 --2- 172.21.15.89:0/2414286590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31880b2900 0x7f31881f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 >> 172.21.15.89:0/2414286590 conn(0x7f31880ccf20 msgr2=0x7f3188074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:39.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 shutdown_connections 2024-08-31T04:04:39.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.504+0000 7f318fc00640 1 -- 172.21.15.89:0/2414286590 wait complete. 2024-08-31T04:04:39.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:39.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 -- 172.21.15.89:0/3481326755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 msgr2=0x7fb638074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 --2- 172.21.15.89:0/3481326755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 0x7fb638074720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb638070b70 tx=0x7fb63001f580 comp rx=0 tx=0).stop 2024-08-31T04:04:39.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 -- 172.21.15.89:0/3481326755 shutdown_connections 2024-08-31T04:04:39.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 --2- 172.21.15.89:0/3481326755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 0x7fb638074720 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 --2- 172.21.15.89:0/3481326755 >> v2:172.21.15.170:3300/0 conn(0x7fb6380c1f40 0x7fb638152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 -- 172.21.15.89:0/3481326755 >> 172.21.15.89:0/3481326755 conn(0x7fb6380ccf20 msgr2=0x7fb6380cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:39.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 -- 172.21.15.89:0/3481326755 shutdown_connections 2024-08-31T04:04:39.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 -- 172.21.15.89:0/3481326755 wait complete. 2024-08-31T04:04:39.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 Processor -- start 2024-08-31T04:04:39.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.680+0000 7fb63d400640 1 -- start start 2024-08-31T04:04:39.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb63d400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6380c1f40 0x7fb63815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb63d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 0x7fb6380c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb63d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63815bc70 0x7fb6380b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb63d400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb6380c8030 con 0x7fb6380c9330 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb63d400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb6380c3150 con 0x7fb63815bc70 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb63d400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb638074c60 con 0x7fb6380c1f40 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb635e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 0x7fb6380c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb635e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 0x7fb6380c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50550/0 (socket says 172.21.15.89:50550) 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb635e00640 1 -- 172.21.15.89:0/667224536 learned_addr learned my addr 172.21.15.89:0/667224536 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb637200640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63815bc70 0x7fb6380b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:39.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb636800640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6380c1f40 0x7fb63815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:39.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb635e00640 1 -- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6380c1f40 msgr2=0x7fb63815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb635e00640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6380c1f40 0x7fb63815aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb635e00640 1 -- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63815bc70 msgr2=0x7fb6380b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb635e00640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63815bc70 0x7fb6380b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb635e00640 1 -- 172.21.15.89:0/667224536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63815b420 con 0x7fb6380c9330 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb635e00640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 0x7fb6380c5ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb62400d780 tx=0x7fb62400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb62ea00640 1 -- 172.21.15.89:0/667224536 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624017070 con 0x7fb6380c9330 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb62ea00640 1 -- 172.21.15.89:0/667224536 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb62400de90 con 0x7fb6380c9330 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6381f2d80 con 0x7fb6380c9330 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb62ea00640 1 -- 172.21.15.89:0/667224536 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624004020 con 0x7fb6380c9330 2024-08-31T04:04:39.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6381532f0 con 0x7fb6380c9330 2024-08-31T04:04:39.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.684+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6381f2af0 con 0x7fb6380c9330 2024-08-31T04:04:39.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.688+0000 7fb62ea00640 1 -- 172.21.15.89:0/667224536 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb6240041c0 con 0x7fb6380c9330 2024-08-31T04:04:39.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.688+0000 7fb62ea00640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6180720c0 0x7fb6180745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:39.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.688+0000 7fb62ea00640 1 -- 172.21.15.89:0/667224536 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb6240934d0 con 0x7fb6380c9330 2024-08-31T04:04:39.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.688+0000 7fb636800640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6180720c0 0x7fb6180745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:39.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.688+0000 7fb636800640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6180720c0 0x7fb6180745d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb628001650 tx=0x7fb628009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:39.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.692+0000 7fb62ea00640 1 -- 172.21.15.89:0/667224536 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb624020020 con 0x7fb6380c9330 2024-08-31T04:04:39.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.896+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb638152a10 con 0x7fb6380c9330 2024-08-31T04:04:39.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.896+0000 7fb62ea00640 1 -- 172.21.15.89:0/667224536 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fb62405eb50 con 0x7fb6380c9330 2024-08-31T04:04:39.902 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:39.902 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:39.903 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:04:39.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6180720c0 msgr2=0x7fb6180745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6180720c0 0x7fb6180745d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb628001650 tx=0x7fb628009040 comp rx=0 tx=0).stop 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 msgr2=0x7fb6380c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 0x7fb6380c5ca0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb62400d780 tx=0x7fb62400dc40 comp rx=0 tx=0).stop 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 shutdown_connections 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb6180720c0 0x7fb6180745d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6380c9330 0x7fb6380c5ca0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb63815bc70 0x7fb6380b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 --2- 172.21.15.89:0/667224536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6380c1f40 0x7fb63815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 >> 172.21.15.89:0/667224536 conn(0x7fb6380ccf20 msgr2=0x7fb6380765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 shutdown_connections 2024-08-31T04:04:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:39.900+0000 7fb63d400640 1 -- 172.21.15.89:0/667224536 wait complete. 2024-08-31T04:04:39.922 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:04:40.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.072+0000 7fdbf2200640 1 -- 172.21.15.89:0/4233607370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec0b39c0 msgr2=0x7fdbec153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.072+0000 7fdbf2200640 1 --2- 172.21.15.89:0/4233607370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec0b39c0 0x7fdbec153930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009900 tx=0x7fdbd401c820 comp rx=0 tx=0).stop 2024-08-31T04:04:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.072+0000 7fdbf2200640 1 -- 172.21.15.89:0/4233607370 shutdown_connections 2024-08-31T04:04:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.072+0000 7fdbf2200640 1 --2- 172.21.15.89:0/4233607370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec0b39c0 0x7fdbec153930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.072+0000 7fdbf2200640 1 -- 172.21.15.89:0/4233607370 >> 172.21.15.89:0/4233607370 conn(0x7fdbec06d720 msgr2=0x7fdbec073130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.072+0000 7fdbf2200640 1 -- 172.21.15.89:0/4233607370 shutdown_connections 2024-08-31T04:04:40.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.072+0000 7fdbf2200640 1 -- 172.21.15.89:0/4233607370 wait complete. 2024-08-31T04:04:40.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf2200640 1 Processor -- start 2024-08-31T04:04:40.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf2200640 1 -- start start 2024-08-31T04:04:40.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf2200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbec0b39c0 0x7fdbec0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:40.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf2200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbec0b3f10 0x7fdbec1457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:40.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf2200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1595f0 0x7fdbec1f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:40.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf2200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec0c9d70 con 0x7fdbec1595f0 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf2200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec0c4520 con 0x7fdbec0b3f10 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf2200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdbec0c9ef0 con 0x7fdbec0b39c0 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1595f0 0x7fdbec1f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1595f0 0x7fdbec1f84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50562/0 (socket says 172.21.15.89:50562) 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf1800640 1 -- 172.21.15.89:0/1645900396 learned_addr learned my addr 172.21.15.89:0/1645900396 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbe3e00640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbec0b3f10 0x7fdbec1457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf0e00640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbec0b39c0 0x7fdbec0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf1800640 1 -- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbec0b39c0 msgr2=0x7fdbec0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf1800640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbec0b39c0 0x7fdbec0ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf1800640 1 -- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbec0b3f10 msgr2=0x7fdbec1457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf1800640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbec0b3f10 0x7fdbec1457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf1800640 1 -- 172.21.15.89:0/1645900396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbec0cede0 con 0x7fdbec1595f0 2024-08-31T04:04:40.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf1800640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1595f0 0x7fdbec1f84d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400c6e0 tx=0x7fdbe400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:40.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbe9600640 1 -- 172.21.15.89:0/1645900396 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4003b80 con 0x7fdbec1595f0 2024-08-31T04:04:40.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbe9600640 1 -- 172.21.15.89:0/1645900396 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbe4003d20 con 0x7fdbec1595f0 2024-08-31T04:04:40.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbec154210 con 0x7fdbec1595f0 2024-08-31T04:04:40.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.076+0000 7fdbe9600640 1 -- 172.21.15.89:0/1645900396 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4005330 con 0x7fdbec1595f0 2024-08-31T04:04:40.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.080+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbec0cd3a0 con 0x7fdbec1595f0 2024-08-31T04:04:40.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.080+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbec153930 con 0x7fdbec1595f0 2024-08-31T04:04:40.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.080+0000 7fdbe9600640 1 -- 172.21.15.89:0/1645900396 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdbe40054d0 con 0x7fdbec1595f0 2024-08-31T04:04:40.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.080+0000 7fdbe9600640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc80720c0 0x7fdbc80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:40.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.080+0000 7fdbe9600640 1 -- 172.21.15.89:0/1645900396 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdbe4093720 con 0x7fdbec1595f0 2024-08-31T04:04:40.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.080+0000 7fdbf0e00640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc80720c0 0x7fdbc80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:40.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.084+0000 7fdbf0e00640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc80720c0 0x7fdbc80745d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc007fd0 tx=0x7fdbdc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:40.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.084+0000 7fdbe9600640 1 -- 172.21.15.89:0/1645900396 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdbe405e630 con 0x7fdbec1595f0 2024-08-31T04:04:40.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.264+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbec0ca710 con 0x7fdbec1595f0 2024-08-31T04:04:40.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.264+0000 7fdbe9600640 1 -- 172.21.15.89:0/1645900396 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18745 (secure 0 0 0) 0x7fdbe4062df0 con 0x7fdbec1595f0 2024-08-31T04:04:40.266 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:40.267 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":27,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:04:40.188303+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:04:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc80720c0 msgr2=0x7fdbc80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc80720c0 0x7fdbc80745d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc007fd0 tx=0x7fdbdc009040 comp rx=0 tx=0).stop 2024-08-31T04:04:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1595f0 msgr2=0x7fdbec1f84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1595f0 0x7fdbec1f84d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400c6e0 tx=0x7fdbe400cba0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 shutdown_connections 2024-08-31T04:04:40.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc80720c0 0x7fdbc80745d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1595f0 0x7fdbec1f84d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbec0b3f10 0x7fdbec1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 --2- 172.21.15.89:0/1645900396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbec0b39c0 0x7fdbec0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 >> 172.21.15.89:0/1645900396 conn(0x7fdbec06d720 msgr2=0x7fdbec0765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 shutdown_connections 2024-08-31T04:04:40.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.268+0000 7fdbf2200640 1 -- 172.21.15.89:0/1645900396 wait complete. 2024-08-31T04:04:40.289 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get run_dir 2024-08-31T04:04:40.449 INFO:teuthology.orchestra.run.smithi089.stdout:{"run_dir":"/var/run/ceph"} 2024-08-31T04:04:40.450 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-31T04:04:40.450 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 5413 2024-08-31T04:04:40.450 DEBUG:tasks.quiescer:Yielding 2024-08-31T04:04:40.450 INFO:teuthology.run_tasks:Running task workunit... 2024-08-31T04:04:40.463 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:04:40.464 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-31T04:04:40.464 INFO:tasks.workunit:timeout=6h 2024-08-31T04:04:40.464 INFO:tasks.workunit:cleanup=True 2024-08-31T04:04:40.464 DEBUG:teuthology.orchestra.run.smithi089:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-31T04:04:40.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:40.473 INFO:teuthology.orchestra.run.smithi089.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-31T04:04:40.473 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-31T04:04:40.473 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-08-31T04:04:40.474 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:04:40.474 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-31T04:04:40.474 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-08-31 04:04:05.872654589 +0000 2024-08-31T04:04:40.474 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-08-31 04:04:14.839119614 +0000 2024-08-31T04:04:40.474 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-08-31 04:04:05.872654589 +0000 2024-08-31T04:04:40.474 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-31T04:04:40.474 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-31T04:04:40.544 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:04:40.599 INFO:tasks.workunit.client.0.smithi089.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-31T04:04:40.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.624+0000 7f2fb5c00640 1 -- 172.21.15.89:0/260262942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00c80b0 msgr2=0x7f2fb0071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.624+0000 7f2fb5c00640 1 --2- 172.21.15.89:0/260262942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00c80b0 0x7f2fb0071dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2fb006ea90 tx=0x7f2f9c01f0b0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.624+0000 7f2fb5c00640 1 -- 172.21.15.89:0/260262942 shutdown_connections 2024-08-31T04:04:40.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.624+0000 7f2fb5c00640 1 --2- 172.21.15.89:0/260262942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00c80b0 0x7f2fb0071dc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.624+0000 7f2fb5c00640 1 --2- 172.21.15.89:0/260262942 >> v2:172.21.15.170:3300/0 conn(0x7f2fb0070af0 0x7f2fb006df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.624+0000 7f2fb5c00640 1 -- 172.21.15.89:0/260262942 >> 172.21.15.89:0/260262942 conn(0x7f2fb00ce2c0 msgr2=0x7f2fb00ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:40.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.624+0000 7f2fb5c00640 1 -- 172.21.15.89:0/260262942 shutdown_connections 2024-08-31T04:04:40.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.624+0000 7f2fb5c00640 1 -- 172.21.15.89:0/260262942 wait complete. 2024-08-31T04:04:40.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fb5c00640 1 Processor -- start 2024-08-31T04:04:40.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fb5c00640 1 -- start start 2024-08-31T04:04:40.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fb5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb0070af0 0x7f2fb01f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fb5c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00711c0 0x7f2fb01f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fb5c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb00c80b0 0x7f2fb00c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fb5c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb0072d80 con 0x7f2fb00711c0 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fb5c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00c4a80 con 0x7f2fb0070af0 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fb5c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb0072f00 con 0x7f2fb00c80b0 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2faf400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00711c0 0x7f2fb01f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2faf400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00711c0 0x7f2fb01f2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50576/0 (socket says 172.21.15.89:50576) 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2faf400640 1 -- 172.21.15.89:0/692494893 learned_addr learned my addr 172.21.15.89:0/692494893 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fafe00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb0070af0 0x7f2fb01f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:40.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2fb5200640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb00c80b0 0x7f2fb00c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2faf400640 1 -- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb00c80b0 msgr2=0x7f2fb00c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2faf400640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb00c80b0 0x7f2fb00c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2faf400640 1 -- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb0070af0 msgr2=0x7f2fb01f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2faf400640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb0070af0 0x7f2fb01f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.628+0000 7f2faf400640 1 -- 172.21.15.89:0/692494893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb01f2cc0 con 0x7f2fb00711c0 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2faf400640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00711c0 0x7f2fb01f2780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0b3040 tx=0x7f2f9c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2fa7e00640 1 -- 172.21.15.89:0/692494893 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0b5040 con 0x7f2fb00711c0 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2fa7e00640 1 -- 172.21.15.89:0/692494893 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f9c005310 con 0x7f2fb00711c0 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb015c820 con 0x7f2fb00711c0 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2fa7e00640 1 -- 172.21.15.89:0/692494893 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0046d0 con 0x7f2fb00711c0 2024-08-31T04:04:40.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb01f5670 con 0x7f2fb00711c0 2024-08-31T04:04:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb015c590 con 0x7f2fb00711c0 2024-08-31T04:04:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2fa7e00640 1 -- 172.21.15.89:0/692494893 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2f9c0c1060 con 0x7f2fb00711c0 2024-08-31T04:04:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2fa7e00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f900720f0 0x7f2f90074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.632+0000 7f2fa7e00640 1 -- 172.21.15.89:0/692494893 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6619+0+0 (secure 0 0 0) 0x7f2f9c1300a0 con 0x7f2fb00711c0 2024-08-31T04:04:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.636+0000 7f2fafe00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f900720f0 0x7f2f90074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:40.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.636+0000 7f2fafe00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f900720f0 0x7f2f90074600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0001650 tx=0x7f2fa0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:40.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.636+0000 7f2fa7e00640 1 -- 172.21.15.89:0/692494893 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2fb01f2cc0 con 0x7f2fb00711c0 2024-08-31T04:04:40.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fb015d7c0 con 0x7f2fb00711c0 2024-08-31T04:04:40.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fa7e00640 1 -- 172.21.15.89:0/692494893 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f2f9c018c10 con 0x7f2fb00711c0 2024-08-31T04:04:40.842 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:40.842 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:40.842 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f900720f0 msgr2=0x7f2f90074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f900720f0 0x7f2f90074600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0001650 tx=0x7f2fa0009040 comp rx=0 tx=0).stop 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00711c0 msgr2=0x7f2fb01f2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00711c0 0x7f2fb01f2780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0b3040 tx=0x7f2f9c005e00 comp rx=0 tx=0).stop 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 shutdown_connections 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f900720f0 0x7f2f90074600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb00711c0 0x7f2fb01f2780 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb00c80b0 0x7f2fb00c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 --2- 172.21.15.89:0/692494893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb0070af0 0x7f2fb01f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 >> 172.21.15.89:0/692494893 conn(0x7f2fb00ce2c0 msgr2=0x7f2fb0159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:40.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 shutdown_connections 2024-08-31T04:04:40.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:40.840+0000 7f2fb5c00640 1 -- 172.21.15.89:0/692494893 wait complete. 2024-08-31T04:04:41.468 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-31T04:04:00.242319+0000', 'modified': '2024-08-31T04:04:24.589391+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4420}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4420': {'gid': 4420, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.170:6835/890662790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6834', 'nonce': 890662790}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 890662790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4420, 'qdb_cluster': [4420]} 2024-08-31T04:04:41.469 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-31T04:04:41.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-31T04:04:41.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.620+0000 7f39c1800640 1 -- 172.21.15.89:0/77703568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc152a10 msgr2=0x7f39bc0c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:41.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.620+0000 7f39c1800640 1 --2- 172.21.15.89:0/77703568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc152a10 0x7f39bc0c9330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009c80 tx=0x7f39b401f5a0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.620+0000 7f39c1800640 1 -- 172.21.15.89:0/77703568 shutdown_connections 2024-08-31T04:04:41.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.620+0000 7f39c1800640 1 --2- 172.21.15.89:0/77703568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc152a10 0x7f39bc0c9330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.620+0000 7f39c1800640 1 -- 172.21.15.89:0/77703568 >> 172.21.15.89:0/77703568 conn(0x7f39bc0ccf20 msgr2=0x7f39bc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:41.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.620+0000 7f39c1800640 1 -- 172.21.15.89:0/77703568 shutdown_connections 2024-08-31T04:04:41.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.620+0000 7f39c1800640 1 -- 172.21.15.89:0/77703568 wait complete. 2024-08-31T04:04:41.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39c1800640 1 Processor -- start 2024-08-31T04:04:41.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39c1800640 1 -- start start 2024-08-31T04:04:41.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39c1800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39bc0c1f40 0x7f39bc1f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39c1800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39bc152a10 0x7f39bc153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39c1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc15bc70 0x7f39bc0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39c1800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc074e30 con 0x7f39bc15bc70 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39c1800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc0c8030 con 0x7f39bc0c1f40 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39c1800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc074fb0 con 0x7f39bc152a10 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc15bc70 0x7f39bc0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc15bc70 0x7f39bc0b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48790/0 (socket says 172.21.15.89:48790) 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39bb400640 1 -- 172.21.15.89:0/2791370428 learned_addr learned my addr 172.21.15.89:0/2791370428 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39b3e00640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39bc152a10 0x7f39bc153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39baa00640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39bc0c1f40 0x7f39bc1f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39bb400640 1 -- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39bc152a10 msgr2=0x7f39bc153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:41.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39bb400640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39bc152a10 0x7f39bc153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39bb400640 1 -- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39bc0c1f40 msgr2=0x7f39bc1f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:41.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39bb400640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39bc0c1f40 0x7f39bc1f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39bb400640 1 -- 172.21.15.89:0/2791370428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc1f2ac0 con 0x7f39bc15bc70 2024-08-31T04:04:41.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39b3e00640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39bc152a10 0x7f39bc153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:41.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39bb400640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc15bc70 0x7f39bc0b1170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39b401dc50 tx=0x7f39b40af410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:41.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39b2a00640 1 -- 172.21.15.89:0/2791370428 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4004e60 con 0x7f39bc15bc70 2024-08-31T04:04:41.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39b2a00640 1 -- 172.21.15.89:0/2791370428 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b40be070 con 0x7f39bc15bc70 2024-08-31T04:04:41.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39c1800640 1 -- 172.21.15.89:0/2791370428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39bc1574b0 con 0x7f39bc15bc70 2024-08-31T04:04:41.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.624+0000 7f39b2a00640 1 -- 172.21.15.89:0/2791370428 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b40afb00 con 0x7f39bc15bc70 2024-08-31T04:04:41.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.628+0000 7f39c1800640 1 -- 172.21.15.89:0/2791370428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39bc157a70 con 0x7f39bc15bc70 2024-08-31T04:04:41.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.628+0000 7f39b2a00640 1 -- 172.21.15.89:0/2791370428 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f39b40afca0 con 0x7f39bc15bc70 2024-08-31T04:04:41.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.628+0000 7f39b2a00640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.628+0000 7f39b2a00640 1 -- 172.21.15.89:0/2791370428 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7f39b4132000 con 0x7f39bc15bc70 2024-08-31T04:04:41.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.628+0000 7f39c8eff000 1 Processor -- start 2024-08-31T04:04:41.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.628+0000 7f39baa00640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.628+0000 7f39c8eff000 1 -- start start 2024-08-31T04:04:41.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39baa00640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39ac001650 tx=0x7f39ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:41.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 0x55f022397eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f02239bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f02239c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f0221b7360 con 0x55f022254d90 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f0221a68f0 con 0x55f021e65460 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f0221aa8a0 con 0x55f02223e860 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39b3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f02239bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39b3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f02239bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48798/0 (socket says 172.21.15.89:48798) 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39b3e00640 1 -- 172.21.15.89:0/256970633 learned_addr learned my addr 172.21.15.89:0/256970633 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39baa00640 1 --2- 172.21.15.89:0/256970633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 0x55f022397eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39bb400640 1 --2- 172.21.15.89:0/256970633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f02239c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39b3e00640 1 -- 172.21.15.89:0/256970633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 msgr2=0x55f02239c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39b3e00640 1 --2- 172.21.15.89:0/256970633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f02239c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39b3e00640 1 -- 172.21.15.89:0/256970633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 msgr2=0x55f022397eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39b3e00640 1 --2- 172.21.15.89:0/256970633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 0x55f022397eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39b3e00640 1 -- 172.21.15.89:0/256970633 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f022146190 con 0x55f022254d90 2024-08-31T04:04:41.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39b3e00640 1 --2- 172.21.15.89:0/256970633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f02239bb40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f39a4001640 tx=0x7f39a4001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cddffe3121ed888 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:41.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39ab400640 1 -- 172.21.15.89:0/256970633 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4019070 con 0x55f022254d90 2024-08-31T04:04:41.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39ab400640 1 -- 172.21.15.89:0/256970633 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a40052e0 con 0x55f022254d90 2024-08-31T04:04:41.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39ab400640 1 -- 172.21.15.89:0/256970633 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4001d50 con 0x55f022254d90 2024-08-31T04:04:41.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 -- 172.21.15.89:0/256970633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 msgr2=0x55f02239bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:41.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 --2- 172.21.15.89:0/256970633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f02239bb40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f39a4001640 tx=0x7f39a4001b00 comp rx=0 tx=0).stop 2024-08-31T04:04:41.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 -- 172.21.15.89:0/256970633 shutdown_connections 2024-08-31T04:04:41.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 --2- 172.21.15.89:0/256970633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f02239bb40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 --2- 172.21.15.89:0/256970633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f02239c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 --2- 172.21.15.89:0/256970633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 0x55f022397eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 -- 172.21.15.89:0/256970633 >> 172.21.15.89:0/256970633 conn(0x55f02232aae0 msgr2=0x55f02239a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:41.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 -- 172.21.15.89:0/256970633 shutdown_connections 2024-08-31T04:04:41.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.632+0000 7f39c8eff000 1 -- 172.21.15.89:0/256970633 wait complete. 2024-08-31T04:04:41.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 -- start start 2024-08-31T04:04:41.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 Processor -- start 2024-08-31T04:04:41.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f022396a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f022396fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 0x55f022397500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f022173500 con 0x55f021e65460 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f022174190 con 0x55f022254d90 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f0221a9bb0 con 0x55f02223e860 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 10 client.0 _ll_register_callbacks cb 0x55f022347100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39baa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f022396a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39baa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f022396a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48812/0 (socket says 172.21.15.89:48812) 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39baa00640 1 -- 172.21.15.89:0/353475879 learned_addr learned my addr 172.21.15.89:0/353475879 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39bb400640 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 0x55f022397500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39b3e00640 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f022396fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39baa00640 1 -- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 msgr2=0x55f022396fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:41.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39baa00640 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f022396fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39baa00640 1 -- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 msgr2=0x55f022397500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39baa00640 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 0x55f022397500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39baa00640 1 -- 172.21.15.89:0/353475879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f022141530 con 0x55f021e65460 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39baa00640 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f022396a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0038b0 tx=0x7f39ac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120c1ee96b52c029 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f399fe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f399fe00640 1 -- 172.21.15.89:0/353475879 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac027060 con 0x55f021e65460 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f399fe00640 1 -- 172.21.15.89:0/353475879 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7f39ac010040 con 0x55f021e65460 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 -- 172.21.15.89:0/353475879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f022140110 con 0x55f021e65460 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f399fe00640 1 -- 172.21.15.89:0/353475879 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f39ac003e30 con 0x55f021e65460 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 10 client.4812 fetch_fsmap learned FSMap version 9 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 -- 172.21.15.89:0/353475879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f02222bff0 con 0x55f021e65460 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f399fe00640 1 -- 172.21.15.89:0/353475879 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f022140110 con 0x55f021e65460 2024-08-31T04:04:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f399fe00640 1 -- 172.21.15.89:0/353475879 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f39ac015940 con 0x55f021e65460 2024-08-31T04:04:41.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 10 client.4812 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:04:41.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 10 client.4812 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:04:41.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 20 client.4812 populate_metadata read hostname 'smithi089' 2024-08-31T04:04:41.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55f021e4a7d0 0x55f0223b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 4 client.4812 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:04:41.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.636+0000 7f39c8eff000 1 -- 172.21.15.89:0/353475879 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0221b92b0 con 0x55f021e4a7d0 2024-08-31T04:04:41.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39b3e00640 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55f021e4a7d0 0x55f0223b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39b3e00640 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55f021e4a7d0 0x55f0223b1600 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6d53d947845453 server_cookie=31946727c5afffb8 in_seq=0 out_seq=0 2024-08-31T04:04:41.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f399fe00640 10 client.4812 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:41.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f399fe00640 1 -- 172.21.15.89:0/353475879 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0221b92b0 con 0x55f021e4a7d0 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f399fe00640 10 client.4812 handle_command_reply: tid=0 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 client.4812 shutdown 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 -- 172.21.15.89:0/353475879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 msgr2=0x55f022396a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f022396a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0038b0 tx=0x7f39ac000bd0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 -- 172.21.15.89:0/353475879 shutdown_connections 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55f021e4a7d0 0x55f0223b1600 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 0x55f022397500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f022396fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f399fe00640 0 client.4812 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 --2- 172.21.15.89:0/353475879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f022396a80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 -- 172.21.15.89:0/353475879 >> 172.21.15.89:0/353475879 conn(0x55f02232aae0 msgr2=0x55f0223992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 -- 172.21.15.89:0/353475879 shutdown_connections 2024-08-31T04:04:41.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 1 -- 172.21.15.89:0/353475879 wait complete. 2024-08-31T04:04:41.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.640+0000 7f39c8eff000 20 client.4812 trim_cache size 0 max 16384 2024-08-31T04:04:41.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39c8eff000 1 Processor -- start 2024-08-31T04:04:41.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39c8eff000 1 -- start start 2024-08-31T04:04:41.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 0x55f02239a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f022361800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f022361d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39c8eff000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc1ff580 con 0x55f022254d90 2024-08-31T04:04:41.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39c8eff000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc1fe8d0 con 0x55f021e65460 2024-08-31T04:04:41.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39c8eff000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc1feee0 con 0x55f02223e860 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f022361d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f022361d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48828/0 (socket says 172.21.15.89:48828) 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39bb400640 1 -- 172.21.15.89:0/3480414115 learned_addr learned my addr 172.21.15.89:0/3480414115 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39baa00640 1 --2- 172.21.15.89:0/3480414115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 0x55f02239a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39b3e00640 1 --2- 172.21.15.89:0/3480414115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f022361800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39bb400640 1 -- 172.21.15.89:0/3480414115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 msgr2=0x55f022361800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39bb400640 1 --2- 172.21.15.89:0/3480414115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f022361800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39bb400640 1 -- 172.21.15.89:0/3480414115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 msgr2=0x55f02239a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39bb400640 1 --2- 172.21.15.89:0/3480414115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 0x55f02239a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.660+0000 7f39bb400640 1 -- 172.21.15.89:0/3480414115 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0222034b0 con 0x55f022254d90 2024-08-31T04:04:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39bb400640 1 --2- 172.21.15.89:0/3480414115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f022361d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39b40f9410 tx=0x7f39b40fc830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b35f6db5aee084a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39aaa00640 1 -- 172.21.15.89:0/3480414115 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b40fce20 con 0x55f022254d90 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39aaa00640 1 -- 172.21.15.89:0/3480414115 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b40b4040 con 0x55f022254d90 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39aaa00640 1 -- 172.21.15.89:0/3480414115 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4101690 con 0x55f022254d90 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 -- 172.21.15.89:0/3480414115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 msgr2=0x55f022361d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3480414115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f022361d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39b40f9410 tx=0x7f39b40fc830 comp rx=0 tx=0).stop 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 -- 172.21.15.89:0/3480414115 shutdown_connections 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3480414115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f022254d90 0x55f022361d40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3480414115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f022361800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3480414115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f021e65460 0x55f02239a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 -- 172.21.15.89:0/3480414115 >> 172.21.15.89:0/3480414115 conn(0x55f02232aae0 msgr2=0x55f0223a4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 -- 172.21.15.89:0/3480414115 shutdown_connections 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 -- 172.21.15.89:0/3480414115 wait complete. 2024-08-31T04:04:41.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 -- start start 2024-08-31T04:04:41.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 Processor -- start 2024-08-31T04:04:41.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f02239edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f02239f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 0x55f02239f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f02215e340 con 0x55f021e65460 2024-08-31T04:04:41.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f0221aeed0 con 0x55f022254d90 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f022166de0 con 0x55f02223e860 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.664+0000 7f39c8eff000 10 client.0 _ll_register_callbacks cb 0x7f39ac0013b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39baa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f02239edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39baa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f02239edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48842/0 (socket says 172.21.15.89:48842) 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39baa00640 1 -- 172.21.15.89:0/3633271428 learned_addr learned my addr 172.21.15.89:0/3633271428 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39bb400640 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 0x55f02239f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39b3e00640 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f02239f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39baa00640 1 -- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 msgr2=0x55f02239f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39baa00640 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f02239f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39baa00640 1 -- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 msgr2=0x55f02239f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39baa00640 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 0x55f02239f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39baa00640 1 -- 172.21.15.89:0/3633271428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f022160f30 con 0x55f021e65460 2024-08-31T04:04:41.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39baa00640 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f02239edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f39ac005610 tx=0x7f39ac015810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24af560853b59f3d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 1 -- 172.21.15.89:0/3633271428 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac022450 con 0x55f021e65460 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 1 -- 172.21.15.89:0/3633271428 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7f39ac010070 con 0x55f021e65460 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 -- 172.21.15.89:0/3633271428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39b40b4040 con 0x55f021e65460 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 1 -- 172.21.15.89:0/3633271428 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f39ac0225f0 con 0x55f021e65460 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 10 client.4818 fetch_fsmap learned FSMap version 9 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 -- 172.21.15.89:0/3633271428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f02214c590 con 0x55f021e65460 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 1 -- 172.21.15.89:0/3633271428 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b40b4040 con 0x55f021e65460 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 1 -- 172.21.15.89:0/3633271428 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f39ac022790 con 0x55f021e65460 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 10 client.4818 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:04:41.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 20 client.4818 populate_metadata read hostname 'smithi089' 2024-08-31T04:04:41.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55f021e38830 0x55f02241ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:41.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 4 client.4818 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:04:41.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 -- 172.21.15.89:0/3633271428 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "status"}) -- 0x55f0221b4d50 con 0x55f021e38830 2024-08-31T04:04:41.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39b3e00640 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55f021e38830 0x55f02241ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 10 client.4818 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39b3e00640 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55f021e38830 0x55f02241ef70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a90bebe1f74b699 server_cookie=bfe070395050af21 in_seq=0 out_seq=0 2024-08-31T04:04:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 1 -- 172.21.15.89:0/3633271428 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55f0221b4d50 con 0x55f021e38830 2024-08-31T04:04:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 10 client.4818 handle_command_reply: tid=0 2024-08-31T04:04:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 client.4818 shutdown 2024-08-31T04:04:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 -- 172.21.15.89:0/3633271428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 msgr2=0x55f02239edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f02239edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f39ac005610 tx=0x7f39ac015810 comp rx=0 tx=0).stop 2024-08-31T04:04:41.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 -- 172.21.15.89:0/3633271428 shutdown_connections 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55f021e38830 0x55f02241ef70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f022254d90 0x55f02239f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f02223e860 0x55f02239f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 --2- 172.21.15.89:0/3633271428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f021e65460 0x55f02239edb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f399fe00640 0 client.4818 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 -- 172.21.15.89:0/3633271428 >> 172.21.15.89:0/3633271428 conn(0x55f02232aae0 msgr2=0x55f0223597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 -- 172.21.15.89:0/3633271428 shutdown_connections 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 1 -- 172.21.15.89:0/3633271428 wait complete. 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.668+0000 7f39c8eff000 20 client.4818 trim_cache size 0 max 16384 2024-08-31T04:04:41.675 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "4a16b848-e6b2-47d6-97cd-edff59841cb1", 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4420, 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 40.801660011999999, 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 9, 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 28, 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 26, 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 46.216421142999998 2024-08-31T04:04:41.676 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:04:41.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 -- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 msgr2=0x7f39980745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:41.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39ac001650 tx=0x7f39ac009040 comp rx=0 tx=0).stop 2024-08-31T04:04:41.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 -- 172.21.15.89:0/2791370428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc15bc70 msgr2=0x7f39bc0b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:41.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc15bc70 0x7f39bc0b1170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39b401dc50 tx=0x7f39b40af410 comp rx=0 tx=0).stop 2024-08-31T04:04:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 -- 172.21.15.89:0/2791370428 shutdown_connections 2024-08-31T04:04:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39980720c0 0x7f39980745d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39bc15bc70 0x7f39bc0b1170 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39bc152a10 0x7f39bc153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 --2- 172.21.15.89:0/2791370428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39bc0c1f40 0x7f39bc1f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 -- 172.21.15.89:0/2791370428 >> 172.21.15.89:0/2791370428 conn(0x7f39bc0ccf20 msgr2=0x7f39bc1586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 -- 172.21.15.89:0/2791370428 shutdown_connections 2024-08-31T04:04:41.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:41.672+0000 7f39c1800640 1 -- 172.21.15.89:0/2791370428 wait complete. 2024-08-31T04:04:41.691 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-31T04:04:56.692 INFO:tasks.quiescer.fs.[cephfs]:Total duration (52.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:04:56.693 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T04:04:56.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:04:56.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.855+0000 7fbaada00640 1 -- 172.21.15.89:0/3376148219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa815d220 msgr2=0x7fbaa8164180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:56.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.855+0000 7fbaada00640 1 --2- 172.21.15.89:0/3376148219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa815d220 0x7fbaa8164180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009bf0 tx=0x7fbaa001f350 comp rx=0 tx=0).stop 2024-08-31T04:04:56.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.855+0000 7fbaada00640 1 -- 172.21.15.89:0/3376148219 shutdown_connections 2024-08-31T04:04:56.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.855+0000 7fbaada00640 1 --2- 172.21.15.89:0/3376148219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa815d220 0x7fbaa8164180 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:56.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.855+0000 7fbaada00640 1 --2- 172.21.15.89:0/3376148219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbaa8074e20 0x7fbaa8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:56.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.855+0000 7fbaada00640 1 -- 172.21.15.89:0/3376148219 >> 172.21.15.89:0/3376148219 conn(0x7fbaa80ccf20 msgr2=0x7fbaa80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:56.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.855+0000 7fbaada00640 1 -- 172.21.15.89:0/3376148219 shutdown_connections 2024-08-31T04:04:56.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.855+0000 7fbaada00640 1 -- 172.21.15.89:0/3376148219 wait complete. 2024-08-31T04:04:56.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaada00640 1 Processor -- start 2024-08-31T04:04:56.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaada00640 1 -- start start 2024-08-31T04:04:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaada00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa8074e20 0x7fbaa815ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaada00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbaa815ce10 0x7fbaa8151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaada00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa815d220 0x7fbaa8070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaada00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa8159c90 con 0x7fbaa8074e20 2024-08-31T04:04:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaada00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa81599b0 con 0x7fbaa815d220 2024-08-31T04:04:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaada00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa8159f70 con 0x7fbaa815ce10 2024-08-31T04:04:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaa6a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa8074e20 0x7fbaa815ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaa6a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa8074e20 0x7fbaa815ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47234/0 (socket says 172.21.15.89:47234) 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaa6a00640 1 -- 172.21.15.89:0/1039433756 learned_addr learned my addr 172.21.15.89:0/1039433756 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fba9e000640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbaa815ce10 0x7fbaa8151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaa7400640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa815d220 0x7fbaa8070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaa6a00640 1 -- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbaa815ce10 msgr2=0x7fbaa8151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaa6a00640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbaa815ce10 0x7fbaa8151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaa6a00640 1 -- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa815d220 msgr2=0x7fbaa8070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaa6a00640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa815d220 0x7fbaa8070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.859+0000 7fbaa6a00640 1 -- 172.21.15.89:0/1039433756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa8154770 con 0x7fbaa8074e20 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.863+0000 7fbaa6a00640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa8074e20 0x7fbaa815ac40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba9000e7d0 tx=0x7fba9000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.863+0000 7fba9f400640 1 -- 172.21.15.89:0/1039433756 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9000ccc0 con 0x7fbaa8074e20 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.863+0000 7fba9f400640 1 -- 172.21.15.89:0/1039433756 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba90010430 con 0x7fbaa8074e20 2024-08-31T04:04:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.863+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa81549e0 con 0x7fbaa8074e20 2024-08-31T04:04:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.863+0000 7fba9f400640 1 -- 172.21.15.89:0/1039433756 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90010860 con 0x7fbaa8074e20 2024-08-31T04:04:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.863+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa815c700 con 0x7fbaa8074e20 2024-08-31T04:04:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.863+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa80c38a0 con 0x7fbaa8074e20 2024-08-31T04:04:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.863+0000 7fba9f400640 1 -- 172.21.15.89:0/1039433756 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fba90010a00 con 0x7fbaa8074e20 2024-08-31T04:04:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.867+0000 7fba9f400640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fba840720c0 0x7fba840745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.867+0000 7fba9f400640 1 -- 172.21.15.89:0/1039433756 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7fba90093980 con 0x7fbaa8074e20 2024-08-31T04:04:56.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.867+0000 7fba9e000640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fba840720c0 0x7fba840745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:56.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.867+0000 7fba9e000640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fba840720c0 0x7fba840745d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80b1a60 tx=0x7fba98009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:56.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:56.871+0000 7fba9f400640 1 -- 172.21.15.89:0/1039433756 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fba9005ee90 con 0x7fbaa8074e20 2024-08-31T04:04:57.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.071+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbaa8074c00 con 0x7fbaa8074e20 2024-08-31T04:04:57.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.071+0000 7fba9f400640 1 -- 172.21.15.89:0/1039433756 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fba9005e790 con 0x7fbaa8074e20 2024-08-31T04:04:57.076 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:04:57.076 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:04:57.076 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:04:57.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fba840720c0 msgr2=0x7fba840745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fba840720c0 0x7fba840745d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80b1a60 tx=0x7fba98009040 comp rx=0 tx=0).stop 2024-08-31T04:04:57.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa8074e20 msgr2=0x7fbaa815ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa8074e20 0x7fbaa815ac40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba9000e7d0 tx=0x7fba9000ec90 comp rx=0 tx=0).stop 2024-08-31T04:04:57.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 shutdown_connections 2024-08-31T04:04:57.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fba840720c0 0x7fba840745d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbaa815d220 0x7fbaa8070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbaa815ce10 0x7fbaa8151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 --2- 172.21.15.89:0/1039433756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa8074e20 0x7fbaa815ac40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 >> 172.21.15.89:0/1039433756 conn(0x7fbaa80ccf20 msgr2=0x7fbaa80c6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:57.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 shutdown_connections 2024-08-31T04:04:57.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.075+0000 7fbaada00640 1 -- 172.21.15.89:0/1039433756 wait complete. 2024-08-31T04:04:57.098 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T04:04:57.098 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T04:04:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.259+0000 7eff7fc00640 1 -- 172.21.15.89:0/980566091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4650 msgr2=0x7eff780ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.259+0000 7eff7fc00640 1 --2- 172.21.15.89:0/980566091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4650 0x7eff780ce240 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7eff64009900 tx=0x7eff6401c8e0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.259+0000 7eff7fc00640 1 -- 172.21.15.89:0/980566091 shutdown_connections 2024-08-31T04:04:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.259+0000 7eff7fc00640 1 --2- 172.21.15.89:0/980566091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4650 0x7eff780ce240 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.259+0000 7eff7fc00640 1 --2- 172.21.15.89:0/980566091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff780c3e40 0x7eff78156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.259+0000 7eff7fc00640 1 -- 172.21.15.89:0/980566091 >> 172.21.15.89:0/980566091 conn(0x7eff78071a70 msgr2=0x7eff7806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.259+0000 7eff7fc00640 1 -- 172.21.15.89:0/980566091 shutdown_connections 2024-08-31T04:04:57.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.259+0000 7eff7fc00640 1 -- 172.21.15.89:0/980566091 wait complete. 2024-08-31T04:04:57.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 Processor -- start 2024-08-31T04:04:57.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 -- start start 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780c3e40 0x7eff7806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff780c4650 0x7eff780cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4a60 0x7eff781509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7eff780cc0c0 con 0x7eff780c4a60 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7eff780cbf40 con 0x7eff780c3e40 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7eff781668a0 con 0x7eff780c4650 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4a60 0x7eff781509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4a60 0x7eff781509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47260/0 (socket says 172.21.15.89:47260) 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7dc00640 1 -- 172.21.15.89:0/3462535275 learned_addr learned my addr 172.21.15.89:0/3462535275 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:57.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7d200640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780c3e40 0x7eff7806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff77e00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff780c4650 0x7eff780cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7dc00640 1 -- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff780c4650 msgr2=0x7eff780cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7dc00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff780c4650 0x7eff780cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7dc00640 1 -- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780c3e40 msgr2=0x7eff7806f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7dc00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780c3e40 0x7eff7806f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7dc00640 1 -- 172.21.15.89:0/3462535275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7814ad30 con 0x7eff780c4a60 2024-08-31T04:04:57.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7d200640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780c3e40 0x7eff7806f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:57.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7dc00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4a60 0x7eff781509b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c760 tx=0x7eff7000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:57.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff74c00640 1 -- 172.21.15.89:0/3462535275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70003ba0 con 0x7eff780c4a60 2024-08-31T04:04:57.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff74c00640 1 -- 172.21.15.89:0/3462535275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff70003d60 con 0x7eff780c4a60 2024-08-31T04:04:57.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff74c00640 1 -- 172.21.15.89:0/3462535275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7000aab0 con 0x7eff780c4a60 2024-08-31T04:04:57.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 -- 172.21.15.89:0/3462535275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7806f970 con 0x7eff780c4a60 2024-08-31T04:04:57.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.263+0000 7eff7fc00640 1 -- 172.21.15.89:0/3462535275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff781f8e50 con 0x7eff780c4a60 2024-08-31T04:04:57.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.267+0000 7eff74c00640 1 -- 172.21.15.89:0/3462535275 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7eff7000ac50 con 0x7eff780c4a60 2024-08-31T04:04:57.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.267+0000 7eff74c00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7eff580720c0 0x7eff580745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.267+0000 7eff87419000 1 Processor -- start 2024-08-31T04:04:57.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.267+0000 7eff74c00640 1 -- 172.21.15.89:0/3462535275 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7eff70092da0 con 0x7eff780c4a60 2024-08-31T04:04:57.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.267+0000 7eff87419000 1 -- start start 2024-08-31T04:04:57.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.267+0000 7eff7d200640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7eff580720c0 0x7eff580745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff7d200640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7eff580720c0 0x7eff580745d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00bbd0 tx=0x7eff6c00b5b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:57.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 0x55fcb508dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb5056ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f33960 0x55fcb5057220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fcb4eac820 con 0x55fcb4f49e90 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55fcb4e9bdb0 con 0x55fcb4f33960 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55fcb4e9fd60 con 0x55fcb4f543f0 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb5056ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb5056ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47264/0 (socket says 172.21.15.89:47264) 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff77e00640 1 -- 172.21.15.89:0/1741893080 learned_addr learned my addr 172.21.15.89:0/1741893080 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff7d200640 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 0x55fcb508dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff7dc00640 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f33960 0x55fcb5057220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff77e00640 1 -- 172.21.15.89:0/1741893080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 msgr2=0x55fcb508dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:57.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff77e00640 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 0x55fcb508dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff77e00640 1 -- 172.21.15.89:0/1741893080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f33960 msgr2=0x55fcb5057220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:57.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff77e00640 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f33960 0x55fcb5057220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff77e00640 1 -- 172.21.15.89:0/1741893080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb4e36b70 con 0x55fcb4f49e90 2024-08-31T04:04:57.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff7dc00640 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f33960 0x55fcb5057220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:57.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff77e00640 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb5056ce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff64009230 tx=0x7eff64019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16407e9d6f6f8a81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:57.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff69600640 1 -- 172.21.15.89:0/1741893080 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640ba020 con 0x55fcb4f49e90 2024-08-31T04:04:57.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff69600640 1 -- 172.21.15.89:0/1741893080 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff64004310 con 0x55fcb4f49e90 2024-08-31T04:04:57.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff69600640 1 -- 172.21.15.89:0/1741893080 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640b2040 con 0x55fcb4f49e90 2024-08-31T04:04:57.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 -- 172.21.15.89:0/1741893080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 msgr2=0x55fcb5056ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb5056ce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff64009230 tx=0x7eff64019680 comp rx=0 tx=0).stop 2024-08-31T04:04:57.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 -- 172.21.15.89:0/1741893080 shutdown_connections 2024-08-31T04:04:57.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb5056ce0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f33960 0x55fcb5057220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 --2- 172.21.15.89:0/1741893080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 0x55fcb508dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 -- 172.21.15.89:0/1741893080 >> 172.21.15.89:0/1741893080 conn(0x55fcb4b5b210 msgr2=0x55fcb5090990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:57.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 -- 172.21.15.89:0/1741893080 shutdown_connections 2024-08-31T04:04:57.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.271+0000 7eff87419000 1 -- 172.21.15.89:0/1741893080 wait complete. 2024-08-31T04:04:57.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 -- start start 2024-08-31T04:04:57.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 Processor -- start 2024-08-31T04:04:57.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 0x55fcb508c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb508ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 0x55fcb508d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fcb4b62b10 con 0x55fcb4f49e90 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55fcb4e226f0 con 0x55fcb4f543f0 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55fcb4ea4390 con 0x55fcb4f33960 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 10 client.0 _ll_register_callbacks cb 0x55fcb4e43b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb508ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb508ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47266/0 (socket says 172.21.15.89:47266) 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff77e00640 1 -- 172.21.15.89:0/3074097392 learned_addr learned my addr 172.21.15.89:0/3074097392 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff7d200640 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 0x55fcb508c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff7dc00640 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 0x55fcb508d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff77e00640 1 -- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 msgr2=0x55fcb508c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff77e00640 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 0x55fcb508c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff77e00640 1 -- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 msgr2=0x55fcb508d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff77e00640 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 0x55fcb508d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff77e00640 1 -- 172.21.15.89:0/3074097392 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb4e5a380 con 0x55fcb4f49e90 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff7dc00640 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 0x55fcb508d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff77e00640 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb508ce30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7eff640194f0 tx=0x7eff640044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c8c42aaa6ddc7c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff5e000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff5e000640 1 -- 172.21.15.89:0/3074097392 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640b2070 con 0x55fcb4f49e90 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff5e000640 1 -- 172.21.15.89:0/3074097392 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7eff640a5a90 con 0x55fcb4f49e90 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 -- 172.21.15.89:0/3074097392 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fcb4eaad20 con 0x55fcb4f49e90 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff5e000640 1 -- 172.21.15.89:0/3074097392 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7eff640ba040 con 0x55fcb4f49e90 2024-08-31T04:04:57.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 10 client.4833 fetch_fsmap learned FSMap version 9 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 1 -- 172.21.15.89:0/3074097392 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55fcb4f20e40 con 0x55fcb4f49e90 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff5e000640 1 -- 172.21.15.89:0/3074097392 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55fcb4eaad20 con 0x55fcb4f49e90 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff5e000640 1 -- 172.21.15.89:0/3074097392 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7eff640b5050 con 0x55fcb4f49e90 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 10 client.4833 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.275+0000 7eff87419000 10 client.4833 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 20 client.4833 populate_metadata read hostname 'smithi089' 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55fcb4b3fdc0 0x55fcb50a7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 4 client.4833 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 -- 172.21.15.89:0/3074097392 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcb4eae770 con 0x55fcb4b3fdc0 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff7d200640 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55fcb4b3fdc0 0x55fcb50a7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff7d200640 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55fcb4b3fdc0 0x55fcb50a7f90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2505e352b731e6a server_cookie=d9aa04b8eb947ee in_seq=0 out_seq=0 2024-08-31T04:04:57.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff5e000640 10 client.4833 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff5e000640 1 -- 172.21.15.89:0/3074097392 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fcb4eae770 con 0x55fcb4b3fdc0 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff5e000640 10 client.4833 handle_command_reply: tid=0 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 client.4833 shutdown 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 -- 172.21.15.89:0/3074097392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 msgr2=0x55fcb508ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb508ce30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7eff640194f0 tx=0x7eff640044b0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 -- 172.21.15.89:0/3074097392 shutdown_connections 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55fcb4b3fdc0 0x55fcb50a7f90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb508ce30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 0x55fcb508d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff5e000640 0 client.4833 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:57.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 --2- 172.21.15.89:0/3074097392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 0x55fcb508c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 -- 172.21.15.89:0/3074097392 >> 172.21.15.89:0/3074097392 conn(0x55fcb4b5b210 msgr2=0x55fcb508f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:57.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 -- 172.21.15.89:0/3074097392 shutdown_connections 2024-08-31T04:04:57.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 1 -- 172.21.15.89:0/3074097392 wait complete. 2024-08-31T04:04:57.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.279+0000 7eff87419000 20 client.4833 trim_cache size 0 max 16384 2024-08-31T04:04:57.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff87419000 1 Processor -- start 2024-08-31T04:04:57.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff87419000 1 -- start start 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff87419000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 0x55fcb5056c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff87419000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb504f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff87419000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 0x55fcb504fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff87419000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7eff781538f0 con 0x55fcb4f49e90 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff87419000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7eff78202990 con 0x55fcb4f543f0 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff87419000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7eff78201d10 con 0x55fcb4f33960 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb504f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb504f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47268/0 (socket says 172.21.15.89:47268) 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff77e00640 1 -- 172.21.15.89:0/63163540 learned_addr learned my addr 172.21.15.89:0/63163540 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:57.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff7dc00640 1 --2- 172.21.15.89:0/63163540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 0x55fcb504fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff7d200640 1 --2- 172.21.15.89:0/63163540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 0x55fcb5056c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff77e00640 1 -- 172.21.15.89:0/63163540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 msgr2=0x55fcb5056c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff77e00640 1 --2- 172.21.15.89:0/63163540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 0x55fcb5056c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff77e00640 1 -- 172.21.15.89:0/63163540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 msgr2=0x55fcb504fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff77e00640 1 --2- 172.21.15.89:0/63163540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 0x55fcb504fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff77e00640 1 -- 172.21.15.89:0/63163540 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb4ef85b0 con 0x55fcb4f49e90 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff77e00640 1 --2- 172.21.15.89:0/63163540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb504f9b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff6401a510 tx=0x7eff64004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ade20db4f44f2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff68c00640 1 -- 172.21.15.89:0/63163540 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640b2070 con 0x55fcb4f49e90 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff68c00640 1 -- 172.21.15.89:0/63163540 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff64000e50 con 0x55fcb4f49e90 2024-08-31T04:04:57.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.299+0000 7eff68c00640 1 -- 172.21.15.89:0/63163540 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64005340 con 0x55fcb4f49e90 2024-08-31T04:04:57.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 -- 172.21.15.89:0/63163540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 msgr2=0x55fcb504f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 --2- 172.21.15.89:0/63163540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb504f9b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff6401a510 tx=0x7eff64004520 comp rx=0 tx=0).stop 2024-08-31T04:04:57.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 -- 172.21.15.89:0/63163540 shutdown_connections 2024-08-31T04:04:57.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 --2- 172.21.15.89:0/63163540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f49e90 0x55fcb504f9b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 --2- 172.21.15.89:0/63163540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f543f0 0x55fcb504fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 --2- 172.21.15.89:0/63163540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f33960 0x55fcb5056c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 -- 172.21.15.89:0/63163540 >> 172.21.15.89:0/63163540 conn(0x55fcb4b5b210 msgr2=0x55fcb504f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:57.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 -- 172.21.15.89:0/63163540 shutdown_connections 2024-08-31T04:04:57.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 -- 172.21.15.89:0/63163540 wait complete. 2024-08-31T04:04:57.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 -- start start 2024-08-31T04:04:57.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 Processor -- start 2024-08-31T04:04:57.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f33960 0x55fcb50ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f49e90 0x55fcb50ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 0x55fcb50abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fcb4e1deb0 con 0x55fcb4f33960 2024-08-31T04:04:57.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7eff782022e0 con 0x55fcb4f49e90 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55fcb4e43f20 con 0x55fcb4f543f0 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff87419000 10 client.0 _ll_register_callbacks cb 0x7eff6c015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f33960 0x55fcb50ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f33960 0x55fcb50ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47282/0 (socket says 172.21.15.89:47282) 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7d200640 1 -- 172.21.15.89:0/509111566 learned_addr learned my addr 172.21.15.89:0/509111566 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7dc00640 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 0x55fcb50abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff77e00640 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f49e90 0x55fcb50ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7d200640 1 -- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 msgr2=0x55fcb50abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7d200640 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 0x55fcb50abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7d200640 1 -- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f49e90 msgr2=0x55fcb50ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7d200640 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f49e90 0x55fcb50ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7d200640 1 -- 172.21.15.89:0/509111566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb4e2cfc0 con 0x55fcb4f33960 2024-08-31T04:04:57.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff7d200640 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f33960 0x55fcb50ab070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0115e0 tx=0x7eff6c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcff2764b2ece140 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.303+0000 7eff5e000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff5e000640 1 -- 172.21.15.89:0/509111566 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c02b780 con 0x55fcb4f33960 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff5e000640 1 -- 172.21.15.89:0/509111566 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7eff6c02b920 con 0x55fcb4f33960 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff87419000 1 -- 172.21.15.89:0/509111566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff64000e50 con 0x55fcb4f33960 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff5e000640 1 -- 172.21.15.89:0/509111566 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7eff6c03d050 con 0x55fcb4f33960 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff87419000 10 client.4839 fetch_fsmap learned FSMap version 9 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff87419000 1 -- 172.21.15.89:0/509111566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55fcb4e25e00 con 0x55fcb4f33960 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff5e000640 1 -- 172.21.15.89:0/509111566 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff64000e50 con 0x55fcb4f33960 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff5e000640 1 -- 172.21.15.89:0/509111566 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7eff6c040020 con 0x55fcb4f33960 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff87419000 10 client.4839 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff87419000 10 client.4839 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff87419000 20 client.4839 populate_metadata read hostname 'smithi089' 2024-08-31T04:04:57.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff87419000 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55fcb4b2de20 0x55fcb50ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:04:57.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff87419000 4 client.4839 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T04:04:57.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff87419000 1 -- 172.21.15.89:0/509111566 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x55fcb4eaa210 con 0x55fcb4b2de20 2024-08-31T04:04:57.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff77e00640 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55fcb4b2de20 0x55fcb50ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:04:57.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff77e00640 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55fcb4b2de20 0x55fcb50ac030 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=601bc1167bd5bd2f server_cookie=4c606e126c349dca in_seq=0 out_seq=0 2024-08-31T04:04:57.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.307+0000 7eff5e000640 10 client.4839 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:57.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff5e000640 1 -- 172.21.15.89:0/509111566 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55fcb4eaa210 con 0x55fcb4b2de20 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff5e000640 10 client.4839 handle_command_reply: tid=0 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 client.4839 shutdown 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 -- 172.21.15.89:0/509111566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f33960 msgr2=0x55fcb50ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f33960 0x55fcb50ab070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0115e0 tx=0x7eff6c0046d0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 -- 172.21.15.89:0/509111566 shutdown_connections 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55fcb4b2de20 0x55fcb50ac030 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55fcb4f543f0 0x55fcb50abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fcb4f49e90 0x55fcb50ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff5e000640 0 client.4839 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 --2- 172.21.15.89:0/509111566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fcb4f33960 0x55fcb50ab070 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 -- 172.21.15.89:0/509111566 >> 172.21.15.89:0/509111566 conn(0x55fcb4b5b210 msgr2=0x55fcb5055840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:57.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 -- 172.21.15.89:0/509111566 shutdown_connections 2024-08-31T04:04:57.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 1 -- 172.21.15.89:0/509111566 wait complete. 2024-08-31T04:04:57.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff87419000 20 client.4839 trim_cache size 0 max 16384 2024-08-31T04:04:57.321 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:04:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:04:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:04:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 2, 2024-08-31T04:04:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:04:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "d4019c2b": { 2024-08-31T04:04:57.321 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 2, 2024-08-31T04:04:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:04:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:04:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:04:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:04:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:04:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:04:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 146.4, 2024-08-31T04:04:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:04:57.322 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:04:57.323 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:04:57.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 -- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7eff580720c0 msgr2=0x7eff580745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7eff580720c0 0x7eff580745d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00bbd0 tx=0x7eff6c00b5b0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 -- 172.21.15.89:0/3462535275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4a60 msgr2=0x7eff781509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:04:57.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4a60 0x7eff781509b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c760 tx=0x7eff7000cc20 comp rx=0 tx=0).stop 2024-08-31T04:04:57.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 -- 172.21.15.89:0/3462535275 shutdown_connections 2024-08-31T04:04:57.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7eff580720c0 0x7eff580745d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff780c4a60 0x7eff781509b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff780c4650 0x7eff780cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 --2- 172.21.15.89:0/3462535275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780c3e40 0x7eff7806f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:04:57.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 -- 172.21.15.89:0/3462535275 >> 172.21.15.89:0/3462535275 conn(0x7eff78071a70 msgr2=0x7eff780c69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:04:57.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 -- 172.21.15.89:0/3462535275 shutdown_connections 2024-08-31T04:04:57.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:04:57.315+0000 7eff7fc00640 1 -- 172.21.15.89:0/3462535275 wait complete. 2024-08-31T04:04:57.339 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd4019c2b', quiesce took 0.6 seconds. Will release after: 25.799999999999997 2024-08-31T04:04:58.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:04:58.888 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:05:23.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:05:23.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.395+0000 7feb65000640 1 -- 172.21.15.89:0/3773503993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600c7b00 msgr2=0x7feb60152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:23.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.395+0000 7feb65000640 1 --2- 172.21.15.89:0/3773503993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600c7b00 0x7feb60152430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feb600c92d0 tx=0x7feb4c01c8c0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.395+0000 7feb65000640 1 -- 172.21.15.89:0/3773503993 shutdown_connections 2024-08-31T04:05:23.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.395+0000 7feb65000640 1 --2- 172.21.15.89:0/3773503993 >> v2:172.21.15.89:3300/0 conn(0x7feb600ca690 0x7feb600caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.395+0000 7feb65000640 1 --2- 172.21.15.89:0/3773503993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600c7b00 0x7feb60152430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.395+0000 7feb65000640 1 -- 172.21.15.89:0/3773503993 >> 172.21.15.89:0/3773503993 conn(0x7feb60071f20 msgr2=0x7feb60072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:23.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.395+0000 7feb65000640 1 -- 172.21.15.89:0/3773503993 shutdown_connections 2024-08-31T04:05:23.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.395+0000 7feb65000640 1 -- 172.21.15.89:0/3773503993 wait complete. 2024-08-31T04:05:23.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.399+0000 7feb65000640 1 Processor -- start 2024-08-31T04:05:23.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.399+0000 7feb65000640 1 -- start start 2024-08-31T04:05:23.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb65000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb600c5120 0x7feb60165610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:23.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb65000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600c7b00 0x7feb60151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:23.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb65000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb600ca690 0x7feb6013f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:23.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb5f400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb600c5120 0x7feb60165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:23.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb5ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600c7b00 0x7feb60151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:23.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb5f400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb600c5120 0x7feb60165610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:60266/0 (socket says 172.21.15.89:60266) 2024-08-31T04:05:23.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb5f400640 1 -- 172.21.15.89:0/313043319 learned_addr learned my addr 172.21.15.89:0/313043319 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:23.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb5fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb600ca690 0x7feb6013f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:23.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feb600c7690 con 0x7feb600ca690 2024-08-31T04:05:23.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feb600c6560 con 0x7feb600c7b00 2024-08-31T04:05:23.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.403+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feb60070df0 con 0x7feb600c5120 2024-08-31T04:05:23.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb5f400640 1 -- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600c7b00 msgr2=0x7feb60151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:23.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb5f400640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600c7b00 0x7feb60151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb5f400640 1 -- 172.21.15.89:0/313043319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb600ca690 msgr2=0x7feb6013f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:23.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb5f400640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb600ca690 0x7feb6013f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb5f400640 1 -- 172.21.15.89:0/313043319 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb601f8b30 con 0x7feb600c5120 2024-08-31T04:05:23.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb5fe00640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb600ca690 0x7feb6013f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:05:23.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb5f400640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb600c5120 0x7feb60165610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb5000c3f0 tx=0x7feb5000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:23.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb57400640 1 -- 172.21.15.89:0/313043319 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500052d0 con 0x7feb600c5120 2024-08-31T04:05:23.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb57400640 1 -- 172.21.15.89:0/313043319 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb50007020 con 0x7feb600c5120 2024-08-31T04:05:23.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb601f8dd0 con 0x7feb600c5120 2024-08-31T04:05:23.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb57400640 1 -- 172.21.15.89:0/313043319 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50007470 con 0x7feb600c5120 2024-08-31T04:05:23.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6014ce10 con 0x7feb600c5120 2024-08-31T04:05:23.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.407+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb60158470 con 0x7feb600c5120 2024-08-31T04:05:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.411+0000 7feb57400640 1 -- 172.21.15.89:0/313043319 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7feb500067e0 con 0x7feb600c5120 2024-08-31T04:05:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.411+0000 7feb57400640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb400720c0 0x7feb400745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.411+0000 7feb57400640 1 -- 172.21.15.89:0/313043319 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7feb500926d0 con 0x7feb600c5120 2024-08-31T04:05:23.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.411+0000 7feb5ea00640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb400720c0 0x7feb400745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:23.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.415+0000 7feb5ea00640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb400720c0 0x7feb400745d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb600c92d0 tx=0x7feb4c01b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:23.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.423+0000 7feb57400640 1 -- 172.21.15.89:0/313043319 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7feb50001090 con 0x7feb600c5120 2024-08-31T04:05:23.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.839+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb600c7320 con 0x7feb600c5120 2024-08-31T04:05:23.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb57400640 1 -- 172.21.15.89:0/313043319 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7feb5005d620 con 0x7feb600c5120 2024-08-31T04:05:23.845 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:05:23.845 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:05:23.846 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:05:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb400720c0 msgr2=0x7feb400745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb400720c0 0x7feb400745d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb600c92d0 tx=0x7feb4c01b100 comp rx=0 tx=0).stop 2024-08-31T04:05:23.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb600c5120 msgr2=0x7feb60165610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb600c5120 0x7feb60165610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb5000c3f0 tx=0x7feb5000c7f0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 shutdown_connections 2024-08-31T04:05:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7feb400720c0 0x7feb400745d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb600ca690 0x7feb6013f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600c7b00 0x7feb60151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 --2- 172.21.15.89:0/313043319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb600c5120 0x7feb60165610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 >> 172.21.15.89:0/313043319 conn(0x7feb60071f20 msgr2=0x7feb60142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 shutdown_connections 2024-08-31T04:05:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:23.843+0000 7feb65000640 1 -- 172.21.15.89:0/313043319 wait complete. 2024-08-31T04:05:23.878 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id d4019c2b --release --await' 2024-08-31T04:05:23.878 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id d4019c2b --release --await 2024-08-31T04:05:24.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.147+0000 7efe7cc00640 1 -- 172.21.15.89:0/945921484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe5c003c70 msgr2=0x7efe5c0040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.147+0000 7efe7cc00640 1 --2- 172.21.15.89:0/945921484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe5c003c70 0x7efe5c0040c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efe6800c310 tx=0x7efe6801ce00 comp rx=0 tx=0).stop 2024-08-31T04:05:24.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.147+0000 7efe77e00640 1 -- 172.21.15.89:0/945921484 reap_dead start 2024-08-31T04:05:24.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.147+0000 7efe7cc00640 1 -- 172.21.15.89:0/945921484 shutdown_connections 2024-08-31T04:05:24.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.147+0000 7efe7cc00640 1 -- 172.21.15.89:0/945921484 >> 172.21.15.89:0/945921484 conn(0x7efe7806dd40 msgr2=0x7efe7806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:24.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.147+0000 7efe7cc00640 1 -- 172.21.15.89:0/945921484 shutdown_connections 2024-08-31T04:05:24.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.147+0000 7efe7cc00640 1 -- 172.21.15.89:0/945921484 wait complete. 2024-08-31T04:05:24.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.151+0000 7efe7cc00640 1 Processor -- start 2024-08-31T04:05:24.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.151+0000 7efe7cc00640 1 -- start start 2024-08-31T04:05:24.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe7cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5c003c70 0x7efe7815e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe7cc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe781f87b0 0x7efe781517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe7cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe78151ce0 0x7efe7815a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe7cc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efe7806ebf0 con 0x7efe78151ce0 2024-08-31T04:05:24.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe7cc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efe780c32f0 con 0x7efe5c003c70 2024-08-31T04:05:24.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe7cc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efe7806cc30 con 0x7efe781f87b0 2024-08-31T04:05:24.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe78151ce0 0x7efe7815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe78151ce0 0x7efe7815a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39430/0 (socket says 172.21.15.89:39430) 2024-08-31T04:05:24.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77e00640 1 -- 172.21.15.89:0/285552511 learned_addr learned my addr 172.21.15.89:0/285552511 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:24.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe76a00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe781f87b0 0x7efe781517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77400640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5c003c70 0x7efe7815e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77e00640 1 -- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe781f87b0 msgr2=0x7efe781517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77e00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe781f87b0 0x7efe781517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77e00640 1 -- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5c003c70 msgr2=0x7efe7815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77e00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5c003c70 0x7efe7815e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77e00640 1 -- 172.21.15.89:0/285552511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe780cdc70 con 0x7efe78151ce0 2024-08-31T04:05:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe77e00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe78151ce0 0x7efe7815a240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efe780c5800 tx=0x7efe700064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe6f400640 1 -- 172.21.15.89:0/285552511 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7000f9e0 con 0x7efe78151ce0 2024-08-31T04:05:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe6f400640 1 -- 172.21.15.89:0/285552511 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe7000fb80 con 0x7efe78151ce0 2024-08-31T04:05:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe7cc00640 1 -- 172.21.15.89:0/285552511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe780cd990 con 0x7efe78151ce0 2024-08-31T04:05:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.155+0000 7efe7cc00640 1 -- 172.21.15.89:0/285552511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7815b5d0 con 0x7efe78151ce0 2024-08-31T04:05:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.159+0000 7efe6f400640 1 -- 172.21.15.89:0/285552511 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70011430 con 0x7efe78151ce0 2024-08-31T04:05:24.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.159+0000 7efe6f400640 1 -- 172.21.15.89:0/285552511 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7efe700115d0 con 0x7efe78151ce0 2024-08-31T04:05:24.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe857d8000 1 Processor -- start 2024-08-31T04:05:24.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe6f400640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efe580720c0 0x7efe580745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe6f400640 1 -- 172.21.15.89:0/285552511 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7efe70093630 con 0x7efe78151ce0 2024-08-31T04:05:24.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe857d8000 1 -- start start 2024-08-31T04:05:24.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe77400640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efe580720c0 0x7efe580745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe77400640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efe580720c0 0x7efe580745d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efe680ab000 tx=0x7efe68019c40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:24.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe857d8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507f6950 0x559650914e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe857d8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507e0930 0x559650919ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe857d8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x55965091a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe857d8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5596507bff30 con 0x5596507d1890 2024-08-31T04:05:24.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe857d8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x559650735690 con 0x5596507f6950 2024-08-31T04:05:24.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.163+0000 7efe857d8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x559650724c20 con 0x5596507e0930 2024-08-31T04:05:24.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x55965091a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507f6950 0x559650914e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x55965091a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39434/0 (socket says 172.21.15.89:39434) 2024-08-31T04:05:24.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77e00640 1 -- 172.21.15.89:0/205576087 learned_addr learned my addr 172.21.15.89:0/205576087 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:24.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe76a00640 1 --2- 172.21.15.89:0/205576087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507e0930 0x559650919ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77e00640 1 -- 172.21.15.89:0/205576087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507e0930 msgr2=0x559650919ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:24.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77e00640 1 --2- 172.21.15.89:0/205576087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507e0930 0x559650919ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77e00640 1 -- 172.21.15.89:0/205576087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507f6950 msgr2=0x559650914e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:24.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77e00640 1 --2- 172.21.15.89:0/205576087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507f6950 0x559650914e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77e00640 1 -- 172.21.15.89:0/205576087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596506d98f0 con 0x5596507d1890 2024-08-31T04:05:24.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe77e00640 1 --2- 172.21.15.89:0/205576087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x55965091a010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efe7005e520 tx=0x7efe7005e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3970315303ac7935 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:24.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe63400640 1 -- 172.21.15.89:0/205576087 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7005a4b0 con 0x5596507d1890 2024-08-31T04:05:24.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe63400640 1 -- 172.21.15.89:0/205576087 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe70062d50 con 0x5596507d1890 2024-08-31T04:05:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe63400640 1 -- 172.21.15.89:0/205576087 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70067770 con 0x5596507d1890 2024-08-31T04:05:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe857d8000 1 -- 172.21.15.89:0/205576087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 msgr2=0x55965091a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe857d8000 1 --2- 172.21.15.89:0/205576087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x55965091a010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efe7005e520 tx=0x7efe7005e490 comp rx=0 tx=0).stop 2024-08-31T04:05:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe857d8000 1 -- 172.21.15.89:0/205576087 shutdown_connections 2024-08-31T04:05:24.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe857d8000 1 --2- 172.21.15.89:0/205576087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x55965091a010 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe857d8000 1 --2- 172.21.15.89:0/205576087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507e0930 0x559650919ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe857d8000 1 --2- 172.21.15.89:0/205576087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507f6950 0x559650914e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe857d8000 1 -- 172.21.15.89:0/205576087 >> 172.21.15.89:0/205576087 conn(0x5596507f6540 msgr2=0x559650917890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:24.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe857d8000 1 -- 172.21.15.89:0/205576087 shutdown_connections 2024-08-31T04:05:24.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.167+0000 7efe857d8000 1 -- 172.21.15.89:0/205576087 wait complete. 2024-08-31T04:05:24.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.171+0000 7efe857d8000 1 -- start start 2024-08-31T04:05:24.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.171+0000 7efe857d8000 1 Processor -- start 2024-08-31T04:05:24.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.171+0000 7efe857d8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x559650913c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.171+0000 7efe857d8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 0x559650914150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.171+0000 7efe857d8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507f6950 0x559650914690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.171+0000 7efe857d8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5596506ab500 con 0x5596507d1890 2024-08-31T04:05:24.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.171+0000 7efe857d8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x559650728bd0 con 0x5596507e0930 2024-08-31T04:05:24.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.171+0000 7efe857d8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5596506cca30 con 0x5596507f6950 2024-08-31T04:05:24.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.171+0000 7efe857d8000 10 client.0 _ll_register_callbacks cb 0x5596507dab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:05:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x559650913c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe76a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 0x559650914150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x559650913c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39436/0 (socket says 172.21.15.89:39436) 2024-08-31T04:05:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77400640 1 -- 172.21.15.89:0/3597470129 learned_addr learned my addr 172.21.15.89:0/3597470129 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77e00640 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507f6950 0x559650914690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77400640 1 -- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507f6950 msgr2=0x559650914690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:24.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77400640 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507f6950 0x559650914690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77400640 1 -- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 msgr2=0x559650914150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:24.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77400640 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 0x559650914150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77400640 1 -- 172.21.15.89:0/3597470129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596506c46a0 con 0x5596507d1890 2024-08-31T04:05:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe77400640 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x559650913c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efe680987b0 tx=0x7efe680a7050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472c535b4178f8e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe57e00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:05:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe57e00640 1 -- 172.21.15.89:0/3597470129 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68003800 con 0x5596507d1890 2024-08-31T04:05:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe57e00640 1 -- 172.21.15.89:0/3597470129 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7efe680039a0 con 0x5596507d1890 2024-08-31T04:05:24.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe857d8000 1 -- 172.21.15.89:0/3597470129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596506be7e0 con 0x5596507d1890 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe57e00640 1 -- 172.21.15.89:0/3597470129 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7efe68003ba0 con 0x5596507d1890 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe857d8000 10 client.4860 fetch_fsmap learned FSMap version 9 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe857d8000 1 -- 172.21.15.89:0/3597470129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5596506e31c0 con 0x5596507d1890 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe57e00640 1 -- 172.21.15.89:0/3597470129 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5596506be7e0 con 0x5596507d1890 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe57e00640 1 -- 172.21.15.89:0/3597470129 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7efe680cf050 con 0x5596507d1890 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe857d8000 10 client.4860 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe857d8000 10 client.4860 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe857d8000 20 client.4860 populate_metadata read hostname 'smithi089' 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe857d8000 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5596507bafc0 0x55965092f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe857d8000 4 client.4860 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:05:24.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe857d8000 1 -- 172.21.15.89:0/3597470129 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596507375e0 con 0x5596507bafc0 2024-08-31T04:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.174+0000 7efe76a00640 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5596507bafc0 0x55965092f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe76a00640 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5596507bafc0 0x55965092f010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8f1818c6b1e1931 server_cookie=621080edcac079fc in_seq=0 out_seq=0 2024-08-31T04:05:24.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe57e00640 10 client.4860 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe57e00640 1 -- 172.21.15.89:0/3597470129 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596507375e0 con 0x5596507bafc0 2024-08-31T04:05:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe57e00640 10 client.4860 handle_command_reply: tid=0 2024-08-31T04:05:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 client.4860 shutdown 2024-08-31T04:05:24.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 -- 172.21.15.89:0/3597470129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 msgr2=0x559650913c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x559650913c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efe680987b0 tx=0x7efe680a7050 comp rx=0 tx=0).stop 2024-08-31T04:05:24.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 -- 172.21.15.89:0/3597470129 shutdown_connections 2024-08-31T04:05:24.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5596507bafc0 0x55965092f010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe57e00640 0 client.4860 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507f6950 0x559650914690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 0x559650914150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 --2- 172.21.15.89:0/3597470129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507d1890 0x559650913c10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 -- 172.21.15.89:0/3597470129 >> 172.21.15.89:0/3597470129 conn(0x5596507f6540 msgr2=0x559650915040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 -- 172.21.15.89:0/3597470129 shutdown_connections 2024-08-31T04:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 1 -- 172.21.15.89:0/3597470129 wait complete. 2024-08-31T04:05:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.178+0000 7efe857d8000 20 client.4860 trim_cache size 0 max 16384 2024-08-31T04:05:24.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.214+0000 7efe857d8000 1 Processor -- start 2024-08-31T04:05:24.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.214+0000 7efe857d8000 1 -- start start 2024-08-31T04:05:24.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe857d8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507bafc0 0x559650932260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe857d8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507d1890 0x5596509327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe857d8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 0x55965098daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe857d8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efe5000ed00 con 0x5596507bafc0 2024-08-31T04:05:24.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe857d8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efe5000dbe0 con 0x5596507e0930 2024-08-31T04:05:24.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe857d8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efe5000c100 con 0x5596507d1890 2024-08-31T04:05:24.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507bafc0 0x559650932260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507bafc0 0x559650932260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39440/0 (socket says 172.21.15.89:39440) 2024-08-31T04:05:24.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77400640 1 -- 172.21.15.89:0/3528824124 learned_addr learned my addr 172.21.15.89:0/3528824124 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:24.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe76a00640 1 --2- 172.21.15.89:0/3528824124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507d1890 0x5596509327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77e00640 1 --2- 172.21.15.89:0/3528824124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 0x55965098daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77400640 1 -- 172.21.15.89:0/3528824124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507d1890 msgr2=0x5596509327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:24.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77400640 1 --2- 172.21.15.89:0/3528824124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507d1890 0x5596509327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77400640 1 -- 172.21.15.89:0/3528824124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 msgr2=0x55965098daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77400640 1 --2- 172.21.15.89:0/3528824124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 0x55965098daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77400640 1 -- 172.21.15.89:0/3528824124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596507a92f0 con 0x5596507bafc0 2024-08-31T04:05:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe77400640 1 --2- 172.21.15.89:0/3528824124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507bafc0 0x559650932260 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efe68006090 tx=0x7efe68000fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8961d49ac614dc9f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe62a00640 1 -- 172.21.15.89:0/3528824124 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe680a5c90 con 0x5596507bafc0 2024-08-31T04:05:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe62a00640 1 -- 172.21.15.89:0/3528824124 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe680a5e30 con 0x5596507bafc0 2024-08-31T04:05:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.218+0000 7efe62a00640 1 -- 172.21.15.89:0/3528824124 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68003800 con 0x5596507bafc0 2024-08-31T04:05:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 -- 172.21.15.89:0/3528824124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507bafc0 msgr2=0x559650932260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 --2- 172.21.15.89:0/3528824124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507bafc0 0x559650932260 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efe68006090 tx=0x7efe68000fa0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 -- 172.21.15.89:0/3528824124 shutdown_connections 2024-08-31T04:05:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 --2- 172.21.15.89:0/3528824124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507e0930 0x55965098daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 --2- 172.21.15.89:0/3528824124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507d1890 0x5596509327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 --2- 172.21.15.89:0/3528824124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507bafc0 0x559650932260 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 -- 172.21.15.89:0/3528824124 >> 172.21.15.89:0/3528824124 conn(0x5596507f6540 msgr2=0x5596508d8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 -- 172.21.15.89:0/3528824124 shutdown_connections 2024-08-31T04:05:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 -- 172.21.15.89:0/3528824124 wait complete. 2024-08-31T04:05:24.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 -- start start 2024-08-31T04:05:24.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.222+0000 7efe857d8000 1 Processor -- start 2024-08-31T04:05:24.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507bafc0 0x5596509327f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507d1890 0x559650931b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507e0930 0x559650932090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efe5000c770 con 0x5596507e0930 2024-08-31T04:05:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efe5000d510 con 0x5596507d1890 2024-08-31T04:05:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efe5000ce40 con 0x5596507bafc0 2024-08-31T04:05:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 10 client.0 _ll_register_callbacks cb 0x7efe5c00c150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:05:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe76a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507d1890 0x559650931b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe77400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507bafc0 0x5596509327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507e0930 0x559650932090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe76a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507d1890 0x559650931b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:49902/0 (socket says 172.21.15.89:49902) 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe76a00640 1 -- 172.21.15.89:0/1349849526 learned_addr learned my addr 172.21.15.89:0/1349849526 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe77400640 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507bafc0 0x5596509327f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:60314/0 (socket says 172.21.15.89:60314) 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe77e00640 1 -- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507bafc0 msgr2=0x5596509327f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe77e00640 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507bafc0 0x5596509327f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe77e00640 1 -- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507d1890 msgr2=0x559650931b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe77e00640 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507d1890 0x559650931b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe77e00640 1 -- 172.21.15.89:0/1349849526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596506aeb30 con 0x5596507e0930 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe77e00640 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507e0930 0x559650932090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efe70010010 tx=0x7efe7005dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0aac301332947d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe57e00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:05:24.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe57e00640 1 -- 172.21.15.89:0/1349849526 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7005e590 con 0x5596507e0930 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe57e00640 1 -- 172.21.15.89:0/1349849526 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7efe70065070 con 0x5596507e0930 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 1 -- 172.21.15.89:0/1349849526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe680a5e30 con 0x5596507e0930 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe57e00640 1 -- 172.21.15.89:0/1349849526 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7efe70065270 con 0x5596507e0930 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 10 client.4866 fetch_fsmap learned FSMap version 9 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 1 -- 172.21.15.89:0/1349849526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5596506bbc70 con 0x5596507e0930 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe57e00640 1 -- 172.21.15.89:0/1349849526 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe680a5e30 con 0x5596507e0930 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe57e00640 1 -- 172.21.15.89:0/1349849526 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7efe70091b50 con 0x5596507e0930 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 10 client.4866 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 10 client.4866 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.226+0000 7efe857d8000 20 client.4866 populate_metadata read hostname 'smithi089' 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.230+0000 7efe857d8000 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5596503e24d0 0x559650955560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.230+0000 7efe857d8000 4 client.4866 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d4019c2b", "release": true, "await": true}] 2024-08-31T04:05:24.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.230+0000 7efe857d8000 1 -- 172.21.15.89:0/1349849526 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d4019c2b", "release": true, "await": true}) -- 0x559650733080 con 0x5596503e24d0 2024-08-31T04:05:24.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.230+0000 7efe77400640 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5596503e24d0 0x559650955560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.230+0000 7efe77400640 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5596503e24d0 0x559650955560 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=854569558af98776 server_cookie=ac47a423f5b69c50 in_seq=0 out_seq=0 2024-08-31T04:05:24.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.230+0000 7efe57e00640 10 client.4866 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:24.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe57e00640 1 -- 172.21.15.89:0/1349849526 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x559650733080 con 0x5596503e24d0 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe57e00640 10 client.4866 handle_command_reply: tid=0 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 client.4866 shutdown 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 -- 172.21.15.89:0/1349849526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507e0930 msgr2=0x559650932090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507e0930 0x559650932090 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efe70010010 tx=0x7efe7005dc10 comp rx=0 tx=0).stop 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 -- 172.21.15.89:0/1349849526 shutdown_connections 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5596503e24d0 0x559650955560 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5596507e0930 0x559650932090 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5596507d1890 0x559650931b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 --2- 172.21.15.89:0/1349849526 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5596507bafc0 0x5596509327f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 -- 172.21.15.89:0/1349849526 >> 172.21.15.89:0/1349849526 conn(0x5596507f6540 msgr2=0x5596508d8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe57e00640 0 client.4866 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 -- 172.21.15.89:0/1349849526 shutdown_connections 2024-08-31T04:05:24.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 1 -- 172.21.15.89:0/1349849526 wait complete. 2024-08-31T04:05:24.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe857d8000 20 client.4866 trim_cache size 0 max 16384 2024-08-31T04:05:24.239 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:05:24.239 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:05:24.239 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:05:24.239 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 4, 2024-08-31T04:05:24.239 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:05:24.239 INFO:teuthology.orchestra.run.smithi089.stdout: "d4019c2b": { 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 4, 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 146.4, 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:05:24.240 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:05:24.241 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:05:24.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:24.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:24.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:24.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:24.241 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:24.241 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 -- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efe580720c0 msgr2=0x7efe580745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efe580720c0 0x7efe580745d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efe680ab000 tx=0x7efe68019c40 comp rx=0 tx=0).stop 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 -- 172.21.15.89:0/285552511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe78151ce0 msgr2=0x7efe7815a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe78151ce0 0x7efe7815a240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efe780c5800 tx=0x7efe700064f0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 -- 172.21.15.89:0/285552511 shutdown_connections 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7efe580720c0 0x7efe580745d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe78151ce0 0x7efe7815a240 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe781f87b0 0x7efe781517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 --2- 172.21.15.89:0/285552511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5c003c70 0x7efe7815e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 -- 172.21.15.89:0/285552511 >> 172.21.15.89:0/285552511 conn(0x7efe7806dd40 msgr2=0x7efe78163720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 -- 172.21.15.89:0/285552511 shutdown_connections 2024-08-31T04:05:24.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.234+0000 7efe7cc00640 1 -- 172.21.15.89:0/285552511 wait complete. 2024-08-31T04:05:24.268 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd4019c2b', total seconds elapsed: 27.6 2024-08-31T04:05:24.268 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T04:05:24.268 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:05:24.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.518+0000 7f1649a00640 1 -- 172.21.15.89:0/912366068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16440c5120 msgr2=0x7f16440c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.518+0000 7f1649a00640 1 --2- 172.21.15.89:0/912366068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16440c5120 0x7f16440c7b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1634009870 tx=0x7f163401c830 comp rx=0 tx=0).stop 2024-08-31T04:05:24.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.518+0000 7f1649a00640 1 -- 172.21.15.89:0/912366068 shutdown_connections 2024-08-31T04:05:24.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.518+0000 7f1649a00640 1 --2- 172.21.15.89:0/912366068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16440c5120 0x7f16440c7b00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.518+0000 7f1649a00640 1 -- 172.21.15.89:0/912366068 >> 172.21.15.89:0/912366068 conn(0x7f1644071f20 msgr2=0x7f1644072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:24.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.518+0000 7f1649a00640 1 -- 172.21.15.89:0/912366068 shutdown_connections 2024-08-31T04:05:24.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.518+0000 7f1649a00640 1 -- 172.21.15.89:0/912366068 wait complete. 2024-08-31T04:05:24.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.522+0000 7f1649a00640 1 Processor -- start 2024-08-31T04:05:24.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.522+0000 7f1649a00640 1 -- start start 2024-08-31T04:05:24.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1649a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16440c5120 0x7f1644154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1649a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16440ca690 0x7f1644142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1649a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1644152430 0x7f16440c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1649a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16440caeb0 con 0x7f16440ca690 2024-08-31T04:05:24.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1649a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1644070df0 con 0x7f1644152430 2024-08-31T04:05:24.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1649a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f16440c58c0 con 0x7f16440c5120 2024-08-31T04:05:24.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16440ca690 0x7f1644142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16440ca690 0x7f1644142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39464/0 (socket says 172.21.15.89:39464) 2024-08-31T04:05:24.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643400640 1 -- 172.21.15.89:0/2132298769 learned_addr learned my addr 172.21.15.89:0/2132298769 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:24.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643e00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16440c5120 0x7f1644154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1649000640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1644152430 0x7f16440c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643400640 1 -- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16440c5120 msgr2=0x7f1644154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643400640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16440c5120 0x7f1644154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643400640 1 -- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1644152430 msgr2=0x7f16440c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643400640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1644152430 0x7f16440c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643400640 1 -- 172.21.15.89:0/2132298769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164414cc10 con 0x7f16440ca690 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1643400640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16440ca690 0x7f1644142ac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f163000c430 tx=0x7f163000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f163be00640 1 -- 172.21.15.89:0/2132298769 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630017070 con 0x7f16440ca690 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f163be00640 1 -- 172.21.15.89:0/2132298769 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16300053c0 con 0x7f16440ca690 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1644150970 con 0x7f16440ca690 2024-08-31T04:05:24.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f163be00640 1 -- 172.21.15.89:0/2132298769 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630003860 con 0x7f16440ca690 2024-08-31T04:05:24.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.526+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1644154820 con 0x7f16440ca690 2024-08-31T04:05:24.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.530+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1644150760 con 0x7f16440ca690 2024-08-31T04:05:24.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.530+0000 7f163be00640 1 -- 172.21.15.89:0/2132298769 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f163001a070 con 0x7f16440ca690 2024-08-31T04:05:24.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.534+0000 7f163be00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1624072110 0x7f1624074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:24.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.534+0000 7f163be00640 1 -- 172.21.15.89:0/2132298769 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7f1630092250 con 0x7f16440ca690 2024-08-31T04:05:24.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.534+0000 7f1643e00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1624072110 0x7f1624074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:24.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.534+0000 7f1643e00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1624072110 0x7f1624074620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16340af000 tx=0x7f163401b070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:24.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.542+0000 7f163be00640 1 -- 172.21.15.89:0/2132298769 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f163005d1a0 con 0x7f16440ca690 2024-08-31T04:05:24.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.958+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1644158470 con 0x7f16440ca690 2024-08-31T04:05:24.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.958+0000 7f163be00640 1 -- 172.21.15.89:0/2132298769 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f1630061960 con 0x7f16440ca690 2024-08-31T04:05:24.964 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:05:24.964 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:05:24.964 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:05:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1624072110 msgr2=0x7f1624074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1624072110 0x7f1624074620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16340af000 tx=0x7f163401b070 comp rx=0 tx=0).stop 2024-08-31T04:05:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16440ca690 msgr2=0x7f1644142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16440ca690 0x7f1644142ac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f163000c430 tx=0x7f163000c8f0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 shutdown_connections 2024-08-31T04:05:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1624072110 0x7f1624074620 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16440ca690 0x7f1644142ac0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1644152430 0x7f16440c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 --2- 172.21.15.89:0/2132298769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16440c5120 0x7f1644154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 >> 172.21.15.89:0/2132298769 conn(0x7f1644071f20 msgr2=0x7f1644155070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 shutdown_connections 2024-08-31T04:05:24.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:24.962+0000 7f1649a00640 1 -- 172.21.15.89:0/2132298769 wait complete. 2024-08-31T04:05:24.999 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T04:05:24.999 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T04:05:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.274+0000 7fe30d200640 1 -- 172.21.15.89:0/2155847068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 msgr2=0x7fe30815cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:25.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.274+0000 7fe30d200640 1 --2- 172.21.15.89:0/2155847068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 0x7fe30815cba0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009900 tx=0x7fe2f401c8e0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.274+0000 7fe30d200640 1 -- 172.21.15.89:0/2155847068 shutdown_connections 2024-08-31T04:05:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.274+0000 7fe30d200640 1 --2- 172.21.15.89:0/2155847068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 0x7fe30815cba0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.274+0000 7fe30d200640 1 --2- 172.21.15.89:0/2155847068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3080c4ba0 0x7fe308153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.274+0000 7fe30d200640 1 -- 172.21.15.89:0/2155847068 >> 172.21.15.89:0/2155847068 conn(0x7fe3080733e0 msgr2=0x7fe3080737f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.274+0000 7fe30d200640 1 -- 172.21.15.89:0/2155847068 shutdown_connections 2024-08-31T04:05:25.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.274+0000 7fe30d200640 1 -- 172.21.15.89:0/2155847068 wait complete. 2024-08-31T04:05:25.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.278+0000 7fe30d200640 1 Processor -- start 2024-08-31T04:05:25.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.278+0000 7fe30d200640 1 -- start start 2024-08-31T04:05:25.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe30d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3080c4ba0 0x7fe30815aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe30d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 0x7fe308156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe30d200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3080ca320 0x7fe308152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe30d200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe3080cab40 con 0x7fe3080c5bc0 2024-08-31T04:05:25.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe30d200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe3080c53c0 con 0x7fe3080c4ba0 2024-08-31T04:05:25.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe30d200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe3080c4650 con 0x7fe3080ca320 2024-08-31T04:05:25.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe306a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 0x7fe308156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe306a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 0x7fe308156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39470/0 (socket says 172.21.15.89:39470) 2024-08-31T04:05:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe306a00640 1 -- 172.21.15.89:0/1853932270 learned_addr learned my addr 172.21.15.89:0/1853932270 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe307400640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3080c4ba0 0x7fe30815aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe307e00640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3080ca320 0x7fe308152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe306a00640 1 -- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3080ca320 msgr2=0x7fe308152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe306a00640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3080ca320 0x7fe308152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe306a00640 1 -- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3080c4ba0 msgr2=0x7fe30815aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe306a00640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3080c4ba0 0x7fe30815aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe306a00640 1 -- 172.21.15.89:0/1853932270 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30815b0e0 con 0x7fe3080c5bc0 2024-08-31T04:05:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe306a00640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 0x7fe308156450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009850 tx=0x7fe2f4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:25.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe2ff400640 1 -- 172.21.15.89:0/1853932270 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40b2040 con 0x7fe3080c5bc0 2024-08-31T04:05:25.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe2ff400640 1 -- 172.21.15.89:0/1853932270 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2f4005030 con 0x7fe3080c5bc0 2024-08-31T04:05:25.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe2ff400640 1 -- 172.21.15.89:0/1853932270 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4005440 con 0x7fe3080c5bc0 2024-08-31T04:05:25.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe30d200640 1 -- 172.21.15.89:0/1853932270 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30815bc60 con 0x7fe3080c5bc0 2024-08-31T04:05:25.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.282+0000 7fe30d200640 1 -- 172.21.15.89:0/1853932270 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30815c1e0 con 0x7fe3080c5bc0 2024-08-31T04:05:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe2ff400640 1 -- 172.21.15.89:0/1853932270 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe2f40046d0 con 0x7fe3080c5bc0 2024-08-31T04:05:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe315dd9000 1 Processor -- start 2024-08-31T04:05:25.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe315dd9000 1 -- start start 2024-08-31T04:05:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe2ff400640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe2e80720f0 0x7fe2e8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe2ff400640 1 -- 172.21.15.89:0/1853932270 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7fe2f412c090 con 0x7fe3080c5bc0 2024-08-31T04:05:25.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe307e00640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe2e80720f0 0x7fe2e8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec9893f0 0x55e1ecac60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1eca8bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1eca8c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe315dd9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e1ec8e1820 con 0x55e1ec97ee90 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe315dd9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e1ec8d0db0 con 0x55e1ec9893f0 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe315dd9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e1ec8d4d60 con 0x55e1ec968960 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.290+0000 7fe307e00640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe2e80720f0 0x7fe2e8074600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe3080b1630 tx=0x7fe300009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe306a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1eca8bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe307400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec9893f0 0x55e1ecac60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe306a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1eca8bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39486/0 (socket says 172.21.15.89:39486) 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe306a00640 1 -- 172.21.15.89:0/1947178974 learned_addr learned my addr 172.21.15.89:0/1947178974 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:25.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe307e00640 1 --2- 172.21.15.89:0/1947178974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1eca8c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe306a00640 1 -- 172.21.15.89:0/1947178974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 msgr2=0x55e1eca8c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:25.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe306a00640 1 --2- 172.21.15.89:0/1947178974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1eca8c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe306a00640 1 -- 172.21.15.89:0/1947178974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec9893f0 msgr2=0x55e1ecac60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe306a00640 1 --2- 172.21.15.89:0/1947178974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec9893f0 0x55e1ecac60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe306a00640 1 -- 172.21.15.89:0/1947178974 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1ec86bb70 con 0x55e1ec97ee90 2024-08-31T04:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe307400640 1 --2- 172.21.15.89:0/1947178974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec9893f0 0x55e1ecac60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe306a00640 1 --2- 172.21.15.89:0/1947178974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1eca8bce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40b0040 tx=0x7fe2f40f6bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ffe5847c6edebb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe2f3e00640 1 -- 172.21.15.89:0/1947178974 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40f6930 con 0x55e1ec97ee90 2024-08-31T04:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe2f3e00640 1 -- 172.21.15.89:0/1947178974 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2f40f7520 con 0x55e1ec97ee90 2024-08-31T04:05:25.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe2f3e00640 1 -- 172.21.15.89:0/1947178974 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40f6e20 con 0x55e1ec97ee90 2024-08-31T04:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe315dd9000 1 -- 172.21.15.89:0/1947178974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 msgr2=0x55e1eca8bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1947178974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1eca8bce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40b0040 tx=0x7fe2f40f6bf0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe315dd9000 1 -- 172.21.15.89:0/1947178974 shutdown_connections 2024-08-31T04:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1947178974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1eca8bce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1947178974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1eca8c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1947178974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec9893f0 0x55e1ecac60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe315dd9000 1 -- 172.21.15.89:0/1947178974 >> 172.21.15.89:0/1947178974 conn(0x55e1ec590210 msgr2=0x55e1ecac5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe315dd9000 1 -- 172.21.15.89:0/1947178974 shutdown_connections 2024-08-31T04:05:25.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.294+0000 7fe315dd9000 1 -- 172.21.15.89:0/1947178974 wait complete. 2024-08-31T04:05:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.298+0000 7fe315dd9000 1 -- start start 2024-08-31T04:05:25.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.298+0000 7fe315dd9000 1 Processor -- start 2024-08-31T04:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.298+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec968960 0x55e1ecac24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.298+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec97ee90 0x55e1ecac2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.298+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec9893f0 0x55e1ecac2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.298+0000 7fe315dd9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e1ec597b10 con 0x55e1ec9893f0 2024-08-31T04:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.298+0000 7fe315dd9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e1ec8576f0 con 0x55e1ec968960 2024-08-31T04:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.298+0000 7fe315dd9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e1ec8d9390 con 0x55e1ec97ee90 2024-08-31T04:05:25.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.298+0000 7fe315dd9000 10 client.0 _ll_register_callbacks cb 0x55e1ec878b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:05:25.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe307e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec9893f0 0x55e1ecac2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe306a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec97ee90 0x55e1ecac2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe306a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec97ee90 0x55e1ecac2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:60358/0 (socket says 172.21.15.89:60358) 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe306a00640 1 -- 172.21.15.89:0/1045893892 learned_addr learned my addr 172.21.15.89:0/1045893892 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe307400640 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec968960 0x55e1ecac24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe307e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec9893f0 0x55e1ecac2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39500/0 (socket says 172.21.15.89:39500) 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe306a00640 1 -- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec968960 msgr2=0x55e1ecac24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe306a00640 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec968960 0x55e1ecac24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe306a00640 1 -- 172.21.15.89:0/1045893892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec9893f0 msgr2=0x55e1ecac2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe306a00640 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec9893f0 0x55e1ecac2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe306a00640 1 -- 172.21.15.89:0/1045893892 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55e1ec88f380 con 0x55e1ec97ee90 2024-08-31T04:05:25.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe306a00640 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec97ee90 0x55e1ecac2a20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40f6db0 tx=0x7fe2f40095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6282286d1451658 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:25.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe2f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3301/0 2024-08-31T04:05:25.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe2f0c00640 1 -- 172.21.15.89:0/1045893892 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40f6930 con 0x55e1ec97ee90 2024-08-31T04:05:25.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe315dd9000 1 -- 172.21.15.89:0/1045893892 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e1ec8dfd20 con 0x55e1ec97ee90 2024-08-31T04:05:25.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe2f0c00640 1 -- 172.21.15.89:0/1045893892 <== mon.2 v2:172.21.15.170:3301/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7fe2f40fb180 con 0x55e1ec97ee90 2024-08-31T04:05:25.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe2f0c00640 1 -- 172.21.15.89:0/1045893892 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe2f40f7520 con 0x55e1ec97ee90 2024-08-31T04:05:25.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe315dd9000 10 client.4772 fetch_fsmap learned FSMap version 9 2024-08-31T04:05:25.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe315dd9000 1 -- 172.21.15.89:0/1045893892 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e1ec955e40 con 0x55e1ec97ee90 2024-08-31T04:05:25.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.302+0000 7fe2f0c00640 1 -- 172.21.15.89:0/1045893892 <== mon.2 v2:172.21.15.170:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e1ec8dfd20 con 0x55e1ec97ee90 2024-08-31T04:05:25.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe2f0c00640 1 -- 172.21.15.89:0/1045893892 <== mon.2 v2:172.21.15.170:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fe2f40f6080 con 0x55e1ec97ee90 2024-08-31T04:05:25.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe315dd9000 10 client.4772 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:05:25.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe315dd9000 10 client.4772 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:05:25.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe315dd9000 20 client.4772 populate_metadata read hostname 'smithi089' 2024-08-31T04:05:25.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e1ec574dc0 0x55e1ecadcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe315dd9000 4 client.4772 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:05:25.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe315dd9000 1 -- 172.21.15.89:0/1045893892 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1ec8e3770 con 0x55e1ec574dc0 2024-08-31T04:05:25.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe307400640 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e1ec574dc0 0x55e1ecadcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe307400640 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e1ec574dc0 0x55e1ecadcf90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8012b2cb96e8203d server_cookie=5a2aeded882ab23d in_seq=0 out_seq=0 2024-08-31T04:05:25.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe2f0c00640 10 client.4772 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:25.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe2f0c00640 1 -- 172.21.15.89:0/1045893892 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1ec8e3770 con 0x55e1ec574dc0 2024-08-31T04:05:25.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe2f0c00640 10 client.4772 handle_command_reply: tid=0 2024-08-31T04:05:25.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.306+0000 7fe315dd9000 1 client.4772 shutdown 2024-08-31T04:05:25.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 -- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec97ee90 msgr2=0x55e1ecac2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:25.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec97ee90 0x55e1ecac2a20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40f6db0 tx=0x7fe2f40095f0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 -- 172.21.15.89:0/1045893892 shutdown_connections 2024-08-31T04:05:25.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e1ec574dc0 0x55e1ecadcf90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec9893f0 0x55e1ecac2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec97ee90 0x55e1ecac2a20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 --2- 172.21.15.89:0/1045893892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec968960 0x55e1ecac24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 -- 172.21.15.89:0/1045893892 >> 172.21.15.89:0/1045893892 conn(0x55e1ec590210 msgr2=0x55e1ecac4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:25.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe2f0c00640 0 client.4772 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:25.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 -- 172.21.15.89:0/1045893892 shutdown_connections 2024-08-31T04:05:25.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 1 -- 172.21.15.89:0/1045893892 wait complete. 2024-08-31T04:05:25.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.310+0000 7fe315dd9000 20 client.4772 trim_cache size 0 max 16384 2024-08-31T04:05:25.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe315dd9000 1 Processor -- start 2024-08-31T04:05:25.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe315dd9000 1 -- start start 2024-08-31T04:05:25.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 0x55e1ecac92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1ecac9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecac9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe315dd9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe3082013e0 con 0x55e1ec97ee90 2024-08-31T04:05:25.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe315dd9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe308202700 con 0x55e1ec590210 2024-08-31T04:05:25.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe315dd9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe308201a30 con 0x55e1ec968960 2024-08-31T04:05:25.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe307e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecac9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe306a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1ecac9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe307e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecac9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39502/0 (socket says 172.21.15.89:39502) 2024-08-31T04:05:25.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe307e00640 1 -- 172.21.15.89:0/3153473815 learned_addr learned my addr 172.21.15.89:0/3153473815 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:25.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe307400640 1 --2- 172.21.15.89:0/3153473815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 0x55e1ecac92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe307e00640 1 -- 172.21.15.89:0/3153473815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 msgr2=0x55e1ecac9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe307e00640 1 --2- 172.21.15.89:0/3153473815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1ecac9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe307e00640 1 -- 172.21.15.89:0/3153473815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 msgr2=0x55e1ecac92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe307e00640 1 --2- 172.21.15.89:0/3153473815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 0x55e1ecac92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.346+0000 7fe307e00640 1 -- 172.21.15.89:0/3153473815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1ec92d5b0 con 0x55e1ec97ee90 2024-08-31T04:05:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe307e00640 1 --2- 172.21.15.89:0/3153473815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecac9d50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe300003dc0 tx=0x7fe300011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f022eea14a5fdef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe2f3400640 1 -- 172.21.15.89:0/3153473815 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300028070 con 0x55e1ec97ee90 2024-08-31T04:05:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe2f3400640 1 -- 172.21.15.89:0/3153473815 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe300005490 con 0x55e1ec97ee90 2024-08-31T04:05:25.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe2f3400640 1 -- 172.21.15.89:0/3153473815 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300005640 con 0x55e1ec97ee90 2024-08-31T04:05:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 -- 172.21.15.89:0/3153473815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 msgr2=0x55e1ecac9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3153473815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecac9d50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe300003dc0 tx=0x7fe300011000 comp rx=0 tx=0).stop 2024-08-31T04:05:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 -- 172.21.15.89:0/3153473815 shutdown_connections 2024-08-31T04:05:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3153473815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecac9d50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3153473815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1ecac9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3153473815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 0x55e1ecac92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 -- 172.21.15.89:0/3153473815 >> 172.21.15.89:0/3153473815 conn(0x55e1eca8bf20 msgr2=0x55e1ecac4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 -- 172.21.15.89:0/3153473815 shutdown_connections 2024-08-31T04:05:25.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 -- 172.21.15.89:0/3153473815 wait complete. 2024-08-31T04:05:25.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.350+0000 7fe315dd9000 1 -- start start 2024-08-31T04:05:25.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe315dd9000 1 Processor -- start 2024-08-31T04:05:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 0x55e1ecaccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1ecb3d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe315dd9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecb3ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe315dd9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e1ec852eb0 con 0x55e1ec97ee90 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe315dd9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe308202050 con 0x55e1ec590210 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe315dd9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e1ec878f20 con 0x55e1ec968960 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe315dd9000 10 client.0 _ll_register_callbacks cb 0x7fe2f80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe307e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecb3ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe307e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecb3ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39506/0 (socket says 172.21.15.89:39506) 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe307e00640 1 -- 172.21.15.89:0/3184812040 learned_addr learned my addr 172.21.15.89:0/3184812040 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe306a00640 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1ecb3d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe307400640 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 0x55e1ecaccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe307e00640 1 -- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 msgr2=0x55e1ecb3d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe307e00640 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1ecb3d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe307e00640 1 -- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 msgr2=0x55e1ecaccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe307e00640 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 0x55e1ecaccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.354+0000 7fe307e00640 1 -- 172.21.15.89:0/3184812040 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1ec861fc0 con 0x55e1ec97ee90 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe307e00640 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecb3ddc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe300009010 tx=0x7fe300005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a105413e3bfecc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe2f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe2f0c00640 1 -- 172.21.15.89:0/3184812040 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300028070 con 0x55e1ec97ee90 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe2f0c00640 1 -- 172.21.15.89:0/3184812040 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7fe30002de40 con 0x55e1ec97ee90 2024-08-31T04:05:25.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe315dd9000 1 -- 172.21.15.89:0/3184812040 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe300005490 con 0x55e1ec97ee90 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe2f0c00640 1 -- 172.21.15.89:0/3184812040 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe300023850 con 0x55e1ec97ee90 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe315dd9000 10 client.4890 fetch_fsmap learned FSMap version 9 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe315dd9000 1 -- 172.21.15.89:0/3184812040 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e1ec85ae00 con 0x55e1ec97ee90 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe2f0c00640 1 -- 172.21.15.89:0/3184812040 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe300005490 con 0x55e1ec97ee90 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe2f0c00640 1 -- 172.21.15.89:0/3184812040 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fe3000239f0 con 0x55e1ec97ee90 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe315dd9000 10 client.4890 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe315dd9000 10 client.4890 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe315dd9000 20 client.4890 populate_metadata read hostname 'smithi089' 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e1ec58e470 0x55e1ecb3e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe315dd9000 4 client.4890 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe315dd9000 1 -- 172.21.15.89:0/3184812040 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x55e1ec8df210 con 0x55e1ec58e470 2024-08-31T04:05:25.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.358+0000 7fe307400640 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e1ec58e470 0x55e1ecb3e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.362+0000 7fe307400640 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e1ec58e470 0x55e1ecb3e910 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f35b0175ea24524 server_cookie=3096af99276ac25d in_seq=0 out_seq=0 2024-08-31T04:05:25.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.362+0000 7fe2f0c00640 10 client.4890 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe2f0c00640 1 -- 172.21.15.89:0/3184812040 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55e1ec8df210 con 0x55e1ec58e470 2024-08-31T04:05:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe2f0c00640 10 client.4890 handle_command_reply: tid=0 2024-08-31T04:05:25.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 client.4890 shutdown 2024-08-31T04:05:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 -- 172.21.15.89:0/3184812040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 msgr2=0x55e1ecb3ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecb3ddc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe300009010 tx=0x7fe300005870 comp rx=0 tx=0).stop 2024-08-31T04:05:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 -- 172.21.15.89:0/3184812040 shutdown_connections 2024-08-31T04:05:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e1ec58e470 0x55e1ecb3e910 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e1ec97ee90 0x55e1ecb3ddc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e1ec968960 0x55e1ecb3d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 --2- 172.21.15.89:0/3184812040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e1ec590210 0x55e1ecaccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 -- 172.21.15.89:0/3184812040 >> 172.21.15.89:0/3184812040 conn(0x55e1eca8bf20 msgr2=0x55e1ecac40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:25.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe2f0c00640 0 client.4890 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:25.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 -- 172.21.15.89:0/3184812040 shutdown_connections 2024-08-31T04:05:25.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 1 -- 172.21.15.89:0/3184812040 wait complete. 2024-08-31T04:05:25.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe315dd9000 20 client.4890 trim_cache size 0 max 16384 2024-08-31T04:05:25.371 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 6, 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "146c31bd": { 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 6, 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 146.4, 2024-08-31T04:05:25.372 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:25.373 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 -- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe2e80720f0 msgr2=0x7fe2e8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe2e80720f0 0x7fe2e8074600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe3080b1630 tx=0x7fe300009040 comp rx=0 tx=0).stop 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 -- 172.21.15.89:0/1853932270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 msgr2=0x7fe308156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 0x7fe308156450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009850 tx=0x7fe2f4004040 comp rx=0 tx=0).stop 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 -- 172.21.15.89:0/1853932270 shutdown_connections 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe2e80720f0 0x7fe2e8074600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3080c5bc0 0x7fe308156450 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3080ca320 0x7fe308152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 --2- 172.21.15.89:0/1853932270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3080c4ba0 0x7fe30815aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:25.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 -- 172.21.15.89:0/1853932270 >> 172.21.15.89:0/1853932270 conn(0x7fe3080733e0 msgr2=0x7fe308157420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:25.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 -- 172.21.15.89:0/1853932270 shutdown_connections 2024-08-31T04:05:25.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:25.366+0000 7fe30d200640 1 -- 172.21.15.89:0/1853932270 wait complete. 2024-08-31T04:05:25.401 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '146c31bd', quiesce took 1.1 seconds. Will release after: 25.299999999999997 2024-08-31T04:05:28.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:05:28.950 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:05:40.188 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 66% (8480/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr: git switch -c 2024-08-31T04:05:40.751 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-08-31T04:05:40.752 INFO:tasks.workunit.client.0.smithi089.stderr:Or undo this operation with: 2024-08-31T04:05:40.752 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-08-31T04:05:40.752 INFO:tasks.workunit.client.0.smithi089.stderr: git switch - 2024-08-31T04:05:40.752 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-08-31T04:05:40.752 INFO:tasks.workunit.client.0.smithi089.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T04:05:40.752 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-08-31T04:05:40.752 INFO:tasks.workunit.client.0.smithi089.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T04:05:40.762 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-31T04:05:40.771 INFO:tasks.workunit.client.0.smithi089.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T04:05:40.774 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T04:05:40.774 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T04:05:41.509 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T04:05:41.590 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T04:05:41.649 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T04:05:41.651 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T04:05:41.651 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T04:05:41.704 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T04:05:41.710 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:05:41.710 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-31T04:05:41.760 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2024-08-31T04:05:41.761 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2024-08-31T04:05:41.761 DEBUG:teuthology.orchestra.run.smithi089:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2024-08-31T04:05:50.703 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:05:50.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.862+0000 7ff8ac800640 1 -- 172.21.15.89:0/3060718163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a40c9330 msgr2=0x7ff8a4074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:50.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.862+0000 7ff8ac800640 1 --2- 172.21.15.89:0/3060718163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a40c9330 0x7ff8a4074720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4072540 tx=0x7ff8a001f580 comp rx=0 tx=0).stop 2024-08-31T04:05:50.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.862+0000 7ff8ac800640 1 -- 172.21.15.89:0/3060718163 shutdown_connections 2024-08-31T04:05:50.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.862+0000 7ff8ac800640 1 --2- 172.21.15.89:0/3060718163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a40c9330 0x7ff8a4074720 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:50.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.862+0000 7ff8ac800640 1 --2- 172.21.15.89:0/3060718163 >> v2:172.21.15.170:3300/0 conn(0x7ff8a415bc70 0x7ff8a4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:50.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.862+0000 7ff8ac800640 1 -- 172.21.15.89:0/3060718163 >> 172.21.15.89:0/3060718163 conn(0x7ff8a40ccf20 msgr2=0x7ff8a40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:50.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 -- 172.21.15.89:0/3060718163 shutdown_connections 2024-08-31T04:05:50.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 -- 172.21.15.89:0/3060718163 wait complete. 2024-08-31T04:05:50.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 Processor -- start 2024-08-31T04:05:50.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 -- start start 2024-08-31T04:05:50.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8a40c1f40 0x7ff8a415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:50.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8a40c9330 0x7ff8a40c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:50.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a415bc70 0x7ff8a40b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:50.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a40c8030 con 0x7ff8a415bc70 2024-08-31T04:05:50.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a40c3150 con 0x7ff8a40c9330 2024-08-31T04:05:50.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8ac800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a4074c60 con 0x7ff8a40c1f40 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8aa800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a415bc70 0x7ff8a40b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8aa800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a415bc70 0x7ff8a40b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37672/0 (socket says 172.21.15.89:37672) 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.866+0000 7ff8aa800640 1 -- 172.21.15.89:0/1314517846 learned_addr learned my addr 172.21.15.89:0/1314517846 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8a9e00640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8a40c1f40 0x7ff8a415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8a9400640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8a40c9330 0x7ff8a40c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8aa800640 1 -- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8a40c1f40 msgr2=0x7ff8a415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8aa800640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8a40c1f40 0x7ff8a415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8aa800640 1 -- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8a40c9330 msgr2=0x7ff8a40c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8aa800640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8a40c9330 0x7ff8a40c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8aa800640 1 -- 172.21.15.89:0/1314517846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a415a5e0 con 0x7ff8a415bc70 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8aa800640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a415bc70 0x7ff8a40b1c30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff8a001dc30 tx=0x7ff8a0003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff89e000640 1 -- 172.21.15.89:0/1314517846 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0004c50 con 0x7ff8a415bc70 2024-08-31T04:05:50.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff89e000640 1 -- 172.21.15.89:0/1314517846 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8a00be030 con 0x7ff8a415bc70 2024-08-31T04:05:50.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff89e000640 1 -- 172.21.15.89:0/1314517846 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00afae0 con 0x7ff8a415bc70 2024-08-31T04:05:50.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a4155e10 con 0x7ff8a415bc70 2024-08-31T04:05:50.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a41f2a90 con 0x7ff8a415bc70 2024-08-31T04:05:50.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a4074720 con 0x7ff8a415bc70 2024-08-31T04:05:50.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff89e000640 1 -- 172.21.15.89:0/1314517846 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff8a00afc80 con 0x7ff8a415bc70 2024-08-31T04:05:50.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.870+0000 7ff89e000640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff8880720f0 0x7ff888074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:50.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.874+0000 7ff89e000640 1 -- 172.21.15.89:0/1314517846 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7ff8a0131930 con 0x7ff8a415bc70 2024-08-31T04:05:50.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.874+0000 7ff8a9e00640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff8880720f0 0x7ff888074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:50.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.874+0000 7ff8a9e00640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff8880720f0 0x7ff888074600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff898005fd0 tx=0x7ff898005d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:50.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:50.878+0000 7ff89e000640 1 -- 172.21.15.89:0/1314517846 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff8a00190e0 con 0x7ff8a415bc70 2024-08-31T04:05:51.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.074+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8a41560a0 con 0x7ff8a415bc70 2024-08-31T04:05:51.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.074+0000 7ff89e000640 1 -- 172.21.15.89:0/1314517846 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7ff8a00fcee0 con 0x7ff8a415bc70 2024-08-31T04:05:51.080 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:05:51.081 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:05:51.082 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:05:51.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff8880720f0 msgr2=0x7ff888074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff8880720f0 0x7ff888074600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff898005fd0 tx=0x7ff898005d10 comp rx=0 tx=0).stop 2024-08-31T04:05:51.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a415bc70 msgr2=0x7ff8a40b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a415bc70 0x7ff8a40b1c30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff8a001dc30 tx=0x7ff8a0003f60 comp rx=0 tx=0).stop 2024-08-31T04:05:51.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 shutdown_connections 2024-08-31T04:05:51.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff8880720f0 0x7ff888074600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8a415bc70 0x7ff8a40b1c30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8a40c9330 0x7ff8a40c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 --2- 172.21.15.89:0/1314517846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8a40c1f40 0x7ff8a415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 >> 172.21.15.89:0/1314517846 conn(0x7ff8a40ccf20 msgr2=0x7ff8a4150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:51.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 shutdown_connections 2024-08-31T04:05:51.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.078+0000 7ff8ac800640 1 -- 172.21.15.89:0/1314517846 wait complete. 2024-08-31T04:05:51.102 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 146c31bd --release --await' 2024-08-31T04:05:51.102 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 146c31bd --release --await 2024-08-31T04:05:51.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.262+0000 7f8abce00640 1 -- 172.21.15.89:0/1324129437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a9c004810 msgr2=0x7f8a9c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.262+0000 7f8abce00640 1 --2- 172.21.15.89:0/1324129437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a9c004810 0x7f8a9c004c20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00016c0 tx=0x7f8aa001c730 comp rx=0 tx=0).stop 2024-08-31T04:05:51.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.262+0000 7f8abce00640 1 -- 172.21.15.89:0/1324129437 shutdown_connections 2024-08-31T04:05:51.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.262+0000 7f8abce00640 1 --2- 172.21.15.89:0/1324129437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a9c004810 0x7f8a9c004c20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.262+0000 7f8abce00640 1 -- 172.21.15.89:0/1324129437 >> 172.21.15.89:0/1324129437 conn(0x7f8ab80c99b0 msgr2=0x7f8ab80c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:51.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.262+0000 7f8abce00640 1 -- 172.21.15.89:0/1324129437 shutdown_connections 2024-08-31T04:05:51.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.262+0000 7f8abce00640 1 -- 172.21.15.89:0/1324129437 wait complete. 2024-08-31T04:05:51.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.262+0000 7f8abce00640 1 Processor -- start 2024-08-31T04:05:51.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.262+0000 7f8abce00640 1 -- start start 2024-08-31T04:05:51.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8abce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c004810 0x7f8ab80c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8abce00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80c4e00 0x7f8ab815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8abce00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ab815b320 0x7f8ab815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8abce00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab80c32e0 con 0x7f8ab80c4e00 2024-08-31T04:05:51.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8abce00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab80c3160 con 0x7f8a9c004810 2024-08-31T04:05:51.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8abce00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab81585d0 con 0x7f8ab815b320 2024-08-31T04:05:51.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80c4e00 0x7f8ab815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80c4e00 0x7f8ab815ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37702/0 (socket says 172.21.15.89:37702) 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aad400640 1 -- 172.21.15.89:0/1203996177 learned_addr learned my addr 172.21.15.89:0/1203996177 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c004810 0x7f8ab80c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8ab6800640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ab815b320 0x7f8ab815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aad400640 1 -- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ab815b320 msgr2=0x7f8ab815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aad400640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ab815b320 0x7f8ab815c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aad400640 1 -- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c004810 msgr2=0x7f8ab80c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aad400640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c004810 0x7f8ab80c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aad400640 1 -- 172.21.15.89:0/1203996177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab815b820 con 0x7f8ab80c4e00 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c004810 0x7f8ab80c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aad400640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80c4e00 0x7f8ab815ade0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0006040 tx=0x7f8aa0003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aaea00640 1 -- 172.21.15.89:0/1203996177 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00ae070 con 0x7f8ab80c4e00 2024-08-31T04:05:51.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aaea00640 1 -- 172.21.15.89:0/1203996177 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8aa0006500 con 0x7f8ab80c4e00 2024-08-31T04:05:51.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8abce00640 1 -- 172.21.15.89:0/1203996177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab80c67b0 con 0x7f8ab80c4e00 2024-08-31T04:05:51.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aaea00640 1 -- 172.21.15.89:0/1203996177 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0001310 con 0x7f8ab80c4e00 2024-08-31T04:05:51.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8abce00640 1 -- 172.21.15.89:0/1203996177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab81f50e0 con 0x7f8ab80c4e00 2024-08-31T04:05:51.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.266+0000 7f8aaea00640 1 -- 172.21.15.89:0/1203996177 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8aa00a8450 con 0x7f8ab80c4e00 2024-08-31T04:05:51.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8aaea00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8a940720f0 0x7f8a94074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8aaea00640 1 -- 172.21.15.89:0/1203996177 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7f8aa012d2f0 con 0x7f8ab80c4e00 2024-08-31T04:05:51.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ac468b000 1 Processor -- start 2024-08-31T04:05:51.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8a940720f0 0x7f8a94074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ac468b000 1 -- start start 2024-08-31T04:05:51.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8a940720f0 0x7f8a94074600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8ab806b990 tx=0x7f8aa80067b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3ae50e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 0x561e3ae55ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae56010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ac468b000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561e3acfbf30 con 0x561e3ad32950 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ac468b000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561e3ac71690 con 0x561e3ad1c930 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ac468b000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561e3ac60c20 con 0x561e3ad0d890 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3ae50e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3ae50e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37718/0 (socket says 172.21.15.89:37718) 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 -- 172.21.15.89:0/803491107 learned_addr learned my addr 172.21.15.89:0/803491107 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8aad400640 1 --2- 172.21.15.89:0/803491107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 0x561e3ae55ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab6800640 1 --2- 172.21.15.89:0/803491107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae56010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 -- 172.21.15.89:0/803491107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 msgr2=0x561e3ae56010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:51.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/803491107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae56010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 -- 172.21.15.89:0/803491107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 msgr2=0x561e3ae55ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:51.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/803491107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 0x561e3ae55ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 -- 172.21.15.89:0/803491107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e3ac158f0 con 0x561e3ad32950 2024-08-31T04:05:51.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.270+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/803491107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3ae50e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8005a20 tx=0x7f8aa8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca922d835baf643 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:51.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8aa6a00640 1 -- 172.21.15.89:0/803491107 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8012700 con 0x561e3ad32950 2024-08-31T04:05:51.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8aa6a00640 1 -- 172.21.15.89:0/803491107 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8aa8022030 con 0x561e3ad32950 2024-08-31T04:05:51.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8aa6a00640 1 -- 172.21.15.89:0/803491107 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8012b00 con 0x561e3ad32950 2024-08-31T04:05:51.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 -- 172.21.15.89:0/803491107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 msgr2=0x561e3ae50e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 --2- 172.21.15.89:0/803491107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3ae50e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8005a20 tx=0x7f8aa8014000 comp rx=0 tx=0).stop 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 -- 172.21.15.89:0/803491107 shutdown_connections 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 --2- 172.21.15.89:0/803491107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae56010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 --2- 172.21.15.89:0/803491107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 0x561e3ae55ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 --2- 172.21.15.89:0/803491107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3ae50e30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 -- 172.21.15.89:0/803491107 >> 172.21.15.89:0/803491107 conn(0x561e3ad32540 msgr2=0x561e3ae53890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 -- 172.21.15.89:0/803491107 shutdown_connections 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 -- 172.21.15.89:0/803491107 wait complete. 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 -- start start 2024-08-31T04:05:51.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 Processor -- start 2024-08-31T04:05:51.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae50030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad1c930 0x561e3ae50570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 0x561e3ae5abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561e3abe7500 con 0x561e3ad1c930 2024-08-31T04:05:51.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561e3ac64bd0 con 0x561e3ad32950 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561e3ac08a30 con 0x561e3ad0d890 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.274+0000 7f8ac468b000 10 client.0 _ll_register_callbacks cb 0x561e3ad16b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8aad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad1c930 0x561e3ae50570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8aad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad1c930 0x561e3ae50570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37720/0 (socket says 172.21.15.89:37720) 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8aad400640 1 -- 172.21.15.89:0/2067403410 learned_addr learned my addr 172.21.15.89:0/2067403410 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ab6800640 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 0x561e3ae5abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae50030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8aad400640 1 -- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 msgr2=0x561e3ae50030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8aad400640 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae50030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8aad400640 1 -- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 msgr2=0x561e3ae5abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8aad400640 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 0x561e3ae5abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8aad400640 1 -- 172.21.15.89:0/2067403410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e3ac006a0 con 0x561e3ad1c930 2024-08-31T04:05:51.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8aad400640 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad1c930 0x561e3ae50570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00016c0 tx=0x7f8aa00f7cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f4cbff51282796 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8a9b400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8a9b400640 1 -- 172.21.15.89:0/2067403410 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00e1dd0 con 0x561e3ad1c930 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ac468b000 1 -- 172.21.15.89:0/2067403410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561e3abfa7e0 con 0x561e3ad1c930 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8a9b400640 1 -- 172.21.15.89:0/2067403410 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7f8aa00fdba0 con 0x561e3ad1c930 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8a9b400640 1 -- 172.21.15.89:0/2067403410 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8aa00fca10 con 0x561e3ad1c930 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ac468b000 10 client.4908 fetch_fsmap learned FSMap version 9 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ac468b000 1 -- 172.21.15.89:0/2067403410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561e3ac1f1c0 con 0x561e3ad1c930 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8a9b400640 1 -- 172.21.15.89:0/2067403410 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561e3abfa7e0 con 0x561e3ad1c930 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8a9b400640 1 -- 172.21.15.89:0/2067403410 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8aa00b4070 con 0x561e3ad1c930 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ac468b000 10 client.4908 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ac468b000 10 client.4908 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ac468b000 20 client.4908 populate_metadata read hostname 'smithi089' 2024-08-31T04:05:51.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ac468b000 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561e3acf6fc0 0x561e3ae5b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ac468b000 4 client.4908 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:05:51.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ac468b000 1 -- 172.21.15.89:0/2067403410 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e3ac735e0 con 0x561e3acf6fc0 2024-08-31T04:05:51.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.278+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561e3acf6fc0 0x561e3ae5b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8a9b400640 10 client.4908 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:51.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561e3acf6fc0 0x561e3ae5b970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3fb37f0344154e4 server_cookie=2e2cd240488c7acf in_seq=0 out_seq=0 2024-08-31T04:05:51.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8a9b400640 1 -- 172.21.15.89:0/2067403410 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e3ac735e0 con 0x561e3acf6fc0 2024-08-31T04:05:51.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8a9b400640 10 client.4908 handle_command_reply: tid=0 2024-08-31T04:05:51.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 client.4908 shutdown 2024-08-31T04:05:51.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 -- 172.21.15.89:0/2067403410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad1c930 msgr2=0x561e3ae50570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad1c930 0x561e3ae50570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00016c0 tx=0x7f8aa00f7cb0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 -- 172.21.15.89:0/2067403410 shutdown_connections 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561e3acf6fc0 0x561e3ae5b970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad1c930 0x561e3ae50570 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 0x561e3ae5abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8a9b400640 0 client.4908 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 --2- 172.21.15.89:0/2067403410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae50030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 -- 172.21.15.89:0/2067403410 >> 172.21.15.89:0/2067403410 conn(0x561e3ad32540 msgr2=0x561e3ae51040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 -- 172.21.15.89:0/2067403410 shutdown_connections 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 1 -- 172.21.15.89:0/2067403410 wait complete. 2024-08-31T04:05:51.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.282+0000 7f8ac468b000 20 client.4908 trim_cache size 0 max 16384 2024-08-31T04:05:51.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 Processor -- start 2024-08-31T04:05:51.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 -- start start 2024-08-31T04:05:51.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad0d890 0x561e3ae59d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad1c930 0x561e3ae5a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 0x561e3aec9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab82041a0 con 0x561e3ad0d890 2024-08-31T04:05:51.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8203080 con 0x561e3ad32950 2024-08-31T04:05:51.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab8201670 con 0x561e3ad1c930 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad0d890 0x561e3ae59d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad0d890 0x561e3ae59d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37722/0 (socket says 172.21.15.89:37722) 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab5e00640 1 -- 172.21.15.89:0/74143703 learned_addr learned my addr 172.21.15.89:0/74143703 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8aad400640 1 --2- 172.21.15.89:0/74143703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad1c930 0x561e3ae5a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab6800640 1 --2- 172.21.15.89:0/74143703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 0x561e3aec9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab5e00640 1 -- 172.21.15.89:0/74143703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad1c930 msgr2=0x561e3ae5a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/74143703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad1c930 0x561e3ae5a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab5e00640 1 -- 172.21.15.89:0/74143703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 msgr2=0x561e3aec9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/74143703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 0x561e3aec9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab5e00640 1 -- 172.21.15.89:0/74143703 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e3ae5af40 con 0x561e3ad0d890 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/74143703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad0d890 0x561e3ae59d10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8005a20 tx=0x7f8aa8020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5091cc63e5bd9a26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8aa6000640 1 -- 172.21.15.89:0/74143703 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8005340 con 0x561e3ad0d890 2024-08-31T04:05:51.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8aa6000640 1 -- 172.21.15.89:0/74143703 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8aa8036070 con 0x561e3ad0d890 2024-08-31T04:05:51.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8aa6000640 1 -- 172.21.15.89:0/74143703 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8012720 con 0x561e3ad0d890 2024-08-31T04:05:51.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 -- 172.21.15.89:0/74143703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad0d890 msgr2=0x561e3ae59d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 --2- 172.21.15.89:0/74143703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad0d890 0x561e3ae59d10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8005a20 tx=0x7f8aa8020040 comp rx=0 tx=0).stop 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 -- 172.21.15.89:0/74143703 shutdown_connections 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 --2- 172.21.15.89:0/74143703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad32950 0x561e3aec9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 --2- 172.21.15.89:0/74143703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad1c930 0x561e3ae5a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 --2- 172.21.15.89:0/74143703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad0d890 0x561e3ae59d10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 -- 172.21.15.89:0/74143703 >> 172.21.15.89:0/74143703 conn(0x561e3ad32540 msgr2=0x561e3ae70600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 -- 172.21.15.89:0/74143703 shutdown_connections 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.302+0000 7f8ac468b000 1 -- 172.21.15.89:0/74143703 wait complete. 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 -- start start 2024-08-31T04:05:51.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 Processor -- start 2024-08-31T04:05:51.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 0x561e3ae70900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3aecab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8201cc0 con 0x561e3ad32950 2024-08-31T04:05:51.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab82029b0 con 0x561e3ad1c930 2024-08-31T04:05:51.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab82022e0 con 0x561e3ad0d890 2024-08-31T04:05:51.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 10 client.0 _ll_register_callbacks cb 0x7f8aa00f7f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3aecab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3aecab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37728/0 (socket says 172.21.15.89:37728) 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab6800640 1 -- 172.21.15.89:0/3851726582 learned_addr learned my addr 172.21.15.89:0/3851726582 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8aad400640 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 0x561e3ae70900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab6800640 1 -- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 msgr2=0x561e3ae703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab6800640 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab6800640 1 -- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 msgr2=0x561e3ae70900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab6800640 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 0x561e3ae70900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab6800640 1 -- 172.21.15.89:0/3851726582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e3ace52f0 con 0x561e3ad32950 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ab6800640 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3aecab40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80c3c70 tx=0x7f8ab0004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703ae69e950f17d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8a9b400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:05:51.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8a9b400640 1 -- 172.21.15.89:0/3851726582 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0010d70 con 0x561e3ad32950 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8a9b400640 1 -- 172.21.15.89:0/3851726582 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6619+0+0 (secure 0 0 0) 0x7f8ab0004b30 con 0x561e3ad32950 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 -- 172.21.15.89:0/3851726582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8aa8036070 con 0x561e3ad32950 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8a9b400640 1 -- 172.21.15.89:0/3851726582 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8ab0004d30 con 0x561e3ad32950 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 10 client.4914 fetch_fsmap learned FSMap version 9 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.306+0000 7f8ac468b000 1 -- 172.21.15.89:0/3851726582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561e3abeab30 con 0x561e3ad32950 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8a9b400640 1 -- 172.21.15.89:0/3851726582 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8aa8036070 con 0x561e3ad32950 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8a9b400640 1 -- 172.21.15.89:0/3851726582 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8ab0029080 con 0x561e3ad32950 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8ac468b000 10 client.4914 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8ac468b000 10 client.4914 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8ac468b000 20 client.4914 populate_metadata read hostname 'smithi089' 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8ac468b000 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561e3a8f2e80 0x561e3aecb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8ac468b000 4 client.4914 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "146c31bd", "release": true, "await": true}] 2024-08-31T04:05:51.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8ac468b000 1 -- 172.21.15.89:0/3851726582 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "146c31bd", "release": true, "await": true}) -- 0x561e3ac6f080 con 0x561e3a8f2e80 2024-08-31T04:05:51.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561e3a8f2e80 0x561e3aecb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:05:51.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8a9b400640 10 client.4914 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:51.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.310+0000 7f8ab5e00640 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561e3a8f2e80 0x561e3aecb080 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dab5c0faba4daa63 server_cookie=f89ba57f82f0fd in_seq=0 out_seq=0 2024-08-31T04:05:51.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8a9b400640 1 -- 172.21.15.89:0/3851726582 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x561e3ac6f080 con 0x561e3a8f2e80 2024-08-31T04:05:51.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8a9b400640 10 client.4914 handle_command_reply: tid=0 2024-08-31T04:05:51.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 client.4914 shutdown 2024-08-31T04:05:51.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 -- 172.21.15.89:0/3851726582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 msgr2=0x561e3aecab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3aecab40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80c3c70 tx=0x7f8ab0004700 comp rx=0 tx=0).stop 2024-08-31T04:05:51.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 -- 172.21.15.89:0/3851726582 shutdown_connections 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561e3a8f2e80 0x561e3aecb080 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561e3ad32950 0x561e3aecab40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561e3ad1c930 0x561e3ae70900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 --2- 172.21.15.89:0/3851726582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561e3ad0d890 0x561e3ae703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 -- 172.21.15.89:0/3851726582 >> 172.21.15.89:0/3851726582 conn(0x561e3ad32540 msgr2=0x561e3ae596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8a9b400640 0 client.4914 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 -- 172.21.15.89:0/3851726582 shutdown_connections 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 1 -- 172.21.15.89:0/3851726582 wait complete. 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8ac468b000 20 client.4914 trim_cache size 0 max 16384 2024-08-31T04:05:51.318 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 8, 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "146c31bd": { 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 8, 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:05:51.319 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 146.4, 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:05:51.320 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:05:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 -- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8a940720f0 msgr2=0x7f8a94074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8a940720f0 0x7f8a94074600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8ab806b990 tx=0x7f8aa80067b0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 -- 172.21.15.89:0/1203996177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80c4e00 msgr2=0x7f8ab815ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:05:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80c4e00 0x7f8ab815ade0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0006040 tx=0x7f8aa0003be0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 -- 172.21.15.89:0/1203996177 shutdown_connections 2024-08-31T04:05:51.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8a940720f0 0x7f8a94074600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab80c4e00 0x7f8ab815ade0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ab815b320 0x7f8ab815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 --2- 172.21.15.89:0/1203996177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c004810 0x7f8ab80c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:05:51.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 -- 172.21.15.89:0/1203996177 >> 172.21.15.89:0/1203996177 conn(0x7f8ab80c99b0 msgr2=0x7f8ab8158870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:05:51.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 -- 172.21.15.89:0/1203996177 shutdown_connections 2024-08-31T04:05:51.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:05:51.314+0000 7f8abce00640 1 -- 172.21.15.89:0/1203996177 wait complete. 2024-08-31T04:05:51.323 INFO:tasks.workunit.client.0.smithi089.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2024-08-31T04:05:51.338 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '146c31bd', total seconds elapsed: 27.1 2024-08-31T04:05:53.664 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir foo 2024-08-31T04:05:53.675 INFO:tasks.workunit.client.0.smithi089.stderr:+ cp linux-2.6.33.tar.bz2 foo 2024-08-31T04:05:53.760 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir foo/.snap/barsnap 2024-08-31T04:05:53.777 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm foo/linux-2.6.33.tar.bz2 2024-08-31T04:05:54.198 INFO:tasks.workunit.client.0.smithi089.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2024-08-31T04:05:54.757 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo passed: files are identical 2024-08-31T04:05:54.757 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir foo/.snap/barsnap 2024-08-31T04:05:54.758 INFO:tasks.workunit.client.0.smithi089.stdout:passed: files are identical 2024-08-31T04:05:54.782 INFO:tasks.workunit.client.0.smithi089.stdout:OK 2024-08-31T04:05:54.784 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo OK 2024-08-31T04:05:54.784 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T04:05:54.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T04:05:54.828 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2024-08-31T04:05:54.829 DEBUG:teuthology.orchestra.run.smithi089:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2024-08-31T04:05:55.145 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 1 2024-08-31T04:05:55.148 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 2 2024-08-31T04:05:55.150 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 3 2024-08-31T04:05:55.153 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' -e file4 ']' 2024-08-31T04:05:55.153 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/snap1 2024-08-31T04:05:55.174 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 4 2024-08-31T04:05:55.177 INFO:tasks.workunit.client.0.smithi089.stderr:++ ls 2024-08-31T04:05:55.184 INFO:tasks.workunit.client.0.smithi089.stderr:+ now='file1 2024-08-31T04:05:55.184 INFO:tasks.workunit.client.0.smithi089.stderr:file2 2024-08-31T04:05:55.184 INFO:tasks.workunit.client.0.smithi089.stderr:file3 2024-08-31T04:05:55.184 INFO:tasks.workunit.client.0.smithi089.stderr:file4' 2024-08-31T04:05:55.184 INFO:tasks.workunit.client.0.smithi089.stderr:++ ls .snap/snap1 2024-08-31T04:05:55.191 INFO:tasks.workunit.client.0.smithi089.stderr:+ then='file1 2024-08-31T04:05:55.191 INFO:tasks.workunit.client.0.smithi089.stderr:file2 2024-08-31T04:05:55.191 INFO:tasks.workunit.client.0.smithi089.stderr:file3' 2024-08-31T04:05:55.191 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir .snap/snap1 2024-08-31T04:05:55.201 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 'file1 2024-08-31T04:05:55.201 INFO:tasks.workunit.client.0.smithi089.stderr:file2 2024-08-31T04:05:55.201 INFO:tasks.workunit.client.0.smithi089.stderr:file3 2024-08-31T04:05:55.201 INFO:tasks.workunit.client.0.smithi089.stderr:file4' = 'file1 2024-08-31T04:05:55.201 INFO:tasks.workunit.client.0.smithi089.stderr:file2 2024-08-31T04:05:55.201 INFO:tasks.workunit.client.0.smithi089.stderr:file3' ']' 2024-08-31T04:05:55.201 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 1 2024-08-31T04:05:55.213 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 2 2024-08-31T04:05:55.226 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 3 2024-08-31T04:05:55.241 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/snap1 2024-08-31T04:05:55.253 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 4 2024-08-31T04:05:55.266 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir .snap/snap1 2024-08-31T04:05:55.280 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm file1 file2 file3 file4 2024-08-31T04:05:55.299 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo OK 2024-08-31T04:05:55.300 INFO:tasks.workunit.client.0.smithi089.stdout:OK 2024-08-31T04:05:55.300 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T04:05:55.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T04:05:55.332 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2024-08-31T04:05:55.332 DEBUG:teuthology.orchestra.run.smithi089:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2024-08-31T04:05:55.398 INFO:tasks.workunit.client.0.smithi089.stdout:Create dir 100 to 199 ... 2024-08-31T04:05:55.400 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 100 2024-08-31T04:05:55.431 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 101 2024-08-31T04:05:55.462 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 102 2024-08-31T04:05:55.492 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 103 2024-08-31T04:05:55.524 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 104 2024-08-31T04:05:55.555 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 105 2024-08-31T04:05:55.591 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 106 2024-08-31T04:05:55.636 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 107 2024-08-31T04:05:55.679 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 108 2024-08-31T04:05:55.721 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 109 2024-08-31T04:05:55.761 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 110 2024-08-31T04:05:55.801 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 111 2024-08-31T04:05:55.840 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 112 2024-08-31T04:05:55.880 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 113 2024-08-31T04:05:55.916 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 114 2024-08-31T04:05:55.948 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 115 2024-08-31T04:05:55.999 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 116 2024-08-31T04:05:56.027 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 117 2024-08-31T04:05:56.068 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 118 2024-08-31T04:05:56.352 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 119 2024-08-31T04:05:56.633 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 120 2024-08-31T04:05:56.665 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 121 2024-08-31T04:05:56.697 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 122 2024-08-31T04:05:56.729 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 123 2024-08-31T04:05:56.761 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 124 2024-08-31T04:05:56.792 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 125 2024-08-31T04:05:56.825 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 126 2024-08-31T04:05:57.249 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 127 2024-08-31T04:05:57.284 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 128 2024-08-31T04:05:57.589 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 129 2024-08-31T04:05:58.628 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 130 2024-08-31T04:05:58.677 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 131 2024-08-31T04:05:58.712 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 132 2024-08-31T04:05:58.755 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 133 2024-08-31T04:05:58.801 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 134 2024-08-31T04:05:58.834 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 135 2024-08-31T04:05:59.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:05:59.280 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:05:59.321 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 136 2024-08-31T04:05:59.349 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 137 2024-08-31T04:05:59.376 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 138 2024-08-31T04:05:59.408 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 139 2024-08-31T04:05:59.441 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 140 2024-08-31T04:05:59.473 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 141 2024-08-31T04:06:00.110 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 142 2024-08-31T04:06:00.138 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 143 2024-08-31T04:06:00.177 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 144 2024-08-31T04:06:00.224 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 145 2024-08-31T04:06:00.509 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 146 2024-08-31T04:06:00.541 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 147 2024-08-31T04:06:00.570 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 148 2024-08-31T04:06:00.601 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 149 2024-08-31T04:06:00.632 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 150 2024-08-31T04:06:00.662 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 151 2024-08-31T04:06:00.693 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 152 2024-08-31T04:06:00.723 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 153 2024-08-31T04:06:00.754 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 154 2024-08-31T04:06:00.790 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 155 2024-08-31T04:06:00.820 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 156 2024-08-31T04:06:00.853 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 157 2024-08-31T04:06:00.885 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 158 2024-08-31T04:06:00.923 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 159 2024-08-31T04:06:01.556 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 160 2024-08-31T04:06:01.586 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 161 2024-08-31T04:06:01.619 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 162 2024-08-31T04:06:01.652 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 163 2024-08-31T04:06:01.685 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 164 2024-08-31T04:06:01.717 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 165 2024-08-31T04:06:01.750 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 166 2024-08-31T04:06:01.784 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 167 2024-08-31T04:06:01.814 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 168 2024-08-31T04:06:01.847 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 169 2024-08-31T04:06:01.877 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 170 2024-08-31T04:06:02.115 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 171 2024-08-31T04:06:02.147 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 172 2024-08-31T04:06:02.178 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 173 2024-08-31T04:06:02.210 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 174 2024-08-31T04:06:02.246 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 175 2024-08-31T04:06:02.280 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 176 2024-08-31T04:06:02.311 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 177 2024-08-31T04:06:02.341 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 178 2024-08-31T04:06:02.373 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 179 2024-08-31T04:06:02.404 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 180 2024-08-31T04:06:02.435 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 181 2024-08-31T04:06:02.466 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 182 2024-08-31T04:06:02.497 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 183 2024-08-31T04:06:02.528 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 184 2024-08-31T04:06:03.556 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 185 2024-08-31T04:06:03.769 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 186 2024-08-31T04:06:03.803 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 187 2024-08-31T04:06:03.838 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 188 2024-08-31T04:06:03.872 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 189 2024-08-31T04:06:04.157 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 190 2024-08-31T04:06:04.443 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 191 2024-08-31T04:06:04.728 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 192 2024-08-31T04:06:04.763 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 193 2024-08-31T04:06:04.799 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 194 2024-08-31T04:06:04.833 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 195 2024-08-31T04:06:04.871 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 196 2024-08-31T04:06:04.906 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 197 2024-08-31T04:06:04.941 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 198 2024-08-31T04:06:04.975 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 199 2024-08-31T04:06:05.002 INFO:tasks.workunit.client.0.smithi089.stdout:Take first snapshot .snap/test1 2024-08-31T04:06:05.572 INFO:tasks.workunit.client.0.smithi089.stdout:Create dir 200 to 299 ... 2024-08-31T04:06:05.574 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 200 2024-08-31T04:06:05.606 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 201 2024-08-31T04:06:05.637 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 202 2024-08-31T04:06:05.668 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 203 2024-08-31T04:06:05.699 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 204 2024-08-31T04:06:05.730 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 205 2024-08-31T04:06:05.761 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 206 2024-08-31T04:06:05.793 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 207 2024-08-31T04:06:05.822 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 208 2024-08-31T04:06:05.852 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 209 2024-08-31T04:06:05.885 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 210 2024-08-31T04:06:05.917 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 211 2024-08-31T04:06:05.953 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 212 2024-08-31T04:06:05.988 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 213 2024-08-31T04:06:06.021 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 214 2024-08-31T04:06:06.058 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 215 2024-08-31T04:06:06.096 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 216 2024-08-31T04:06:06.134 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 217 2024-08-31T04:06:06.163 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 218 2024-08-31T04:06:06.190 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 219 2024-08-31T04:06:06.216 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 220 2024-08-31T04:06:06.244 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 221 2024-08-31T04:06:06.270 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 222 2024-08-31T04:06:06.552 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 223 2024-08-31T04:06:06.584 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 224 2024-08-31T04:06:06.616 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 225 2024-08-31T04:06:06.648 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 226 2024-08-31T04:06:06.680 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 227 2024-08-31T04:06:06.711 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 228 2024-08-31T04:06:06.743 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 229 2024-08-31T04:06:06.775 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 230 2024-08-31T04:06:07.057 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 231 2024-08-31T04:06:07.089 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 232 2024-08-31T04:06:07.370 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 233 2024-08-31T04:06:07.402 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 234 2024-08-31T04:06:07.434 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 235 2024-08-31T04:06:07.465 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 236 2024-08-31T04:06:07.496 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 237 2024-08-31T04:06:07.529 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 238 2024-08-31T04:06:07.560 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 239 2024-08-31T04:06:07.592 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 240 2024-08-31T04:06:07.623 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 241 2024-08-31T04:06:07.654 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 242 2024-08-31T04:06:08.563 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 243 2024-08-31T04:06:09.139 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 244 2024-08-31T04:06:09.172 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 245 2024-08-31T04:06:09.203 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 246 2024-08-31T04:06:09.235 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 247 2024-08-31T04:06:09.267 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 248 2024-08-31T04:06:09.300 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 249 2024-08-31T04:06:09.332 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 250 2024-08-31T04:06:09.370 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 251 2024-08-31T04:06:11.181 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 252 2024-08-31T04:06:11.211 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 253 2024-08-31T04:06:11.240 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 254 2024-08-31T04:06:11.269 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 255 2024-08-31T04:06:11.299 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 256 2024-08-31T04:06:11.327 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 257 2024-08-31T04:06:11.357 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 258 2024-08-31T04:06:11.386 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 259 2024-08-31T04:06:11.416 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 260 2024-08-31T04:06:11.696 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 261 2024-08-31T04:06:11.725 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 262 2024-08-31T04:06:12.014 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 263 2024-08-31T04:06:12.161 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 264 2024-08-31T04:06:12.177 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 265 2024-08-31T04:06:12.198 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 266 2024-08-31T04:06:12.221 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 267 2024-08-31T04:06:12.243 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 268 2024-08-31T04:06:13.125 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 269 2024-08-31T04:06:13.155 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 270 2024-08-31T04:06:13.185 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 271 2024-08-31T04:06:13.214 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 272 2024-08-31T04:06:13.245 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 273 2024-08-31T04:06:13.274 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 274 2024-08-31T04:06:13.305 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 275 2024-08-31T04:06:13.335 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 276 2024-08-31T04:06:13.365 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 277 2024-08-31T04:06:13.395 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 278 2024-08-31T04:06:13.425 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 279 2024-08-31T04:06:13.455 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 280 2024-08-31T04:06:13.485 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 281 2024-08-31T04:06:13.516 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 282 2024-08-31T04:06:13.544 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 283 2024-08-31T04:06:13.574 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 284 2024-08-31T04:06:13.605 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 285 2024-08-31T04:06:13.635 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 286 2024-08-31T04:06:13.667 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 287 2024-08-31T04:06:13.697 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 288 2024-08-31T04:06:13.728 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 289 2024-08-31T04:06:13.758 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 290 2024-08-31T04:06:13.789 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 291 2024-08-31T04:06:13.818 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 292 2024-08-31T04:06:13.849 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 293 2024-08-31T04:06:13.879 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 294 2024-08-31T04:06:13.909 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 295 2024-08-31T04:06:13.937 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 296 2024-08-31T04:06:13.972 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 297 2024-08-31T04:06:14.002 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 298 2024-08-31T04:06:14.033 INFO:tasks.workunit.client.0.smithi089.stdout: create dir 299 2024-08-31T04:06:14.202 INFO:tasks.workunit.client.0.smithi089.stdout:Create a snapshot in every first level dir ... 2024-08-31T04:06:14.489 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/.snap/snap-subdir-test 2024-08-31T04:06:14.503 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/30 file after the snapshot 2024-08-31T04:06:14.506 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/31 file after the snapshot 2024-08-31T04:06:14.509 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/32 file after the snapshot 2024-08-31T04:06:14.511 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/33 file after the snapshot 2024-08-31T04:06:14.514 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/34 file after the snapshot 2024-08-31T04:06:14.516 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/35 file after the snapshot 2024-08-31T04:06:14.519 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/36 file after the snapshot 2024-08-31T04:06:14.521 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/37 file after the snapshot 2024-08-31T04:06:14.524 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/38 file after the snapshot 2024-08-31T04:06:14.527 INFO:tasks.workunit.client.0.smithi089.stdout: create 100/39 file after the snapshot 2024-08-31T04:06:14.530 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/.snap/snap-subdir-test 2024-08-31T04:06:14.551 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/30 file after the snapshot 2024-08-31T04:06:14.553 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/31 file after the snapshot 2024-08-31T04:06:14.556 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/32 file after the snapshot 2024-08-31T04:06:14.559 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/33 file after the snapshot 2024-08-31T04:06:14.561 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/34 file after the snapshot 2024-08-31T04:06:14.564 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/35 file after the snapshot 2024-08-31T04:06:14.567 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/36 file after the snapshot 2024-08-31T04:06:14.569 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/37 file after the snapshot 2024-08-31T04:06:14.572 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/38 file after the snapshot 2024-08-31T04:06:14.575 INFO:tasks.workunit.client.0.smithi089.stdout: create 101/39 file after the snapshot 2024-08-31T04:06:14.577 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/.snap/snap-subdir-test 2024-08-31T04:06:14.605 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/30 file after the snapshot 2024-08-31T04:06:14.608 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/31 file after the snapshot 2024-08-31T04:06:14.611 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/32 file after the snapshot 2024-08-31T04:06:14.613 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/33 file after the snapshot 2024-08-31T04:06:14.616 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/34 file after the snapshot 2024-08-31T04:06:14.619 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/35 file after the snapshot 2024-08-31T04:06:14.621 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/36 file after the snapshot 2024-08-31T04:06:14.624 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/37 file after the snapshot 2024-08-31T04:06:14.627 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/38 file after the snapshot 2024-08-31T04:06:14.630 INFO:tasks.workunit.client.0.smithi089.stdout: create 102/39 file after the snapshot 2024-08-31T04:06:14.633 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/.snap/snap-subdir-test 2024-08-31T04:06:14.660 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/30 file after the snapshot 2024-08-31T04:06:14.663 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/31 file after the snapshot 2024-08-31T04:06:14.665 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/32 file after the snapshot 2024-08-31T04:06:14.668 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/33 file after the snapshot 2024-08-31T04:06:14.670 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/34 file after the snapshot 2024-08-31T04:06:14.673 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/35 file after the snapshot 2024-08-31T04:06:14.676 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/36 file after the snapshot 2024-08-31T04:06:14.678 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/37 file after the snapshot 2024-08-31T04:06:14.681 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/38 file after the snapshot 2024-08-31T04:06:14.684 INFO:tasks.workunit.client.0.smithi089.stdout: create 103/39 file after the snapshot 2024-08-31T04:06:14.686 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/.snap/snap-subdir-test 2024-08-31T04:06:14.712 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/30 file after the snapshot 2024-08-31T04:06:14.715 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/31 file after the snapshot 2024-08-31T04:06:14.718 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/32 file after the snapshot 2024-08-31T04:06:14.721 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/33 file after the snapshot 2024-08-31T04:06:15.377 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/34 file after the snapshot 2024-08-31T04:06:15.380 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/35 file after the snapshot 2024-08-31T04:06:15.383 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/36 file after the snapshot 2024-08-31T04:06:15.385 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/37 file after the snapshot 2024-08-31T04:06:15.388 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/38 file after the snapshot 2024-08-31T04:06:15.391 INFO:tasks.workunit.client.0.smithi089.stdout: create 104/39 file after the snapshot 2024-08-31T04:06:15.394 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/.snap/snap-subdir-test 2024-08-31T04:06:15.428 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/30 file after the snapshot 2024-08-31T04:06:15.432 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/31 file after the snapshot 2024-08-31T04:06:15.440 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/32 file after the snapshot 2024-08-31T04:06:15.442 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/33 file after the snapshot 2024-08-31T04:06:15.445 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/34 file after the snapshot 2024-08-31T04:06:15.448 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/35 file after the snapshot 2024-08-31T04:06:15.451 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/36 file after the snapshot 2024-08-31T04:06:15.453 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/37 file after the snapshot 2024-08-31T04:06:15.456 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/38 file after the snapshot 2024-08-31T04:06:15.458 INFO:tasks.workunit.client.0.smithi089.stdout: create 105/39 file after the snapshot 2024-08-31T04:06:15.461 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/.snap/snap-subdir-test 2024-08-31T04:06:15.497 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/30 file after the snapshot 2024-08-31T04:06:15.508 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/31 file after the snapshot 2024-08-31T04:06:15.532 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/32 file after the snapshot 2024-08-31T04:06:15.534 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/33 file after the snapshot 2024-08-31T04:06:15.537 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/34 file after the snapshot 2024-08-31T04:06:15.539 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/35 file after the snapshot 2024-08-31T04:06:15.541 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/36 file after the snapshot 2024-08-31T04:06:15.544 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/37 file after the snapshot 2024-08-31T04:06:15.546 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/38 file after the snapshot 2024-08-31T04:06:15.548 INFO:tasks.workunit.client.0.smithi089.stdout: create 106/39 file after the snapshot 2024-08-31T04:06:15.550 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/.snap/snap-subdir-test 2024-08-31T04:06:15.594 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/30 file after the snapshot 2024-08-31T04:06:15.600 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/31 file after the snapshot 2024-08-31T04:06:15.620 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/32 file after the snapshot 2024-08-31T04:06:15.635 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/33 file after the snapshot 2024-08-31T04:06:15.638 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/34 file after the snapshot 2024-08-31T04:06:15.640 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/35 file after the snapshot 2024-08-31T04:06:15.643 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/36 file after the snapshot 2024-08-31T04:06:15.645 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/37 file after the snapshot 2024-08-31T04:06:15.648 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/38 file after the snapshot 2024-08-31T04:06:15.650 INFO:tasks.workunit.client.0.smithi089.stdout: create 107/39 file after the snapshot 2024-08-31T04:06:15.653 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/.snap/snap-subdir-test 2024-08-31T04:06:15.695 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/30 file after the snapshot 2024-08-31T04:06:15.700 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/31 file after the snapshot 2024-08-31T04:06:15.710 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/32 file after the snapshot 2024-08-31T04:06:15.727 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/33 file after the snapshot 2024-08-31T04:06:15.729 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/34 file after the snapshot 2024-08-31T04:06:15.731 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/35 file after the snapshot 2024-08-31T04:06:15.733 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/36 file after the snapshot 2024-08-31T04:06:15.735 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/37 file after the snapshot 2024-08-31T04:06:15.737 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/38 file after the snapshot 2024-08-31T04:06:15.740 INFO:tasks.workunit.client.0.smithi089.stdout: create 108/39 file after the snapshot 2024-08-31T04:06:15.742 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/.snap/snap-subdir-test 2024-08-31T04:06:15.789 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/30 file after the snapshot 2024-08-31T04:06:15.793 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/31 file after the snapshot 2024-08-31T04:06:15.802 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/32 file after the snapshot 2024-08-31T04:06:15.824 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/33 file after the snapshot 2024-08-31T04:06:15.825 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/34 file after the snapshot 2024-08-31T04:06:15.827 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/35 file after the snapshot 2024-08-31T04:06:15.829 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/36 file after the snapshot 2024-08-31T04:06:15.831 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/37 file after the snapshot 2024-08-31T04:06:15.834 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/38 file after the snapshot 2024-08-31T04:06:15.836 INFO:tasks.workunit.client.0.smithi089.stdout: create 109/39 file after the snapshot 2024-08-31T04:06:15.838 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/.snap/snap-subdir-test 2024-08-31T04:06:15.873 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/30 file after the snapshot 2024-08-31T04:06:15.880 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/31 file after the snapshot 2024-08-31T04:06:15.902 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/32 file after the snapshot 2024-08-31T04:06:15.908 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/33 file after the snapshot 2024-08-31T04:06:15.910 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/34 file after the snapshot 2024-08-31T04:06:15.912 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/35 file after the snapshot 2024-08-31T04:06:15.914 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/36 file after the snapshot 2024-08-31T04:06:15.916 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/37 file after the snapshot 2024-08-31T04:06:15.918 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/38 file after the snapshot 2024-08-31T04:06:15.920 INFO:tasks.workunit.client.0.smithi089.stdout: create 110/39 file after the snapshot 2024-08-31T04:06:15.921 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/.snap/snap-subdir-test 2024-08-31T04:06:16.377 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/30 file after the snapshot 2024-08-31T04:06:16.389 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/31 file after the snapshot 2024-08-31T04:06:16.419 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/32 file after the snapshot 2024-08-31T04:06:16.423 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/33 file after the snapshot 2024-08-31T04:06:16.426 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/34 file after the snapshot 2024-08-31T04:06:16.428 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/35 file after the snapshot 2024-08-31T04:06:16.430 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/36 file after the snapshot 2024-08-31T04:06:16.432 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/37 file after the snapshot 2024-08-31T04:06:16.435 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/38 file after the snapshot 2024-08-31T04:06:16.437 INFO:tasks.workunit.client.0.smithi089.stdout: create 111/39 file after the snapshot 2024-08-31T04:06:16.439 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/.snap/snap-subdir-test 2024-08-31T04:06:16.481 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/30 file after the snapshot 2024-08-31T04:06:16.488 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/31 file after the snapshot 2024-08-31T04:06:16.512 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/32 file after the snapshot 2024-08-31T04:06:16.520 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/33 file after the snapshot 2024-08-31T04:06:16.523 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/34 file after the snapshot 2024-08-31T04:06:16.525 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/35 file after the snapshot 2024-08-31T04:06:16.527 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/36 file after the snapshot 2024-08-31T04:06:16.530 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/37 file after the snapshot 2024-08-31T04:06:16.532 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/38 file after the snapshot 2024-08-31T04:06:16.535 INFO:tasks.workunit.client.0.smithi089.stdout: create 112/39 file after the snapshot 2024-08-31T04:06:16.538 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/.snap/snap-subdir-test 2024-08-31T04:06:16.581 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/30 file after the snapshot 2024-08-31T04:06:16.595 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/31 file after the snapshot 2024-08-31T04:06:16.628 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/32 file after the snapshot 2024-08-31T04:06:16.630 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/33 file after the snapshot 2024-08-31T04:06:16.633 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/34 file after the snapshot 2024-08-31T04:06:16.636 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/35 file after the snapshot 2024-08-31T04:06:16.638 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/36 file after the snapshot 2024-08-31T04:06:16.641 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/37 file after the snapshot 2024-08-31T04:06:16.644 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/38 file after the snapshot 2024-08-31T04:06:16.646 INFO:tasks.workunit.client.0.smithi089.stdout: create 113/39 file after the snapshot 2024-08-31T04:06:16.649 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/.snap/snap-subdir-test 2024-08-31T04:06:16.703 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/30 file after the snapshot 2024-08-31T04:06:16.710 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/31 file after the snapshot 2024-08-31T04:06:16.727 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/32 file after the snapshot 2024-08-31T04:06:16.739 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/33 file after the snapshot 2024-08-31T04:06:16.741 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/34 file after the snapshot 2024-08-31T04:06:16.743 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/35 file after the snapshot 2024-08-31T04:06:16.745 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/36 file after the snapshot 2024-08-31T04:06:16.747 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/37 file after the snapshot 2024-08-31T04:06:16.749 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/38 file after the snapshot 2024-08-31T04:06:16.751 INFO:tasks.workunit.client.0.smithi089.stdout: create 114/39 file after the snapshot 2024-08-31T04:06:16.753 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/.snap/snap-subdir-test 2024-08-31T04:06:16.787 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/30 file after the snapshot 2024-08-31T04:06:16.792 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/31 file after the snapshot 2024-08-31T04:06:16.803 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/32 file after the snapshot 2024-08-31T04:06:16.824 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/33 file after the snapshot 2024-08-31T04:06:16.826 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/34 file after the snapshot 2024-08-31T04:06:16.829 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/35 file after the snapshot 2024-08-31T04:06:16.831 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/36 file after the snapshot 2024-08-31T04:06:16.833 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/37 file after the snapshot 2024-08-31T04:06:16.835 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/38 file after the snapshot 2024-08-31T04:06:16.837 INFO:tasks.workunit.client.0.smithi089.stdout: create 115/39 file after the snapshot 2024-08-31T04:06:16.840 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/.snap/snap-subdir-test 2024-08-31T04:06:16.889 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/30 file after the snapshot 2024-08-31T04:06:16.895 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/31 file after the snapshot 2024-08-31T04:06:16.914 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/32 file after the snapshot 2024-08-31T04:06:16.923 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/33 file after the snapshot 2024-08-31T04:06:16.925 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/34 file after the snapshot 2024-08-31T04:06:16.927 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/35 file after the snapshot 2024-08-31T04:06:16.929 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/36 file after the snapshot 2024-08-31T04:06:16.931 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/37 file after the snapshot 2024-08-31T04:06:16.933 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/38 file after the snapshot 2024-08-31T04:06:16.935 INFO:tasks.workunit.client.0.smithi089.stdout: create 116/39 file after the snapshot 2024-08-31T04:06:16.937 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/.snap/snap-subdir-test 2024-08-31T04:06:16.979 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/30 file after the snapshot 2024-08-31T04:06:16.985 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/31 file after the snapshot 2024-08-31T04:06:16.999 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/32 file after the snapshot 2024-08-31T04:06:17.022 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/33 file after the snapshot 2024-08-31T04:06:17.044 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/34 file after the snapshot 2024-08-31T04:06:17.052 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/35 file after the snapshot 2024-08-31T04:06:17.067 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/36 file after the snapshot 2024-08-31T04:06:17.072 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/37 file after the snapshot 2024-08-31T04:06:17.082 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/38 file after the snapshot 2024-08-31T04:06:17.093 INFO:tasks.workunit.client.0.smithi089.stdout: create 117/39 file after the snapshot 2024-08-31T04:06:17.103 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/.snap/snap-subdir-test 2024-08-31T04:06:19.550 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/30 file after the snapshot 2024-08-31T04:06:19.554 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/31 file after the snapshot 2024-08-31T04:06:19.558 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/32 file after the snapshot 2024-08-31T04:06:19.562 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/33 file after the snapshot 2024-08-31T04:06:19.566 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/34 file after the snapshot 2024-08-31T04:06:19.570 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/35 file after the snapshot 2024-08-31T04:06:19.574 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/36 file after the snapshot 2024-08-31T04:06:19.578 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/37 file after the snapshot 2024-08-31T04:06:19.582 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/38 file after the snapshot 2024-08-31T04:06:19.586 INFO:tasks.workunit.client.0.smithi089.stdout: create 118/39 file after the snapshot 2024-08-31T04:06:19.590 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/.snap/snap-subdir-test 2024-08-31T04:06:19.613 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/30 file after the snapshot 2024-08-31T04:06:19.617 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/31 file after the snapshot 2024-08-31T04:06:19.621 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/32 file after the snapshot 2024-08-31T04:06:19.625 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/33 file after the snapshot 2024-08-31T04:06:19.629 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/34 file after the snapshot 2024-08-31T04:06:19.633 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/35 file after the snapshot 2024-08-31T04:06:19.637 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/36 file after the snapshot 2024-08-31T04:06:19.641 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/37 file after the snapshot 2024-08-31T04:06:19.645 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/38 file after the snapshot 2024-08-31T04:06:19.650 INFO:tasks.workunit.client.0.smithi089.stdout: create 119/39 file after the snapshot 2024-08-31T04:06:19.653 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/.snap/snap-subdir-test 2024-08-31T04:06:19.679 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/30 file after the snapshot 2024-08-31T04:06:20.242 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/31 file after the snapshot 2024-08-31T04:06:20.244 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/32 file after the snapshot 2024-08-31T04:06:20.247 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/33 file after the snapshot 2024-08-31T04:06:20.250 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/34 file after the snapshot 2024-08-31T04:06:20.253 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/35 file after the snapshot 2024-08-31T04:06:20.256 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/36 file after the snapshot 2024-08-31T04:06:20.258 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/37 file after the snapshot 2024-08-31T04:06:20.261 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/38 file after the snapshot 2024-08-31T04:06:20.264 INFO:tasks.workunit.client.0.smithi089.stdout: create 120/39 file after the snapshot 2024-08-31T04:06:20.267 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/.snap/snap-subdir-test 2024-08-31T04:06:20.295 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/30 file after the snapshot 2024-08-31T04:06:20.297 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/31 file after the snapshot 2024-08-31T04:06:20.300 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/32 file after the snapshot 2024-08-31T04:06:20.302 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/33 file after the snapshot 2024-08-31T04:06:20.305 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/34 file after the snapshot 2024-08-31T04:06:20.307 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/35 file after the snapshot 2024-08-31T04:06:20.310 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/36 file after the snapshot 2024-08-31T04:06:20.313 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/37 file after the snapshot 2024-08-31T04:06:20.315 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/38 file after the snapshot 2024-08-31T04:06:20.318 INFO:tasks.workunit.client.0.smithi089.stdout: create 121/39 file after the snapshot 2024-08-31T04:06:20.321 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/.snap/snap-subdir-test 2024-08-31T04:06:20.347 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/30 file after the snapshot 2024-08-31T04:06:20.349 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/31 file after the snapshot 2024-08-31T04:06:20.352 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/32 file after the snapshot 2024-08-31T04:06:20.354 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/33 file after the snapshot 2024-08-31T04:06:20.357 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/34 file after the snapshot 2024-08-31T04:06:20.360 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/35 file after the snapshot 2024-08-31T04:06:20.362 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/36 file after the snapshot 2024-08-31T04:06:20.365 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/37 file after the snapshot 2024-08-31T04:06:20.367 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/38 file after the snapshot 2024-08-31T04:06:20.370 INFO:tasks.workunit.client.0.smithi089.stdout: create 122/39 file after the snapshot 2024-08-31T04:06:20.372 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/.snap/snap-subdir-test 2024-08-31T04:06:20.398 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/30 file after the snapshot 2024-08-31T04:06:20.400 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/31 file after the snapshot 2024-08-31T04:06:20.403 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/32 file after the snapshot 2024-08-31T04:06:20.406 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/33 file after the snapshot 2024-08-31T04:06:20.408 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/34 file after the snapshot 2024-08-31T04:06:20.411 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/35 file after the snapshot 2024-08-31T04:06:20.414 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/36 file after the snapshot 2024-08-31T04:06:20.416 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/37 file after the snapshot 2024-08-31T04:06:20.419 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/38 file after the snapshot 2024-08-31T04:06:20.421 INFO:tasks.workunit.client.0.smithi089.stdout: create 123/39 file after the snapshot 2024-08-31T04:06:20.424 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/.snap/snap-subdir-test 2024-08-31T04:06:20.450 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/30 file after the snapshot 2024-08-31T04:06:20.452 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/31 file after the snapshot 2024-08-31T04:06:20.455 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/32 file after the snapshot 2024-08-31T04:06:20.458 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/33 file after the snapshot 2024-08-31T04:06:20.460 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/34 file after the snapshot 2024-08-31T04:06:20.463 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/35 file after the snapshot 2024-08-31T04:06:20.466 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/36 file after the snapshot 2024-08-31T04:06:20.468 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/37 file after the snapshot 2024-08-31T04:06:20.471 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/38 file after the snapshot 2024-08-31T04:06:20.473 INFO:tasks.workunit.client.0.smithi089.stdout: create 124/39 file after the snapshot 2024-08-31T04:06:20.477 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/.snap/snap-subdir-test 2024-08-31T04:06:20.501 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/30 file after the snapshot 2024-08-31T04:06:20.503 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/31 file after the snapshot 2024-08-31T04:06:20.506 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/32 file after the snapshot 2024-08-31T04:06:20.509 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/33 file after the snapshot 2024-08-31T04:06:20.511 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/34 file after the snapshot 2024-08-31T04:06:20.514 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/35 file after the snapshot 2024-08-31T04:06:20.516 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/36 file after the snapshot 2024-08-31T04:06:20.519 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/37 file after the snapshot 2024-08-31T04:06:20.522 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/38 file after the snapshot 2024-08-31T04:06:20.524 INFO:tasks.workunit.client.0.smithi089.stdout: create 125/39 file after the snapshot 2024-08-31T04:06:20.527 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/.snap/snap-subdir-test 2024-08-31T04:06:20.597 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/30 file after the snapshot 2024-08-31T04:06:20.599 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/31 file after the snapshot 2024-08-31T04:06:20.601 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/32 file after the snapshot 2024-08-31T04:06:20.604 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/33 file after the snapshot 2024-08-31T04:06:20.607 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/34 file after the snapshot 2024-08-31T04:06:20.610 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/35 file after the snapshot 2024-08-31T04:06:20.612 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/36 file after the snapshot 2024-08-31T04:06:20.615 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/37 file after the snapshot 2024-08-31T04:06:20.618 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/38 file after the snapshot 2024-08-31T04:06:20.620 INFO:tasks.workunit.client.0.smithi089.stdout: create 126/39 file after the snapshot 2024-08-31T04:06:20.623 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/.snap/snap-subdir-test 2024-08-31T04:06:20.656 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/30 file after the snapshot 2024-08-31T04:06:20.659 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/31 file after the snapshot 2024-08-31T04:06:20.661 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/32 file after the snapshot 2024-08-31T04:06:20.665 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/33 file after the snapshot 2024-08-31T04:06:20.670 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/34 file after the snapshot 2024-08-31T04:06:20.674 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/35 file after the snapshot 2024-08-31T04:06:20.678 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/36 file after the snapshot 2024-08-31T04:06:20.682 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/37 file after the snapshot 2024-08-31T04:06:20.686 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/38 file after the snapshot 2024-08-31T04:06:20.689 INFO:tasks.workunit.client.0.smithi089.stdout: create 127/39 file after the snapshot 2024-08-31T04:06:20.692 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/.snap/snap-subdir-test 2024-08-31T04:06:20.724 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/30 file after the snapshot 2024-08-31T04:06:20.728 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/31 file after the snapshot 2024-08-31T04:06:20.731 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/32 file after the snapshot 2024-08-31T04:06:20.736 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/33 file after the snapshot 2024-08-31T04:06:20.739 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/34 file after the snapshot 2024-08-31T04:06:20.743 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/35 file after the snapshot 2024-08-31T04:06:20.747 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/36 file after the snapshot 2024-08-31T04:06:20.751 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/37 file after the snapshot 2024-08-31T04:06:20.755 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/38 file after the snapshot 2024-08-31T04:06:20.759 INFO:tasks.workunit.client.0.smithi089.stdout: create 128/39 file after the snapshot 2024-08-31T04:06:20.762 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/.snap/snap-subdir-test 2024-08-31T04:06:20.795 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/30 file after the snapshot 2024-08-31T04:06:20.797 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/31 file after the snapshot 2024-08-31T04:06:20.800 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/32 file after the snapshot 2024-08-31T04:06:20.802 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/33 file after the snapshot 2024-08-31T04:06:20.805 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/34 file after the snapshot 2024-08-31T04:06:20.807 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/35 file after the snapshot 2024-08-31T04:06:20.810 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/36 file after the snapshot 2024-08-31T04:06:20.813 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/37 file after the snapshot 2024-08-31T04:06:20.815 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/38 file after the snapshot 2024-08-31T04:06:20.818 INFO:tasks.workunit.client.0.smithi089.stdout: create 129/39 file after the snapshot 2024-08-31T04:06:20.820 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/.snap/snap-subdir-test 2024-08-31T04:06:20.853 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/30 file after the snapshot 2024-08-31T04:06:20.855 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/31 file after the snapshot 2024-08-31T04:06:20.858 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/32 file after the snapshot 2024-08-31T04:06:20.860 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/33 file after the snapshot 2024-08-31T04:06:20.863 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/34 file after the snapshot 2024-08-31T04:06:20.865 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/35 file after the snapshot 2024-08-31T04:06:20.868 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/36 file after the snapshot 2024-08-31T04:06:20.871 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/37 file after the snapshot 2024-08-31T04:06:20.873 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/38 file after the snapshot 2024-08-31T04:06:20.876 INFO:tasks.workunit.client.0.smithi089.stdout: create 130/39 file after the snapshot 2024-08-31T04:06:20.878 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/.snap/snap-subdir-test 2024-08-31T04:06:20.911 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/30 file after the snapshot 2024-08-31T04:06:20.921 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/31 file after the snapshot 2024-08-31T04:06:20.926 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/32 file after the snapshot 2024-08-31T04:06:20.934 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/33 file after the snapshot 2024-08-31T04:06:20.937 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/34 file after the snapshot 2024-08-31T04:06:20.940 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/35 file after the snapshot 2024-08-31T04:06:20.943 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/36 file after the snapshot 2024-08-31T04:06:20.947 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/37 file after the snapshot 2024-08-31T04:06:20.955 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/38 file after the snapshot 2024-08-31T04:06:20.962 INFO:tasks.workunit.client.0.smithi089.stdout: create 131/39 file after the snapshot 2024-08-31T04:06:20.969 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/.snap/snap-subdir-test 2024-08-31T04:06:21.001 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/30 file after the snapshot 2024-08-31T04:06:21.003 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/31 file after the snapshot 2024-08-31T04:06:21.005 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/32 file after the snapshot 2024-08-31T04:06:21.006 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/33 file after the snapshot 2024-08-31T04:06:21.008 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/34 file after the snapshot 2024-08-31T04:06:21.009 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/35 file after the snapshot 2024-08-31T04:06:21.011 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/36 file after the snapshot 2024-08-31T04:06:21.012 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/37 file after the snapshot 2024-08-31T04:06:21.013 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/38 file after the snapshot 2024-08-31T04:06:21.015 INFO:tasks.workunit.client.0.smithi089.stdout: create 132/39 file after the snapshot 2024-08-31T04:06:21.020 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/.snap/snap-subdir-test 2024-08-31T04:06:21.047 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/30 file after the snapshot 2024-08-31T04:06:21.049 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/31 file after the snapshot 2024-08-31T04:06:21.052 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/32 file after the snapshot 2024-08-31T04:06:21.055 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/33 file after the snapshot 2024-08-31T04:06:21.058 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/34 file after the snapshot 2024-08-31T04:06:21.060 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/35 file after the snapshot 2024-08-31T04:06:21.063 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/36 file after the snapshot 2024-08-31T04:06:21.066 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/37 file after the snapshot 2024-08-31T04:06:21.068 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/38 file after the snapshot 2024-08-31T04:06:21.071 INFO:tasks.workunit.client.0.smithi089.stdout: create 133/39 file after the snapshot 2024-08-31T04:06:21.074 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/.snap/snap-subdir-test 2024-08-31T04:06:21.107 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/30 file after the snapshot 2024-08-31T04:06:21.358 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/31 file after the snapshot 2024-08-31T04:06:21.360 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/32 file after the snapshot 2024-08-31T04:06:21.363 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/33 file after the snapshot 2024-08-31T04:06:21.365 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/34 file after the snapshot 2024-08-31T04:06:21.368 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/35 file after the snapshot 2024-08-31T04:06:21.371 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/36 file after the snapshot 2024-08-31T04:06:21.373 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/37 file after the snapshot 2024-08-31T04:06:21.376 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/38 file after the snapshot 2024-08-31T04:06:21.378 INFO:tasks.workunit.client.0.smithi089.stdout: create 134/39 file after the snapshot 2024-08-31T04:06:21.381 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/.snap/snap-subdir-test 2024-08-31T04:06:21.417 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/30 file after the snapshot 2024-08-31T04:06:21.419 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/31 file after the snapshot 2024-08-31T04:06:21.422 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/32 file after the snapshot 2024-08-31T04:06:21.424 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/33 file after the snapshot 2024-08-31T04:06:21.427 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/34 file after the snapshot 2024-08-31T04:06:21.430 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/35 file after the snapshot 2024-08-31T04:06:21.432 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/36 file after the snapshot 2024-08-31T04:06:21.435 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/37 file after the snapshot 2024-08-31T04:06:21.437 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/38 file after the snapshot 2024-08-31T04:06:21.440 INFO:tasks.workunit.client.0.smithi089.stdout: create 135/39 file after the snapshot 2024-08-31T04:06:21.443 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/.snap/snap-subdir-test 2024-08-31T04:06:21.477 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/30 file after the snapshot 2024-08-31T04:06:21.479 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/31 file after the snapshot 2024-08-31T04:06:21.482 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/32 file after the snapshot 2024-08-31T04:06:21.484 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/33 file after the snapshot 2024-08-31T04:06:21.487 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/34 file after the snapshot 2024-08-31T04:06:21.489 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/35 file after the snapshot 2024-08-31T04:06:21.492 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/36 file after the snapshot 2024-08-31T04:06:21.494 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/37 file after the snapshot 2024-08-31T04:06:21.497 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/38 file after the snapshot 2024-08-31T04:06:21.499 INFO:tasks.workunit.client.0.smithi089.stdout: create 136/39 file after the snapshot 2024-08-31T04:06:21.502 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/.snap/snap-subdir-test 2024-08-31T04:06:21.535 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/30 file after the snapshot 2024-08-31T04:06:21.538 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/31 file after the snapshot 2024-08-31T04:06:21.540 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/32 file after the snapshot 2024-08-31T04:06:21.543 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/33 file after the snapshot 2024-08-31T04:06:21.545 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/34 file after the snapshot 2024-08-31T04:06:21.548 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/35 file after the snapshot 2024-08-31T04:06:21.550 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/36 file after the snapshot 2024-08-31T04:06:21.553 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/37 file after the snapshot 2024-08-31T04:06:21.555 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/38 file after the snapshot 2024-08-31T04:06:21.558 INFO:tasks.workunit.client.0.smithi089.stdout: create 137/39 file after the snapshot 2024-08-31T04:06:21.561 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/.snap/snap-subdir-test 2024-08-31T04:06:21.593 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/30 file after the snapshot 2024-08-31T04:06:21.595 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/31 file after the snapshot 2024-08-31T04:06:21.598 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/32 file after the snapshot 2024-08-31T04:06:21.600 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/33 file after the snapshot 2024-08-31T04:06:21.602 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/34 file after the snapshot 2024-08-31T04:06:21.605 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/35 file after the snapshot 2024-08-31T04:06:21.607 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/36 file after the snapshot 2024-08-31T04:06:21.610 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/37 file after the snapshot 2024-08-31T04:06:21.613 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/38 file after the snapshot 2024-08-31T04:06:21.615 INFO:tasks.workunit.client.0.smithi089.stdout: create 138/39 file after the snapshot 2024-08-31T04:06:21.618 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/.snap/snap-subdir-test 2024-08-31T04:06:21.643 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/30 file after the snapshot 2024-08-31T04:06:21.645 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/31 file after the snapshot 2024-08-31T04:06:21.648 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/32 file after the snapshot 2024-08-31T04:06:21.650 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/33 file after the snapshot 2024-08-31T04:06:21.653 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/34 file after the snapshot 2024-08-31T04:06:21.655 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/35 file after the snapshot 2024-08-31T04:06:21.658 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/36 file after the snapshot 2024-08-31T04:06:21.660 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/37 file after the snapshot 2024-08-31T04:06:21.663 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/38 file after the snapshot 2024-08-31T04:06:21.666 INFO:tasks.workunit.client.0.smithi089.stdout: create 139/39 file after the snapshot 2024-08-31T04:06:21.668 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/.snap/snap-subdir-test 2024-08-31T04:06:21.693 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/30 file after the snapshot 2024-08-31T04:06:21.697 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/31 file after the snapshot 2024-08-31T04:06:21.701 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/32 file after the snapshot 2024-08-31T04:06:21.705 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/33 file after the snapshot 2024-08-31T04:06:21.709 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/34 file after the snapshot 2024-08-31T04:06:21.713 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/35 file after the snapshot 2024-08-31T04:06:21.717 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/36 file after the snapshot 2024-08-31T04:06:21.721 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/37 file after the snapshot 2024-08-31T04:06:21.725 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/38 file after the snapshot 2024-08-31T04:06:21.729 INFO:tasks.workunit.client.0.smithi089.stdout: create 140/39 file after the snapshot 2024-08-31T04:06:21.733 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/.snap/snap-subdir-test 2024-08-31T04:06:21.760 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/30 file after the snapshot 2024-08-31T04:06:21.764 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/31 file after the snapshot 2024-08-31T04:06:21.768 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/32 file after the snapshot 2024-08-31T04:06:21.772 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/33 file after the snapshot 2024-08-31T04:06:22.018 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/34 file after the snapshot 2024-08-31T04:06:22.022 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/35 file after the snapshot 2024-08-31T04:06:22.026 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/36 file after the snapshot 2024-08-31T04:06:22.031 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/37 file after the snapshot 2024-08-31T04:06:22.035 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/38 file after the snapshot 2024-08-31T04:06:22.039 INFO:tasks.workunit.client.0.smithi089.stdout: create 141/39 file after the snapshot 2024-08-31T04:06:22.043 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/.snap/snap-subdir-test 2024-08-31T04:06:22.071 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/30 file after the snapshot 2024-08-31T04:06:22.075 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/31 file after the snapshot 2024-08-31T04:06:22.422 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/32 file after the snapshot 2024-08-31T04:06:22.426 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/33 file after the snapshot 2024-08-31T04:06:22.431 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/34 file after the snapshot 2024-08-31T04:06:22.435 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/35 file after the snapshot 2024-08-31T04:06:22.439 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/36 file after the snapshot 2024-08-31T04:06:22.443 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/37 file after the snapshot 2024-08-31T04:06:22.447 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/38 file after the snapshot 2024-08-31T04:06:22.452 INFO:tasks.workunit.client.0.smithi089.stdout: create 142/39 file after the snapshot 2024-08-31T04:06:22.456 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/.snap/snap-subdir-test 2024-08-31T04:06:22.486 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/30 file after the snapshot 2024-08-31T04:06:22.489 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/31 file after the snapshot 2024-08-31T04:06:22.492 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/32 file after the snapshot 2024-08-31T04:06:22.494 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/33 file after the snapshot 2024-08-31T04:06:22.497 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/34 file after the snapshot 2024-08-31T04:06:22.500 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/35 file after the snapshot 2024-08-31T04:06:22.503 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/36 file after the snapshot 2024-08-31T04:06:22.506 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/37 file after the snapshot 2024-08-31T04:06:22.509 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/38 file after the snapshot 2024-08-31T04:06:22.512 INFO:tasks.workunit.client.0.smithi089.stdout: create 143/39 file after the snapshot 2024-08-31T04:06:22.514 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/.snap/snap-subdir-test 2024-08-31T04:06:22.541 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/30 file after the snapshot 2024-08-31T04:06:22.544 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/31 file after the snapshot 2024-08-31T04:06:22.546 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/32 file after the snapshot 2024-08-31T04:06:22.549 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/33 file after the snapshot 2024-08-31T04:06:22.552 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/34 file after the snapshot 2024-08-31T04:06:22.555 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/35 file after the snapshot 2024-08-31T04:06:22.557 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/36 file after the snapshot 2024-08-31T04:06:22.560 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/37 file after the snapshot 2024-08-31T04:06:22.563 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/38 file after the snapshot 2024-08-31T04:06:22.565 INFO:tasks.workunit.client.0.smithi089.stdout: create 144/39 file after the snapshot 2024-08-31T04:06:22.568 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/.snap/snap-subdir-test 2024-08-31T04:06:22.594 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/30 file after the snapshot 2024-08-31T04:06:22.597 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/31 file after the snapshot 2024-08-31T04:06:22.600 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/32 file after the snapshot 2024-08-31T04:06:22.603 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/33 file after the snapshot 2024-08-31T04:06:22.606 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/34 file after the snapshot 2024-08-31T04:06:22.608 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/35 file after the snapshot 2024-08-31T04:06:22.611 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/36 file after the snapshot 2024-08-31T04:06:22.614 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/37 file after the snapshot 2024-08-31T04:06:22.617 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/38 file after the snapshot 2024-08-31T04:06:22.620 INFO:tasks.workunit.client.0.smithi089.stdout: create 145/39 file after the snapshot 2024-08-31T04:06:22.623 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/.snap/snap-subdir-test 2024-08-31T04:06:22.649 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/30 file after the snapshot 2024-08-31T04:06:22.651 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/31 file after the snapshot 2024-08-31T04:06:22.654 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/32 file after the snapshot 2024-08-31T04:06:22.657 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/33 file after the snapshot 2024-08-31T04:06:22.660 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/34 file after the snapshot 2024-08-31T04:06:22.663 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/35 file after the snapshot 2024-08-31T04:06:22.666 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/36 file after the snapshot 2024-08-31T04:06:22.668 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/37 file after the snapshot 2024-08-31T04:06:22.671 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/38 file after the snapshot 2024-08-31T04:06:22.674 INFO:tasks.workunit.client.0.smithi089.stdout: create 146/39 file after the snapshot 2024-08-31T04:06:22.677 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/.snap/snap-subdir-test 2024-08-31T04:06:22.703 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/30 file after the snapshot 2024-08-31T04:06:22.706 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/31 file after the snapshot 2024-08-31T04:06:22.708 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/32 file after the snapshot 2024-08-31T04:06:22.711 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/33 file after the snapshot 2024-08-31T04:06:22.714 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/34 file after the snapshot 2024-08-31T04:06:22.716 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/35 file after the snapshot 2024-08-31T04:06:22.719 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/36 file after the snapshot 2024-08-31T04:06:22.722 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/37 file after the snapshot 2024-08-31T04:06:22.724 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/38 file after the snapshot 2024-08-31T04:06:22.727 INFO:tasks.workunit.client.0.smithi089.stdout: create 147/39 file after the snapshot 2024-08-31T04:06:22.730 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/.snap/snap-subdir-test 2024-08-31T04:06:22.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/30 file after the snapshot 2024-08-31T04:06:22.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/31 file after the snapshot 2024-08-31T04:06:22.761 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/32 file after the snapshot 2024-08-31T04:06:22.763 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/33 file after the snapshot 2024-08-31T04:06:22.766 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/34 file after the snapshot 2024-08-31T04:06:22.769 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/35 file after the snapshot 2024-08-31T04:06:22.772 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/36 file after the snapshot 2024-08-31T04:06:22.774 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/37 file after the snapshot 2024-08-31T04:06:22.777 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/38 file after the snapshot 2024-08-31T04:06:22.780 INFO:tasks.workunit.client.0.smithi089.stdout: create 148/39 file after the snapshot 2024-08-31T04:06:22.782 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/.snap/snap-subdir-test 2024-08-31T04:06:22.812 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/30 file after the snapshot 2024-08-31T04:06:22.812 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/31 file after the snapshot 2024-08-31T04:06:22.815 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/32 file after the snapshot 2024-08-31T04:06:22.817 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/33 file after the snapshot 2024-08-31T04:06:22.820 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/34 file after the snapshot 2024-08-31T04:06:22.823 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/35 file after the snapshot 2024-08-31T04:06:22.825 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/36 file after the snapshot 2024-08-31T04:06:22.828 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/37 file after the snapshot 2024-08-31T04:06:22.831 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/38 file after the snapshot 2024-08-31T04:06:22.833 INFO:tasks.workunit.client.0.smithi089.stdout: create 149/39 file after the snapshot 2024-08-31T04:06:22.836 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/.snap/snap-subdir-test 2024-08-31T04:06:22.862 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/30 file after the snapshot 2024-08-31T04:06:22.865 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/31 file after the snapshot 2024-08-31T04:06:22.868 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/32 file after the snapshot 2024-08-31T04:06:22.870 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/33 file after the snapshot 2024-08-31T04:06:22.873 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/34 file after the snapshot 2024-08-31T04:06:22.876 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/35 file after the snapshot 2024-08-31T04:06:22.879 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/36 file after the snapshot 2024-08-31T04:06:22.881 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/37 file after the snapshot 2024-08-31T04:06:22.884 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/38 file after the snapshot 2024-08-31T04:06:22.887 INFO:tasks.workunit.client.0.smithi089.stdout: create 150/39 file after the snapshot 2024-08-31T04:06:22.889 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/.snap/snap-subdir-test 2024-08-31T04:06:22.915 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/30 file after the snapshot 2024-08-31T04:06:22.918 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/31 file after the snapshot 2024-08-31T04:06:22.921 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/32 file after the snapshot 2024-08-31T04:06:22.924 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/33 file after the snapshot 2024-08-31T04:06:22.926 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/34 file after the snapshot 2024-08-31T04:06:22.929 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/35 file after the snapshot 2024-08-31T04:06:22.932 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/36 file after the snapshot 2024-08-31T04:06:22.934 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/37 file after the snapshot 2024-08-31T04:06:22.937 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/38 file after the snapshot 2024-08-31T04:06:22.940 INFO:tasks.workunit.client.0.smithi089.stdout: create 151/39 file after the snapshot 2024-08-31T04:06:22.942 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/.snap/snap-subdir-test 2024-08-31T04:06:22.970 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/30 file after the snapshot 2024-08-31T04:06:22.974 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/31 file after the snapshot 2024-08-31T04:06:22.977 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/32 file after the snapshot 2024-08-31T04:06:22.980 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/33 file after the snapshot 2024-08-31T04:06:22.982 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/34 file after the snapshot 2024-08-31T04:06:22.985 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/35 file after the snapshot 2024-08-31T04:06:22.988 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/36 file after the snapshot 2024-08-31T04:06:22.990 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/37 file after the snapshot 2024-08-31T04:06:22.993 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/38 file after the snapshot 2024-08-31T04:06:22.996 INFO:tasks.workunit.client.0.smithi089.stdout: create 152/39 file after the snapshot 2024-08-31T04:06:22.998 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/.snap/snap-subdir-test 2024-08-31T04:06:23.025 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/30 file after the snapshot 2024-08-31T04:06:23.028 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/31 file after the snapshot 2024-08-31T04:06:23.030 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/32 file after the snapshot 2024-08-31T04:06:23.033 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/33 file after the snapshot 2024-08-31T04:06:23.036 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/34 file after the snapshot 2024-08-31T04:06:23.038 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/35 file after the snapshot 2024-08-31T04:06:23.497 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/36 file after the snapshot 2024-08-31T04:06:23.500 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/37 file after the snapshot 2024-08-31T04:06:23.503 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/38 file after the snapshot 2024-08-31T04:06:23.506 INFO:tasks.workunit.client.0.smithi089.stdout: create 153/39 file after the snapshot 2024-08-31T04:06:23.508 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/.snap/snap-subdir-test 2024-08-31T04:06:23.538 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/30 file after the snapshot 2024-08-31T04:06:23.540 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/31 file after the snapshot 2024-08-31T04:06:23.543 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/32 file after the snapshot 2024-08-31T04:06:23.545 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/33 file after the snapshot 2024-08-31T04:06:23.548 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/34 file after the snapshot 2024-08-31T04:06:23.551 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/35 file after the snapshot 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/36 file after the snapshot 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/37 file after the snapshot 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/38 file after the snapshot 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 154/39 file after the snapshot 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/.snap/snap-subdir-test 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/30 file after the snapshot 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/31 file after the snapshot 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/32 file after the snapshot 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/33 file after the snapshot 2024-08-31T04:06:23.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/34 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/35 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/36 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/37 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/38 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 155/39 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/.snap/snap-subdir-test 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/30 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/31 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/32 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/33 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/34 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/35 file after the snapshot 2024-08-31T04:06:23.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/36 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/37 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/38 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 156/39 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/.snap/snap-subdir-test 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/30 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/31 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/32 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/33 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/34 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/35 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/36 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/37 file after the snapshot 2024-08-31T04:06:23.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/38 file after the snapshot 2024-08-31T04:06:23.759 INFO:tasks.workunit.client.0.smithi089.stdout: create 157/39 file after the snapshot 2024-08-31T04:06:23.759 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/.snap/snap-subdir-test 2024-08-31T04:06:23.759 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/30 file after the snapshot 2024-08-31T04:06:23.759 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/31 file after the snapshot 2024-08-31T04:06:23.759 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/32 file after the snapshot 2024-08-31T04:06:23.762 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/33 file after the snapshot 2024-08-31T04:06:23.765 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/34 file after the snapshot 2024-08-31T04:06:23.767 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/35 file after the snapshot 2024-08-31T04:06:23.770 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/36 file after the snapshot 2024-08-31T04:06:23.773 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/37 file after the snapshot 2024-08-31T04:06:23.775 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/38 file after the snapshot 2024-08-31T04:06:23.778 INFO:tasks.workunit.client.0.smithi089.stdout: create 158/39 file after the snapshot 2024-08-31T04:06:23.781 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/.snap/snap-subdir-test 2024-08-31T04:06:23.808 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/30 file after the snapshot 2024-08-31T04:06:23.811 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/31 file after the snapshot 2024-08-31T04:06:23.814 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/32 file after the snapshot 2024-08-31T04:06:23.816 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/33 file after the snapshot 2024-08-31T04:06:23.819 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/34 file after the snapshot 2024-08-31T04:06:23.822 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/35 file after the snapshot 2024-08-31T04:06:23.825 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/36 file after the snapshot 2024-08-31T04:06:23.827 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/37 file after the snapshot 2024-08-31T04:06:23.830 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/38 file after the snapshot 2024-08-31T04:06:23.833 INFO:tasks.workunit.client.0.smithi089.stdout: create 159/39 file after the snapshot 2024-08-31T04:06:23.837 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/.snap/snap-subdir-test 2024-08-31T04:06:23.864 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/30 file after the snapshot 2024-08-31T04:06:23.866 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/31 file after the snapshot 2024-08-31T04:06:23.868 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/32 file after the snapshot 2024-08-31T04:06:23.870 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/33 file after the snapshot 2024-08-31T04:06:23.873 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/34 file after the snapshot 2024-08-31T04:06:24.127 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/35 file after the snapshot 2024-08-31T04:06:24.129 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/36 file after the snapshot 2024-08-31T04:06:24.132 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/37 file after the snapshot 2024-08-31T04:06:24.135 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/38 file after the snapshot 2024-08-31T04:06:24.138 INFO:tasks.workunit.client.0.smithi089.stdout: create 160/39 file after the snapshot 2024-08-31T04:06:24.141 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/.snap/snap-subdir-test 2024-08-31T04:06:24.170 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/30 file after the snapshot 2024-08-31T04:06:24.174 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/31 file after the snapshot 2024-08-31T04:06:24.178 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/32 file after the snapshot 2024-08-31T04:06:24.182 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/33 file after the snapshot 2024-08-31T04:06:24.186 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/34 file after the snapshot 2024-08-31T04:06:24.190 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/35 file after the snapshot 2024-08-31T04:06:24.194 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/36 file after the snapshot 2024-08-31T04:06:24.448 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/37 file after the snapshot 2024-08-31T04:06:24.451 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/38 file after the snapshot 2024-08-31T04:06:24.455 INFO:tasks.workunit.client.0.smithi089.stdout: create 161/39 file after the snapshot 2024-08-31T04:06:24.459 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/.snap/snap-subdir-test 2024-08-31T04:06:24.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/30 file after the snapshot 2024-08-31T04:06:24.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/31 file after the snapshot 2024-08-31T04:06:24.761 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/32 file after the snapshot 2024-08-31T04:06:24.763 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/33 file after the snapshot 2024-08-31T04:06:24.766 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/34 file after the snapshot 2024-08-31T04:06:24.768 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/35 file after the snapshot 2024-08-31T04:06:24.771 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/36 file after the snapshot 2024-08-31T04:06:24.774 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/37 file after the snapshot 2024-08-31T04:06:24.777 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/38 file after the snapshot 2024-08-31T04:06:24.779 INFO:tasks.workunit.client.0.smithi089.stdout: create 162/39 file after the snapshot 2024-08-31T04:06:24.782 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/.snap/snap-subdir-test 2024-08-31T04:06:24.818 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/30 file after the snapshot 2024-08-31T04:06:24.821 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/31 file after the snapshot 2024-08-31T04:06:24.824 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/32 file after the snapshot 2024-08-31T04:06:24.826 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/33 file after the snapshot 2024-08-31T04:06:24.829 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/34 file after the snapshot 2024-08-31T04:06:24.832 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/35 file after the snapshot 2024-08-31T04:06:24.835 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/36 file after the snapshot 2024-08-31T04:06:24.838 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/37 file after the snapshot 2024-08-31T04:06:24.841 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/38 file after the snapshot 2024-08-31T04:06:24.843 INFO:tasks.workunit.client.0.smithi089.stdout: create 163/39 file after the snapshot 2024-08-31T04:06:24.846 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/.snap/snap-subdir-test 2024-08-31T04:06:24.881 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/30 file after the snapshot 2024-08-31T04:06:24.884 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/31 file after the snapshot 2024-08-31T04:06:24.887 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/32 file after the snapshot 2024-08-31T04:06:24.890 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/33 file after the snapshot 2024-08-31T04:06:24.894 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/34 file after the snapshot 2024-08-31T04:06:24.897 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/35 file after the snapshot 2024-08-31T04:06:24.900 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/36 file after the snapshot 2024-08-31T04:06:24.903 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/37 file after the snapshot 2024-08-31T04:06:24.905 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/38 file after the snapshot 2024-08-31T04:06:24.908 INFO:tasks.workunit.client.0.smithi089.stdout: create 164/39 file after the snapshot 2024-08-31T04:06:24.911 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/.snap/snap-subdir-test 2024-08-31T04:06:24.937 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/30 file after the snapshot 2024-08-31T04:06:24.938 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/31 file after the snapshot 2024-08-31T04:06:24.940 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/32 file after the snapshot 2024-08-31T04:06:24.942 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/33 file after the snapshot 2024-08-31T04:06:24.944 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/34 file after the snapshot 2024-08-31T04:06:24.946 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/35 file after the snapshot 2024-08-31T04:06:24.948 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/36 file after the snapshot 2024-08-31T04:06:24.950 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/37 file after the snapshot 2024-08-31T04:06:24.952 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/38 file after the snapshot 2024-08-31T04:06:24.954 INFO:tasks.workunit.client.0.smithi089.stdout: create 165/39 file after the snapshot 2024-08-31T04:06:24.956 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/.snap/snap-subdir-test 2024-08-31T04:06:24.981 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/30 file after the snapshot 2024-08-31T04:06:24.983 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/31 file after the snapshot 2024-08-31T04:06:24.986 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/32 file after the snapshot 2024-08-31T04:06:25.523 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/33 file after the snapshot 2024-08-31T04:06:25.782 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/34 file after the snapshot 2024-08-31T04:06:25.785 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/35 file after the snapshot 2024-08-31T04:06:25.787 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/36 file after the snapshot 2024-08-31T04:06:25.790 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/37 file after the snapshot 2024-08-31T04:06:25.793 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/38 file after the snapshot 2024-08-31T04:06:25.796 INFO:tasks.workunit.client.0.smithi089.stdout: create 166/39 file after the snapshot 2024-08-31T04:06:26.521 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/.snap/snap-subdir-test 2024-08-31T04:06:26.594 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/30 file after the snapshot 2024-08-31T04:06:27.069 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/31 file after the snapshot 2024-08-31T04:06:27.072 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/32 file after the snapshot 2024-08-31T04:06:27.075 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/33 file after the snapshot 2024-08-31T04:06:27.078 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/34 file after the snapshot 2024-08-31T04:06:27.081 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/35 file after the snapshot 2024-08-31T04:06:27.083 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/36 file after the snapshot 2024-08-31T04:06:27.086 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/37 file after the snapshot 2024-08-31T04:06:27.089 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/38 file after the snapshot 2024-08-31T04:06:27.091 INFO:tasks.workunit.client.0.smithi089.stdout: create 167/39 file after the snapshot 2024-08-31T04:06:27.094 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/.snap/snap-subdir-test 2024-08-31T04:06:27.121 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/30 file after the snapshot 2024-08-31T04:06:27.123 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/31 file after the snapshot 2024-08-31T04:06:27.126 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/32 file after the snapshot 2024-08-31T04:06:27.378 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/33 file after the snapshot 2024-08-31T04:06:27.381 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/34 file after the snapshot 2024-08-31T04:06:27.384 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/35 file after the snapshot 2024-08-31T04:06:27.387 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/36 file after the snapshot 2024-08-31T04:06:27.391 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/37 file after the snapshot 2024-08-31T04:06:27.394 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/38 file after the snapshot 2024-08-31T04:06:27.397 INFO:tasks.workunit.client.0.smithi089.stdout: create 168/39 file after the snapshot 2024-08-31T04:06:27.399 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/.snap/snap-subdir-test 2024-08-31T04:06:27.426 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/30 file after the snapshot 2024-08-31T04:06:27.428 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/31 file after the snapshot 2024-08-31T04:06:27.431 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/32 file after the snapshot 2024-08-31T04:06:27.434 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/33 file after the snapshot 2024-08-31T04:06:27.437 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/34 file after the snapshot 2024-08-31T04:06:27.440 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/35 file after the snapshot 2024-08-31T04:06:27.442 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/36 file after the snapshot 2024-08-31T04:06:27.445 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/37 file after the snapshot 2024-08-31T04:06:27.448 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/38 file after the snapshot 2024-08-31T04:06:27.451 INFO:tasks.workunit.client.0.smithi089.stdout: create 169/39 file after the snapshot 2024-08-31T04:06:27.453 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/.snap/snap-subdir-test 2024-08-31T04:06:27.736 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/30 file after the snapshot 2024-08-31T04:06:27.738 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/31 file after the snapshot 2024-08-31T04:06:27.741 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/32 file after the snapshot 2024-08-31T04:06:27.743 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/33 file after the snapshot 2024-08-31T04:06:27.746 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/34 file after the snapshot 2024-08-31T04:06:27.748 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/35 file after the snapshot 2024-08-31T04:06:27.751 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/36 file after the snapshot 2024-08-31T04:06:27.754 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/37 file after the snapshot 2024-08-31T04:06:27.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/38 file after the snapshot 2024-08-31T04:06:27.760 INFO:tasks.workunit.client.0.smithi089.stdout: create 170/39 file after the snapshot 2024-08-31T04:06:27.763 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/.snap/snap-subdir-test 2024-08-31T04:06:27.799 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/30 file after the snapshot 2024-08-31T04:06:27.802 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/31 file after the snapshot 2024-08-31T04:06:27.805 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/32 file after the snapshot 2024-08-31T04:06:27.808 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/33 file after the snapshot 2024-08-31T04:06:27.810 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/34 file after the snapshot 2024-08-31T04:06:27.813 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/35 file after the snapshot 2024-08-31T04:06:27.816 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/36 file after the snapshot 2024-08-31T04:06:27.819 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/37 file after the snapshot 2024-08-31T04:06:27.821 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/38 file after the snapshot 2024-08-31T04:06:27.824 INFO:tasks.workunit.client.0.smithi089.stdout: create 171/39 file after the snapshot 2024-08-31T04:06:27.826 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/.snap/snap-subdir-test 2024-08-31T04:06:27.863 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/30 file after the snapshot 2024-08-31T04:06:27.866 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/31 file after the snapshot 2024-08-31T04:06:27.869 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/32 file after the snapshot 2024-08-31T04:06:27.872 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/33 file after the snapshot 2024-08-31T04:06:27.874 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/34 file after the snapshot 2024-08-31T04:06:27.877 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/35 file after the snapshot 2024-08-31T04:06:27.880 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/36 file after the snapshot 2024-08-31T04:06:27.883 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/37 file after the snapshot 2024-08-31T04:06:27.885 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/38 file after the snapshot 2024-08-31T04:06:27.888 INFO:tasks.workunit.client.0.smithi089.stdout: create 172/39 file after the snapshot 2024-08-31T04:06:27.891 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/.snap/snap-subdir-test 2024-08-31T04:06:27.926 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/30 file after the snapshot 2024-08-31T04:06:27.928 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/31 file after the snapshot 2024-08-31T04:06:27.931 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/32 file after the snapshot 2024-08-31T04:06:27.934 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/33 file after the snapshot 2024-08-31T04:06:27.936 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/34 file after the snapshot 2024-08-31T04:06:27.939 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/35 file after the snapshot 2024-08-31T04:06:27.941 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/36 file after the snapshot 2024-08-31T04:06:27.944 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/37 file after the snapshot 2024-08-31T04:06:27.946 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/38 file after the snapshot 2024-08-31T04:06:27.949 INFO:tasks.workunit.client.0.smithi089.stdout: create 173/39 file after the snapshot 2024-08-31T04:06:27.952 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/.snap/snap-subdir-test 2024-08-31T04:06:27.978 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/30 file after the snapshot 2024-08-31T04:06:27.981 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/31 file after the snapshot 2024-08-31T04:06:27.983 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/32 file after the snapshot 2024-08-31T04:06:27.986 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/33 file after the snapshot 2024-08-31T04:06:28.006 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/34 file after the snapshot 2024-08-31T04:06:28.008 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/35 file after the snapshot 2024-08-31T04:06:28.011 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/36 file after the snapshot 2024-08-31T04:06:28.014 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/37 file after the snapshot 2024-08-31T04:06:28.017 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/38 file after the snapshot 2024-08-31T04:06:28.020 INFO:tasks.workunit.client.0.smithi089.stdout: create 174/39 file after the snapshot 2024-08-31T04:06:28.022 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/.snap/snap-subdir-test 2024-08-31T04:06:28.050 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/30 file after the snapshot 2024-08-31T04:06:28.053 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/31 file after the snapshot 2024-08-31T04:06:28.055 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/32 file after the snapshot 2024-08-31T04:06:28.058 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/33 file after the snapshot 2024-08-31T04:06:28.061 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/34 file after the snapshot 2024-08-31T04:06:28.063 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/35 file after the snapshot 2024-08-31T04:06:28.065 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/36 file after the snapshot 2024-08-31T04:06:28.068 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/37 file after the snapshot 2024-08-31T04:06:28.070 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/38 file after the snapshot 2024-08-31T04:06:28.073 INFO:tasks.workunit.client.0.smithi089.stdout: create 175/39 file after the snapshot 2024-08-31T04:06:28.075 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/.snap/snap-subdir-test 2024-08-31T04:06:28.101 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/30 file after the snapshot 2024-08-31T04:06:28.104 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/31 file after the snapshot 2024-08-31T04:06:28.106 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/32 file after the snapshot 2024-08-31T04:06:28.109 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/33 file after the snapshot 2024-08-31T04:06:28.112 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/34 file after the snapshot 2024-08-31T04:06:28.115 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/35 file after the snapshot 2024-08-31T04:06:28.117 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/36 file after the snapshot 2024-08-31T04:06:28.120 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/37 file after the snapshot 2024-08-31T04:06:28.122 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/38 file after the snapshot 2024-08-31T04:06:28.125 INFO:tasks.workunit.client.0.smithi089.stdout: create 176/39 file after the snapshot 2024-08-31T04:06:28.128 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/.snap/snap-subdir-test 2024-08-31T04:06:28.174 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/30 file after the snapshot 2024-08-31T04:06:28.177 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/31 file after the snapshot 2024-08-31T04:06:28.179 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/32 file after the snapshot 2024-08-31T04:06:28.182 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/33 file after the snapshot 2024-08-31T04:06:28.184 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/34 file after the snapshot 2024-08-31T04:06:28.187 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/35 file after the snapshot 2024-08-31T04:06:28.189 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/36 file after the snapshot 2024-08-31T04:06:28.191 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/37 file after the snapshot 2024-08-31T04:06:28.194 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/38 file after the snapshot 2024-08-31T04:06:28.196 INFO:tasks.workunit.client.0.smithi089.stdout: create 177/39 file after the snapshot 2024-08-31T04:06:28.199 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/.snap/snap-subdir-test 2024-08-31T04:06:28.225 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/30 file after the snapshot 2024-08-31T04:06:28.228 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/31 file after the snapshot 2024-08-31T04:06:28.230 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/32 file after the snapshot 2024-08-31T04:06:28.233 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/33 file after the snapshot 2024-08-31T04:06:28.236 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/34 file after the snapshot 2024-08-31T04:06:28.239 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/35 file after the snapshot 2024-08-31T04:06:28.243 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/36 file after the snapshot 2024-08-31T04:06:28.247 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/37 file after the snapshot 2024-08-31T04:06:28.249 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/38 file after the snapshot 2024-08-31T04:06:28.252 INFO:tasks.workunit.client.0.smithi089.stdout: create 178/39 file after the snapshot 2024-08-31T04:06:28.255 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/.snap/snap-subdir-test 2024-08-31T04:06:29.086 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/30 file after the snapshot 2024-08-31T04:06:29.088 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/31 file after the snapshot 2024-08-31T04:06:29.090 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/32 file after the snapshot 2024-08-31T04:06:29.093 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/33 file after the snapshot 2024-08-31T04:06:29.096 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/34 file after the snapshot 2024-08-31T04:06:29.099 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/35 file after the snapshot 2024-08-31T04:06:29.101 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/36 file after the snapshot 2024-08-31T04:06:29.104 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/37 file after the snapshot 2024-08-31T04:06:29.107 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/38 file after the snapshot 2024-08-31T04:06:29.109 INFO:tasks.workunit.client.0.smithi089.stdout: create 179/39 file after the snapshot 2024-08-31T04:06:29.112 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/.snap/snap-subdir-test 2024-08-31T04:06:29.140 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/30 file after the snapshot 2024-08-31T04:06:29.142 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/31 file after the snapshot 2024-08-31T04:06:29.145 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/32 file after the snapshot 2024-08-31T04:06:29.147 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/33 file after the snapshot 2024-08-31T04:06:29.150 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/34 file after the snapshot 2024-08-31T04:06:29.153 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/35 file after the snapshot 2024-08-31T04:06:29.156 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/36 file after the snapshot 2024-08-31T04:06:29.159 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/37 file after the snapshot 2024-08-31T04:06:29.161 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/38 file after the snapshot 2024-08-31T04:06:29.164 INFO:tasks.workunit.client.0.smithi089.stdout: create 180/39 file after the snapshot 2024-08-31T04:06:29.167 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/.snap/snap-subdir-test 2024-08-31T04:06:29.193 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/30 file after the snapshot 2024-08-31T04:06:29.195 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/31 file after the snapshot 2024-08-31T04:06:29.198 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/32 file after the snapshot 2024-08-31T04:06:29.200 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/33 file after the snapshot 2024-08-31T04:06:29.203 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/34 file after the snapshot 2024-08-31T04:06:29.206 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/35 file after the snapshot 2024-08-31T04:06:29.208 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/36 file after the snapshot 2024-08-31T04:06:29.211 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/37 file after the snapshot 2024-08-31T04:06:29.214 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/38 file after the snapshot 2024-08-31T04:06:29.216 INFO:tasks.workunit.client.0.smithi089.stdout: create 181/39 file after the snapshot 2024-08-31T04:06:29.219 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/.snap/snap-subdir-test 2024-08-31T04:06:29.244 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/30 file after the snapshot 2024-08-31T04:06:29.246 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/31 file after the snapshot 2024-08-31T04:06:29.249 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/32 file after the snapshot 2024-08-31T04:06:29.252 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/33 file after the snapshot 2024-08-31T04:06:29.254 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/34 file after the snapshot 2024-08-31T04:06:29.257 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/35 file after the snapshot 2024-08-31T04:06:29.259 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/36 file after the snapshot 2024-08-31T04:06:29.262 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/37 file after the snapshot 2024-08-31T04:06:29.265 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/38 file after the snapshot 2024-08-31T04:06:29.267 INFO:tasks.workunit.client.0.smithi089.stdout: create 182/39 file after the snapshot 2024-08-31T04:06:29.270 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/.snap/snap-subdir-test 2024-08-31T04:06:29.295 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/30 file after the snapshot 2024-08-31T04:06:29.298 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/31 file after the snapshot 2024-08-31T04:06:29.301 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/32 file after the snapshot 2024-08-31T04:06:29.303 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/33 file after the snapshot 2024-08-31T04:06:29.306 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/34 file after the snapshot 2024-08-31T04:06:29.308 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/35 file after the snapshot 2024-08-31T04:06:29.311 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/36 file after the snapshot 2024-08-31T04:06:29.314 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/37 file after the snapshot 2024-08-31T04:06:29.316 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/38 file after the snapshot 2024-08-31T04:06:29.319 INFO:tasks.workunit.client.0.smithi089.stdout: create 183/39 file after the snapshot 2024-08-31T04:06:29.321 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/.snap/snap-subdir-test 2024-08-31T04:06:29.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:06:29.335 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:06:29.347 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/30 file after the snapshot 2024-08-31T04:06:29.349 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/31 file after the snapshot 2024-08-31T04:06:29.351 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/32 file after the snapshot 2024-08-31T04:06:29.352 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/33 file after the snapshot 2024-08-31T04:06:29.353 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/34 file after the snapshot 2024-08-31T04:06:29.354 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/35 file after the snapshot 2024-08-31T04:06:29.356 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/36 file after the snapshot 2024-08-31T04:06:29.357 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/37 file after the snapshot 2024-08-31T04:06:29.358 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/38 file after the snapshot 2024-08-31T04:06:29.360 INFO:tasks.workunit.client.0.smithi089.stdout: create 184/39 file after the snapshot 2024-08-31T04:06:29.361 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/.snap/snap-subdir-test 2024-08-31T04:06:30.116 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/30 file after the snapshot 2024-08-31T04:06:30.118 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/31 file after the snapshot 2024-08-31T04:06:30.121 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/32 file after the snapshot 2024-08-31T04:06:30.124 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/33 file after the snapshot 2024-08-31T04:06:30.126 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/34 file after the snapshot 2024-08-31T04:06:30.129 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/35 file after the snapshot 2024-08-31T04:06:30.132 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/36 file after the snapshot 2024-08-31T04:06:30.134 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/37 file after the snapshot 2024-08-31T04:06:30.137 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/38 file after the snapshot 2024-08-31T04:06:30.140 INFO:tasks.workunit.client.0.smithi089.stdout: create 185/39 file after the snapshot 2024-08-31T04:06:30.143 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/.snap/snap-subdir-test 2024-08-31T04:06:30.176 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/30 file after the snapshot 2024-08-31T04:06:30.178 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/31 file after the snapshot 2024-08-31T04:06:30.181 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/32 file after the snapshot 2024-08-31T04:06:30.183 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/33 file after the snapshot 2024-08-31T04:06:30.186 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/34 file after the snapshot 2024-08-31T04:06:30.188 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/35 file after the snapshot 2024-08-31T04:06:30.191 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/36 file after the snapshot 2024-08-31T04:06:30.194 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/37 file after the snapshot 2024-08-31T04:06:30.196 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/38 file after the snapshot 2024-08-31T04:06:30.199 INFO:tasks.workunit.client.0.smithi089.stdout: create 186/39 file after the snapshot 2024-08-31T04:06:30.202 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/.snap/snap-subdir-test 2024-08-31T04:06:30.228 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/30 file after the snapshot 2024-08-31T04:06:30.231 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/31 file after the snapshot 2024-08-31T04:06:30.233 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/32 file after the snapshot 2024-08-31T04:06:30.236 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/33 file after the snapshot 2024-08-31T04:06:30.239 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/34 file after the snapshot 2024-08-31T04:06:30.241 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/35 file after the snapshot 2024-08-31T04:06:30.244 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/36 file after the snapshot 2024-08-31T04:06:30.246 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/37 file after the snapshot 2024-08-31T04:06:30.249 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/38 file after the snapshot 2024-08-31T04:06:30.253 INFO:tasks.workunit.client.0.smithi089.stdout: create 187/39 file after the snapshot 2024-08-31T04:06:30.580 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/.snap/snap-subdir-test 2024-08-31T04:06:30.851 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/30 file after the snapshot 2024-08-31T04:06:30.854 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/31 file after the snapshot 2024-08-31T04:06:30.856 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/32 file after the snapshot 2024-08-31T04:06:30.859 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/33 file after the snapshot 2024-08-31T04:06:30.861 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/34 file after the snapshot 2024-08-31T04:06:30.864 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/35 file after the snapshot 2024-08-31T04:06:30.867 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/36 file after the snapshot 2024-08-31T04:06:30.869 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/37 file after the snapshot 2024-08-31T04:06:30.872 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/38 file after the snapshot 2024-08-31T04:06:30.875 INFO:tasks.workunit.client.0.smithi089.stdout: create 188/39 file after the snapshot 2024-08-31T04:06:30.878 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/.snap/snap-subdir-test 2024-08-31T04:06:30.904 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/30 file after the snapshot 2024-08-31T04:06:30.907 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/31 file after the snapshot 2024-08-31T04:06:30.909 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/32 file after the snapshot 2024-08-31T04:06:30.913 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/33 file after the snapshot 2024-08-31T04:06:30.916 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/34 file after the snapshot 2024-08-31T04:06:31.539 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/35 file after the snapshot 2024-08-31T04:06:31.684 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/36 file after the snapshot 2024-08-31T04:06:31.687 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/37 file after the snapshot 2024-08-31T04:06:31.690 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/38 file after the snapshot 2024-08-31T04:06:31.692 INFO:tasks.workunit.client.0.smithi089.stdout: create 189/39 file after the snapshot 2024-08-31T04:06:31.695 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/.snap/snap-subdir-test 2024-08-31T04:06:31.722 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/30 file after the snapshot 2024-08-31T04:06:31.725 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/31 file after the snapshot 2024-08-31T04:06:31.727 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/32 file after the snapshot 2024-08-31T04:06:31.730 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/33 file after the snapshot 2024-08-31T04:06:31.733 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/34 file after the snapshot 2024-08-31T04:06:31.736 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/35 file after the snapshot 2024-08-31T04:06:31.739 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/36 file after the snapshot 2024-08-31T04:06:31.741 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/37 file after the snapshot 2024-08-31T04:06:31.744 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/38 file after the snapshot 2024-08-31T04:06:31.747 INFO:tasks.workunit.client.0.smithi089.stdout: create 190/39 file after the snapshot 2024-08-31T04:06:31.750 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/.snap/snap-subdir-test 2024-08-31T04:06:31.776 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/30 file after the snapshot 2024-08-31T04:06:31.779 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/31 file after the snapshot 2024-08-31T04:06:31.781 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/32 file after the snapshot 2024-08-31T04:06:31.784 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/33 file after the snapshot 2024-08-31T04:06:31.787 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/34 file after the snapshot 2024-08-31T04:06:31.790 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/35 file after the snapshot 2024-08-31T04:06:31.792 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/36 file after the snapshot 2024-08-31T04:06:31.795 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/37 file after the snapshot 2024-08-31T04:06:31.798 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/38 file after the snapshot 2024-08-31T04:06:31.801 INFO:tasks.workunit.client.0.smithi089.stdout: create 191/39 file after the snapshot 2024-08-31T04:06:31.803 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/.snap/snap-subdir-test 2024-08-31T04:06:31.829 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/30 file after the snapshot 2024-08-31T04:06:31.831 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/31 file after the snapshot 2024-08-31T04:06:31.834 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/32 file after the snapshot 2024-08-31T04:06:31.837 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/33 file after the snapshot 2024-08-31T04:06:31.840 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/34 file after the snapshot 2024-08-31T04:06:31.842 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/35 file after the snapshot 2024-08-31T04:06:31.845 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/36 file after the snapshot 2024-08-31T04:06:31.847 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/37 file after the snapshot 2024-08-31T04:06:31.850 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/38 file after the snapshot 2024-08-31T04:06:31.853 INFO:tasks.workunit.client.0.smithi089.stdout: create 192/39 file after the snapshot 2024-08-31T04:06:31.856 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/.snap/snap-subdir-test 2024-08-31T04:06:31.883 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/30 file after the snapshot 2024-08-31T04:06:31.887 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/31 file after the snapshot 2024-08-31T04:06:31.892 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/32 file after the snapshot 2024-08-31T04:06:31.897 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/33 file after the snapshot 2024-08-31T04:06:31.901 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/34 file after the snapshot 2024-08-31T04:06:31.905 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/35 file after the snapshot 2024-08-31T04:06:31.909 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/36 file after the snapshot 2024-08-31T04:06:31.912 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/37 file after the snapshot 2024-08-31T04:06:31.915 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/38 file after the snapshot 2024-08-31T04:06:31.918 INFO:tasks.workunit.client.0.smithi089.stdout: create 193/39 file after the snapshot 2024-08-31T04:06:31.921 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/.snap/snap-subdir-test 2024-08-31T04:06:31.946 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/30 file after the snapshot 2024-08-31T04:06:31.949 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/31 file after the snapshot 2024-08-31T04:06:31.951 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/32 file after the snapshot 2024-08-31T04:06:31.954 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/33 file after the snapshot 2024-08-31T04:06:31.957 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/34 file after the snapshot 2024-08-31T04:06:31.960 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/35 file after the snapshot 2024-08-31T04:06:31.963 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/36 file after the snapshot 2024-08-31T04:06:31.965 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/37 file after the snapshot 2024-08-31T04:06:31.968 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/38 file after the snapshot 2024-08-31T04:06:31.970 INFO:tasks.workunit.client.0.smithi089.stdout: create 194/39 file after the snapshot 2024-08-31T04:06:31.973 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/.snap/snap-subdir-test 2024-08-31T04:06:32.000 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/30 file after the snapshot 2024-08-31T04:06:32.002 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/31 file after the snapshot 2024-08-31T04:06:32.005 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/32 file after the snapshot 2024-08-31T04:06:32.007 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/33 file after the snapshot 2024-08-31T04:06:32.009 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/34 file after the snapshot 2024-08-31T04:06:32.012 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/35 file after the snapshot 2024-08-31T04:06:32.014 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/36 file after the snapshot 2024-08-31T04:06:32.017 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/37 file after the snapshot 2024-08-31T04:06:32.020 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/38 file after the snapshot 2024-08-31T04:06:32.023 INFO:tasks.workunit.client.0.smithi089.stdout: create 195/39 file after the snapshot 2024-08-31T04:06:32.025 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/.snap/snap-subdir-test 2024-08-31T04:06:32.050 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/30 file after the snapshot 2024-08-31T04:06:32.053 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/31 file after the snapshot 2024-08-31T04:06:32.056 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/32 file after the snapshot 2024-08-31T04:06:32.058 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/33 file after the snapshot 2024-08-31T04:06:32.061 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/34 file after the snapshot 2024-08-31T04:06:32.064 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/35 file after the snapshot 2024-08-31T04:06:32.066 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/36 file after the snapshot 2024-08-31T04:06:32.069 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/37 file after the snapshot 2024-08-31T04:06:32.071 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/38 file after the snapshot 2024-08-31T04:06:32.074 INFO:tasks.workunit.client.0.smithi089.stdout: create 196/39 file after the snapshot 2024-08-31T04:06:32.077 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/.snap/snap-subdir-test 2024-08-31T04:06:32.103 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/30 file after the snapshot 2024-08-31T04:06:32.105 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/31 file after the snapshot 2024-08-31T04:06:32.108 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/32 file after the snapshot 2024-08-31T04:06:32.110 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/33 file after the snapshot 2024-08-31T04:06:32.309 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/34 file after the snapshot 2024-08-31T04:06:32.311 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/35 file after the snapshot 2024-08-31T04:06:32.314 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/36 file after the snapshot 2024-08-31T04:06:32.317 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/37 file after the snapshot 2024-08-31T04:06:32.319 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/38 file after the snapshot 2024-08-31T04:06:32.322 INFO:tasks.workunit.client.0.smithi089.stdout: create 197/39 file after the snapshot 2024-08-31T04:06:32.324 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/.snap/snap-subdir-test 2024-08-31T04:06:32.351 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/30 file after the snapshot 2024-08-31T04:06:32.353 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/31 file after the snapshot 2024-08-31T04:06:32.356 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/32 file after the snapshot 2024-08-31T04:06:32.358 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/33 file after the snapshot 2024-08-31T04:06:32.361 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/34 file after the snapshot 2024-08-31T04:06:32.363 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/35 file after the snapshot 2024-08-31T04:06:32.366 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/36 file after the snapshot 2024-08-31T04:06:32.369 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/37 file after the snapshot 2024-08-31T04:06:32.372 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/38 file after the snapshot 2024-08-31T04:06:32.374 INFO:tasks.workunit.client.0.smithi089.stdout: create 198/39 file after the snapshot 2024-08-31T04:06:32.377 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/.snap/snap-subdir-test 2024-08-31T04:06:32.638 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/30 file after the snapshot 2024-08-31T04:06:32.640 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/31 file after the snapshot 2024-08-31T04:06:32.642 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/32 file after the snapshot 2024-08-31T04:06:32.645 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/33 file after the snapshot 2024-08-31T04:06:32.648 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/34 file after the snapshot 2024-08-31T04:06:32.650 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/35 file after the snapshot 2024-08-31T04:06:32.653 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/36 file after the snapshot 2024-08-31T04:06:32.656 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/37 file after the snapshot 2024-08-31T04:06:32.658 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/38 file after the snapshot 2024-08-31T04:06:32.661 INFO:tasks.workunit.client.0.smithi089.stdout: create 199/39 file after the snapshot 2024-08-31T04:06:32.664 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/.snap/snap-subdir-test 2024-08-31T04:06:32.690 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/30 file after the snapshot 2024-08-31T04:06:32.692 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/31 file after the snapshot 2024-08-31T04:06:32.695 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/32 file after the snapshot 2024-08-31T04:06:32.698 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/33 file after the snapshot 2024-08-31T04:06:32.700 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/34 file after the snapshot 2024-08-31T04:06:32.703 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/35 file after the snapshot 2024-08-31T04:06:32.706 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/36 file after the snapshot 2024-08-31T04:06:32.709 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/37 file after the snapshot 2024-08-31T04:06:32.711 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/38 file after the snapshot 2024-08-31T04:06:32.714 INFO:tasks.workunit.client.0.smithi089.stdout: create 200/39 file after the snapshot 2024-08-31T04:06:32.716 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/.snap/snap-subdir-test 2024-08-31T04:06:32.744 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/30 file after the snapshot 2024-08-31T04:06:32.746 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/31 file after the snapshot 2024-08-31T04:06:32.749 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/32 file after the snapshot 2024-08-31T04:06:32.751 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/33 file after the snapshot 2024-08-31T04:06:32.755 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/34 file after the snapshot 2024-08-31T04:06:32.758 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/35 file after the snapshot 2024-08-31T04:06:32.761 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/36 file after the snapshot 2024-08-31T04:06:32.764 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/37 file after the snapshot 2024-08-31T04:06:32.766 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/38 file after the snapshot 2024-08-31T04:06:32.769 INFO:tasks.workunit.client.0.smithi089.stdout: create 201/39 file after the snapshot 2024-08-31T04:06:32.772 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/.snap/snap-subdir-test 2024-08-31T04:06:32.798 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/30 file after the snapshot 2024-08-31T04:06:32.800 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/31 file after the snapshot 2024-08-31T04:06:32.803 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/32 file after the snapshot 2024-08-31T04:06:32.805 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/33 file after the snapshot 2024-08-31T04:06:32.807 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/34 file after the snapshot 2024-08-31T04:06:32.810 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/35 file after the snapshot 2024-08-31T04:06:32.813 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/36 file after the snapshot 2024-08-31T04:06:32.815 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/37 file after the snapshot 2024-08-31T04:06:32.817 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/38 file after the snapshot 2024-08-31T04:06:32.820 INFO:tasks.workunit.client.0.smithi089.stdout: create 202/39 file after the snapshot 2024-08-31T04:06:32.823 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/.snap/snap-subdir-test 2024-08-31T04:06:32.848 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/30 file after the snapshot 2024-08-31T04:06:32.850 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/31 file after the snapshot 2024-08-31T04:06:32.853 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/32 file after the snapshot 2024-08-31T04:06:32.856 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/33 file after the snapshot 2024-08-31T04:06:32.858 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/34 file after the snapshot 2024-08-31T04:06:32.861 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/35 file after the snapshot 2024-08-31T04:06:32.863 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/36 file after the snapshot 2024-08-31T04:06:32.866 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/37 file after the snapshot 2024-08-31T04:06:32.869 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/38 file after the snapshot 2024-08-31T04:06:32.871 INFO:tasks.workunit.client.0.smithi089.stdout: create 203/39 file after the snapshot 2024-08-31T04:06:32.874 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/.snap/snap-subdir-test 2024-08-31T04:06:32.903 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/30 file after the snapshot 2024-08-31T04:06:32.905 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/31 file after the snapshot 2024-08-31T04:06:32.908 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/32 file after the snapshot 2024-08-31T04:06:32.910 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/33 file after the snapshot 2024-08-31T04:06:32.913 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/34 file after the snapshot 2024-08-31T04:06:32.915 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/35 file after the snapshot 2024-08-31T04:06:32.918 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/36 file after the snapshot 2024-08-31T04:06:32.921 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/37 file after the snapshot 2024-08-31T04:06:32.923 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/38 file after the snapshot 2024-08-31T04:06:32.925 INFO:tasks.workunit.client.0.smithi089.stdout: create 204/39 file after the snapshot 2024-08-31T04:06:32.928 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/.snap/snap-subdir-test 2024-08-31T04:06:32.952 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/30 file after the snapshot 2024-08-31T04:06:32.956 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/31 file after the snapshot 2024-08-31T04:06:32.958 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/32 file after the snapshot 2024-08-31T04:06:32.961 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/33 file after the snapshot 2024-08-31T04:06:32.963 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/34 file after the snapshot 2024-08-31T04:06:32.965 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/35 file after the snapshot 2024-08-31T04:06:32.968 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/36 file after the snapshot 2024-08-31T04:06:32.970 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/37 file after the snapshot 2024-08-31T04:06:32.973 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/38 file after the snapshot 2024-08-31T04:06:32.975 INFO:tasks.workunit.client.0.smithi089.stdout: create 205/39 file after the snapshot 2024-08-31T04:06:32.978 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/.snap/snap-subdir-test 2024-08-31T04:06:33.002 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/30 file after the snapshot 2024-08-31T04:06:33.005 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/31 file after the snapshot 2024-08-31T04:06:33.007 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/32 file after the snapshot 2024-08-31T04:06:33.010 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/33 file after the snapshot 2024-08-31T04:06:33.012 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/34 file after the snapshot 2024-08-31T04:06:33.015 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/35 file after the snapshot 2024-08-31T04:06:33.017 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/36 file after the snapshot 2024-08-31T04:06:33.020 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/37 file after the snapshot 2024-08-31T04:06:33.023 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/38 file after the snapshot 2024-08-31T04:06:33.025 INFO:tasks.workunit.client.0.smithi089.stdout: create 206/39 file after the snapshot 2024-08-31T04:06:33.027 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/.snap/snap-subdir-test 2024-08-31T04:06:33.053 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/30 file after the snapshot 2024-08-31T04:06:33.055 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/31 file after the snapshot 2024-08-31T04:06:33.057 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/32 file after the snapshot 2024-08-31T04:06:33.060 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/33 file after the snapshot 2024-08-31T04:06:33.063 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/34 file after the snapshot 2024-08-31T04:06:33.065 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/35 file after the snapshot 2024-08-31T04:06:33.068 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/36 file after the snapshot 2024-08-31T04:06:33.070 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/37 file after the snapshot 2024-08-31T04:06:33.073 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/38 file after the snapshot 2024-08-31T04:06:33.075 INFO:tasks.workunit.client.0.smithi089.stdout: create 207/39 file after the snapshot 2024-08-31T04:06:33.078 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/.snap/snap-subdir-test 2024-08-31T04:06:33.103 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/30 file after the snapshot 2024-08-31T04:06:33.105 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/31 file after the snapshot 2024-08-31T04:06:33.107 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/32 file after the snapshot 2024-08-31T04:06:33.110 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/33 file after the snapshot 2024-08-31T04:06:33.112 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/34 file after the snapshot 2024-08-31T04:06:33.115 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/35 file after the snapshot 2024-08-31T04:06:33.117 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/36 file after the snapshot 2024-08-31T04:06:33.120 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/37 file after the snapshot 2024-08-31T04:06:33.123 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/38 file after the snapshot 2024-08-31T04:06:33.125 INFO:tasks.workunit.client.0.smithi089.stdout: create 208/39 file after the snapshot 2024-08-31T04:06:33.128 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/.snap/snap-subdir-test 2024-08-31T04:06:33.153 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/30 file after the snapshot 2024-08-31T04:06:33.156 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/31 file after the snapshot 2024-08-31T04:06:33.159 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/32 file after the snapshot 2024-08-31T04:06:33.161 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/33 file after the snapshot 2024-08-31T04:06:33.163 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/34 file after the snapshot 2024-08-31T04:06:33.166 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/35 file after the snapshot 2024-08-31T04:06:33.169 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/36 file after the snapshot 2024-08-31T04:06:33.171 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/37 file after the snapshot 2024-08-31T04:06:33.174 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/38 file after the snapshot 2024-08-31T04:06:33.177 INFO:tasks.workunit.client.0.smithi089.stdout: create 209/39 file after the snapshot 2024-08-31T04:06:33.179 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/.snap/snap-subdir-test 2024-08-31T04:06:33.205 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/30 file after the snapshot 2024-08-31T04:06:33.207 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/31 file after the snapshot 2024-08-31T04:06:33.210 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/32 file after the snapshot 2024-08-31T04:06:33.212 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/33 file after the snapshot 2024-08-31T04:06:33.214 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/34 file after the snapshot 2024-08-31T04:06:33.217 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/35 file after the snapshot 2024-08-31T04:06:33.219 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/36 file after the snapshot 2024-08-31T04:06:33.222 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/37 file after the snapshot 2024-08-31T04:06:33.224 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/38 file after the snapshot 2024-08-31T04:06:33.226 INFO:tasks.workunit.client.0.smithi089.stdout: create 210/39 file after the snapshot 2024-08-31T04:06:33.229 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/.snap/snap-subdir-test 2024-08-31T04:06:33.254 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/30 file after the snapshot 2024-08-31T04:06:33.256 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/31 file after the snapshot 2024-08-31T04:06:33.258 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/32 file after the snapshot 2024-08-31T04:06:33.261 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/33 file after the snapshot 2024-08-31T04:06:33.263 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/34 file after the snapshot 2024-08-31T04:06:33.266 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/35 file after the snapshot 2024-08-31T04:06:33.269 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/36 file after the snapshot 2024-08-31T04:06:33.271 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/37 file after the snapshot 2024-08-31T04:06:33.274 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/38 file after the snapshot 2024-08-31T04:06:33.278 INFO:tasks.workunit.client.0.smithi089.stdout: create 211/39 file after the snapshot 2024-08-31T04:06:33.282 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/.snap/snap-subdir-test 2024-08-31T04:06:33.307 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/30 file after the snapshot 2024-08-31T04:06:33.309 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/31 file after the snapshot 2024-08-31T04:06:33.312 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/32 file after the snapshot 2024-08-31T04:06:33.315 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/33 file after the snapshot 2024-08-31T04:06:33.318 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/34 file after the snapshot 2024-08-31T04:06:33.321 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/35 file after the snapshot 2024-08-31T04:06:33.323 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/36 file after the snapshot 2024-08-31T04:06:33.326 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/37 file after the snapshot 2024-08-31T04:06:33.328 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/38 file after the snapshot 2024-08-31T04:06:33.331 INFO:tasks.workunit.client.0.smithi089.stdout: create 212/39 file after the snapshot 2024-08-31T04:06:33.334 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/.snap/snap-subdir-test 2024-08-31T04:06:33.359 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/30 file after the snapshot 2024-08-31T04:06:33.361 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/31 file after the snapshot 2024-08-31T04:06:33.364 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/32 file after the snapshot 2024-08-31T04:06:33.367 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/33 file after the snapshot 2024-08-31T04:06:33.369 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/34 file after the snapshot 2024-08-31T04:06:33.372 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/35 file after the snapshot 2024-08-31T04:06:33.374 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/36 file after the snapshot 2024-08-31T04:06:33.377 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/37 file after the snapshot 2024-08-31T04:06:33.380 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/38 file after the snapshot 2024-08-31T04:06:33.382 INFO:tasks.workunit.client.0.smithi089.stdout: create 213/39 file after the snapshot 2024-08-31T04:06:33.385 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/.snap/snap-subdir-test 2024-08-31T04:06:33.410 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/30 file after the snapshot 2024-08-31T04:06:33.412 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/31 file after the snapshot 2024-08-31T04:06:33.415 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/32 file after the snapshot 2024-08-31T04:06:33.418 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/33 file after the snapshot 2024-08-31T04:06:33.420 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/34 file after the snapshot 2024-08-31T04:06:33.423 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/35 file after the snapshot 2024-08-31T04:06:33.425 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/36 file after the snapshot 2024-08-31T04:06:33.428 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/37 file after the snapshot 2024-08-31T04:06:33.430 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/38 file after the snapshot 2024-08-31T04:06:33.433 INFO:tasks.workunit.client.0.smithi089.stdout: create 214/39 file after the snapshot 2024-08-31T04:06:33.436 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/.snap/snap-subdir-test 2024-08-31T04:06:33.462 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/30 file after the snapshot 2024-08-31T04:06:33.464 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/31 file after the snapshot 2024-08-31T04:06:33.467 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/32 file after the snapshot 2024-08-31T04:06:33.469 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/33 file after the snapshot 2024-08-31T04:06:33.472 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/34 file after the snapshot 2024-08-31T04:06:33.474 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/35 file after the snapshot 2024-08-31T04:06:33.477 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/36 file after the snapshot 2024-08-31T04:06:33.555 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/37 file after the snapshot 2024-08-31T04:06:34.210 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/38 file after the snapshot 2024-08-31T04:06:34.212 INFO:tasks.workunit.client.0.smithi089.stdout: create 215/39 file after the snapshot 2024-08-31T04:06:34.215 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/.snap/snap-subdir-test 2024-08-31T04:06:34.245 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/30 file after the snapshot 2024-08-31T04:06:34.249 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/31 file after the snapshot 2024-08-31T04:06:34.253 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/32 file after the snapshot 2024-08-31T04:06:34.257 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/33 file after the snapshot 2024-08-31T04:06:34.261 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/34 file after the snapshot 2024-08-31T04:06:34.265 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/35 file after the snapshot 2024-08-31T04:06:34.269 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/36 file after the snapshot 2024-08-31T04:06:34.273 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/37 file after the snapshot 2024-08-31T04:06:34.277 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/38 file after the snapshot 2024-08-31T04:06:34.281 INFO:tasks.workunit.client.0.smithi089.stdout: create 216/39 file after the snapshot 2024-08-31T04:06:34.285 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/.snap/snap-subdir-test 2024-08-31T04:06:34.322 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/30 file after the snapshot 2024-08-31T04:06:34.324 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/31 file after the snapshot 2024-08-31T04:06:34.327 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/32 file after the snapshot 2024-08-31T04:06:34.329 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/33 file after the snapshot 2024-08-31T04:06:34.332 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/34 file after the snapshot 2024-08-31T04:06:34.335 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/35 file after the snapshot 2024-08-31T04:06:34.338 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/36 file after the snapshot 2024-08-31T04:06:34.341 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/37 file after the snapshot 2024-08-31T04:06:34.343 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/38 file after the snapshot 2024-08-31T04:06:34.346 INFO:tasks.workunit.client.0.smithi089.stdout: create 217/39 file after the snapshot 2024-08-31T04:06:34.349 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/.snap/snap-subdir-test 2024-08-31T04:06:34.385 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/30 file after the snapshot 2024-08-31T04:06:34.388 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/31 file after the snapshot 2024-08-31T04:06:34.391 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/32 file after the snapshot 2024-08-31T04:06:34.393 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/33 file after the snapshot 2024-08-31T04:06:34.396 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/34 file after the snapshot 2024-08-31T04:06:34.398 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/35 file after the snapshot 2024-08-31T04:06:34.401 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/36 file after the snapshot 2024-08-31T04:06:34.404 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/37 file after the snapshot 2024-08-31T04:06:34.406 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/38 file after the snapshot 2024-08-31T04:06:34.409 INFO:tasks.workunit.client.0.smithi089.stdout: create 218/39 file after the snapshot 2024-08-31T04:06:34.411 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/.snap/snap-subdir-test 2024-08-31T04:06:34.452 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/30 file after the snapshot 2024-08-31T04:06:34.454 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/31 file after the snapshot 2024-08-31T04:06:34.457 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/32 file after the snapshot 2024-08-31T04:06:34.460 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/33 file after the snapshot 2024-08-31T04:06:34.462 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/34 file after the snapshot 2024-08-31T04:06:34.465 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/35 file after the snapshot 2024-08-31T04:06:34.468 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/36 file after the snapshot 2024-08-31T04:06:34.470 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/37 file after the snapshot 2024-08-31T04:06:34.473 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/38 file after the snapshot 2024-08-31T04:06:34.476 INFO:tasks.workunit.client.0.smithi089.stdout: create 219/39 file after the snapshot 2024-08-31T04:06:34.479 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/.snap/snap-subdir-test 2024-08-31T04:06:34.508 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/30 file after the snapshot 2024-08-31T04:06:34.511 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/31 file after the snapshot 2024-08-31T04:06:34.513 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/32 file after the snapshot 2024-08-31T04:06:34.516 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/33 file after the snapshot 2024-08-31T04:06:34.519 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/34 file after the snapshot 2024-08-31T04:06:34.521 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/35 file after the snapshot 2024-08-31T04:06:34.524 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/36 file after the snapshot 2024-08-31T04:06:34.527 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/37 file after the snapshot 2024-08-31T04:06:34.529 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/38 file after the snapshot 2024-08-31T04:06:34.532 INFO:tasks.workunit.client.0.smithi089.stdout: create 220/39 file after the snapshot 2024-08-31T04:06:34.534 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/.snap/snap-subdir-test 2024-08-31T04:06:34.573 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/30 file after the snapshot 2024-08-31T04:06:34.576 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/31 file after the snapshot 2024-08-31T04:06:34.578 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/32 file after the snapshot 2024-08-31T04:06:34.581 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/33 file after the snapshot 2024-08-31T04:06:34.584 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/34 file after the snapshot 2024-08-31T04:06:34.586 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/35 file after the snapshot 2024-08-31T04:06:34.589 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/36 file after the snapshot 2024-08-31T04:06:34.591 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/37 file after the snapshot 2024-08-31T04:06:34.594 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/38 file after the snapshot 2024-08-31T04:06:34.597 INFO:tasks.workunit.client.0.smithi089.stdout: create 221/39 file after the snapshot 2024-08-31T04:06:34.599 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/.snap/snap-subdir-test 2024-08-31T04:06:34.629 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/30 file after the snapshot 2024-08-31T04:06:34.632 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/31 file after the snapshot 2024-08-31T04:06:34.634 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/32 file after the snapshot 2024-08-31T04:06:34.637 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/33 file after the snapshot 2024-08-31T04:06:34.640 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/34 file after the snapshot 2024-08-31T04:06:34.642 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/35 file after the snapshot 2024-08-31T04:06:34.645 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/36 file after the snapshot 2024-08-31T04:06:34.647 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/37 file after the snapshot 2024-08-31T04:06:34.650 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/38 file after the snapshot 2024-08-31T04:06:34.653 INFO:tasks.workunit.client.0.smithi089.stdout: create 222/39 file after the snapshot 2024-08-31T04:06:34.655 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/.snap/snap-subdir-test 2024-08-31T04:06:34.685 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/30 file after the snapshot 2024-08-31T04:06:34.687 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/31 file after the snapshot 2024-08-31T04:06:34.690 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/32 file after the snapshot 2024-08-31T04:06:34.693 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/33 file after the snapshot 2024-08-31T04:06:34.695 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/34 file after the snapshot 2024-08-31T04:06:34.699 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/35 file after the snapshot 2024-08-31T04:06:34.701 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/36 file after the snapshot 2024-08-31T04:06:34.704 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/37 file after the snapshot 2024-08-31T04:06:34.706 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/38 file after the snapshot 2024-08-31T04:06:34.709 INFO:tasks.workunit.client.0.smithi089.stdout: create 223/39 file after the snapshot 2024-08-31T04:06:34.712 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/.snap/snap-subdir-test 2024-08-31T04:06:34.741 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/30 file after the snapshot 2024-08-31T04:06:34.744 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/31 file after the snapshot 2024-08-31T04:06:34.746 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/32 file after the snapshot 2024-08-31T04:06:34.749 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/33 file after the snapshot 2024-08-31T04:06:34.752 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/34 file after the snapshot 2024-08-31T04:06:34.755 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/35 file after the snapshot 2024-08-31T04:06:34.757 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/36 file after the snapshot 2024-08-31T04:06:34.760 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/37 file after the snapshot 2024-08-31T04:06:34.762 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/38 file after the snapshot 2024-08-31T04:06:34.765 INFO:tasks.workunit.client.0.smithi089.stdout: create 224/39 file after the snapshot 2024-08-31T04:06:34.768 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/.snap/snap-subdir-test 2024-08-31T04:06:34.797 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/30 file after the snapshot 2024-08-31T04:06:34.800 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/31 file after the snapshot 2024-08-31T04:06:34.802 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/32 file after the snapshot 2024-08-31T04:06:34.805 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/33 file after the snapshot 2024-08-31T04:06:34.807 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/34 file after the snapshot 2024-08-31T04:06:34.810 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/35 file after the snapshot 2024-08-31T04:06:34.813 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/36 file after the snapshot 2024-08-31T04:06:34.815 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/37 file after the snapshot 2024-08-31T04:06:34.818 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/38 file after the snapshot 2024-08-31T04:06:34.821 INFO:tasks.workunit.client.0.smithi089.stdout: create 225/39 file after the snapshot 2024-08-31T04:06:34.823 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/.snap/snap-subdir-test 2024-08-31T04:06:34.854 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/30 file after the snapshot 2024-08-31T04:06:34.856 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/31 file after the snapshot 2024-08-31T04:06:34.859 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/32 file after the snapshot 2024-08-31T04:06:34.861 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/33 file after the snapshot 2024-08-31T04:06:34.864 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/34 file after the snapshot 2024-08-31T04:06:34.867 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/35 file after the snapshot 2024-08-31T04:06:34.870 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/36 file after the snapshot 2024-08-31T04:06:34.872 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/37 file after the snapshot 2024-08-31T04:06:34.875 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/38 file after the snapshot 2024-08-31T04:06:34.880 INFO:tasks.workunit.client.0.smithi089.stdout: create 226/39 file after the snapshot 2024-08-31T04:06:34.881 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/.snap/snap-subdir-test 2024-08-31T04:06:35.901 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/30 file after the snapshot 2024-08-31T04:06:35.904 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/31 file after the snapshot 2024-08-31T04:06:35.907 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/32 file after the snapshot 2024-08-31T04:06:35.911 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/33 file after the snapshot 2024-08-31T04:06:35.914 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/34 file after the snapshot 2024-08-31T04:06:35.916 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/35 file after the snapshot 2024-08-31T04:06:35.920 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/36 file after the snapshot 2024-08-31T04:06:35.923 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/37 file after the snapshot 2024-08-31T04:06:35.925 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/38 file after the snapshot 2024-08-31T04:06:35.928 INFO:tasks.workunit.client.0.smithi089.stdout: create 227/39 file after the snapshot 2024-08-31T04:06:35.931 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/.snap/snap-subdir-test 2024-08-31T04:06:35.959 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/30 file after the snapshot 2024-08-31T04:06:35.962 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/31 file after the snapshot 2024-08-31T04:06:35.964 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/32 file after the snapshot 2024-08-31T04:06:35.967 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/33 file after the snapshot 2024-08-31T04:06:35.970 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/34 file after the snapshot 2024-08-31T04:06:35.973 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/35 file after the snapshot 2024-08-31T04:06:35.975 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/36 file after the snapshot 2024-08-31T04:06:35.978 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/37 file after the snapshot 2024-08-31T04:06:35.981 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/38 file after the snapshot 2024-08-31T04:06:35.984 INFO:tasks.workunit.client.0.smithi089.stdout: create 228/39 file after the snapshot 2024-08-31T04:06:35.986 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/.snap/snap-subdir-test 2024-08-31T04:06:36.026 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/30 file after the snapshot 2024-08-31T04:06:36.028 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/31 file after the snapshot 2024-08-31T04:06:36.032 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/32 file after the snapshot 2024-08-31T04:06:36.034 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/33 file after the snapshot 2024-08-31T04:06:36.037 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/34 file after the snapshot 2024-08-31T04:06:36.039 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/35 file after the snapshot 2024-08-31T04:06:36.042 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/36 file after the snapshot 2024-08-31T04:06:36.045 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/37 file after the snapshot 2024-08-31T04:06:36.048 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/38 file after the snapshot 2024-08-31T04:06:36.051 INFO:tasks.workunit.client.0.smithi089.stdout: create 229/39 file after the snapshot 2024-08-31T04:06:36.053 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/.snap/snap-subdir-test 2024-08-31T04:06:36.085 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/30 file after the snapshot 2024-08-31T04:06:36.087 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/31 file after the snapshot 2024-08-31T04:06:36.090 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/32 file after the snapshot 2024-08-31T04:06:36.093 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/33 file after the snapshot 2024-08-31T04:06:36.096 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/34 file after the snapshot 2024-08-31T04:06:36.098 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/35 file after the snapshot 2024-08-31T04:06:36.101 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/36 file after the snapshot 2024-08-31T04:06:36.103 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/37 file after the snapshot 2024-08-31T04:06:36.106 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/38 file after the snapshot 2024-08-31T04:06:36.109 INFO:tasks.workunit.client.0.smithi089.stdout: create 230/39 file after the snapshot 2024-08-31T04:06:36.111 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/.snap/snap-subdir-test 2024-08-31T04:06:36.142 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/30 file after the snapshot 2024-08-31T04:06:36.144 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/31 file after the snapshot 2024-08-31T04:06:36.147 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/32 file after the snapshot 2024-08-31T04:06:36.150 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/33 file after the snapshot 2024-08-31T04:06:36.152 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/34 file after the snapshot 2024-08-31T04:06:36.155 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/35 file after the snapshot 2024-08-31T04:06:36.158 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/36 file after the snapshot 2024-08-31T04:06:36.161 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/37 file after the snapshot 2024-08-31T04:06:36.163 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/38 file after the snapshot 2024-08-31T04:06:36.166 INFO:tasks.workunit.client.0.smithi089.stdout: create 231/39 file after the snapshot 2024-08-31T04:06:36.169 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/.snap/snap-subdir-test 2024-08-31T04:06:36.199 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/30 file after the snapshot 2024-08-31T04:06:36.203 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/31 file after the snapshot 2024-08-31T04:06:36.205 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/32 file after the snapshot 2024-08-31T04:06:36.208 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/33 file after the snapshot 2024-08-31T04:06:36.211 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/34 file after the snapshot 2024-08-31T04:06:36.213 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/35 file after the snapshot 2024-08-31T04:06:36.216 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/36 file after the snapshot 2024-08-31T04:06:36.219 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/37 file after the snapshot 2024-08-31T04:06:36.221 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/38 file after the snapshot 2024-08-31T04:06:36.224 INFO:tasks.workunit.client.0.smithi089.stdout: create 232/39 file after the snapshot 2024-08-31T04:06:36.553 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/.snap/snap-subdir-test 2024-08-31T04:06:36.583 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/30 file after the snapshot 2024-08-31T04:06:36.586 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/31 file after the snapshot 2024-08-31T04:06:36.589 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/32 file after the snapshot 2024-08-31T04:06:36.591 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/33 file after the snapshot 2024-08-31T04:06:36.594 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/34 file after the snapshot 2024-08-31T04:06:36.597 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/35 file after the snapshot 2024-08-31T04:06:36.600 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/36 file after the snapshot 2024-08-31T04:06:36.602 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/37 file after the snapshot 2024-08-31T04:06:36.605 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/38 file after the snapshot 2024-08-31T04:06:36.608 INFO:tasks.workunit.client.0.smithi089.stdout: create 233/39 file after the snapshot 2024-08-31T04:06:36.610 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/.snap/snap-subdir-test 2024-08-31T04:06:36.641 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/30 file after the snapshot 2024-08-31T04:06:36.644 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/31 file after the snapshot 2024-08-31T04:06:36.647 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/32 file after the snapshot 2024-08-31T04:06:36.649 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/33 file after the snapshot 2024-08-31T04:06:36.652 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/34 file after the snapshot 2024-08-31T04:06:36.655 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/35 file after the snapshot 2024-08-31T04:06:36.658 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/36 file after the snapshot 2024-08-31T04:06:36.662 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/37 file after the snapshot 2024-08-31T04:06:36.664 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/38 file after the snapshot 2024-08-31T04:06:36.667 INFO:tasks.workunit.client.0.smithi089.stdout: create 234/39 file after the snapshot 2024-08-31T04:06:36.669 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/.snap/snap-subdir-test 2024-08-31T04:06:36.700 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/30 file after the snapshot 2024-08-31T04:06:36.703 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/31 file after the snapshot 2024-08-31T04:06:36.706 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/32 file after the snapshot 2024-08-31T04:06:36.708 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/33 file after the snapshot 2024-08-31T04:06:36.711 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/34 file after the snapshot 2024-08-31T04:06:36.714 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/35 file after the snapshot 2024-08-31T04:06:36.716 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/36 file after the snapshot 2024-08-31T04:06:36.720 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/37 file after the snapshot 2024-08-31T04:06:36.722 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/38 file after the snapshot 2024-08-31T04:06:36.725 INFO:tasks.workunit.client.0.smithi089.stdout: create 235/39 file after the snapshot 2024-08-31T04:06:36.727 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/.snap/snap-subdir-test 2024-08-31T04:06:37.428 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/30 file after the snapshot 2024-08-31T04:06:37.432 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/31 file after the snapshot 2024-08-31T04:06:37.437 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/32 file after the snapshot 2024-08-31T04:06:37.441 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/33 file after the snapshot 2024-08-31T04:06:37.695 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/34 file after the snapshot 2024-08-31T04:06:37.699 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/35 file after the snapshot 2024-08-31T04:06:37.703 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/36 file after the snapshot 2024-08-31T04:06:37.706 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/37 file after the snapshot 2024-08-31T04:06:37.709 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/38 file after the snapshot 2024-08-31T04:06:37.711 INFO:tasks.workunit.client.0.smithi089.stdout: create 236/39 file after the snapshot 2024-08-31T04:06:37.714 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/.snap/snap-subdir-test 2024-08-31T04:06:37.744 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/30 file after the snapshot 2024-08-31T04:06:37.748 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/31 file after the snapshot 2024-08-31T04:06:37.752 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/32 file after the snapshot 2024-08-31T04:06:37.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/33 file after the snapshot 2024-08-31T04:06:37.760 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/34 file after the snapshot 2024-08-31T04:06:37.764 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/35 file after the snapshot 2024-08-31T04:06:37.769 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/36 file after the snapshot 2024-08-31T04:06:37.773 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/37 file after the snapshot 2024-08-31T04:06:37.777 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/38 file after the snapshot 2024-08-31T04:06:37.781 INFO:tasks.workunit.client.0.smithi089.stdout: create 237/39 file after the snapshot 2024-08-31T04:06:37.785 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/.snap/snap-subdir-test 2024-08-31T04:06:37.819 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/30 file after the snapshot 2024-08-31T04:06:37.823 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/31 file after the snapshot 2024-08-31T04:06:37.828 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/32 file after the snapshot 2024-08-31T04:06:37.832 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/33 file after the snapshot 2024-08-31T04:06:37.836 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/34 file after the snapshot 2024-08-31T04:06:37.840 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/35 file after the snapshot 2024-08-31T04:06:37.844 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/36 file after the snapshot 2024-08-31T04:06:37.848 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/37 file after the snapshot 2024-08-31T04:06:37.853 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/38 file after the snapshot 2024-08-31T04:06:37.855 INFO:tasks.workunit.client.0.smithi089.stdout: create 238/39 file after the snapshot 2024-08-31T04:06:37.857 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/.snap/snap-subdir-test 2024-08-31T04:06:37.888 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/30 file after the snapshot 2024-08-31T04:06:37.890 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/31 file after the snapshot 2024-08-31T04:06:37.893 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/32 file after the snapshot 2024-08-31T04:06:37.896 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/33 file after the snapshot 2024-08-31T04:06:37.899 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/34 file after the snapshot 2024-08-31T04:06:37.901 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/35 file after the snapshot 2024-08-31T04:06:37.904 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/36 file after the snapshot 2024-08-31T04:06:37.907 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/37 file after the snapshot 2024-08-31T04:06:37.910 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/38 file after the snapshot 2024-08-31T04:06:37.913 INFO:tasks.workunit.client.0.smithi089.stdout: create 239/39 file after the snapshot 2024-08-31T04:06:37.915 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/.snap/snap-subdir-test 2024-08-31T04:06:37.946 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/30 file after the snapshot 2024-08-31T04:06:37.948 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/31 file after the snapshot 2024-08-31T04:06:37.951 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/32 file after the snapshot 2024-08-31T04:06:37.953 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/33 file after the snapshot 2024-08-31T04:06:37.956 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/34 file after the snapshot 2024-08-31T04:06:37.959 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/35 file after the snapshot 2024-08-31T04:06:37.961 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/36 file after the snapshot 2024-08-31T04:06:37.964 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/37 file after the snapshot 2024-08-31T04:06:37.968 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/38 file after the snapshot 2024-08-31T04:06:37.971 INFO:tasks.workunit.client.0.smithi089.stdout: create 240/39 file after the snapshot 2024-08-31T04:06:37.973 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/.snap/snap-subdir-test 2024-08-31T04:06:38.004 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/30 file after the snapshot 2024-08-31T04:06:38.006 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/31 file after the snapshot 2024-08-31T04:06:38.009 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/32 file after the snapshot 2024-08-31T04:06:38.012 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/33 file after the snapshot 2024-08-31T04:06:38.014 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/34 file after the snapshot 2024-08-31T04:06:38.017 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/35 file after the snapshot 2024-08-31T04:06:38.020 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/36 file after the snapshot 2024-08-31T04:06:38.023 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/37 file after the snapshot 2024-08-31T04:06:38.026 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/38 file after the snapshot 2024-08-31T04:06:38.028 INFO:tasks.workunit.client.0.smithi089.stdout: create 241/39 file after the snapshot 2024-08-31T04:06:38.031 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/.snap/snap-subdir-test 2024-08-31T04:06:38.065 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/30 file after the snapshot 2024-08-31T04:06:38.067 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/31 file after the snapshot 2024-08-31T04:06:38.070 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/32 file after the snapshot 2024-08-31T04:06:38.073 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/33 file after the snapshot 2024-08-31T04:06:38.075 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/34 file after the snapshot 2024-08-31T04:06:38.078 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/35 file after the snapshot 2024-08-31T04:06:38.081 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/36 file after the snapshot 2024-08-31T04:06:38.084 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/37 file after the snapshot 2024-08-31T04:06:38.086 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/38 file after the snapshot 2024-08-31T04:06:38.088 INFO:tasks.workunit.client.0.smithi089.stdout: create 242/39 file after the snapshot 2024-08-31T04:06:38.090 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/.snap/snap-subdir-test 2024-08-31T04:06:38.123 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/30 file after the snapshot 2024-08-31T04:06:38.125 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/31 file after the snapshot 2024-08-31T04:06:38.128 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/32 file after the snapshot 2024-08-31T04:06:38.131 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/33 file after the snapshot 2024-08-31T04:06:38.133 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/34 file after the snapshot 2024-08-31T04:06:38.136 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/35 file after the snapshot 2024-08-31T04:06:38.139 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/36 file after the snapshot 2024-08-31T04:06:38.141 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/37 file after the snapshot 2024-08-31T04:06:38.144 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/38 file after the snapshot 2024-08-31T04:06:38.147 INFO:tasks.workunit.client.0.smithi089.stdout: create 243/39 file after the snapshot 2024-08-31T04:06:38.150 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/.snap/snap-subdir-test 2024-08-31T04:06:38.185 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/30 file after the snapshot 2024-08-31T04:06:38.188 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/31 file after the snapshot 2024-08-31T04:06:38.191 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/32 file after the snapshot 2024-08-31T04:06:38.193 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/33 file after the snapshot 2024-08-31T04:06:38.196 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/34 file after the snapshot 2024-08-31T04:06:38.199 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/35 file after the snapshot 2024-08-31T04:06:38.201 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/36 file after the snapshot 2024-08-31T04:06:38.204 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/37 file after the snapshot 2024-08-31T04:06:38.207 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/38 file after the snapshot 2024-08-31T04:06:38.210 INFO:tasks.workunit.client.0.smithi089.stdout: create 244/39 file after the snapshot 2024-08-31T04:06:38.213 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/.snap/snap-subdir-test 2024-08-31T04:06:38.242 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/30 file after the snapshot 2024-08-31T04:06:38.245 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/31 file after the snapshot 2024-08-31T04:06:38.248 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/32 file after the snapshot 2024-08-31T04:06:38.579 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/33 file after the snapshot 2024-08-31T04:06:38.616 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/34 file after the snapshot 2024-08-31T04:06:38.618 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/35 file after the snapshot 2024-08-31T04:06:38.621 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/36 file after the snapshot 2024-08-31T04:06:38.624 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/37 file after the snapshot 2024-08-31T04:06:38.626 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/38 file after the snapshot 2024-08-31T04:06:38.629 INFO:tasks.workunit.client.0.smithi089.stdout: create 245/39 file after the snapshot 2024-08-31T04:06:38.631 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/.snap/snap-subdir-test 2024-08-31T04:06:38.671 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/30 file after the snapshot 2024-08-31T04:06:38.673 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/31 file after the snapshot 2024-08-31T04:06:38.676 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/32 file after the snapshot 2024-08-31T04:06:38.679 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/33 file after the snapshot 2024-08-31T04:06:38.681 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/34 file after the snapshot 2024-08-31T04:06:38.684 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/35 file after the snapshot 2024-08-31T04:06:38.686 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/36 file after the snapshot 2024-08-31T04:06:38.689 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/37 file after the snapshot 2024-08-31T04:06:38.692 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/38 file after the snapshot 2024-08-31T04:06:38.695 INFO:tasks.workunit.client.0.smithi089.stdout: create 246/39 file after the snapshot 2024-08-31T04:06:38.697 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/.snap/snap-subdir-test 2024-08-31T04:06:38.729 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/30 file after the snapshot 2024-08-31T04:06:38.731 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/31 file after the snapshot 2024-08-31T04:06:38.734 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/32 file after the snapshot 2024-08-31T04:06:38.737 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/33 file after the snapshot 2024-08-31T04:06:38.739 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/34 file after the snapshot 2024-08-31T04:06:38.742 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/35 file after the snapshot 2024-08-31T04:06:38.745 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/36 file after the snapshot 2024-08-31T04:06:38.747 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/37 file after the snapshot 2024-08-31T04:06:38.750 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/38 file after the snapshot 2024-08-31T04:06:38.753 INFO:tasks.workunit.client.0.smithi089.stdout: create 247/39 file after the snapshot 2024-08-31T04:06:38.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/.snap/snap-subdir-test 2024-08-31T04:06:38.786 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/30 file after the snapshot 2024-08-31T04:06:38.789 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/31 file after the snapshot 2024-08-31T04:06:38.792 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/32 file after the snapshot 2024-08-31T04:06:38.795 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/33 file after the snapshot 2024-08-31T04:06:38.797 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/34 file after the snapshot 2024-08-31T04:06:38.800 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/35 file after the snapshot 2024-08-31T04:06:38.803 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/36 file after the snapshot 2024-08-31T04:06:38.805 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/37 file after the snapshot 2024-08-31T04:06:38.808 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/38 file after the snapshot 2024-08-31T04:06:38.811 INFO:tasks.workunit.client.0.smithi089.stdout: create 248/39 file after the snapshot 2024-08-31T04:06:38.814 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/.snap/snap-subdir-test 2024-08-31T04:06:38.846 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/30 file after the snapshot 2024-08-31T04:06:38.849 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/31 file after the snapshot 2024-08-31T04:06:38.852 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/32 file after the snapshot 2024-08-31T04:06:38.854 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/33 file after the snapshot 2024-08-31T04:06:38.857 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/34 file after the snapshot 2024-08-31T04:06:38.860 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/35 file after the snapshot 2024-08-31T04:06:38.863 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/36 file after the snapshot 2024-08-31T04:06:38.865 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/37 file after the snapshot 2024-08-31T04:06:38.868 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/38 file after the snapshot 2024-08-31T04:06:38.871 INFO:tasks.workunit.client.0.smithi089.stdout: create 249/39 file after the snapshot 2024-08-31T04:06:38.874 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/.snap/snap-subdir-test 2024-08-31T04:06:38.905 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/30 file after the snapshot 2024-08-31T04:06:38.907 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/31 file after the snapshot 2024-08-31T04:06:38.910 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/32 file after the snapshot 2024-08-31T04:06:38.913 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/33 file after the snapshot 2024-08-31T04:06:38.915 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/34 file after the snapshot 2024-08-31T04:06:38.918 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/35 file after the snapshot 2024-08-31T04:06:38.921 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/36 file after the snapshot 2024-08-31T04:06:38.924 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/37 file after the snapshot 2024-08-31T04:06:38.927 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/38 file after the snapshot 2024-08-31T04:06:38.929 INFO:tasks.workunit.client.0.smithi089.stdout: create 250/39 file after the snapshot 2024-08-31T04:06:38.932 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/.snap/snap-subdir-test 2024-08-31T04:06:39.574 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/30 file after the snapshot 2024-08-31T04:06:39.576 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/31 file after the snapshot 2024-08-31T04:06:39.579 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/32 file after the snapshot 2024-08-31T04:06:39.581 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/33 file after the snapshot 2024-08-31T04:06:39.584 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/34 file after the snapshot 2024-08-31T04:06:39.587 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/35 file after the snapshot 2024-08-31T04:06:39.589 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/36 file after the snapshot 2024-08-31T04:06:39.592 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/37 file after the snapshot 2024-08-31T04:06:39.595 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/38 file after the snapshot 2024-08-31T04:06:39.597 INFO:tasks.workunit.client.0.smithi089.stdout: create 251/39 file after the snapshot 2024-08-31T04:06:39.600 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/.snap/snap-subdir-test 2024-08-31T04:06:39.630 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/30 file after the snapshot 2024-08-31T04:06:39.633 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/31 file after the snapshot 2024-08-31T04:06:39.636 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/32 file after the snapshot 2024-08-31T04:06:39.638 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/33 file after the snapshot 2024-08-31T04:06:39.641 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/34 file after the snapshot 2024-08-31T04:06:39.643 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/35 file after the snapshot 2024-08-31T04:06:39.646 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/36 file after the snapshot 2024-08-31T04:06:39.649 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/37 file after the snapshot 2024-08-31T04:06:39.651 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/38 file after the snapshot 2024-08-31T04:06:39.654 INFO:tasks.workunit.client.0.smithi089.stdout: create 252/39 file after the snapshot 2024-08-31T04:06:39.656 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/.snap/snap-subdir-test 2024-08-31T04:06:39.688 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/30 file after the snapshot 2024-08-31T04:06:39.691 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/31 file after the snapshot 2024-08-31T04:06:39.694 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/32 file after the snapshot 2024-08-31T04:06:39.696 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/33 file after the snapshot 2024-08-31T04:06:39.699 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/34 file after the snapshot 2024-08-31T04:06:39.702 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/35 file after the snapshot 2024-08-31T04:06:39.704 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/36 file after the snapshot 2024-08-31T04:06:39.707 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/37 file after the snapshot 2024-08-31T04:06:39.710 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/38 file after the snapshot 2024-08-31T04:06:39.712 INFO:tasks.workunit.client.0.smithi089.stdout: create 253/39 file after the snapshot 2024-08-31T04:06:39.715 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/.snap/snap-subdir-test 2024-08-31T04:06:39.746 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/30 file after the snapshot 2024-08-31T04:06:39.748 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/31 file after the snapshot 2024-08-31T04:06:39.751 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/32 file after the snapshot 2024-08-31T04:06:39.753 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/33 file after the snapshot 2024-08-31T04:06:39.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/34 file after the snapshot 2024-08-31T04:06:39.759 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/35 file after the snapshot 2024-08-31T04:06:39.761 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/36 file after the snapshot 2024-08-31T04:06:39.764 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/37 file after the snapshot 2024-08-31T04:06:39.767 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/38 file after the snapshot 2024-08-31T04:06:39.769 INFO:tasks.workunit.client.0.smithi089.stdout: create 254/39 file after the snapshot 2024-08-31T04:06:39.772 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/.snap/snap-subdir-test 2024-08-31T04:06:39.803 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/30 file after the snapshot 2024-08-31T04:06:39.805 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/31 file after the snapshot 2024-08-31T04:06:39.808 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/32 file after the snapshot 2024-08-31T04:06:39.810 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/33 file after the snapshot 2024-08-31T04:06:39.813 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/34 file after the snapshot 2024-08-31T04:06:39.816 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/35 file after the snapshot 2024-08-31T04:06:39.818 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/36 file after the snapshot 2024-08-31T04:06:39.821 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/37 file after the snapshot 2024-08-31T04:06:39.824 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/38 file after the snapshot 2024-08-31T04:06:39.826 INFO:tasks.workunit.client.0.smithi089.stdout: create 255/39 file after the snapshot 2024-08-31T04:06:39.829 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/.snap/snap-subdir-test 2024-08-31T04:06:39.862 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/30 file after the snapshot 2024-08-31T04:06:39.864 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/31 file after the snapshot 2024-08-31T04:06:39.866 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/32 file after the snapshot 2024-08-31T04:06:39.869 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/33 file after the snapshot 2024-08-31T04:06:39.871 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/34 file after the snapshot 2024-08-31T04:06:39.873 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/35 file after the snapshot 2024-08-31T04:06:39.876 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/36 file after the snapshot 2024-08-31T04:06:39.878 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/37 file after the snapshot 2024-08-31T04:06:39.880 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/38 file after the snapshot 2024-08-31T04:06:39.882 INFO:tasks.workunit.client.0.smithi089.stdout: create 256/39 file after the snapshot 2024-08-31T04:06:39.885 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/.snap/snap-subdir-test 2024-08-31T04:06:39.915 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/30 file after the snapshot 2024-08-31T04:06:39.917 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/31 file after the snapshot 2024-08-31T04:06:39.919 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/32 file after the snapshot 2024-08-31T04:06:39.921 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/33 file after the snapshot 2024-08-31T04:06:39.923 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/34 file after the snapshot 2024-08-31T04:06:39.925 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/35 file after the snapshot 2024-08-31T04:06:39.927 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/36 file after the snapshot 2024-08-31T04:06:39.929 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/37 file after the snapshot 2024-08-31T04:06:39.931 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/38 file after the snapshot 2024-08-31T04:06:39.933 INFO:tasks.workunit.client.0.smithi089.stdout: create 257/39 file after the snapshot 2024-08-31T04:06:39.935 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/.snap/snap-subdir-test 2024-08-31T04:06:39.966 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/30 file after the snapshot 2024-08-31T04:06:39.968 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/31 file after the snapshot 2024-08-31T04:06:39.971 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/32 file after the snapshot 2024-08-31T04:06:39.973 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/33 file after the snapshot 2024-08-31T04:06:39.976 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/34 file after the snapshot 2024-08-31T04:06:39.979 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/35 file after the snapshot 2024-08-31T04:06:39.981 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/36 file after the snapshot 2024-08-31T04:06:39.984 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/37 file after the snapshot 2024-08-31T04:06:39.986 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/38 file after the snapshot 2024-08-31T04:06:39.989 INFO:tasks.workunit.client.0.smithi089.stdout: create 258/39 file after the snapshot 2024-08-31T04:06:39.992 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/.snap/snap-subdir-test 2024-08-31T04:06:40.027 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/30 file after the snapshot 2024-08-31T04:06:40.029 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/31 file after the snapshot 2024-08-31T04:06:40.033 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/32 file after the snapshot 2024-08-31T04:06:40.036 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/33 file after the snapshot 2024-08-31T04:06:40.038 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/34 file after the snapshot 2024-08-31T04:06:40.041 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/35 file after the snapshot 2024-08-31T04:06:40.044 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/36 file after the snapshot 2024-08-31T04:06:40.046 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/37 file after the snapshot 2024-08-31T04:06:40.049 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/38 file after the snapshot 2024-08-31T04:06:40.052 INFO:tasks.workunit.client.0.smithi089.stdout: create 259/39 file after the snapshot 2024-08-31T04:06:40.055 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/.snap/snap-subdir-test 2024-08-31T04:06:40.086 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/30 file after the snapshot 2024-08-31T04:06:40.088 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/31 file after the snapshot 2024-08-31T04:06:40.091 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/32 file after the snapshot 2024-08-31T04:06:40.094 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/33 file after the snapshot 2024-08-31T04:06:40.097 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/34 file after the snapshot 2024-08-31T04:06:40.099 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/35 file after the snapshot 2024-08-31T04:06:40.102 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/36 file after the snapshot 2024-08-31T04:06:40.104 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/37 file after the snapshot 2024-08-31T04:06:40.107 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/38 file after the snapshot 2024-08-31T04:06:40.110 INFO:tasks.workunit.client.0.smithi089.stdout: create 260/39 file after the snapshot 2024-08-31T04:06:40.113 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/.snap/snap-subdir-test 2024-08-31T04:06:40.142 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/30 file after the snapshot 2024-08-31T04:06:40.144 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/31 file after the snapshot 2024-08-31T04:06:40.147 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/32 file after the snapshot 2024-08-31T04:06:40.150 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/33 file after the snapshot 2024-08-31T04:06:40.152 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/34 file after the snapshot 2024-08-31T04:06:40.155 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/35 file after the snapshot 2024-08-31T04:06:40.158 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/36 file after the snapshot 2024-08-31T04:06:40.161 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/37 file after the snapshot 2024-08-31T04:06:40.163 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/38 file after the snapshot 2024-08-31T04:06:40.166 INFO:tasks.workunit.client.0.smithi089.stdout: create 261/39 file after the snapshot 2024-08-31T04:06:40.168 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/.snap/snap-subdir-test 2024-08-31T04:06:40.199 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/30 file after the snapshot 2024-08-31T04:06:40.202 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/31 file after the snapshot 2024-08-31T04:06:40.206 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/32 file after the snapshot 2024-08-31T04:06:40.210 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/33 file after the snapshot 2024-08-31T04:06:40.214 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/34 file after the snapshot 2024-08-31T04:06:40.218 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/35 file after the snapshot 2024-08-31T04:06:40.223 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/36 file after the snapshot 2024-08-31T04:06:40.227 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/37 file after the snapshot 2024-08-31T04:06:40.231 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/38 file after the snapshot 2024-08-31T04:06:40.235 INFO:tasks.workunit.client.0.smithi089.stdout: create 262/39 file after the snapshot 2024-08-31T04:06:40.239 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/.snap/snap-subdir-test 2024-08-31T04:06:40.269 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/30 file after the snapshot 2024-08-31T04:06:40.273 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/31 file after the snapshot 2024-08-31T04:06:40.277 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/32 file after the snapshot 2024-08-31T04:06:40.281 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/33 file after the snapshot 2024-08-31T04:06:40.285 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/34 file after the snapshot 2024-08-31T04:06:40.288 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/35 file after the snapshot 2024-08-31T04:06:40.292 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/36 file after the snapshot 2024-08-31T04:06:40.296 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/37 file after the snapshot 2024-08-31T04:06:40.300 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/38 file after the snapshot 2024-08-31T04:06:40.303 INFO:tasks.workunit.client.0.smithi089.stdout: create 263/39 file after the snapshot 2024-08-31T04:06:40.305 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/.snap/snap-subdir-test 2024-08-31T04:06:40.345 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/30 file after the snapshot 2024-08-31T04:06:40.348 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/31 file after the snapshot 2024-08-31T04:06:40.350 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/32 file after the snapshot 2024-08-31T04:06:40.353 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/33 file after the snapshot 2024-08-31T04:06:40.356 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/34 file after the snapshot 2024-08-31T04:06:40.358 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/35 file after the snapshot 2024-08-31T04:06:40.361 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/36 file after the snapshot 2024-08-31T04:06:40.363 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/37 file after the snapshot 2024-08-31T04:06:40.366 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/38 file after the snapshot 2024-08-31T04:06:40.369 INFO:tasks.workunit.client.0.smithi089.stdout: create 264/39 file after the snapshot 2024-08-31T04:06:40.372 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/.snap/snap-subdir-test 2024-08-31T04:06:40.406 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/30 file after the snapshot 2024-08-31T04:06:40.409 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/31 file after the snapshot 2024-08-31T04:06:40.411 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/32 file after the snapshot 2024-08-31T04:06:40.414 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/33 file after the snapshot 2024-08-31T04:06:40.417 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/34 file after the snapshot 2024-08-31T04:06:40.419 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/35 file after the snapshot 2024-08-31T04:06:40.422 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/36 file after the snapshot 2024-08-31T04:06:40.425 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/37 file after the snapshot 2024-08-31T04:06:40.427 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/38 file after the snapshot 2024-08-31T04:06:40.430 INFO:tasks.workunit.client.0.smithi089.stdout: create 265/39 file after the snapshot 2024-08-31T04:06:40.433 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/.snap/snap-subdir-test 2024-08-31T04:06:40.470 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/30 file after the snapshot 2024-08-31T04:06:40.472 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/31 file after the snapshot 2024-08-31T04:06:40.474 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/32 file after the snapshot 2024-08-31T04:06:40.477 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/33 file after the snapshot 2024-08-31T04:06:40.479 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/34 file after the snapshot 2024-08-31T04:06:40.482 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/35 file after the snapshot 2024-08-31T04:06:40.484 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/36 file after the snapshot 2024-08-31T04:06:40.487 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/37 file after the snapshot 2024-08-31T04:06:40.489 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/38 file after the snapshot 2024-08-31T04:06:40.492 INFO:tasks.workunit.client.0.smithi089.stdout: create 266/39 file after the snapshot 2024-08-31T04:06:40.494 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/.snap/snap-subdir-test 2024-08-31T04:06:40.522 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/30 file after the snapshot 2024-08-31T04:06:40.524 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/31 file after the snapshot 2024-08-31T04:06:40.527 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/32 file after the snapshot 2024-08-31T04:06:40.530 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/33 file after the snapshot 2024-08-31T04:06:40.532 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/34 file after the snapshot 2024-08-31T04:06:40.535 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/35 file after the snapshot 2024-08-31T04:06:40.537 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/36 file after the snapshot 2024-08-31T04:06:40.540 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/37 file after the snapshot 2024-08-31T04:06:40.543 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/38 file after the snapshot 2024-08-31T04:06:40.546 INFO:tasks.workunit.client.0.smithi089.stdout: create 267/39 file after the snapshot 2024-08-31T04:06:40.548 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/.snap/snap-subdir-test 2024-08-31T04:06:40.576 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/30 file after the snapshot 2024-08-31T04:06:40.578 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/31 file after the snapshot 2024-08-31T04:06:40.581 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/32 file after the snapshot 2024-08-31T04:06:40.583 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/33 file after the snapshot 2024-08-31T04:06:40.586 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/34 file after the snapshot 2024-08-31T04:06:40.588 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/35 file after the snapshot 2024-08-31T04:06:40.591 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/36 file after the snapshot 2024-08-31T04:06:40.593 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/37 file after the snapshot 2024-08-31T04:06:40.596 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/38 file after the snapshot 2024-08-31T04:06:40.600 INFO:tasks.workunit.client.0.smithi089.stdout: create 268/39 file after the snapshot 2024-08-31T04:06:40.601 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/.snap/snap-subdir-test 2024-08-31T04:06:40.631 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/30 file after the snapshot 2024-08-31T04:06:40.633 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/31 file after the snapshot 2024-08-31T04:06:40.636 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/32 file after the snapshot 2024-08-31T04:06:40.638 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/33 file after the snapshot 2024-08-31T04:06:40.641 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/34 file after the snapshot 2024-08-31T04:06:40.643 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/35 file after the snapshot 2024-08-31T04:06:40.646 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/36 file after the snapshot 2024-08-31T04:06:40.648 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/37 file after the snapshot 2024-08-31T04:06:40.651 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/38 file after the snapshot 2024-08-31T04:06:40.654 INFO:tasks.workunit.client.0.smithi089.stdout: create 269/39 file after the snapshot 2024-08-31T04:06:40.656 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/.snap/snap-subdir-test 2024-08-31T04:06:40.694 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/30 file after the snapshot 2024-08-31T04:06:40.697 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/31 file after the snapshot 2024-08-31T04:06:40.699 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/32 file after the snapshot 2024-08-31T04:06:40.702 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/33 file after the snapshot 2024-08-31T04:06:40.704 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/34 file after the snapshot 2024-08-31T04:06:40.707 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/35 file after the snapshot 2024-08-31T04:06:40.709 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/36 file after the snapshot 2024-08-31T04:06:40.712 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/37 file after the snapshot 2024-08-31T04:06:40.714 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/38 file after the snapshot 2024-08-31T04:06:40.717 INFO:tasks.workunit.client.0.smithi089.stdout: create 270/39 file after the snapshot 2024-08-31T04:06:40.719 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/.snap/snap-subdir-test 2024-08-31T04:06:40.761 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/30 file after the snapshot 2024-08-31T04:06:40.763 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/31 file after the snapshot 2024-08-31T04:06:40.766 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/32 file after the snapshot 2024-08-31T04:06:40.768 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/33 file after the snapshot 2024-08-31T04:06:40.771 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/34 file after the snapshot 2024-08-31T04:06:40.773 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/35 file after the snapshot 2024-08-31T04:06:40.776 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/36 file after the snapshot 2024-08-31T04:06:40.779 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/37 file after the snapshot 2024-08-31T04:06:40.781 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/38 file after the snapshot 2024-08-31T04:06:40.784 INFO:tasks.workunit.client.0.smithi089.stdout: create 271/39 file after the snapshot 2024-08-31T04:06:40.786 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/.snap/snap-subdir-test 2024-08-31T04:06:41.589 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/30 file after the snapshot 2024-08-31T04:06:41.591 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/31 file after the snapshot 2024-08-31T04:06:41.594 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/32 file after the snapshot 2024-08-31T04:06:41.596 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/33 file after the snapshot 2024-08-31T04:06:41.598 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/34 file after the snapshot 2024-08-31T04:06:41.601 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/35 file after the snapshot 2024-08-31T04:06:41.604 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/36 file after the snapshot 2024-08-31T04:06:41.606 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/37 file after the snapshot 2024-08-31T04:06:41.609 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/38 file after the snapshot 2024-08-31T04:06:41.611 INFO:tasks.workunit.client.0.smithi089.stdout: create 272/39 file after the snapshot 2024-08-31T04:06:41.614 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/.snap/snap-subdir-test 2024-08-31T04:06:41.642 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/30 file after the snapshot 2024-08-31T04:06:41.645 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/31 file after the snapshot 2024-08-31T04:06:41.648 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/32 file after the snapshot 2024-08-31T04:06:41.650 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/33 file after the snapshot 2024-08-31T04:06:41.653 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/34 file after the snapshot 2024-08-31T04:06:41.656 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/35 file after the snapshot 2024-08-31T04:06:41.658 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/36 file after the snapshot 2024-08-31T04:06:41.661 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/37 file after the snapshot 2024-08-31T04:06:41.664 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/38 file after the snapshot 2024-08-31T04:06:41.666 INFO:tasks.workunit.client.0.smithi089.stdout: create 273/39 file after the snapshot 2024-08-31T04:06:41.669 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/.snap/snap-subdir-test 2024-08-31T04:06:41.696 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/30 file after the snapshot 2024-08-31T04:06:41.698 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/31 file after the snapshot 2024-08-31T04:06:41.701 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/32 file after the snapshot 2024-08-31T04:06:41.704 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/33 file after the snapshot 2024-08-31T04:06:41.707 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/34 file after the snapshot 2024-08-31T04:06:41.709 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/35 file after the snapshot 2024-08-31T04:06:41.712 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/36 file after the snapshot 2024-08-31T04:06:41.715 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/37 file after the snapshot 2024-08-31T04:06:41.717 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/38 file after the snapshot 2024-08-31T04:06:41.720 INFO:tasks.workunit.client.0.smithi089.stdout: create 274/39 file after the snapshot 2024-08-31T04:06:41.722 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/.snap/snap-subdir-test 2024-08-31T04:06:41.751 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/30 file after the snapshot 2024-08-31T04:06:41.754 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/31 file after the snapshot 2024-08-31T04:06:41.756 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/32 file after the snapshot 2024-08-31T04:06:41.759 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/33 file after the snapshot 2024-08-31T04:06:41.761 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/34 file after the snapshot 2024-08-31T04:06:41.764 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/35 file after the snapshot 2024-08-31T04:06:41.767 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/36 file after the snapshot 2024-08-31T04:06:41.769 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/37 file after the snapshot 2024-08-31T04:06:41.772 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/38 file after the snapshot 2024-08-31T04:06:41.774 INFO:tasks.workunit.client.0.smithi089.stdout: create 275/39 file after the snapshot 2024-08-31T04:06:41.777 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/.snap/snap-subdir-test 2024-08-31T04:06:41.804 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/30 file after the snapshot 2024-08-31T04:06:41.807 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/31 file after the snapshot 2024-08-31T04:06:41.809 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/32 file after the snapshot 2024-08-31T04:06:41.812 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/33 file after the snapshot 2024-08-31T04:06:41.815 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/34 file after the snapshot 2024-08-31T04:06:41.817 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/35 file after the snapshot 2024-08-31T04:06:41.820 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/36 file after the snapshot 2024-08-31T04:06:41.822 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/37 file after the snapshot 2024-08-31T04:06:41.825 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/38 file after the snapshot 2024-08-31T04:06:41.827 INFO:tasks.workunit.client.0.smithi089.stdout: create 276/39 file after the snapshot 2024-08-31T04:06:41.830 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/.snap/snap-subdir-test 2024-08-31T04:06:41.857 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/30 file after the snapshot 2024-08-31T04:06:41.860 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/31 file after the snapshot 2024-08-31T04:06:41.862 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/32 file after the snapshot 2024-08-31T04:06:41.864 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/33 file after the snapshot 2024-08-31T04:06:41.867 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/34 file after the snapshot 2024-08-31T04:06:41.870 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/35 file after the snapshot 2024-08-31T04:06:41.872 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/36 file after the snapshot 2024-08-31T04:06:41.875 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/37 file after the snapshot 2024-08-31T04:06:41.877 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/38 file after the snapshot 2024-08-31T04:06:41.880 INFO:tasks.workunit.client.0.smithi089.stdout: create 277/39 file after the snapshot 2024-08-31T04:06:41.883 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/.snap/snap-subdir-test 2024-08-31T04:06:41.913 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/30 file after the snapshot 2024-08-31T04:06:41.915 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/31 file after the snapshot 2024-08-31T04:06:41.918 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/32 file after the snapshot 2024-08-31T04:06:41.921 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/33 file after the snapshot 2024-08-31T04:06:41.923 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/34 file after the snapshot 2024-08-31T04:06:41.926 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/35 file after the snapshot 2024-08-31T04:06:41.929 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/36 file after the snapshot 2024-08-31T04:06:41.932 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/37 file after the snapshot 2024-08-31T04:06:41.934 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/38 file after the snapshot 2024-08-31T04:06:41.937 INFO:tasks.workunit.client.0.smithi089.stdout: create 278/39 file after the snapshot 2024-08-31T04:06:41.940 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/.snap/snap-subdir-test 2024-08-31T04:06:41.967 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/30 file after the snapshot 2024-08-31T04:06:41.970 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/31 file after the snapshot 2024-08-31T04:06:41.972 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/32 file after the snapshot 2024-08-31T04:06:41.974 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/33 file after the snapshot 2024-08-31T04:06:41.977 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/34 file after the snapshot 2024-08-31T04:06:41.980 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/35 file after the snapshot 2024-08-31T04:06:41.982 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/36 file after the snapshot 2024-08-31T04:06:41.985 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/37 file after the snapshot 2024-08-31T04:06:41.987 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/38 file after the snapshot 2024-08-31T04:06:41.990 INFO:tasks.workunit.client.0.smithi089.stdout: create 279/39 file after the snapshot 2024-08-31T04:06:41.993 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/.snap/snap-subdir-test 2024-08-31T04:06:42.601 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/30 file after the snapshot 2024-08-31T04:06:42.603 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/31 file after the snapshot 2024-08-31T04:06:42.606 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/32 file after the snapshot 2024-08-31T04:06:42.609 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/33 file after the snapshot 2024-08-31T04:06:42.612 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/34 file after the snapshot 2024-08-31T04:06:42.617 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/35 file after the snapshot 2024-08-31T04:06:42.623 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/36 file after the snapshot 2024-08-31T04:06:42.664 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/37 file after the snapshot 2024-08-31T04:06:42.701 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/38 file after the snapshot 2024-08-31T04:06:42.748 INFO:tasks.workunit.client.0.smithi089.stdout: create 280/39 file after the snapshot 2024-08-31T04:06:42.906 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/.snap/snap-subdir-test 2024-08-31T04:06:46.589 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/30 file after the snapshot 2024-08-31T04:06:46.594 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/31 file after the snapshot 2024-08-31T04:06:46.597 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/32 file after the snapshot 2024-08-31T04:06:46.599 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/33 file after the snapshot 2024-08-31T04:06:46.602 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/34 file after the snapshot 2024-08-31T04:06:46.605 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/35 file after the snapshot 2024-08-31T04:06:46.608 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/36 file after the snapshot 2024-08-31T04:06:46.612 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/37 file after the snapshot 2024-08-31T04:06:46.616 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/38 file after the snapshot 2024-08-31T04:06:46.621 INFO:tasks.workunit.client.0.smithi089.stdout: create 281/39 file after the snapshot 2024-08-31T04:06:46.625 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/.snap/snap-subdir-test 2024-08-31T04:06:46.657 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/30 file after the snapshot 2024-08-31T04:06:46.661 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/31 file after the snapshot 2024-08-31T04:06:46.665 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/32 file after the snapshot 2024-08-31T04:06:46.669 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/33 file after the snapshot 2024-08-31T04:06:46.673 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/34 file after the snapshot 2024-08-31T04:06:46.677 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/35 file after the snapshot 2024-08-31T04:06:46.681 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/36 file after the snapshot 2024-08-31T04:06:46.685 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/37 file after the snapshot 2024-08-31T04:06:46.689 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/38 file after the snapshot 2024-08-31T04:06:46.693 INFO:tasks.workunit.client.0.smithi089.stdout: create 282/39 file after the snapshot 2024-08-31T04:06:46.697 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/.snap/snap-subdir-test 2024-08-31T04:06:47.262 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/30 file after the snapshot 2024-08-31T04:06:47.264 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/31 file after the snapshot 2024-08-31T04:06:47.267 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/32 file after the snapshot 2024-08-31T04:06:47.269 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/33 file after the snapshot 2024-08-31T04:06:47.272 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/34 file after the snapshot 2024-08-31T04:06:47.274 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/35 file after the snapshot 2024-08-31T04:06:47.277 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/36 file after the snapshot 2024-08-31T04:06:47.279 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/37 file after the snapshot 2024-08-31T04:06:47.282 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/38 file after the snapshot 2024-08-31T04:06:47.285 INFO:tasks.workunit.client.0.smithi089.stdout: create 283/39 file after the snapshot 2024-08-31T04:06:47.288 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/.snap/snap-subdir-test 2024-08-31T04:06:47.320 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/30 file after the snapshot 2024-08-31T04:06:47.322 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/31 file after the snapshot 2024-08-31T04:06:47.325 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/32 file after the snapshot 2024-08-31T04:06:47.327 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/33 file after the snapshot 2024-08-31T04:06:47.330 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/34 file after the snapshot 2024-08-31T04:06:47.333 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/35 file after the snapshot 2024-08-31T04:06:47.336 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/36 file after the snapshot 2024-08-31T04:06:47.338 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/37 file after the snapshot 2024-08-31T04:06:47.341 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/38 file after the snapshot 2024-08-31T04:06:47.344 INFO:tasks.workunit.client.0.smithi089.stdout: create 284/39 file after the snapshot 2024-08-31T04:06:47.346 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/.snap/snap-subdir-test 2024-08-31T04:06:47.379 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/30 file after the snapshot 2024-08-31T04:06:47.382 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/31 file after the snapshot 2024-08-31T04:06:47.384 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/32 file after the snapshot 2024-08-31T04:06:47.387 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/33 file after the snapshot 2024-08-31T04:06:47.390 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/34 file after the snapshot 2024-08-31T04:06:47.393 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/35 file after the snapshot 2024-08-31T04:06:47.395 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/36 file after the snapshot 2024-08-31T04:06:47.398 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/37 file after the snapshot 2024-08-31T04:06:47.400 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/38 file after the snapshot 2024-08-31T04:06:47.403 INFO:tasks.workunit.client.0.smithi089.stdout: create 285/39 file after the snapshot 2024-08-31T04:06:47.406 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/.snap/snap-subdir-test 2024-08-31T04:06:47.441 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/30 file after the snapshot 2024-08-31T04:06:47.444 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/31 file after the snapshot 2024-08-31T04:06:47.446 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/32 file after the snapshot 2024-08-31T04:06:47.449 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/33 file after the snapshot 2024-08-31T04:06:47.452 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/34 file after the snapshot 2024-08-31T04:06:47.455 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/35 file after the snapshot 2024-08-31T04:06:47.458 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/36 file after the snapshot 2024-08-31T04:06:47.461 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/37 file after the snapshot 2024-08-31T04:06:47.464 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/38 file after the snapshot 2024-08-31T04:06:47.466 INFO:tasks.workunit.client.0.smithi089.stdout: create 286/39 file after the snapshot 2024-08-31T04:06:47.469 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/.snap/snap-subdir-test 2024-08-31T04:06:47.500 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/30 file after the snapshot 2024-08-31T04:06:47.503 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/31 file after the snapshot 2024-08-31T04:06:47.506 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/32 file after the snapshot 2024-08-31T04:06:47.508 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/33 file after the snapshot 2024-08-31T04:06:47.511 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/34 file after the snapshot 2024-08-31T04:06:47.514 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/35 file after the snapshot 2024-08-31T04:06:47.517 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/36 file after the snapshot 2024-08-31T04:06:47.520 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/37 file after the snapshot 2024-08-31T04:06:47.523 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/38 file after the snapshot 2024-08-31T04:06:47.525 INFO:tasks.workunit.client.0.smithi089.stdout: create 287/39 file after the snapshot 2024-08-31T04:06:47.528 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/.snap/snap-subdir-test 2024-08-31T04:06:47.560 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/30 file after the snapshot 2024-08-31T04:06:47.561 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/31 file after the snapshot 2024-08-31T04:06:47.563 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/32 file after the snapshot 2024-08-31T04:06:47.566 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/33 file after the snapshot 2024-08-31T04:06:47.568 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/34 file after the snapshot 2024-08-31T04:06:47.571 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/35 file after the snapshot 2024-08-31T04:06:47.573 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/36 file after the snapshot 2024-08-31T04:06:47.576 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/37 file after the snapshot 2024-08-31T04:06:47.830 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/38 file after the snapshot 2024-08-31T04:06:47.833 INFO:tasks.workunit.client.0.smithi089.stdout: create 288/39 file after the snapshot 2024-08-31T04:06:47.836 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/.snap/snap-subdir-test 2024-08-31T04:06:47.869 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/30 file after the snapshot 2024-08-31T04:06:47.871 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/31 file after the snapshot 2024-08-31T04:06:47.873 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/32 file after the snapshot 2024-08-31T04:06:47.876 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/33 file after the snapshot 2024-08-31T04:06:47.879 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/34 file after the snapshot 2024-08-31T04:06:47.881 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/35 file after the snapshot 2024-08-31T04:06:47.884 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/36 file after the snapshot 2024-08-31T04:06:47.887 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/37 file after the snapshot 2024-08-31T04:06:47.890 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/38 file after the snapshot 2024-08-31T04:06:47.892 INFO:tasks.workunit.client.0.smithi089.stdout: create 289/39 file after the snapshot 2024-08-31T04:06:47.895 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/.snap/snap-subdir-test 2024-08-31T04:06:47.926 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/30 file after the snapshot 2024-08-31T04:06:47.928 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/31 file after the snapshot 2024-08-31T04:06:47.931 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/32 file after the snapshot 2024-08-31T04:06:47.934 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/33 file after the snapshot 2024-08-31T04:06:47.936 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/34 file after the snapshot 2024-08-31T04:06:47.939 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/35 file after the snapshot 2024-08-31T04:06:47.942 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/36 file after the snapshot 2024-08-31T04:06:47.944 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/37 file after the snapshot 2024-08-31T04:06:47.947 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/38 file after the snapshot 2024-08-31T04:06:47.950 INFO:tasks.workunit.client.0.smithi089.stdout: create 290/39 file after the snapshot 2024-08-31T04:06:47.953 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/.snap/snap-subdir-test 2024-08-31T04:06:47.986 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/30 file after the snapshot 2024-08-31T04:06:47.989 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/31 file after the snapshot 2024-08-31T04:06:47.994 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/32 file after the snapshot 2024-08-31T04:06:47.998 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/33 file after the snapshot 2024-08-31T04:06:48.001 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/34 file after the snapshot 2024-08-31T04:06:48.005 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/35 file after the snapshot 2024-08-31T04:06:48.007 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/36 file after the snapshot 2024-08-31T04:06:48.010 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/37 file after the snapshot 2024-08-31T04:06:48.012 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/38 file after the snapshot 2024-08-31T04:06:48.015 INFO:tasks.workunit.client.0.smithi089.stdout: create 291/39 file after the snapshot 2024-08-31T04:06:48.017 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/.snap/snap-subdir-test 2024-08-31T04:06:48.048 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/30 file after the snapshot 2024-08-31T04:06:48.051 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/31 file after the snapshot 2024-08-31T04:06:48.054 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/32 file after the snapshot 2024-08-31T04:06:48.057 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/33 file after the snapshot 2024-08-31T04:06:48.059 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/34 file after the snapshot 2024-08-31T04:06:48.062 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/35 file after the snapshot 2024-08-31T04:06:48.065 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/36 file after the snapshot 2024-08-31T04:06:48.067 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/37 file after the snapshot 2024-08-31T04:06:48.070 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/38 file after the snapshot 2024-08-31T04:06:48.073 INFO:tasks.workunit.client.0.smithi089.stdout: create 292/39 file after the snapshot 2024-08-31T04:06:48.075 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/.snap/snap-subdir-test 2024-08-31T04:06:48.107 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/30 file after the snapshot 2024-08-31T04:06:48.109 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/31 file after the snapshot 2024-08-31T04:06:48.112 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/32 file after the snapshot 2024-08-31T04:06:48.114 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/33 file after the snapshot 2024-08-31T04:06:48.117 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/34 file after the snapshot 2024-08-31T04:06:48.120 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/35 file after the snapshot 2024-08-31T04:06:48.122 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/36 file after the snapshot 2024-08-31T04:06:48.125 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/37 file after the snapshot 2024-08-31T04:06:48.128 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/38 file after the snapshot 2024-08-31T04:06:48.131 INFO:tasks.workunit.client.0.smithi089.stdout: create 293/39 file after the snapshot 2024-08-31T04:06:48.133 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/.snap/snap-subdir-test 2024-08-31T04:06:48.167 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/30 file after the snapshot 2024-08-31T04:06:48.169 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/31 file after the snapshot 2024-08-31T04:06:48.172 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/32 file after the snapshot 2024-08-31T04:06:48.175 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/33 file after the snapshot 2024-08-31T04:06:48.177 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/34 file after the snapshot 2024-08-31T04:06:48.180 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/35 file after the snapshot 2024-08-31T04:06:48.182 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/36 file after the snapshot 2024-08-31T04:06:48.185 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/37 file after the snapshot 2024-08-31T04:06:48.188 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/38 file after the snapshot 2024-08-31T04:06:48.191 INFO:tasks.workunit.client.0.smithi089.stdout: create 294/39 file after the snapshot 2024-08-31T04:06:48.193 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/.snap/snap-subdir-test 2024-08-31T04:06:48.232 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/30 file after the snapshot 2024-08-31T04:06:48.235 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/31 file after the snapshot 2024-08-31T04:06:48.237 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/32 file after the snapshot 2024-08-31T04:06:48.240 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/33 file after the snapshot 2024-08-31T04:06:48.243 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/34 file after the snapshot 2024-08-31T04:06:48.245 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/35 file after the snapshot 2024-08-31T04:06:48.250 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/36 file after the snapshot 2024-08-31T04:06:48.253 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/37 file after the snapshot 2024-08-31T04:06:48.255 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/38 file after the snapshot 2024-08-31T04:06:48.257 INFO:tasks.workunit.client.0.smithi089.stdout: create 295/39 file after the snapshot 2024-08-31T04:06:48.259 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/.snap/snap-subdir-test 2024-08-31T04:06:48.302 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/30 file after the snapshot 2024-08-31T04:06:48.304 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/31 file after the snapshot 2024-08-31T04:06:48.307 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/32 file after the snapshot 2024-08-31T04:06:48.310 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/33 file after the snapshot 2024-08-31T04:06:48.312 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/34 file after the snapshot 2024-08-31T04:06:48.315 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/35 file after the snapshot 2024-08-31T04:06:48.318 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/36 file after the snapshot 2024-08-31T04:06:48.320 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/37 file after the snapshot 2024-08-31T04:06:48.323 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/38 file after the snapshot 2024-08-31T04:06:48.326 INFO:tasks.workunit.client.0.smithi089.stdout: create 296/39 file after the snapshot 2024-08-31T04:06:48.328 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/.snap/snap-subdir-test 2024-08-31T04:06:48.359 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/30 file after the snapshot 2024-08-31T04:06:48.361 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/31 file after the snapshot 2024-08-31T04:06:48.364 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/32 file after the snapshot 2024-08-31T04:06:48.366 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/33 file after the snapshot 2024-08-31T04:06:48.369 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/34 file after the snapshot 2024-08-31T04:06:48.371 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/35 file after the snapshot 2024-08-31T04:06:48.374 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/36 file after the snapshot 2024-08-31T04:06:48.377 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/37 file after the snapshot 2024-08-31T04:06:48.379 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/38 file after the snapshot 2024-08-31T04:06:48.382 INFO:tasks.workunit.client.0.smithi089.stdout: create 297/39 file after the snapshot 2024-08-31T04:06:48.384 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/.snap/snap-subdir-test 2024-08-31T04:06:48.415 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/30 file after the snapshot 2024-08-31T04:06:48.417 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/31 file after the snapshot 2024-08-31T04:06:48.420 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/32 file after the snapshot 2024-08-31T04:06:48.423 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/33 file after the snapshot 2024-08-31T04:06:48.425 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/34 file after the snapshot 2024-08-31T04:06:48.428 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/35 file after the snapshot 2024-08-31T04:06:48.430 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/36 file after the snapshot 2024-08-31T04:06:48.433 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/37 file after the snapshot 2024-08-31T04:06:48.436 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/38 file after the snapshot 2024-08-31T04:06:48.438 INFO:tasks.workunit.client.0.smithi089.stdout: create 298/39 file after the snapshot 2024-08-31T04:06:48.441 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/.snap/snap-subdir-test 2024-08-31T04:06:48.471 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/30 file after the snapshot 2024-08-31T04:06:48.473 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/31 file after the snapshot 2024-08-31T04:06:48.476 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/32 file after the snapshot 2024-08-31T04:06:48.479 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/33 file after the snapshot 2024-08-31T04:06:48.482 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/34 file after the snapshot 2024-08-31T04:06:48.484 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/35 file after the snapshot 2024-08-31T04:06:48.487 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/36 file after the snapshot 2024-08-31T04:06:48.489 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/37 file after the snapshot 2024-08-31T04:06:48.492 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/38 file after the snapshot 2024-08-31T04:06:48.495 INFO:tasks.workunit.client.0.smithi089.stdout: create 299/39 file after the snapshot 2024-08-31T04:06:48.498 INFO:tasks.workunit.client.0.smithi089.stdout:Take second snapshot .snap/test2 2024-08-31T04:06:48.532 INFO:tasks.workunit.client.0.smithi089.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2024-08-31T04:06:50.868 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2024-08-31T04:06:50.868 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2024-08-31T04:06:50.869 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2024-08-31T04:06:50.869 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2024-08-31T04:06:50.869 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2024-08-31T04:06:50.869 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2024-08-31T04:06:50.869 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2024-08-31T04:06:50.869 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2024-08-31T04:06:50.870 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2024-08-31T04:06:50.870 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2024-08-31T04:06:50.870 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2024-08-31T04:06:50.870 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2024-08-31T04:06:50.870 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2024-08-31T04:06:50.871 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2024-08-31T04:06:50.871 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2024-08-31T04:06:50.871 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2024-08-31T04:06:50.871 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2024-08-31T04:06:50.871 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2024-08-31T04:06:50.871 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2024-08-31T04:06:50.871 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2024-08-31T04:06:50.872 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2024-08-31T04:06:50.872 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2024-08-31T04:06:50.872 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2024-08-31T04:06:50.872 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2024-08-31T04:06:50.872 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2024-08-31T04:06:50.872 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2024-08-31T04:06:50.873 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2024-08-31T04:06:50.873 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2024-08-31T04:06:50.873 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2024-08-31T04:06:50.873 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2024-08-31T04:06:50.873 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2024-08-31T04:06:50.873 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2024-08-31T04:06:50.873 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2024-08-31T04:06:50.874 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2024-08-31T04:06:50.874 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2024-08-31T04:06:50.874 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2024-08-31T04:06:50.874 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2024-08-31T04:06:50.874 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2024-08-31T04:06:50.874 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2024-08-31T04:06:50.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2024-08-31T04:06:50.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2024-08-31T04:06:50.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2024-08-31T04:06:50.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2024-08-31T04:06:50.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2024-08-31T04:06:50.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2024-08-31T04:06:50.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2024-08-31T04:06:50.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2024-08-31T04:06:50.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2024-08-31T04:06:50.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2024-08-31T04:06:50.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2024-08-31T04:06:50.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2024-08-31T04:06:50.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2024-08-31T04:06:50.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2024-08-31T04:06:50.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2024-08-31T04:06:50.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2024-08-31T04:06:50.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2024-08-31T04:06:50.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2024-08-31T04:06:50.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2024-08-31T04:06:50.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2024-08-31T04:06:50.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2024-08-31T04:06:50.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2024-08-31T04:06:50.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2024-08-31T04:06:50.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2024-08-31T04:06:50.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2024-08-31T04:06:50.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2024-08-31T04:06:50.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2024-08-31T04:06:50.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2024-08-31T04:06:50.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2024-08-31T04:06:50.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2024-08-31T04:06:50.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2024-08-31T04:06:50.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2024-08-31T04:06:50.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2024-08-31T04:06:50.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2024-08-31T04:06:50.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2024-08-31T04:06:50.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2024-08-31T04:06:50.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2024-08-31T04:06:50.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2024-08-31T04:06:50.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2024-08-31T04:06:50.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2024-08-31T04:06:50.882 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2024-08-31T04:06:50.882 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2024-08-31T04:06:51.533 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2024-08-31T04:06:51.533 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2024-08-31T04:06:51.533 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2024-08-31T04:06:51.533 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2024-08-31T04:06:51.534 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2024-08-31T04:06:51.535 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2024-08-31T04:06:51.536 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2024-08-31T04:06:51.537 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2024-08-31T04:06:51.538 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2024-08-31T04:06:51.539 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2024-08-31T04:06:51.539 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2024-08-31T04:06:51.539 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2024-08-31T04:06:51.539 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2024-08-31T04:06:51.539 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2024-08-31T04:06:51.539 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2024-08-31T04:06:51.539 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2024-08-31T04:06:51.539 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2024-08-31T04:06:53.241 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2024-08-31T04:06:53.241 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2024-08-31T04:06:53.241 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2024-08-31T04:06:53.241 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2024-08-31T04:06:53.241 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2024-08-31T04:06:53.241 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2024-08-31T04:06:53.242 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2024-08-31T04:06:53.243 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2024-08-31T04:06:53.244 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2024-08-31T04:06:53.245 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2024-08-31T04:06:53.246 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2024-08-31T04:06:53.247 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2024-08-31T04:06:53.247 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2024-08-31T04:06:53.247 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2024-08-31T04:06:53.247 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2024-08-31T04:06:53.247 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2024-08-31T04:06:53.247 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2024-08-31T04:06:53.603 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2024-08-31T04:06:53.603 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2024-08-31T04:06:53.603 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2024-08-31T04:06:53.603 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2024-08-31T04:06:53.603 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2024-08-31T04:06:53.603 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2024-08-31T04:06:53.603 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2024-08-31T04:06:53.603 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2024-08-31T04:06:53.604 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2024-08-31T04:06:53.605 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2024-08-31T04:06:53.606 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2024-08-31T04:06:53.606 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2024-08-31T04:06:53.606 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2024-08-31T04:06:53.606 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2024-08-31T04:06:53.606 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2024-08-31T04:06:53.606 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2024-08-31T04:06:53.606 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2024-08-31T04:06:53.606 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2024-08-31T04:06:53.607 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2024-08-31T04:06:53.608 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2024-08-31T04:06:53.609 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2024-08-31T04:06:53.610 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2024-08-31T04:06:54.553 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2024-08-31T04:06:54.553 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2024-08-31T04:06:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2024-08-31T04:06:54.555 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2024-08-31T04:06:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2024-08-31T04:06:54.557 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2024-08-31T04:06:54.558 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2024-08-31T04:06:54.559 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2024-08-31T04:06:54.560 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2024-08-31T04:06:55.184 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2024-08-31T04:06:55.184 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2024-08-31T04:06:55.184 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2024-08-31T04:06:55.184 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2024-08-31T04:06:55.184 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2024-08-31T04:06:55.184 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2024-08-31T04:06:55.185 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2024-08-31T04:06:55.186 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2024-08-31T04:06:55.187 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2024-08-31T04:06:55.188 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2024-08-31T04:06:55.189 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2024-08-31T04:06:55.190 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2024-08-31T04:06:55.190 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2024-08-31T04:06:55.190 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2024-08-31T04:06:55.566 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2024-08-31T04:06:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2024-08-31T04:06:55.568 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2024-08-31T04:06:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2024-08-31T04:06:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2024-08-31T04:06:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2024-08-31T04:06:55.572 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2024-08-31T04:06:55.573 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2024-08-31T04:06:57.579 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2024-08-31T04:06:57.579 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2024-08-31T04:06:57.579 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2024-08-31T04:06:57.579 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2024-08-31T04:06:57.579 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2024-08-31T04:06:57.579 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2024-08-31T04:06:57.579 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2024-08-31T04:06:57.579 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2024-08-31T04:06:57.579 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2024-08-31T04:06:57.580 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2024-08-31T04:06:57.581 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2024-08-31T04:06:57.582 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2024-08-31T04:06:57.583 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2024-08-31T04:06:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2024-08-31T04:06:58.338 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2024-08-31T04:06:58.338 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2024-08-31T04:06:58.338 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2024-08-31T04:06:58.338 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2024-08-31T04:06:58.338 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2024-08-31T04:06:58.338 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2024-08-31T04:06:58.338 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2024-08-31T04:06:58.338 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2024-08-31T04:06:58.338 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2024-08-31T04:06:58.339 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2024-08-31T04:06:58.340 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2024-08-31T04:06:58.341 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2024-08-31T04:06:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2024-08-31T04:06:58.343 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2024-08-31T04:06:58.344 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2024-08-31T04:06:58.345 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2024-08-31T04:06:58.345 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2024-08-31T04:06:58.345 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2024-08-31T04:06:58.345 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2024-08-31T04:06:59.394 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:06:59.398 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2024-08-31T04:07:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2024-08-31T04:07:00.140 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2024-08-31T04:07:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2024-08-31T04:07:00.142 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2024-08-31T04:07:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2024-08-31T04:07:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2024-08-31T04:07:00.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2024-08-31T04:07:00.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2024-08-31T04:07:00.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2024-08-31T04:07:00.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2024-08-31T04:07:00.875 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2024-08-31T04:07:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2024-08-31T04:07:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2024-08-31T04:07:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2024-08-31T04:07:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2024-08-31T04:07:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2024-08-31T04:07:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2024-08-31T04:07:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2024-08-31T04:07:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2024-08-31T04:07:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2024-08-31T04:07:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2024-08-31T04:07:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2024-08-31T04:07:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2024-08-31T04:07:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2024-08-31T04:07:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2024-08-31T04:07:01.473 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2024-08-31T04:07:01.473 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2024-08-31T04:07:01.474 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2024-08-31T04:07:01.474 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2024-08-31T04:07:01.474 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2024-08-31T04:07:01.474 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2024-08-31T04:07:01.474 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2024-08-31T04:07:01.474 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2024-08-31T04:07:01.474 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2024-08-31T04:07:01.475 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2024-08-31T04:07:01.475 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2024-08-31T04:07:01.475 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2024-08-31T04:07:01.475 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2024-08-31T04:07:01.475 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2024-08-31T04:07:01.475 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2024-08-31T04:07:01.475 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2024-08-31T04:07:01.476 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2024-08-31T04:07:01.476 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2024-08-31T04:07:01.476 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2024-08-31T04:07:01.476 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2024-08-31T04:07:01.476 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2024-08-31T04:07:01.476 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2024-08-31T04:07:01.476 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2024-08-31T04:07:01.477 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2024-08-31T04:07:01.477 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2024-08-31T04:07:01.477 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2024-08-31T04:07:01.477 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2024-08-31T04:07:01.477 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2024-08-31T04:07:01.477 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2024-08-31T04:07:01.477 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2024-08-31T04:07:01.478 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2024-08-31T04:07:01.478 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2024-08-31T04:07:01.478 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2024-08-31T04:07:01.478 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2024-08-31T04:07:01.478 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2024-08-31T04:07:01.478 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2024-08-31T04:07:01.479 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2024-08-31T04:07:01.479 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2024-08-31T04:07:01.479 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2024-08-31T04:07:01.479 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2024-08-31T04:07:01.479 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2024-08-31T04:07:01.479 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2024-08-31T04:07:01.479 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2024-08-31T04:07:01.480 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2024-08-31T04:07:01.480 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2024-08-31T04:07:01.480 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2024-08-31T04:07:01.480 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2024-08-31T04:07:01.480 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2024-08-31T04:07:01.480 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2024-08-31T04:07:01.481 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2024-08-31T04:07:01.481 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2024-08-31T04:07:01.481 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2024-08-31T04:07:01.481 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2024-08-31T04:07:01.481 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2024-08-31T04:07:01.481 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2024-08-31T04:07:01.482 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2024-08-31T04:07:01.482 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2024-08-31T04:07:01.482 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2024-08-31T04:07:01.482 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2024-08-31T04:07:01.482 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2024-08-31T04:07:01.482 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2024-08-31T04:07:01.483 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2024-08-31T04:07:01.483 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2024-08-31T04:07:01.483 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2024-08-31T04:07:01.483 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2024-08-31T04:07:01.483 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2024-08-31T04:07:01.483 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2024-08-31T04:07:01.483 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2024-08-31T04:07:01.484 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2024-08-31T04:07:01.484 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2024-08-31T04:07:01.484 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2024-08-31T04:07:01.484 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2024-08-31T04:07:01.484 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2024-08-31T04:07:01.484 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2024-08-31T04:07:01.485 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2024-08-31T04:07:01.485 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2024-08-31T04:07:01.485 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2024-08-31T04:07:01.485 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2024-08-31T04:07:01.485 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2024-08-31T04:07:01.485 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2024-08-31T04:07:01.486 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2024-08-31T04:07:03.520 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2024-08-31T04:07:03.520 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2024-08-31T04:07:03.520 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2024-08-31T04:07:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2024-08-31T04:07:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2024-08-31T04:07:03.523 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2024-08-31T04:07:03.524 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2024-08-31T04:07:03.525 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2024-08-31T04:07:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2024-08-31T04:07:03.911 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2024-08-31T04:07:03.911 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2024-08-31T04:07:03.911 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2024-08-31T04:07:03.911 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2024-08-31T04:07:03.911 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2024-08-31T04:07:03.911 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2024-08-31T04:07:03.911 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2024-08-31T04:07:03.911 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2024-08-31T04:07:03.911 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2024-08-31T04:07:03.912 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2024-08-31T04:07:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2024-08-31T04:07:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2024-08-31T04:07:03.915 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2024-08-31T04:07:03.916 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2024-08-31T04:07:03.917 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2024-08-31T04:07:03.917 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2024-08-31T04:07:03.917 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2024-08-31T04:07:03.917 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2024-08-31T04:07:04.467 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2024-08-31T04:07:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2024-08-31T04:07:04.469 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2024-08-31T04:07:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2024-08-31T04:07:04.471 INFO:tasks.workunit.client.0.smithi089.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2024-08-31T04:07:04.472 INFO:tasks.workunit.client.0.smithi089.stdout:Take third snapshot .snap/test3 2024-08-31T04:07:04.715 INFO:tasks.workunit.client.0.smithi089.stdout:Delete the snapshots... 2024-08-31T04:07:08.230 INFO:tasks.workunit.client.0.smithi089.stdout:.//.snap/test1 2024-08-31T04:07:08.230 INFO:tasks.workunit.client.0.smithi089.stdout:.//.snap/test2 2024-08-31T04:07:08.230 INFO:tasks.workunit.client.0.smithi089.stdout:.//.snap/test3 2024-08-31T04:07:08.246 INFO:tasks.workunit.client.0.smithi089.stdout:./274/.snap/snap-subdir-test 2024-08-31T04:07:08.259 INFO:tasks.workunit.client.0.smithi089.stdout:./166/.snap/snap-subdir-test 2024-08-31T04:07:08.278 INFO:tasks.workunit.client.0.smithi089.stdout:./256/.snap/snap-subdir-test 2024-08-31T04:07:08.295 INFO:tasks.workunit.client.0.smithi089.stdout:./247/.snap/snap-subdir-test 2024-08-31T04:07:08.310 INFO:tasks.workunit.client.0.smithi089.stdout:./248/.snap/snap-subdir-test 2024-08-31T04:07:08.323 INFO:tasks.workunit.client.0.smithi089.stdout:./147/.snap/snap-subdir-test 2024-08-31T04:07:08.338 INFO:tasks.workunit.client.0.smithi089.stdout:./151/.snap/snap-subdir-test 2024-08-31T04:07:08.350 INFO:tasks.workunit.client.0.smithi089.stdout:./170/.snap/snap-subdir-test 2024-08-31T04:07:08.363 INFO:tasks.workunit.client.0.smithi089.stdout:./167/.snap/snap-subdir-test 2024-08-31T04:07:08.377 INFO:tasks.workunit.client.0.smithi089.stdout:./140/.snap/snap-subdir-test 2024-08-31T04:07:08.390 INFO:tasks.workunit.client.0.smithi089.stdout:./142/.snap/snap-subdir-test 2024-08-31T04:07:08.402 INFO:tasks.workunit.client.0.smithi089.stdout:./150/.snap/snap-subdir-test 2024-08-31T04:07:08.415 INFO:tasks.workunit.client.0.smithi089.stdout:./273/.snap/snap-subdir-test 2024-08-31T04:07:08.428 INFO:tasks.workunit.client.0.smithi089.stdout:./269/.snap/snap-subdir-test 2024-08-31T04:07:08.442 INFO:tasks.workunit.client.0.smithi089.stdout:./105/.snap/snap-subdir-test 2024-08-31T04:07:08.534 INFO:tasks.workunit.client.0.smithi089.stdout:./210/.snap/snap-subdir-test 2024-08-31T04:07:10.346 INFO:tasks.workunit.client.0.smithi089.stdout:./265/.snap/snap-subdir-test 2024-08-31T04:07:10.524 INFO:tasks.workunit.client.0.smithi089.stdout:./218/.snap/snap-subdir-test 2024-08-31T04:07:10.534 INFO:tasks.workunit.client.0.smithi089.stdout:./290/.snap/snap-subdir-test 2024-08-31T04:07:10.542 INFO:tasks.workunit.client.0.smithi089.stdout:./149/.snap/snap-subdir-test 2024-08-31T04:07:11.513 INFO:tasks.workunit.client.0.smithi089.stdout:./109/.snap/snap-subdir-test 2024-08-31T04:07:11.530 INFO:tasks.workunit.client.0.smithi089.stdout:./292/.snap/snap-subdir-test 2024-08-31T04:07:11.543 INFO:tasks.workunit.client.0.smithi089.stdout:./242/.snap/snap-subdir-test 2024-08-31T04:07:11.557 INFO:tasks.workunit.client.0.smithi089.stdout:./158/.snap/snap-subdir-test 2024-08-31T04:07:11.571 INFO:tasks.workunit.client.0.smithi089.stdout:./243/.snap/snap-subdir-test 2024-08-31T04:07:11.584 INFO:tasks.workunit.client.0.smithi089.stdout:./106/.snap/snap-subdir-test 2024-08-31T04:07:12.532 INFO:tasks.workunit.client.0.smithi089.stdout:./250/.snap/snap-subdir-test 2024-08-31T04:07:12.545 INFO:tasks.workunit.client.0.smithi089.stdout:./221/.snap/snap-subdir-test 2024-08-31T04:07:12.558 INFO:tasks.workunit.client.0.smithi089.stdout:./244/.snap/snap-subdir-test 2024-08-31T04:07:12.572 INFO:tasks.workunit.client.0.smithi089.stdout:./258/.snap/snap-subdir-test 2024-08-31T04:07:12.585 INFO:tasks.workunit.client.0.smithi089.stdout:./268/.snap/snap-subdir-test 2024-08-31T04:07:12.599 INFO:tasks.workunit.client.0.smithi089.stdout:./189/.snap/snap-subdir-test 2024-08-31T04:07:12.612 INFO:tasks.workunit.client.0.smithi089.stdout:./285/.snap/snap-subdir-test 2024-08-31T04:07:12.626 INFO:tasks.workunit.client.0.smithi089.stdout:./208/.snap/snap-subdir-test 2024-08-31T04:07:12.639 INFO:tasks.workunit.client.0.smithi089.stdout:./288/.snap/snap-subdir-test 2024-08-31T04:07:12.652 INFO:tasks.workunit.client.0.smithi089.stdout:./209/.snap/snap-subdir-test 2024-08-31T04:07:12.667 INFO:tasks.workunit.client.0.smithi089.stdout:./253/.snap/snap-subdir-test 2024-08-31T04:07:12.681 INFO:tasks.workunit.client.0.smithi089.stdout:./249/.snap/snap-subdir-test 2024-08-31T04:07:12.694 INFO:tasks.workunit.client.0.smithi089.stdout:./133/.snap/snap-subdir-test 2024-08-31T04:07:12.708 INFO:tasks.workunit.client.0.smithi089.stdout:./291/.snap/snap-subdir-test 2024-08-31T04:07:12.721 INFO:tasks.workunit.client.0.smithi089.stdout:./226/.snap/snap-subdir-test 2024-08-31T04:07:12.986 INFO:tasks.workunit.client.0.smithi089.stdout:./173/.snap/snap-subdir-test 2024-08-31T04:07:12.999 INFO:tasks.workunit.client.0.smithi089.stdout:./174/.snap/snap-subdir-test 2024-08-31T04:07:13.011 INFO:tasks.workunit.client.0.smithi089.stdout:./299/.snap/snap-subdir-test 2024-08-31T04:07:13.024 INFO:tasks.workunit.client.0.smithi089.stdout:./262/.snap/snap-subdir-test 2024-08-31T04:07:13.037 INFO:tasks.workunit.client.0.smithi089.stdout:./231/.snap/snap-subdir-test 2024-08-31T04:07:13.050 INFO:tasks.workunit.client.0.smithi089.stdout:./214/.snap/snap-subdir-test 2024-08-31T04:07:13.061 INFO:tasks.workunit.client.0.smithi089.stdout:./281/.snap/snap-subdir-test 2024-08-31T04:07:13.074 INFO:tasks.workunit.client.0.smithi089.stdout:./289/.snap/snap-subdir-test 2024-08-31T04:07:13.089 INFO:tasks.workunit.client.0.smithi089.stdout:./283/.snap/snap-subdir-test 2024-08-31T04:07:13.105 INFO:tasks.workunit.client.0.smithi089.stdout:./232/.snap/snap-subdir-test 2024-08-31T04:07:13.120 INFO:tasks.workunit.client.0.smithi089.stdout:./298/.snap/snap-subdir-test 2024-08-31T04:07:13.132 INFO:tasks.workunit.client.0.smithi089.stdout:./233/.snap/snap-subdir-test 2024-08-31T04:07:13.144 INFO:tasks.workunit.client.0.smithi089.stdout:./155/.snap/snap-subdir-test 2024-08-31T04:07:13.156 INFO:tasks.workunit.client.0.smithi089.stdout:./114/.snap/snap-subdir-test 2024-08-31T04:07:13.168 INFO:tasks.workunit.client.0.smithi089.stdout:./159/.snap/snap-subdir-test 2024-08-31T04:07:13.180 INFO:tasks.workunit.client.0.smithi089.stdout:./187/.snap/snap-subdir-test 2024-08-31T04:07:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:./185/.snap/snap-subdir-test 2024-08-31T04:07:13.204 INFO:tasks.workunit.client.0.smithi089.stdout:./293/.snap/snap-subdir-test 2024-08-31T04:07:13.217 INFO:tasks.workunit.client.0.smithi089.stdout:./228/.snap/snap-subdir-test 2024-08-31T04:07:13.229 INFO:tasks.workunit.client.0.smithi089.stdout:./120/.snap/snap-subdir-test 2024-08-31T04:07:13.242 INFO:tasks.workunit.client.0.smithi089.stdout:./110/.snap/snap-subdir-test 2024-08-31T04:07:13.253 INFO:tasks.workunit.client.0.smithi089.stdout:./267/.snap/snap-subdir-test 2024-08-31T04:07:13.265 INFO:tasks.workunit.client.0.smithi089.stdout:./202/.snap/snap-subdir-test 2024-08-31T04:07:13.278 INFO:tasks.workunit.client.0.smithi089.stdout:./137/.snap/snap-subdir-test 2024-08-31T04:07:13.291 INFO:tasks.workunit.client.0.smithi089.stdout:./246/.snap/snap-subdir-test 2024-08-31T04:07:13.302 INFO:tasks.workunit.client.0.smithi089.stdout:./219/.snap/snap-subdir-test 2024-08-31T04:07:13.314 INFO:tasks.workunit.client.0.smithi089.stdout:./198/.snap/snap-subdir-test 2024-08-31T04:07:13.326 INFO:tasks.workunit.client.0.smithi089.stdout:./136/.snap/snap-subdir-test 2024-08-31T04:07:13.339 INFO:tasks.workunit.client.0.smithi089.stdout:./270/.snap/snap-subdir-test 2024-08-31T04:07:13.351 INFO:tasks.workunit.client.0.smithi089.stdout:./125/.snap/snap-subdir-test 2024-08-31T04:07:13.364 INFO:tasks.workunit.client.0.smithi089.stdout:./194/.snap/snap-subdir-test 2024-08-31T04:07:13.377 INFO:tasks.workunit.client.0.smithi089.stdout:./119/.snap/snap-subdir-test 2024-08-31T04:07:13.388 INFO:tasks.workunit.client.0.smithi089.stdout:./297/.snap/snap-subdir-test 2024-08-31T04:07:13.401 INFO:tasks.workunit.client.0.smithi089.stdout:./230/.snap/snap-subdir-test 2024-08-31T04:07:13.414 INFO:tasks.workunit.client.0.smithi089.stdout:./260/.snap/snap-subdir-test 2024-08-31T04:07:13.427 INFO:tasks.workunit.client.0.smithi089.stdout:./157/.snap/snap-subdir-test 2024-08-31T04:07:13.440 INFO:tasks.workunit.client.0.smithi089.stdout:./172/.snap/snap-subdir-test 2024-08-31T04:07:13.453 INFO:tasks.workunit.client.0.smithi089.stdout:./277/.snap/snap-subdir-test 2024-08-31T04:07:13.466 INFO:tasks.workunit.client.0.smithi089.stdout:./186/.snap/snap-subdir-test 2024-08-31T04:07:13.477 INFO:tasks.workunit.client.0.smithi089.stdout:./237/.snap/snap-subdir-test 2024-08-31T04:07:13.490 INFO:tasks.workunit.client.0.smithi089.stdout:./190/.snap/snap-subdir-test 2024-08-31T04:07:13.501 INFO:tasks.workunit.client.0.smithi089.stdout:./213/.snap/snap-subdir-test 2024-08-31T04:07:13.514 INFO:tasks.workunit.client.0.smithi089.stdout:./104/.snap/snap-subdir-test 2024-08-31T04:07:13.528 INFO:tasks.workunit.client.0.smithi089.stdout:./164/.snap/snap-subdir-test 2024-08-31T04:07:13.541 INFO:tasks.workunit.client.0.smithi089.stdout:./112/.snap/snap-subdir-test 2024-08-31T04:07:14.101 INFO:tasks.workunit.client.0.smithi089.stdout:./295/.snap/snap-subdir-test 2024-08-31T04:07:14.115 INFO:tasks.workunit.client.0.smithi089.stdout:./272/.snap/snap-subdir-test 2024-08-31T04:07:14.128 INFO:tasks.workunit.client.0.smithi089.stdout:./100/.snap/snap-subdir-test 2024-08-31T04:07:14.141 INFO:tasks.workunit.client.0.smithi089.stdout:./134/.snap/snap-subdir-test 2024-08-31T04:07:14.154 INFO:tasks.workunit.client.0.smithi089.stdout:./200/.snap/snap-subdir-test 2024-08-31T04:07:14.168 INFO:tasks.workunit.client.0.smithi089.stdout:./115/.snap/snap-subdir-test 2024-08-31T04:07:14.180 INFO:tasks.workunit.client.0.smithi089.stdout:./284/.snap/snap-subdir-test 2024-08-31T04:07:14.194 INFO:tasks.workunit.client.0.smithi089.stdout:./280/.snap/snap-subdir-test 2024-08-31T04:07:14.206 INFO:tasks.workunit.client.0.smithi089.stdout:./116/.snap/snap-subdir-test 2024-08-31T04:07:14.218 INFO:tasks.workunit.client.0.smithi089.stdout:./245/.snap/snap-subdir-test 2024-08-31T04:07:14.232 INFO:tasks.workunit.client.0.smithi089.stdout:./195/.snap/snap-subdir-test 2024-08-31T04:07:14.244 INFO:tasks.workunit.client.0.smithi089.stdout:./138/.snap/snap-subdir-test 2024-08-31T04:07:14.256 INFO:tasks.workunit.client.0.smithi089.stdout:./135/.snap/snap-subdir-test 2024-08-31T04:07:14.275 INFO:tasks.workunit.client.0.smithi089.stdout:./117/.snap/snap-subdir-test 2024-08-31T04:07:14.289 INFO:tasks.workunit.client.0.smithi089.stdout:./241/.snap/snap-subdir-test 2024-08-31T04:07:14.301 INFO:tasks.workunit.client.0.smithi089.stdout:./143/.snap/snap-subdir-test 2024-08-31T04:07:14.313 INFO:tasks.workunit.client.0.smithi089.stdout:./180/.snap/snap-subdir-test 2024-08-31T04:07:14.324 INFO:tasks.workunit.client.0.smithi089.stdout:./126/.snap/snap-subdir-test 2024-08-31T04:07:14.337 INFO:tasks.workunit.client.0.smithi089.stdout:./161/.snap/snap-subdir-test 2024-08-31T04:07:14.349 INFO:tasks.workunit.client.0.smithi089.stdout:./204/.snap/snap-subdir-test 2024-08-31T04:07:14.362 INFO:tasks.workunit.client.0.smithi089.stdout:./176/.snap/snap-subdir-test 2024-08-31T04:07:14.374 INFO:tasks.workunit.client.0.smithi089.stdout:./255/.snap/snap-subdir-test 2024-08-31T04:07:14.387 INFO:tasks.workunit.client.0.smithi089.stdout:./215/.snap/snap-subdir-test 2024-08-31T04:07:14.399 INFO:tasks.workunit.client.0.smithi089.stdout:./111/.snap/snap-subdir-test 2024-08-31T04:07:14.411 INFO:tasks.workunit.client.0.smithi089.stdout:./238/.snap/snap-subdir-test 2024-08-31T04:07:14.424 INFO:tasks.workunit.client.0.smithi089.stdout:./191/.snap/snap-subdir-test 2024-08-31T04:07:14.434 INFO:tasks.workunit.client.0.smithi089.stdout:./184/.snap/snap-subdir-test 2024-08-31T04:07:14.447 INFO:tasks.workunit.client.0.smithi089.stdout:./192/.snap/snap-subdir-test 2024-08-31T04:07:14.459 INFO:tasks.workunit.client.0.smithi089.stdout:./103/.snap/snap-subdir-test 2024-08-31T04:07:14.472 INFO:tasks.workunit.client.0.smithi089.stdout:./128/.snap/snap-subdir-test 2024-08-31T04:07:14.484 INFO:tasks.workunit.client.0.smithi089.stdout:./229/.snap/snap-subdir-test 2024-08-31T04:07:14.496 INFO:tasks.workunit.client.0.smithi089.stdout:./144/.snap/snap-subdir-test 2024-08-31T04:07:14.508 INFO:tasks.workunit.client.0.smithi089.stdout:./146/.snap/snap-subdir-test 2024-08-31T04:07:14.520 INFO:tasks.workunit.client.0.smithi089.stdout:./227/.snap/snap-subdir-test 2024-08-31T04:07:14.532 INFO:tasks.workunit.client.0.smithi089.stdout:./278/.snap/snap-subdir-test 2024-08-31T04:07:14.544 INFO:tasks.workunit.client.0.smithi089.stdout:./141/.snap/snap-subdir-test 2024-08-31T04:07:14.555 INFO:tasks.workunit.client.0.smithi089.stdout:./234/.snap/snap-subdir-test 2024-08-31T04:07:14.568 INFO:tasks.workunit.client.0.smithi089.stdout:./225/.snap/snap-subdir-test 2024-08-31T04:07:14.580 INFO:tasks.workunit.client.0.smithi089.stdout:./182/.snap/snap-subdir-test 2024-08-31T04:07:14.593 INFO:tasks.workunit.client.0.smithi089.stdout:./107/.snap/snap-subdir-test 2024-08-31T04:07:14.605 INFO:tasks.workunit.client.0.smithi089.stdout:./178/.snap/snap-subdir-test 2024-08-31T04:07:14.617 INFO:tasks.workunit.client.0.smithi089.stdout:./266/.snap/snap-subdir-test 2024-08-31T04:07:14.629 INFO:tasks.workunit.client.0.smithi089.stdout:./240/.snap/snap-subdir-test 2024-08-31T04:07:14.642 INFO:tasks.workunit.client.0.smithi089.stdout:./156/.snap/snap-subdir-test 2024-08-31T04:07:14.654 INFO:tasks.workunit.client.0.smithi089.stdout:./131/.snap/snap-subdir-test 2024-08-31T04:07:14.666 INFO:tasks.workunit.client.0.smithi089.stdout:./123/.snap/snap-subdir-test 2024-08-31T04:07:14.678 INFO:tasks.workunit.client.0.smithi089.stdout:./160/.snap/snap-subdir-test 2024-08-31T04:07:14.690 INFO:tasks.workunit.client.0.smithi089.stdout:./165/.snap/snap-subdir-test 2024-08-31T04:07:14.701 INFO:tasks.workunit.client.0.smithi089.stdout:./101/.snap/snap-subdir-test 2024-08-31T04:07:14.712 INFO:tasks.workunit.client.0.smithi089.stdout:./148/.snap/snap-subdir-test 2024-08-31T04:07:14.724 INFO:tasks.workunit.client.0.smithi089.stdout:./168/.snap/snap-subdir-test 2024-08-31T04:07:14.961 INFO:tasks.workunit.client.0.smithi089.stdout:./179/.snap/snap-subdir-test 2024-08-31T04:07:14.973 INFO:tasks.workunit.client.0.smithi089.stdout:./257/.snap/snap-subdir-test 2024-08-31T04:07:14.985 INFO:tasks.workunit.client.0.smithi089.stdout:./252/.snap/snap-subdir-test 2024-08-31T04:07:14.999 INFO:tasks.workunit.client.0.smithi089.stdout:./132/.snap/snap-subdir-test 2024-08-31T04:07:15.011 INFO:tasks.workunit.client.0.smithi089.stdout:./236/.snap/snap-subdir-test 2024-08-31T04:07:15.958 INFO:tasks.workunit.client.0.smithi089.stdout:./211/.snap/snap-subdir-test 2024-08-31T04:07:15.972 INFO:tasks.workunit.client.0.smithi089.stdout:./199/.snap/snap-subdir-test 2024-08-31T04:07:15.984 INFO:tasks.workunit.client.0.smithi089.stdout:./205/.snap/snap-subdir-test 2024-08-31T04:07:15.998 INFO:tasks.workunit.client.0.smithi089.stdout:./163/.snap/snap-subdir-test 2024-08-31T04:07:16.011 INFO:tasks.workunit.client.0.smithi089.stdout:./261/.snap/snap-subdir-test 2024-08-31T04:07:16.023 INFO:tasks.workunit.client.0.smithi089.stdout:./201/.snap/snap-subdir-test 2024-08-31T04:07:16.287 INFO:tasks.workunit.client.0.smithi089.stdout:./282/.snap/snap-subdir-test 2024-08-31T04:07:16.300 INFO:tasks.workunit.client.0.smithi089.stdout:./296/.snap/snap-subdir-test 2024-08-31T04:07:16.312 INFO:tasks.workunit.client.0.smithi089.stdout:./217/.snap/snap-subdir-test 2024-08-31T04:07:16.325 INFO:tasks.workunit.client.0.smithi089.stdout:./153/.snap/snap-subdir-test 2024-08-31T04:07:16.337 INFO:tasks.workunit.client.0.smithi089.stdout:./206/.snap/snap-subdir-test 2024-08-31T04:07:16.349 INFO:tasks.workunit.client.0.smithi089.stdout:./122/.snap/snap-subdir-test 2024-08-31T04:07:16.362 INFO:tasks.workunit.client.0.smithi089.stdout:./162/.snap/snap-subdir-test 2024-08-31T04:07:16.375 INFO:tasks.workunit.client.0.smithi089.stdout:./197/.snap/snap-subdir-test 2024-08-31T04:07:16.387 INFO:tasks.workunit.client.0.smithi089.stdout:./216/.snap/snap-subdir-test 2024-08-31T04:07:18.478 INFO:tasks.workunit.client.0.smithi089.stdout:./254/.snap/snap-subdir-test 2024-08-31T04:07:18.490 INFO:tasks.workunit.client.0.smithi089.stdout:./113/.snap/snap-subdir-test 2024-08-31T04:07:18.502 INFO:tasks.workunit.client.0.smithi089.stdout:./152/.snap/snap-subdir-test 2024-08-31T04:07:18.515 INFO:tasks.workunit.client.0.smithi089.stdout:./121/.snap/snap-subdir-test 2024-08-31T04:07:18.546 INFO:tasks.workunit.client.0.smithi089.stdout:./118/.snap/snap-subdir-test 2024-08-31T04:07:18.557 INFO:tasks.workunit.client.0.smithi089.stdout:./196/.snap/snap-subdir-test 2024-08-31T04:07:18.569 INFO:tasks.workunit.client.0.smithi089.stdout:./124/.snap/snap-subdir-test 2024-08-31T04:07:18.581 INFO:tasks.workunit.client.0.smithi089.stdout:./239/.snap/snap-subdir-test 2024-08-31T04:07:18.594 INFO:tasks.workunit.client.0.smithi089.stdout:./188/.snap/snap-subdir-test 2024-08-31T04:07:18.604 INFO:tasks.workunit.client.0.smithi089.stdout:./287/.snap/snap-subdir-test 2024-08-31T04:07:18.617 INFO:tasks.workunit.client.0.smithi089.stdout:./275/.snap/snap-subdir-test 2024-08-31T04:07:18.629 INFO:tasks.workunit.client.0.smithi089.stdout:./259/.snap/snap-subdir-test 2024-08-31T04:07:18.642 INFO:tasks.workunit.client.0.smithi089.stdout:./224/.snap/snap-subdir-test 2024-08-31T04:07:18.654 INFO:tasks.workunit.client.0.smithi089.stdout:./264/.snap/snap-subdir-test 2024-08-31T04:07:18.667 INFO:tasks.workunit.client.0.smithi089.stdout:./145/.snap/snap-subdir-test 2024-08-31T04:07:18.679 INFO:tasks.workunit.client.0.smithi089.stdout:./279/.snap/snap-subdir-test 2024-08-31T04:07:18.690 INFO:tasks.workunit.client.0.smithi089.stdout:./263/.snap/snap-subdir-test 2024-08-31T04:07:18.703 INFO:tasks.workunit.client.0.smithi089.stdout:./130/.snap/snap-subdir-test 2024-08-31T04:07:18.714 INFO:tasks.workunit.client.0.smithi089.stdout:./193/.snap/snap-subdir-test 2024-08-31T04:07:18.725 INFO:tasks.workunit.client.0.smithi089.stdout:./223/.snap/snap-subdir-test 2024-08-31T04:07:18.736 INFO:tasks.workunit.client.0.smithi089.stdout:./207/.snap/snap-subdir-test 2024-08-31T04:07:18.747 INFO:tasks.workunit.client.0.smithi089.stdout:./276/.snap/snap-subdir-test 2024-08-31T04:07:18.760 INFO:tasks.workunit.client.0.smithi089.stdout:./271/.snap/snap-subdir-test 2024-08-31T04:07:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:./251/.snap/snap-subdir-test 2024-08-31T04:07:18.801 INFO:tasks.workunit.client.0.smithi089.stdout:./175/.snap/snap-subdir-test 2024-08-31T04:07:18.813 INFO:tasks.workunit.client.0.smithi089.stdout:./222/.snap/snap-subdir-test 2024-08-31T04:07:18.825 INFO:tasks.workunit.client.0.smithi089.stdout:./220/.snap/snap-subdir-test 2024-08-31T04:07:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:./203/.snap/snap-subdir-test 2024-08-31T04:07:18.893 INFO:tasks.workunit.client.0.smithi089.stdout:./181/.snap/snap-subdir-test 2024-08-31T04:07:18.905 INFO:tasks.workunit.client.0.smithi089.stdout:./286/.snap/snap-subdir-test 2024-08-31T04:07:18.917 INFO:tasks.workunit.client.0.smithi089.stdout:./127/.snap/snap-subdir-test 2024-08-31T04:07:18.929 INFO:tasks.workunit.client.0.smithi089.stdout:./108/.snap/snap-subdir-test 2024-08-31T04:07:18.942 INFO:tasks.workunit.client.0.smithi089.stdout:./183/.snap/snap-subdir-test 2024-08-31T04:07:18.954 INFO:tasks.workunit.client.0.smithi089.stdout:./294/.snap/snap-subdir-test 2024-08-31T04:07:18.965 INFO:tasks.workunit.client.0.smithi089.stdout:./235/.snap/snap-subdir-test 2024-08-31T04:07:18.976 INFO:tasks.workunit.client.0.smithi089.stdout:./177/.snap/snap-subdir-test 2024-08-31T04:07:18.988 INFO:tasks.workunit.client.0.smithi089.stdout:./169/.snap/snap-subdir-test 2024-08-31T04:07:18.999 INFO:tasks.workunit.client.0.smithi089.stdout:./212/.snap/snap-subdir-test 2024-08-31T04:07:19.010 INFO:tasks.workunit.client.0.smithi089.stdout:./154/.snap/snap-subdir-test 2024-08-31T04:07:19.285 INFO:tasks.workunit.client.0.smithi089.stdout:./171/.snap/snap-subdir-test 2024-08-31T04:07:19.297 INFO:tasks.workunit.client.0.smithi089.stdout:./139/.snap/snap-subdir-test 2024-08-31T04:07:19.310 INFO:tasks.workunit.client.0.smithi089.stdout:./102/.snap/snap-subdir-test 2024-08-31T04:07:19.325 INFO:tasks.workunit.client.0.smithi089.stdout:./129/.snap/snap-subdir-test 2024-08-31T04:07:29.396 INFO:tasks.quiescer.fs.[cephfs]:Total duration (43.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:07:29.396 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.8 2024-08-31T04:07:29.396 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:07:29.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:07:29.463 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:07:29.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.552+0000 7f838be00640 1 -- 172.21.15.89:0/2026934507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83840c9330 msgr2=0x7f8384074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.552+0000 7f838be00640 1 --2- 172.21.15.89:0/2026934507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83840c9330 0x7f8384074720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8384072540 tx=0x7f837c01f580 comp rx=0 tx=0).stop 2024-08-31T04:07:29.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.552+0000 7f838be00640 1 -- 172.21.15.89:0/2026934507 shutdown_connections 2024-08-31T04:07:29.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.552+0000 7f838be00640 1 --2- 172.21.15.89:0/2026934507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83840c9330 0x7f8384074720 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.552+0000 7f838be00640 1 --2- 172.21.15.89:0/2026934507 >> v2:172.21.15.170:3300/0 conn(0x7f838415bc70 0x7f8384152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.552+0000 7f838be00640 1 -- 172.21.15.89:0/2026934507 >> 172.21.15.89:0/2026934507 conn(0x7f83840ccf20 msgr2=0x7f83840cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:29.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.552+0000 7f838be00640 1 -- 172.21.15.89:0/2026934507 shutdown_connections 2024-08-31T04:07:29.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.552+0000 7f838be00640 1 -- 172.21.15.89:0/2026934507 wait complete. 2024-08-31T04:07:29.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 Processor -- start 2024-08-31T04:07:29.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 -- start start 2024-08-31T04:07:29.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83840c1f40 0x7f838414c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83840c9330 0x7f83840c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415bc70 0x7f838414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f83840c8030 con 0x7f838415bc70 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f83840c3150 con 0x7f83840c9330 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8384074c60 con 0x7f83840c1f40 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415bc70 0x7f838414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415bc70 0x7f838414d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36574/0 (socket says 172.21.15.89:36574) 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389e00640 1 -- 172.21.15.89:0/1399066970 learned_addr learned my addr 172.21.15.89:0/1399066970 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389400640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83840c1f40 0x7f838414c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8388a00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83840c9330 0x7f83840c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389e00640 1 -- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83840c1f40 msgr2=0x7f838414c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389e00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83840c1f40 0x7f838414c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389e00640 1 -- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83840c9330 msgr2=0x7f83840c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389e00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83840c9330 0x7f83840c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389e00640 1 -- 172.21.15.89:0/1399066970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838414ca60 con 0x7f838415bc70 2024-08-31T04:07:29.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8389e00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415bc70 0x7f838414d8a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f837c009bd0 tx=0x7f837c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:29.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8381600640 1 -- 172.21.15.89:0/1399066970 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c004c50 con 0x7f838415bc70 2024-08-31T04:07:29.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8381600640 1 -- 172.21.15.89:0/1399066970 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f837c0af880 con 0x7f838415bc70 2024-08-31T04:07:29.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838414e990 con 0x7f838415bc70 2024-08-31T04:07:29.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f8381600640 1 -- 172.21.15.89:0/1399066970 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c0afcb0 con 0x7f838415bc70 2024-08-31T04:07:29.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.556+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838414ef50 con 0x7f838415bc70 2024-08-31T04:07:29.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.560+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8384074720 con 0x7f838415bc70 2024-08-31T04:07:29.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.560+0000 7f8381600640 1 -- 172.21.15.89:0/1399066970 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f837c003fa0 con 0x7f838415bc70 2024-08-31T04:07:29.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.560+0000 7f8381600640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83640720f0 0x7f8364074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.560+0000 7f8381600640 1 -- 172.21.15.89:0/1399066970 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 9739+0+0 (secure 0 0 0) 0x7f837c132480 con 0x7f838415bc70 2024-08-31T04:07:29.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.560+0000 7f8389400640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83640720f0 0x7f8364074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.564+0000 7f8389400640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83640720f0 0x7f8364074600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8378009ad0 tx=0x7f83780091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:29.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.564+0000 7f8381600640 1 -- 172.21.15.89:0/1399066970 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f837c0190e0 con 0x7f838415bc70 2024-08-31T04:07:29.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.764+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83840699c0 con 0x7f838415bc70 2024-08-31T04:07:29.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f8381600640 1 -- 172.21.15.89:0/1399066970 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f837c0fcdf0 con 0x7f838415bc70 2024-08-31T04:07:29.769 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:07:29.769 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:07:29.770 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:07:29.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83640720f0 msgr2=0x7f8364074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83640720f0 0x7f8364074600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8378009ad0 tx=0x7f83780091e0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415bc70 msgr2=0x7f838414d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415bc70 0x7f838414d8a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f837c009bd0 tx=0x7f837c0092c0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 shutdown_connections 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83640720f0 0x7f8364074600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415bc70 0x7f838414d8a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83840c9330 0x7f83840c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 --2- 172.21.15.89:0/1399066970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83840c1f40 0x7f838414c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 >> 172.21.15.89:0/1399066970 conn(0x7f83840ccf20 msgr2=0x7f83841590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 shutdown_connections 2024-08-31T04:07:29.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.768+0000 7f838be00640 1 -- 172.21.15.89:0/1399066970 wait complete. 2024-08-31T04:07:29.791 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0' 2024-08-31T04:07:29.791 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0 2024-08-31T04:07:29.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.964+0000 7f3961400640 1 -- 172.21.15.89:0/2857298844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 msgr2=0x7f394000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.964+0000 7f3961400640 1 --2- 172.21.15.89:0/2857298844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 0x7f394000ba30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3954009f90 tx=0x7f395401c990 comp rx=0 tx=0).stop 2024-08-31T04:07:29.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.964+0000 7f3961400640 1 -- 172.21.15.89:0/2857298844 shutdown_connections 2024-08-31T04:07:29.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.964+0000 7f3961400640 1 --2- 172.21.15.89:0/2857298844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 0x7f394000ba30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.964+0000 7f3961400640 1 -- 172.21.15.89:0/2857298844 >> 172.21.15.89:0/2857298844 conn(0x7f395c073630 msgr2=0x7f395c073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:29.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.964+0000 7f3961400640 1 -- 172.21.15.89:0/2857298844 shutdown_connections 2024-08-31T04:07:29.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.964+0000 7f3961400640 1 -- 172.21.15.89:0/2857298844 wait complete. 2024-08-31T04:07:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f3961400640 1 Processor -- start 2024-08-31T04:07:29.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f3961400640 1 -- start start 2024-08-31T04:07:29.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f3961400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 0x7f395c0b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f3961400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f395c14f8f0 0x7f395c1435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f3961400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395c143ae0 0x7f395c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f3961400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f395c0c99c0 con 0x7f39400053b0 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f3961400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f395c0c5980 con 0x7f395c143ae0 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f3961400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f395c0c3fe0 con 0x7f395c14f8f0 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f395a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 0x7f395c0b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f395a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 0x7f395c0b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36596/0 (socket says 172.21.15.89:36596) 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f395a800640 1 -- 172.21.15.89:0/2923369534 learned_addr learned my addr 172.21.15.89:0/2923369534 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.968+0000 7f3959e00640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f395c14f8f0 0x7f395c1435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f395a800640 1 -- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f395c14f8f0 msgr2=0x7f395c1435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f395a800640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f395c14f8f0 0x7f395c1435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f395a800640 1 -- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395c143ae0 msgr2=0x7f395c15b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f395a800640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395c143ae0 0x7f395c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f395a800640 1 -- 172.21.15.89:0/2923369534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c0b3b30 con 0x7f39400053b0 2024-08-31T04:07:29.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f395a800640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 0x7f395c0b35f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f394c00d500 tx=0x7f394c00d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f3952a00640 1 -- 172.21.15.89:0/2923369534 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c019070 con 0x7f39400053b0 2024-08-31T04:07:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f3952a00640 1 -- 172.21.15.89:0/2923369534 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f394c0052e0 con 0x7f39400053b0 2024-08-31T04:07:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f3961400640 1 -- 172.21.15.89:0/2923369534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c1f0a30 con 0x7f39400053b0 2024-08-31T04:07:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f3952a00640 1 -- 172.21.15.89:0/2923369534 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c003860 con 0x7f39400053b0 2024-08-31T04:07:29.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f3961400640 1 -- 172.21.15.89:0/2923369534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c0b4bf0 con 0x7f39400053b0 2024-08-31T04:07:29.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.972+0000 7f3952a00640 1 -- 172.21.15.89:0/2923369534 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f394c003a00 con 0x7f39400053b0 2024-08-31T04:07:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f3952a00640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f393c0720c0 0x7f393c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f3952a00640 1 -- 172.21.15.89:0/2923369534 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8971+0+0 (secure 0 0 0) 0x7f394c092e20 con 0x7f39400053b0 2024-08-31T04:07:29.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f39689cf000 1 Processor -- start 2024-08-31T04:07:29.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f3959e00640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f393c0720c0 0x7f393c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f39689cf000 1 -- start start 2024-08-31T04:07:29.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f3959e00640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f393c0720c0 0x7f393c0745d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f395c0b46e0 tx=0x7f3948006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f39689cf000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f39689cf000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 0x563f9fe2a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f39689cf000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe2ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f39689cf000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563f9fc49820 con 0x563f9fcf13f0 2024-08-31T04:07:29.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f39689cf000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563f9fc38db0 con 0x563f9fcd0960 2024-08-31T04:07:29.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f39689cf000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563f9fc3cd60 con 0x563f9fce6e90 2024-08-31T04:07:29.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f395a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f395a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36606/0 (socket says 172.21.15.89:36606) 2024-08-31T04:07:29.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f395a800640 1 -- 172.21.15.89:0/1482530590 learned_addr learned my addr 172.21.15.89:0/1482530590 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:29.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f3959e00640 1 --2- 172.21.15.89:0/1482530590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 0x563f9fe2a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f395a800640 1 -- 172.21.15.89:0/1482530590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 msgr2=0x563f9fe2a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:29.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f395a800640 1 --2- 172.21.15.89:0/1482530590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 0x563f9fe2a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f395a800640 1 -- 172.21.15.89:0/1482530590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 msgr2=0x563f9fe2ae40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:07:29.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f395a800640 1 --2- 172.21.15.89:0/1482530590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe2ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f395a800640 1 -- 172.21.15.89:0/1482530590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9fbd3b70 con 0x563f9fcf13f0 2024-08-31T04:07:29.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.976+0000 7f395a800640 1 --2- 172.21.15.89:0/1482530590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf44d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f394c05d3e0 tx=0x7f394c05cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe4860248a3bf3e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:29.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f3947000640 1 -- 172.21.15.89:0/1482530590 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c061c10 con 0x563f9fcf13f0 2024-08-31T04:07:29.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f3947000640 1 -- 172.21.15.89:0/1482530590 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f394c0665a0 con 0x563f9fcf13f0 2024-08-31T04:07:29.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f3947000640 1 -- 172.21.15.89:0/1482530590 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c0596e0 con 0x563f9fcf13f0 2024-08-31T04:07:29.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 -- 172.21.15.89:0/1482530590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 msgr2=0x563f9fdf44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 --2- 172.21.15.89:0/1482530590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf44d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f394c05d3e0 tx=0x7f394c05cc80 comp rx=0 tx=0).stop 2024-08-31T04:07:29.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 -- 172.21.15.89:0/1482530590 shutdown_connections 2024-08-31T04:07:29.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 --2- 172.21.15.89:0/1482530590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe2ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 --2- 172.21.15.89:0/1482530590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 0x563f9fe2a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 --2- 172.21.15.89:0/1482530590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf44d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 -- 172.21.15.89:0/1482530590 >> 172.21.15.89:0/1482530590 conn(0x563f9f8f8210 msgr2=0x563f9fe2d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:29.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 -- 172.21.15.89:0/1482530590 shutdown_connections 2024-08-31T04:07:29.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 -- 172.21.15.89:0/1482530590 wait complete. 2024-08-31T04:07:29.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 -- start start 2024-08-31T04:07:29.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 Processor -- start 2024-08-31T04:07:29.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcd0960 0x563f9fe2a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fce6e90 0x563f9fe2add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fe2b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563f9f8ffb10 con 0x563f9fcf13f0 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563f9fbbf6f0 con 0x563f9fce6e90 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.980+0000 7f39689cf000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563f9fc41390 con 0x563f9fcd0960 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 10 client.0 _ll_register_callbacks cb 0x563f9fbe0b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395b200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fe2b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395b200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fe2b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36612/0 (socket says 172.21.15.89:36612) 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395b200640 1 -- 172.21.15.89:0/1213090935 learned_addr learned my addr 172.21.15.89:0/1213090935 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f3959e00640 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fce6e90 0x563f9fe2add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395a800640 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcd0960 0x563f9fe2a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395b200640 1 -- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcd0960 msgr2=0x563f9fe2a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395b200640 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcd0960 0x563f9fe2a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395b200640 1 -- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fce6e90 msgr2=0x563f9fe2add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395b200640 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fce6e90 0x563f9fe2add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395b200640 1 -- 172.21.15.89:0/1213090935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f9fbf7380 con 0x563f9fcf13f0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395a800640 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcd0960 0x563f9fe2a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f395b200640 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fe2b310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f395401d230 tx=0x7f3954009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f5098010b3024a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f393b400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f393b400640 1 -- 172.21.15.89:0/1213090935 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954003d90 con 0x563f9fcf13f0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 1 -- 172.21.15.89:0/1213090935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f9fc47d20 con 0x563f9fcf13f0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f393b400640 1 -- 172.21.15.89:0/1213090935 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 8971+0+0 (secure 0 0 0) 0x7f39540a5790 con 0x563f9fcf13f0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f393b400640 1 -- 172.21.15.89:0/1213090935 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f39540a5990 con 0x563f9fcf13f0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 10 client.4932 fetch_fsmap learned FSMap version 9 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 1 -- 172.21.15.89:0/1213090935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563f9fcbde40 con 0x563f9fcf13f0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f393b400640 1 -- 172.21.15.89:0/1213090935 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563f9fc47d20 con 0x563f9fcf13f0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f393b400640 1 -- 172.21.15.89:0/1213090935 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f39540a5b30 con 0x563f9fcf13f0 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 10 client.4932 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:07:29.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 10 client.4932 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:07:29.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 20 client.4932 populate_metadata read hostname 'smithi089' 2024-08-31T04:07:29.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563f9f8dcdc0 0x563f9fe49a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:29.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 4 client.4932 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:07:29.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.984+0000 7f39689cf000 1 -- 172.21.15.89:0/1213090935 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f9fc4b770 con 0x563f9f8dcdc0 2024-08-31T04:07:29.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.988+0000 7f395a800640 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563f9f8dcdc0 0x563f9fe49a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:29.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.988+0000 7f393b400640 10 client.4932 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:29.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.988+0000 7f395a800640 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563f9f8dcdc0 0x563f9fe49a20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24dfea90bdc26864 server_cookie=59830e46f031d7f0 in_seq=0 out_seq=0 2024-08-31T04:07:29.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f393b400640 1 -- 172.21.15.89:0/1213090935 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f9fc4b770 con 0x563f9f8dcdc0 2024-08-31T04:07:29.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f393b400640 10 client.4932 handle_command_reply: tid=0 2024-08-31T04:07:29.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 client.4932 shutdown 2024-08-31T04:07:29.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 -- 172.21.15.89:0/1213090935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 msgr2=0x563f9fe2b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:29.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fe2b310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f395401d230 tx=0x7f3954009c70 comp rx=0 tx=0).stop 2024-08-31T04:07:29.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 -- 172.21.15.89:0/1213090935 shutdown_connections 2024-08-31T04:07:29.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563f9f8dcdc0 0x563f9fe49a20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fe2b310 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fce6e90 0x563f9fe2add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f393b400640 0 client.4932 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:29.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 --2- 172.21.15.89:0/1213090935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcd0960 0x563f9fe2a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:29.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 -- 172.21.15.89:0/1213090935 >> 172.21.15.89:0/1213090935 conn(0x563f9f8f8210 msgr2=0x563f9fe2c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:29.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 -- 172.21.15.89:0/1213090935 shutdown_connections 2024-08-31T04:07:29.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 1 -- 172.21.15.89:0/1213090935 wait complete. 2024-08-31T04:07:29.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:29.992+0000 7f39689cf000 20 client.4932 trim_cache size 0 max 16384 2024-08-31T04:07:29.997 INFO:tasks.workunit.client.0.smithi089.stdout:Delete all the files and directories ... 2024-08-31T04:07:30.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f39689cf000 1 Processor -- start 2024-08-31T04:07:30.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f39689cf000 1 -- start start 2024-08-31T04:07:30.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f39689cf000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe3cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:30.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f39689cf000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 0x563f9fdf2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:30.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f39689cf000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f39689cf000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f395c06fd50 con 0x563f9fcf13f0 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f39689cf000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f395c1fc5e0 con 0x563f9fcd0960 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f39689cf000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f395c1fb950 con 0x563f9fce6e90 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395b200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395b200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36618/0 (socket says 172.21.15.89:36618) 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395b200640 1 -- 172.21.15.89:0/1080853990 learned_addr learned my addr 172.21.15.89:0/1080853990 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395a800640 1 --2- 172.21.15.89:0/1080853990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe3cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f3959e00640 1 --2- 172.21.15.89:0/1080853990 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 0x563f9fdf2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395b200640 1 -- 172.21.15.89:0/1080853990 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 msgr2=0x563f9fdf2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395b200640 1 --2- 172.21.15.89:0/1080853990 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 0x563f9fdf2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395b200640 1 -- 172.21.15.89:0/1080853990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 msgr2=0x563f9fe3cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:30.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395b200640 1 --2- 172.21.15.89:0/1080853990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe3cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:30.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395b200640 1 -- 172.21.15.89:0/1080853990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9fc955b0 con 0x563f9fcf13f0 2024-08-31T04:07:30.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f395b200640 1 --2- 172.21.15.89:0/1080853990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf25c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f39540a5fb0 tx=0x7f39540a5590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adb958a6100dfcd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:30.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f3946600640 1 -- 172.21.15.89:0/1080853990 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39540094a0 con 0x563f9fcf13f0 2024-08-31T04:07:30.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f3946600640 1 -- 172.21.15.89:0/1080853990 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39540a5b30 con 0x563f9fcf13f0 2024-08-31T04:07:30.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.012+0000 7f3946600640 1 -- 172.21.15.89:0/1080853990 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954003b90 con 0x563f9fcf13f0 2024-08-31T04:07:30.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 -- 172.21.15.89:0/1080853990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 msgr2=0x563f9fdf25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:30.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 --2- 172.21.15.89:0/1080853990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf25c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f39540a5fb0 tx=0x7f39540a5590 comp rx=0 tx=0).stop 2024-08-31T04:07:30.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 -- 172.21.15.89:0/1080853990 shutdown_connections 2024-08-31T04:07:30.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 --2- 172.21.15.89:0/1080853990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fcf13f0 0x563f9fdf25c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:30.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 --2- 172.21.15.89:0/1080853990 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fce6e90 0x563f9fdf2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:30.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 --2- 172.21.15.89:0/1080853990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe3cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:30.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 -- 172.21.15.89:0/1080853990 >> 172.21.15.89:0/1080853990 conn(0x563f9f8f8210 msgr2=0x563f9fe38250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:30.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 -- 172.21.15.89:0/1080853990 shutdown_connections 2024-08-31T04:07:30.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 -- 172.21.15.89:0/1080853990 wait complete. 2024-08-31T04:07:30.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 -- start start 2024-08-31T04:07:30.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 Processor -- start 2024-08-31T04:07:30.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe38e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fce6e90 0x563f9fe4c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcf13f0 0x563f9fe4ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563f9fbbaeb0 con 0x563f9fce6e90 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f395c1fbf70 con 0x563f9fcd0960 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563f9fbe0f20 con 0x563f9fcf13f0 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f39689cf000 10 client.0 _ll_register_callbacks cb 0x7f3940003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f3959e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fce6e90 0x563f9fe4c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f3959e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fce6e90 0x563f9fe4c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36626/0 (socket says 172.21.15.89:36626) 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f3959e00640 1 -- 172.21.15.89:0/3300398980 learned_addr learned my addr 172.21.15.89:0/3300398980 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f3959e00640 1 -- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcf13f0 msgr2=0x563f9fe4ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f3959e00640 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcf13f0 0x563f9fe4ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:30.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f3959e00640 1 -- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 msgr2=0x563f9fe38e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.016+0000 7f3959e00640 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe38e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f3959e00640 1 -- 172.21.15.89:0/3300398980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f9fbc9fc0 con 0x563f9fce6e90 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f3959e00640 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fce6e90 0x563f9fe4c510 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3948011a00 tx=0x7f395c0b2c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3e15145abcf897 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f393b400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f393b400640 1 -- 172.21.15.89:0/3300398980 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948003c90 con 0x563f9fce6e90 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f39689cf000 1 -- 172.21.15.89:0/3300398980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39540a5b30 con 0x563f9fce6e90 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f393b400640 1 -- 172.21.15.89:0/3300398980 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 8971+0+0 (secure 0 0 0) 0x7f3948020440 con 0x563f9fce6e90 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f393b400640 1 -- 172.21.15.89:0/3300398980 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3948003e30 con 0x563f9fce6e90 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f39689cf000 10 client.4938 fetch_fsmap learned FSMap version 9 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f39689cf000 1 -- 172.21.15.89:0/3300398980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563f9fbc2e00 con 0x563f9fce6e90 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f393b400640 1 -- 172.21.15.89:0/3300398980 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39540a5b30 con 0x563f9fce6e90 2024-08-31T04:07:30.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f393b400640 1 -- 172.21.15.89:0/3300398980 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f3948020640 con 0x563f9fce6e90 2024-08-31T04:07:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f39689cf000 10 client.4938 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:07:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f39689cf000 10 client.4938 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:07:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f39689cf000 20 client.4938 populate_metadata read hostname 'smithi089' 2024-08-31T04:07:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f39689cf000 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563f9f8cae20 0x563f9fe4d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f39689cf000 4 client.4938 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}] 2024-08-31T04:07:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f39689cf000 1 -- 172.21.15.89:0/3300398980 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}) -- 0x563f9fc47210 con 0x563f9f8cae20 2024-08-31T04:07:30.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.020+0000 7f395a800640 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563f9f8cae20 0x563f9fe4d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:30.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.024+0000 7f393b400640 10 client.4938 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:30.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:30.024+0000 7f395a800640 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563f9f8cae20 0x563f9fe4d8c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d46f12b23ed13e3 server_cookie=781e4d623a5f136 in_seq=0 out_seq=0 2024-08-31T04:07:35.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.044+0000 7f393b400640 1 -- 172.21.15.89:0/3300398980 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563f9fc47210 con 0x563f9f8cae20 2024-08-31T04:07:35.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.044+0000 7f393b400640 10 client.4938 handle_command_reply: tid=0 2024-08-31T04:07:35.049 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:07:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:07:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:07:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 10, 2024-08-31T04:07:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:07:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "3291f3c0": { 2024-08-31T04:07:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 10, 2024-08-31T04:07:35.049 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:07:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:07:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:07:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:07:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:07:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:07:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 141.8, 2024-08-31T04:07:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:07:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:07:35.050 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:07:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:07:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:07:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:07:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:35.051 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:35.051 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:07:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.044+0000 7f39689cf000 1 client.4938 shutdown 2024-08-31T04:07:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 -- 172.21.15.89:0/3300398980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fce6e90 msgr2=0x563f9fe4c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fce6e90 0x563f9fe4c510 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3948011a00 tx=0x7f395c0b2c90 comp rx=0 tx=0).stop 2024-08-31T04:07:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 -- 172.21.15.89:0/3300398980 shutdown_connections 2024-08-31T04:07:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563f9f8cae20 0x563f9fe4d8c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563f9fce6e90 0x563f9fe4c510 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563f9fcf13f0 0x563f9fe4ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 --2- 172.21.15.89:0/3300398980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f9fcd0960 0x563f9fe38e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:35.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f393b400640 0 client.4938 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 -- 172.21.15.89:0/3300398980 >> 172.21.15.89:0/3300398980 conn(0x563f9f8f8210 msgr2=0x563f9fe397d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 -- 172.21.15.89:0/3300398980 shutdown_connections 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 1 -- 172.21.15.89:0/3300398980 wait complete. 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f39689cf000 20 client.4938 trim_cache size 0 max 16384 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 -- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f393c0720c0 msgr2=0x7f393c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f393c0720c0 0x7f393c0745d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f395c0b46e0 tx=0x7f3948006040 comp rx=0 tx=0).stop 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 -- 172.21.15.89:0/2923369534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 msgr2=0x7f395c0b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 0x7f395c0b35f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f394c00d500 tx=0x7f394c00d9c0 comp rx=0 tx=0).stop 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 -- 172.21.15.89:0/2923369534 shutdown_connections 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f393c0720c0 0x7f393c0745d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:35.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f395c143ae0 0x7f395c15b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f395c14f8f0 0x7f395c1435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 --2- 172.21.15.89:0/2923369534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39400053b0 0x7f395c0b35f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 -- 172.21.15.89:0/2923369534 >> 172.21.15.89:0/2923369534 conn(0x7f395c073630 msgr2=0x7f395c152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 -- 172.21.15.89:0/2923369534 shutdown_connections 2024-08-31T04:07:35.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:35.048+0000 7f3961400640 1 -- 172.21.15.89:0/2923369534 wait complete. 2024-08-31T04:07:35.133 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3291f3c0', quiesce took 5.7 seconds. Will release after: 16.1 2024-08-31T04:07:51.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:07:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.395+0000 7fd6f9600640 1 -- 172.21.15.89:0/680036725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d8004190 msgr2=0x7fd6d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.395+0000 7fd6f9600640 1 --2- 172.21.15.89:0/680036725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d8004190 0x7fd6d8004810 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6f415cd90 tx=0x7fd6dc01c6e0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.395+0000 7fd6f3400640 1 -- 172.21.15.89:0/680036725 reap_dead start 2024-08-31T04:07:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.395+0000 7fd6f9600640 1 -- 172.21.15.89:0/680036725 shutdown_connections 2024-08-31T04:07:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.395+0000 7fd6f9600640 1 -- 172.21.15.89:0/680036725 >> 172.21.15.89:0/680036725 conn(0x7fd6f40ccf20 msgr2=0x7fd6f40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.395+0000 7fd6f9600640 1 -- 172.21.15.89:0/680036725 shutdown_connections 2024-08-31T04:07:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.395+0000 7fd6f9600640 1 -- 172.21.15.89:0/680036725 wait complete. 2024-08-31T04:07:51.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f9600640 1 Processor -- start 2024-08-31T04:07:51.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f9600640 1 -- start start 2024-08-31T04:07:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f9600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d8004190 0x7fd6f415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f9600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f4154820 0x7fd6f4154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f9600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6f41533b0 0x7fd6f41537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f9600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4074fb0 con 0x7fd6d8004190 2024-08-31T04:07:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f9600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4074e30 con 0x7fd6f4154820 2024-08-31T04:07:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f9600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f4152a10 con 0x7fd6f41533b0 2024-08-31T04:07:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f2a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d8004190 0x7fd6f415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f2a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d8004190 0x7fd6f415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49396/0 (socket says 172.21.15.89:49396) 2024-08-31T04:07:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f2a00640 1 -- 172.21.15.89:0/4026985000 learned_addr learned my addr 172.21.15.89:0/4026985000 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:51.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f2a00640 1 -- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6f41533b0 msgr2=0x7fd6f41537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f2a00640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6f41533b0 0x7fd6f41537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f2a00640 1 -- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f4154820 msgr2=0x7fd6f4154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f2a00640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f4154820 0x7fd6f4154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f2a00640 1 -- 172.21.15.89:0/4026985000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f415aea0 con 0x7fd6d8004190 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.399+0000 7fd6f2a00640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d8004190 0x7fd6f415a340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b580 tx=0x7fd6e400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.403+0000 7fd6eb400640 1 -- 172.21.15.89:0/4026985000 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4014070 con 0x7fd6d8004190 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.403+0000 7fd6eb400640 1 -- 172.21.15.89:0/4026985000 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6e4010960 con 0x7fd6d8004190 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.403+0000 7fd6eb400640 1 -- 172.21.15.89:0/4026985000 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4010db0 con 0x7fd6d8004190 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.403+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f415a880 con 0x7fd6d8004190 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.403+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f4157f40 con 0x7fd6d8004190 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.403+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f4157700 con 0x7fd6d8004190 2024-08-31T04:07:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.403+0000 7fd6eb400640 1 -- 172.21.15.89:0/4026985000 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd6e4017070 con 0x7fd6d8004190 2024-08-31T04:07:51.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.403+0000 7fd6eb400640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6d00720c0 0x7fd6d00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.403+0000 7fd6eb400640 1 -- 172.21.15.89:0/4026985000 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7fd6e4092eb0 con 0x7fd6d8004190 2024-08-31T04:07:51.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.407+0000 7fd6ea000640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6d00720c0 0x7fd6d00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.407+0000 7fd6ea000640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6d00720c0 0x7fd6d00745d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0af000 tx=0x7fd6d8005840 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:51.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.407+0000 7fd6eb400640 1 -- 172.21.15.89:0/4026985000 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd6f4157700 con 0x7fd6d8004190 2024-08-31T04:07:51.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.607+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6f40c72a0 con 0x7fd6d8004190 2024-08-31T04:07:51.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.607+0000 7fd6eb400640 1 -- 172.21.15.89:0/4026985000 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fd6e405e340 con 0x7fd6d8004190 2024-08-31T04:07:51.612 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:07:51.612 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:07:51.612 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:07:51.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6d00720c0 msgr2=0x7fd6d00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6d00720c0 0x7fd6d00745d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0af000 tx=0x7fd6d8005840 comp rx=0 tx=0).stop 2024-08-31T04:07:51.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d8004190 msgr2=0x7fd6f415a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d8004190 0x7fd6f415a340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b580 tx=0x7fd6e400ba40 comp rx=0 tx=0).stop 2024-08-31T04:07:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 shutdown_connections 2024-08-31T04:07:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6d00720c0 0x7fd6d00745d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6f41533b0 0x7fd6f41537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6f4154820 0x7fd6f4154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 --2- 172.21.15.89:0/4026985000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d8004190 0x7fd6f415a340 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 >> 172.21.15.89:0/4026985000 conn(0x7fd6f40ccf20 msgr2=0x7fd6f4073f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 shutdown_connections 2024-08-31T04:07:51.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.611+0000 7fd6f9600640 1 -- 172.21.15.89:0/4026985000 wait complete. 2024-08-31T04:07:51.634 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 3291f3c0 --release --await' 2024-08-31T04:07:51.634 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 3291f3c0 --release --await 2024-08-31T04:07:51.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 -- 172.21.15.89:0/2465592792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40c1ed0 msgr2=0x7fd3c41522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 --2- 172.21.15.89:0/2465592792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40c1ed0 0x7fd3c41522f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4072e40 tx=0x7fd3ac01c8c0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 -- 172.21.15.89:0/2465592792 shutdown_connections 2024-08-31T04:07:51.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 --2- 172.21.15.89:0/2465592792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40c1ed0 0x7fd3c41522f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 --2- 172.21.15.89:0/2465592792 >> v2:172.21.15.170:3300/0 conn(0x7fd3c40ca660 0x7fd3c4074820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 -- 172.21.15.89:0/2465592792 >> 172.21.15.89:0/2465592792 conn(0x7fd3c40c99b0 msgr2=0x7fd3c40c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:51.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 -- 172.21.15.89:0/2465592792 shutdown_connections 2024-08-31T04:07:51.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 -- 172.21.15.89:0/2465592792 wait complete. 2024-08-31T04:07:51.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 Processor -- start 2024-08-31T04:07:51.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.791+0000 7fd3c3200640 1 -- start start 2024-08-31T04:07:51.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c3200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3c40c1ed0 0x7fd3c41f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c3200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40ca660 0x7fd3c406fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3c4152830 0x7fd3c4145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c3200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c40c7a30 con 0x7fd3c40ca660 2024-08-31T04:07:51.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c40c78b0 con 0x7fd3c4152830 2024-08-31T04:07:51.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c3200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c41655b0 con 0x7fd3c40c1ed0 2024-08-31T04:07:51.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3b9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40ca660 0x7fd3c406fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3b9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40ca660 0x7fd3c406fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55986/0 (socket says 172.21.15.89:55986) 2024-08-31T04:07:51.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3b9400640 1 -- 172.21.15.89:0/3627643203 learned_addr learned my addr 172.21.15.89:0/3627643203 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3c40c1ed0 0x7fd3c41f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c2800640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3c4152830 0x7fd3c4145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3b9400640 1 -- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3c40c1ed0 msgr2=0x7fd3c41f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3b9400640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3c40c1ed0 0x7fd3c41f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3b9400640 1 -- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3c4152830 msgr2=0x7fd3c4145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3b9400640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3c4152830 0x7fd3c4145770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3b9400640 1 -- 172.21.15.89:0/3627643203 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c414f570 con 0x7fd3c40ca660 2024-08-31T04:07:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3b9400640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40ca660 0x7fd3c406fc20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0194d0 tx=0x7fd3ac0a5580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:51.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3baa00640 1 -- 172.21.15.89:0/3627643203 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0b2040 con 0x7fd3c40ca660 2024-08-31T04:07:51.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3baa00640 1 -- 172.21.15.89:0/3627643203 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3ac0042c0 con 0x7fd3c40ca660 2024-08-31T04:07:51.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c3200640 1 -- 172.21.15.89:0/3627643203 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c414c260 con 0x7fd3c40ca660 2024-08-31T04:07:51.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3baa00640 1 -- 172.21.15.89:0/3627643203 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac005290 con 0x7fd3c40ca660 2024-08-31T04:07:51.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.795+0000 7fd3c3200640 1 -- 172.21.15.89:0/3627643203 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c414c500 con 0x7fd3c40ca660 2024-08-31T04:07:51.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.799+0000 7fd3baa00640 1 -- 172.21.15.89:0/3627643203 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd3ac005430 con 0x7fd3c40ca660 2024-08-31T04:07:51.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.799+0000 7fd3baa00640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd3a00720f0 0x7fd3a0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.799+0000 7fd3d0098000 1 Processor -- start 2024-08-31T04:07:51.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.799+0000 7fd3baa00640 1 -- 172.21.15.89:0/3627643203 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7fd3ac12cc60 con 0x7fd3c40ca660 2024-08-31T04:07:51.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.799+0000 7fd3d0098000 1 -- start start 2024-08-31T04:07:51.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.799+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd3a00720f0 0x7fd3a0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618ec950 0x556461a0ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 0x556461a0fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd3a00720f0 0x7fd3a0074600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40058d0 tx=0x7fd3b4005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618c7890 0x556461a10010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5564618b5f30 con 0x5564618ec950 2024-08-31T04:07:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55646182b690 con 0x5564618d6930 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55646181ac20 con 0x5564618c7890 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618ec950 0x556461a0ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618ec950 0x556461a0ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55994/0 (socket says 172.21.15.89:55994) 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 -- 172.21.15.89:0/3141563643 learned_addr learned my addr 172.21.15.89:0/3141563643 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c2800640 1 --2- 172.21.15.89:0/3141563643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618c7890 0x556461a10010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3b9400640 1 --2- 172.21.15.89:0/3141563643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 0x556461a0fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 -- 172.21.15.89:0/3141563643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618c7890 msgr2=0x556461a10010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/3141563643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618c7890 0x556461a10010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 -- 172.21.15.89:0/3141563643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 msgr2=0x556461a0fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/3141563643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 0x556461a0fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 -- 172.21.15.89:0/3141563643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564617cf8f0 con 0x5564618ec950 2024-08-31T04:07:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/3141563643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618ec950 0x556461a0ae30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400fdf0 tx=0x7fd3b4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c303b342c3d0313f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:51.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3b2600640 1 -- 172.21.15.89:0/3141563643 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4022070 con 0x5564618ec950 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3b2600640 1 -- 172.21.15.89:0/3141563643 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3b401e450 con 0x5564618ec950 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3b2600640 1 -- 172.21.15.89:0/3141563643 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b401e800 con 0x5564618ec950 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 -- 172.21.15.89:0/3141563643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618ec950 msgr2=0x556461a0ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 --2- 172.21.15.89:0/3141563643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618ec950 0x556461a0ae30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400fdf0 tx=0x7fd3b4012000 comp rx=0 tx=0).stop 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 -- 172.21.15.89:0/3141563643 shutdown_connections 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 --2- 172.21.15.89:0/3141563643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618c7890 0x556461a10010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 --2- 172.21.15.89:0/3141563643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 0x556461a0fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 --2- 172.21.15.89:0/3141563643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618ec950 0x556461a0ae30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 -- 172.21.15.89:0/3141563643 >> 172.21.15.89:0/3141563643 conn(0x5564618ec540 msgr2=0x556461a0d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 -- 172.21.15.89:0/3141563643 shutdown_connections 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 -- 172.21.15.89:0/3141563643 wait complete. 2024-08-31T04:07:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 -- start start 2024-08-31T04:07:51.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.803+0000 7fd3d0098000 1 Processor -- start 2024-08-31T04:07:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x556461a0a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 0x556461a0a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618ec950 0x556461a14bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5564617a1500 con 0x5564618c7890 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55646181ebd0 con 0x5564618d6930 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5564617c2a30 con 0x5564618ec950 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 10 client.0 _ll_register_callbacks cb 0x5564618d0b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x556461a0a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x556461a0a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56010/0 (socket says 172.21.15.89:56010) 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c1e00640 1 -- 172.21.15.89:0/711112386 learned_addr learned my addr 172.21.15.89:0/711112386 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3b9400640 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 0x556461a0a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c2800640 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618ec950 0x556461a14bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c1e00640 1 -- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618ec950 msgr2=0x556461a14bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618ec950 0x556461a14bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c1e00640 1 -- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 msgr2=0x556461a0a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:51.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 0x556461a0a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c1e00640 1 -- 172.21.15.89:0/711112386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564617ba6a0 con 0x5564618c7890 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x556461a0a030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400b7d0 tx=0x7fd3b40206a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ef338dd68954c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3a6a00640 1 -- 172.21.15.89:0/711112386 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4035060 con 0x5564618c7890 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3a6a00640 1 -- 172.21.15.89:0/711112386 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7fd3b4020890 con 0x5564618c7890 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 -- 172.21.15.89:0/711112386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564617b47e0 con 0x5564618c7890 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3a6a00640 1 -- 172.21.15.89:0/711112386 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd3b403b050 con 0x5564618c7890 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 10 client.4959 fetch_fsmap learned FSMap version 9 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 -- 172.21.15.89:0/711112386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5564617d91c0 con 0x5564618c7890 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3a6a00640 1 -- 172.21.15.89:0/711112386 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5564617b47e0 con 0x5564618c7890 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3a6a00640 1 -- 172.21.15.89:0/711112386 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fd3b403e020 con 0x5564618c7890 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 10 client.4959 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 10 client.4959 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:07:51.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 20 client.4959 populate_metadata read hostname 'smithi089' 2024-08-31T04:07:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5564618b0fc0 0x556461a15970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 4 client.4959 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:07:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3d0098000 1 -- 172.21.15.89:0/711112386 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55646182d5e0 con 0x5564618b0fc0 2024-08-31T04:07:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.807+0000 7fd3b9400640 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5564618b0fc0 0x556461a15970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3a6a00640 10 client.4959 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3b9400640 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5564618b0fc0 0x556461a15970 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e36e28891ca59b8 server_cookie=26631a264f07aba8 in_seq=0 out_seq=0 2024-08-31T04:07:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3a6a00640 1 -- 172.21.15.89:0/711112386 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55646182d5e0 con 0x5564618b0fc0 2024-08-31T04:07:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3a6a00640 10 client.4959 handle_command_reply: tid=0 2024-08-31T04:07:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 client.4959 shutdown 2024-08-31T04:07:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 -- 172.21.15.89:0/711112386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 msgr2=0x556461a0a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x556461a0a030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400b7d0 tx=0x7fd3b40206a0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 -- 172.21.15.89:0/711112386 shutdown_connections 2024-08-31T04:07:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5564618b0fc0 0x556461a15970 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618ec950 0x556461a14bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618d6930 0x556461a0a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3a6a00640 0 client.4959 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 --2- 172.21.15.89:0/711112386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x556461a0a030 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 -- 172.21.15.89:0/711112386 >> 172.21.15.89:0/711112386 conn(0x5564618ec540 msgr2=0x556461a0b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 -- 172.21.15.89:0/711112386 shutdown_connections 2024-08-31T04:07:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 1 -- 172.21.15.89:0/711112386 wait complete. 2024-08-31T04:07:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.811+0000 7fd3d0098000 20 client.4959 trim_cache size 0 max 16384 2024-08-31T04:07:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3d0098000 1 Processor -- start 2024-08-31T04:07:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3d0098000 1 -- start start 2024-08-31T04:07:51.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x5564619cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618d6930 0x5564619cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618ec950 0x556461a83920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3d0098000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4203fb0 con 0x5564618c7890 2024-08-31T04:07:51.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3d0098000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4202e90 con 0x5564618ec950 2024-08-31T04:07:51.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3d0098000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c41f96a0 con 0x5564618d6930 2024-08-31T04:07:51.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3c1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x5564619cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3c1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x5564619cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56024/0 (socket says 172.21.15.89:56024) 2024-08-31T04:07:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3c1e00640 1 -- 172.21.15.89:0/1685352721 learned_addr learned my addr 172.21.15.89:0/1685352721 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3b9400640 1 --2- 172.21.15.89:0/1685352721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618d6930 0x5564619cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3c1e00640 1 -- 172.21.15.89:0/1685352721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618d6930 msgr2=0x5564619cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/1685352721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618d6930 0x5564619cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3c1e00640 1 -- 172.21.15.89:0/1685352721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618ec950 msgr2=0x556461a83920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/1685352721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618ec950 0x556461a83920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3c1e00640 1 -- 172.21.15.89:0/1685352721 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556461a14f40 con 0x5564618c7890 2024-08-31T04:07:51.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/1685352721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x5564619cb040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4010010 tx=0x7fd3b4011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892c78ab689cfc53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3b1c00640 1 -- 172.21.15.89:0/1685352721 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b402b070 con 0x5564618c7890 2024-08-31T04:07:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3b1c00640 1 -- 172.21.15.89:0/1685352721 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3b4020710 con 0x5564618c7890 2024-08-31T04:07:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.831+0000 7fd3b1c00640 1 -- 172.21.15.89:0/1685352721 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4015070 con 0x5564618c7890 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 -- 172.21.15.89:0/1685352721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 msgr2=0x5564619cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 --2- 172.21.15.89:0/1685352721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x5564619cb040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4010010 tx=0x7fd3b4011d70 comp rx=0 tx=0).stop 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 -- 172.21.15.89:0/1685352721 shutdown_connections 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 --2- 172.21.15.89:0/1685352721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618ec950 0x556461a83920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 --2- 172.21.15.89:0/1685352721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618d6930 0x5564619cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 --2- 172.21.15.89:0/1685352721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618c7890 0x5564619cb040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 -- 172.21.15.89:0/1685352721 >> 172.21.15.89:0/1685352721 conn(0x5564618ec540 msgr2=0x556461a2a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 -- 172.21.15.89:0/1685352721 shutdown_connections 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 -- 172.21.15.89:0/1685352721 wait complete. 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 -- start start 2024-08-31T04:07:51.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 Processor -- start 2024-08-31T04:07:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618c7890 0x556461a29880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618d6930 0x556461a29dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618ec950 0x556461a289d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4201b40 con 0x5564618d6930 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c42027e0 con 0x5564618ec950 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c4202190 con 0x5564618c7890 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3d0098000 10 client.0 _ll_register_callbacks cb 0x7fd3b400fcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3b9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618d6930 0x556461a29dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3b9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618d6930 0x556461a29dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56026/0 (socket says 172.21.15.89:56026) 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3b9400640 1 -- 172.21.15.89:0/2592931295 learned_addr learned my addr 172.21.15.89:0/2592931295 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3b9400640 1 -- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618c7890 msgr2=0x556461a29880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3b9400640 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618c7890 0x556461a29880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3b9400640 1 -- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618ec950 msgr2=0x556461a289d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:51.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3b9400640 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618ec950 0x556461a289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:51.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3b9400640 1 -- 172.21.15.89:0/2592931295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646189f2f0 con 0x5564618d6930 2024-08-31T04:07:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3b9400640 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618d6930 0x556461a29dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0f7aa0 tx=0x7fd3ac0f7770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9419d22906041e4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.835+0000 7fd3a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:07:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3a6a00640 1 -- 172.21.15.89:0/2592931295 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0f8210 con 0x5564618d6930 2024-08-31T04:07:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3a6a00640 1 -- 172.21.15.89:0/2592931295 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7fd3ac100910 con 0x5564618d6930 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3d0098000 1 -- 172.21.15.89:0/2592931295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b4020710 con 0x5564618d6930 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3a6a00640 1 -- 172.21.15.89:0/2592931295 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd3ac0f7b10 con 0x5564618d6930 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3d0098000 10 client.4965 fetch_fsmap learned FSMap version 9 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3d0098000 1 -- 172.21.15.89:0/2592931295 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5564617a4b30 con 0x5564618d6930 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3a6a00640 1 -- 172.21.15.89:0/2592931295 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3b4020710 con 0x5564618d6930 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3a6a00640 1 -- 172.21.15.89:0/2592931295 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fd3ac0f6d70 con 0x5564618d6930 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3d0098000 10 client.4965 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3d0098000 10 client.4965 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3d0098000 20 client.4965 populate_metadata read hostname 'smithi089' 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3d0098000 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5564614ace80 0x556461a269b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3d0098000 4 client.4965 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3291f3c0", "release": true, "await": true}] 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3d0098000 1 -- 172.21.15.89:0/2592931295 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3291f3c0", "release": true, "await": true}) -- 0x556461829080 con 0x5564614ace80 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5564614ace80 0x556461a269b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3a6a00640 10 client.4965 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:51.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:51.839+0000 7fd3c1e00640 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5564614ace80 0x556461a269b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b48711a64d1613ff server_cookie=ce75c82b737d8357 in_seq=0 out_seq=0 2024-08-31T04:07:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3a6a00640 1 -- 172.21.15.89:0/2592931295 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556461829080 con 0x5564614ace80 2024-08-31T04:07:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3a6a00640 10 client.4965 handle_command_reply: tid=0 2024-08-31T04:07:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 client.4965 shutdown 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 -- 172.21.15.89:0/2592931295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618d6930 msgr2=0x556461a29dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618d6930 0x556461a29dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0f7aa0 tx=0x7fd3ac0f7770 comp rx=0 tx=0).stop 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 -- 172.21.15.89:0/2592931295 shutdown_connections 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5564614ace80 0x556461a269b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5564618d6930 0x556461a29dc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564618ec950 0x556461a289d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 --2- 172.21.15.89:0/2592931295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5564618c7890 0x556461a29880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3a6a00640 0 client.4965 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 -- 172.21.15.89:0/2592931295 >> 172.21.15.89:0/2592931295 conn(0x5564618ec540 msgr2=0x556461a136c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 -- 172.21.15.89:0/2592931295 shutdown_connections 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 1 -- 172.21.15.89:0/2592931295 wait complete. 2024-08-31T04:07:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3d0098000 20 client.4965 trim_cache size 0 max 16384 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 12, 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "3291f3c0": { 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 12, 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:07:52.143 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 141.8, 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:52.144 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:52.145 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:52.145 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 -- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd3a00720f0 msgr2=0x7fd3a0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd3a00720f0 0x7fd3a0074600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40058d0 tx=0x7fd3b4005860 comp rx=0 tx=0).stop 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 -- 172.21.15.89:0/3627643203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40ca660 msgr2=0x7fd3c406fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40ca660 0x7fd3c406fc20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0194d0 tx=0x7fd3ac0a5580 comp rx=0 tx=0).stop 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 -- 172.21.15.89:0/3627643203 shutdown_connections 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd3a00720f0 0x7fd3a0074600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3c40ca660 0x7fd3c406fc20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3c4152830 0x7fd3c4145770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 --2- 172.21.15.89:0/3627643203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3c40c1ed0 0x7fd3c41f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 -- 172.21.15.89:0/3627643203 >> 172.21.15.89:0/3627643203 conn(0x7fd3c40c99b0 msgr2=0x7fd3c4150790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:52.147 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 -- 172.21.15.89:0/3627643203 shutdown_connections 2024-08-31T04:07:52.147 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.139+0000 7fd3c3200640 1 -- 172.21.15.89:0/3627643203 wait complete. 2024-08-31T04:07:52.162 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3291f3c0', total seconds elapsed: 22.8 2024-08-31T04:07:52.162 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.8 2024-08-31T04:07:52.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:07:52.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.315+0000 7fde35c00640 1 -- 172.21.15.89:0/732252474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde14004d50 msgr2=0x7fde14005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.315+0000 7fde35c00640 1 --2- 172.21.15.89:0/732252474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde14004d50 0x7fde14005160 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde300735c0 tx=0x7fde2801fab0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.315+0000 7fde2f400640 1 -- 172.21.15.89:0/732252474 reap_dead start 2024-08-31T04:07:52.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.315+0000 7fde35c00640 1 -- 172.21.15.89:0/732252474 shutdown_connections 2024-08-31T04:07:52.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.315+0000 7fde35c00640 1 -- 172.21.15.89:0/732252474 >> 172.21.15.89:0/732252474 conn(0x7fde300ccf20 msgr2=0x7fde300cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:52.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.315+0000 7fde35c00640 1 -- 172.21.15.89:0/732252474 shutdown_connections 2024-08-31T04:07:52.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.315+0000 7fde35c00640 1 -- 172.21.15.89:0/732252474 wait complete. 2024-08-31T04:07:52.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde35c00640 1 Processor -- start 2024-08-31T04:07:52.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde35c00640 1 -- start start 2024-08-31T04:07:52.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde35c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde301e4410 0x7fde301f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde35c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde300767a0 0x7fde300c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde35c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde30076bb0 0x7fde301e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde35c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fde30074fb0 con 0x7fde301e4410 2024-08-31T04:07:52.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde35c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fde30074e30 con 0x7fde30076bb0 2024-08-31T04:07:52.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde35c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fde300c7d30 con 0x7fde300767a0 2024-08-31T04:07:52.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde2ea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde301e4410 0x7fde301f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde2ea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde301e4410 0x7fde301f0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56042/0 (socket says 172.21.15.89:56042) 2024-08-31T04:07:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.319+0000 7fde2ea00640 1 -- 172.21.15.89:0/997727026 learned_addr learned my addr 172.21.15.89:0/997727026 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde2ea00640 1 -- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde300767a0 msgr2=0x7fde300c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde2ea00640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde300767a0 0x7fde300c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde2ea00640 1 -- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde30076bb0 msgr2=0x7fde301e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde2ea00640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde30076bb0 0x7fde301e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde2ea00640 1 -- 172.21.15.89:0/997727026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde300c50c0 con 0x7fde301e4410 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde2ea00640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde301e4410 0x7fde301f0310 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde2000e970 tx=0x7fde2000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde27400640 1 -- 172.21.15.89:0/997727026 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2000cc40 con 0x7fde301e4410 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde27400640 1 -- 172.21.15.89:0/997727026 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde2000cde0 con 0x7fde301e4410 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde300c5380 con 0x7fde301e4410 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde27400640 1 -- 172.21.15.89:0/997727026 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20005280 con 0x7fde301e4410 2024-08-31T04:07:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde301f2f20 con 0x7fde301e4410 2024-08-31T04:07:52.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde301f0850 con 0x7fde301e4410 2024-08-31T04:07:52.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde27400640 1 -- 172.21.15.89:0/997727026 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fde20005420 con 0x7fde301e4410 2024-08-31T04:07:52.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.323+0000 7fde27400640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde0c0720c0 0x7fde0c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.327+0000 7fde27400640 1 -- 172.21.15.89:0/997727026 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7fde20093980 con 0x7fde301e4410 2024-08-31T04:07:52.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.327+0000 7fde26000640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde0c0720c0 0x7fde0c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.327+0000 7fde26000640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde0c0720c0 0x7fde0c0745d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fde300c25b0 tx=0x7fde180095a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:52.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.331+0000 7fde27400640 1 -- 172.21.15.89:0/997727026 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fde301f0850 con 0x7fde301e4410 2024-08-31T04:07:52.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde300c26e0 con 0x7fde301e4410 2024-08-31T04:07:52.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde27400640 1 -- 172.21.15.89:0/997727026 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fde2005ed70 con 0x7fde301e4410 2024-08-31T04:07:52.537 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:07:52.537 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:07:52.538 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:07:52.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde0c0720c0 msgr2=0x7fde0c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde0c0720c0 0x7fde0c0745d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fde300c25b0 tx=0x7fde180095a0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde301e4410 msgr2=0x7fde301f0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde301e4410 0x7fde301f0310 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde2000e970 tx=0x7fde2000ee30 comp rx=0 tx=0).stop 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 shutdown_connections 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde0c0720c0 0x7fde0c0745d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde30076bb0 0x7fde301e2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde300767a0 0x7fde300c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 --2- 172.21.15.89:0/997727026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde301e4410 0x7fde301f0310 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 >> 172.21.15.89:0/997727026 conn(0x7fde300ccf20 msgr2=0x7fde30151710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 shutdown_connections 2024-08-31T04:07:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.535+0000 7fde35c00640 1 -- 172.21.15.89:0/997727026 wait complete. 2024-08-31T04:07:52.559 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0' 2024-08-31T04:07:52.560 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0 2024-08-31T04:07:52.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.727+0000 7f7db1e00640 1 -- 172.21.15.89:0/3935167415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d90004d50 msgr2=0x7f7d90005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.727+0000 7f7db1e00640 1 --2- 172.21.15.89:0/3935167415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d90004d50 0x7f7d90005200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7da400c610 tx=0x7f7da401d2a0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.727+0000 7f7db1400640 1 -- 172.21.15.89:0/3935167415 reap_dead start 2024-08-31T04:07:52.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.727+0000 7f7db1e00640 1 -- 172.21.15.89:0/3935167415 shutdown_connections 2024-08-31T04:07:52.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.727+0000 7f7db1e00640 1 -- 172.21.15.89:0/3935167415 >> 172.21.15.89:0/3935167415 conn(0x7f7dac071900 msgr2=0x7f7dac06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:52.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.727+0000 7f7db1e00640 1 -- 172.21.15.89:0/3935167415 shutdown_connections 2024-08-31T04:07:52.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.727+0000 7f7db1e00640 1 -- 172.21.15.89:0/3935167415 wait complete. 2024-08-31T04:07:52.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 Processor -- start 2024-08-31T04:07:52.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 -- start start 2024-08-31T04:07:52.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d90004d50 0x7f7dac0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7dac1df890 0x7f7dac0b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dac1dfca0 0x7f7dac0b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac159cb0 con 0x7f7dac1df890 2024-08-31T04:07:52.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1597b0 con 0x7f7d90004d50 2024-08-31T04:07:52.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7dac159f90 con 0x7f7dac1dfca0 2024-08-31T04:07:52.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7dac1df890 0x7f7dac0b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7dac1df890 0x7f7dac0b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56062/0 (socket says 172.21.15.89:56062) 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7dabe00640 1 -- 172.21.15.89:0/3130233272 learned_addr learned my addr 172.21.15.89:0/3130233272 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db0a00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d90004d50 0x7f7dac0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1400640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dac1dfca0 0x7f7dac0b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7dabe00640 1 -- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dac1dfca0 msgr2=0x7f7dac0b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7dabe00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dac1dfca0 0x7f7dac0b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7dabe00640 1 -- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d90004d50 msgr2=0x7f7dac0c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7dabe00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d90004d50 0x7f7dac0c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7dabe00640 1 -- 172.21.15.89:0/3130233272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac0ca350 con 0x7f7dac1df890 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db0a00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d90004d50 0x7f7dac0c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7dabe00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7dac1df890 0x7f7dac0b2ad0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7d98004d90 tx=0x7f7d98001620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:52.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7da8c00640 1 -- 172.21.15.89:0/3130233272 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d980107d0 con 0x7f7dac1df890 2024-08-31T04:07:52.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7da8c00640 1 -- 172.21.15.89:0/3130233272 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d98016070 con 0x7f7dac1df890 2024-08-31T04:07:52.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 -- 172.21.15.89:0/3130233272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac1f1800 con 0x7f7dac1df890 2024-08-31T04:07:52.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7da8c00640 1 -- 172.21.15.89:0/3130233272 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98010ce0 con 0x7f7dac1df890 2024-08-31T04:07:52.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.731+0000 7f7db1e00640 1 -- 172.21.15.89:0/3130233272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac1f1dc0 con 0x7f7dac1df890 2024-08-31T04:07:52.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.735+0000 7f7da8c00640 1 -- 172.21.15.89:0/3130233272 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f7d9801b460 con 0x7f7dac1df890 2024-08-31T04:07:52.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.735+0000 7f7da8c00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7d8c0720f0 0x7f7d8c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.735+0000 7f7da8c00640 1 -- 172.21.15.89:0/3130233272 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f7d98093750 con 0x7f7dac1df890 2024-08-31T04:07:52.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.735+0000 7f7dbabef000 1 Processor -- start 2024-08-31T04:07:52.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.735+0000 7f7db0a00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7d8c0720f0 0x7f7d8c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.735+0000 7f7dbabef000 1 -- start start 2024-08-31T04:07:52.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.735+0000 7f7db0a00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7d8c0720f0 0x7f7d8c074600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009b70 tx=0x7f7d9c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a41b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a3e0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a3e1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ac4a236820 con 0x55ac4a2d3e90 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ac4a225db0 con 0x55ac4a2de3f0 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ac4a229d60 con 0x55ac4a2bd960 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a3e0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a3e0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56066/0 (socket says 172.21.15.89:56066) 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dabe00640 1 -- 172.21.15.89:0/2330509696 learned_addr learned my addr 172.21.15.89:0/2330509696 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7db1400640 1 --2- 172.21.15.89:0/2330509696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a3e1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7db0a00640 1 --2- 172.21.15.89:0/2330509696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a41b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dabe00640 1 -- 172.21.15.89:0/2330509696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 msgr2=0x55ac4a3e1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:52.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dabe00640 1 --2- 172.21.15.89:0/2330509696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a3e1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dabe00640 1 -- 172.21.15.89:0/2330509696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 msgr2=0x55ac4a41b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:52.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dabe00640 1 --2- 172.21.15.89:0/2330509696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a41b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dabe00640 1 -- 172.21.15.89:0/2330509696 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac4a1c0b70 con 0x55ac4a2d3e90 2024-08-31T04:07:52.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dabe00640 1 --2- 172.21.15.89:0/2330509696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a3e0ce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7d9805ab50 tx=0x7f7d9805dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983d0c113ed4d943 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:52.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7da1200640 1 -- 172.21.15.89:0/2330509696 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98067140 con 0x55ac4a2d3e90 2024-08-31T04:07:52.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7da1200640 1 -- 172.21.15.89:0/2330509696 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d9805e560 con 0x55ac4a2d3e90 2024-08-31T04:07:52.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7da1200640 1 -- 172.21.15.89:0/2330509696 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98062dd0 con 0x55ac4a2d3e90 2024-08-31T04:07:52.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 -- 172.21.15.89:0/2330509696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 msgr2=0x55ac4a3e0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2330509696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a3e0ce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7d9805ab50 tx=0x7f7d9805dcd0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 -- 172.21.15.89:0/2330509696 shutdown_connections 2024-08-31T04:07:52.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2330509696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a3e0ce0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2330509696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a3e1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2330509696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a41b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 -- 172.21.15.89:0/2330509696 >> 172.21.15.89:0/2330509696 conn(0x55ac49ee5210 msgr2=0x55ac4a41a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:52.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 -- 172.21.15.89:0/2330509696 shutdown_connections 2024-08-31T04:07:52.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 -- 172.21.15.89:0/2330509696 wait complete. 2024-08-31T04:07:52.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 -- start start 2024-08-31T04:07:52.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.739+0000 7f7dbabef000 1 Processor -- start 2024-08-31T04:07:52.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a4176f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a417c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a418170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ac49eecb10 con 0x55ac4a2d3e90 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ac4a1ac6f0 con 0x55ac4a2de3f0 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ac4a22e390 con 0x55ac4a2bd960 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 10 client.0 _ll_register_callbacks cb 0x55ac4a1cdb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a417c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a417c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56080/0 (socket says 172.21.15.89:56080) 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dabe00640 1 -- 172.21.15.89:0/2986396220 learned_addr learned my addr 172.21.15.89:0/2986396220 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7db0a00640 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a4176f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7db1400640 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a418170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dabe00640 1 -- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 msgr2=0x55ac4a4176f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dabe00640 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a4176f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dabe00640 1 -- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 msgr2=0x55ac4a418170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dabe00640 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a418170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dabe00640 1 -- 172.21.15.89:0/2986396220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac4a1e4380 con 0x55ac4a2d3e90 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dabe00640 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a417c30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7d98000fc0 tx=0x7f7d98010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ced4181c5550b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7d95600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7d95600640 1 -- 172.21.15.89:0/2986396220 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d980833e0 con 0x55ac4a2d3e90 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7d95600640 1 -- 172.21.15.89:0/2986396220 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f7d980650d0 con 0x55ac4a2d3e90 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 -- 172.21.15.89:0/2986396220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ac4a234d20 con 0x55ac4a2d3e90 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7d95600640 1 -- 172.21.15.89:0/2986396220 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7d9805e560 con 0x55ac4a2d3e90 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 10 client.4980 fetch_fsmap learned FSMap version 9 2024-08-31T04:07:52.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 -- 172.21.15.89:0/2986396220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ac4a2aae40 con 0x55ac4a2d3e90 2024-08-31T04:07:52.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7d95600640 1 -- 172.21.15.89:0/2986396220 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ac4a234d20 con 0x55ac4a2d3e90 2024-08-31T04:07:52.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7d95600640 1 -- 172.21.15.89:0/2986396220 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7d9805d7c0 con 0x55ac4a2d3e90 2024-08-31T04:07:52.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 10 client.4980 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:07:52.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 10 client.4980 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:07:52.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 20 client.4980 populate_metadata read hostname 'smithi089' 2024-08-31T04:07:52.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ac49ec9dc0 0x55ac4a431f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 4 client.4980 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:07:52.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7dbabef000 1 -- 172.21.15.89:0/2986396220 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac4a238770 con 0x55ac49ec9dc0 2024-08-31T04:07:52.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.743+0000 7f7db0a00640 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ac49ec9dc0 0x55ac4a431f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7db0a00640 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ac49ec9dc0 0x55ac4a431f90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db5cce226652aef9 server_cookie=b036071e95483e7 in_seq=0 out_seq=0 2024-08-31T04:07:52.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7d95600640 10 client.4980 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:52.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7d95600640 1 -- 172.21.15.89:0/2986396220 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac4a238770 con 0x55ac49ec9dc0 2024-08-31T04:07:52.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7d95600640 10 client.4980 handle_command_reply: tid=0 2024-08-31T04:07:52.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 client.4980 shutdown 2024-08-31T04:07:52.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 -- 172.21.15.89:0/2986396220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 msgr2=0x55ac4a417c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a417c30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7d98000fc0 tx=0x7f7d98010f00 comp rx=0 tx=0).stop 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 -- 172.21.15.89:0/2986396220 shutdown_connections 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ac49ec9dc0 0x55ac4a431f90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a417c30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a418170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2986396220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a4176f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7d95600640 0 client.4980 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 -- 172.21.15.89:0/2986396220 >> 172.21.15.89:0/2986396220 conn(0x55ac49ee5210 msgr2=0x55ac4a419ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.747+0000 7f7dbabef000 1 -- 172.21.15.89:0/2986396220 shutdown_connections 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.751+0000 7f7dbabef000 1 -- 172.21.15.89:0/2986396220 wait complete. 2024-08-31T04:07:52.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.751+0000 7f7dbabef000 20 client.4980 trim_cache size 0 max 16384 2024-08-31T04:07:52.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.767+0000 7f7dbabef000 1 Processor -- start 2024-08-31T04:07:52.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.767+0000 7f7dbabef000 1 -- start start 2024-08-31T04:07:52.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a42e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a42e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a427990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac06fc50 con 0x55ac4a2d3e90 2024-08-31T04:07:52.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1ffac0 con 0x55ac4a2de3f0 2024-08-31T04:07:52.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7dac1fed80 con 0x55ac4a2bd960 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a42e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7db0a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a42e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dabe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a42e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56094/0 (socket says 172.21.15.89:56094) 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dabe00640 1 -- 172.21.15.89:0/1034007796 learned_addr learned my addr 172.21.15.89:0/1034007796 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7db1400640 1 --2- 172.21.15.89:0/1034007796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a427990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dabe00640 1 -- 172.21.15.89:0/1034007796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 msgr2=0x55ac4a42e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dabe00640 1 --2- 172.21.15.89:0/1034007796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a42e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dabe00640 1 -- 172.21.15.89:0/1034007796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 msgr2=0x55ac4a427990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dabe00640 1 --2- 172.21.15.89:0/1034007796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a427990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dabe00640 1 -- 172.21.15.89:0/1034007796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac4a2825b0 con 0x55ac4a2d3e90 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dabe00640 1 --2- 172.21.15.89:0/1034007796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a42e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7d9805e4f0 tx=0x7f7d9805dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915a02ed9386c1ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:52.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7d97e00640 1 -- 172.21.15.89:0/1034007796 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98062dd0 con 0x55ac4a2d3e90 2024-08-31T04:07:52.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7d97e00640 1 -- 172.21.15.89:0/1034007796 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d980831e0 con 0x55ac4a2d3e90 2024-08-31T04:07:52.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7d97e00640 1 -- 172.21.15.89:0/1034007796 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98091320 con 0x55ac4a2d3e90 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 -- 172.21.15.89:0/1034007796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 msgr2=0x55ac4a42e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 --2- 172.21.15.89:0/1034007796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a42e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7d9805e4f0 tx=0x7f7d9805dc20 comp rx=0 tx=0).stop 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 -- 172.21.15.89:0/1034007796 shutdown_connections 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 --2- 172.21.15.89:0/1034007796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2d3e90 0x55ac4a42e770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 --2- 172.21.15.89:0/1034007796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2de3f0 0x55ac4a427990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 --2- 172.21.15.89:0/1034007796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2bd960 0x55ac4a42e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 -- 172.21.15.89:0/1034007796 >> 172.21.15.89:0/1034007796 conn(0x55ac49ee5210 msgr2=0x55ac4a424fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 -- 172.21.15.89:0/1034007796 shutdown_connections 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 -- 172.21.15.89:0/1034007796 wait complete. 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.771+0000 7f7dbabef000 1 -- start start 2024-08-31T04:07:52.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 Processor -- start 2024-08-31T04:07:52.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2bd960 0x55ac4a3de8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2d3e90 0x55ac4a42d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2de3f0 0x55ac4a42d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ac4a1a7eb0 con 0x55ac4a2de3f0 2024-08-31T04:07:52.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1ff3f0 con 0x55ac4a2bd960 2024-08-31T04:07:52.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ac4a1cdf20 con 0x55ac4a2d3e90 2024-08-31T04:07:52.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 10 client.0 _ll_register_callbacks cb 0x7f7d9805e3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:07:52.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7db1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2de3f0 0x55ac4a42d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7db1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2de3f0 0x55ac4a42d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56104/0 (socket says 172.21.15.89:56104) 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7db1400640 1 -- 172.21.15.89:0/2299374271 learned_addr learned my addr 172.21.15.89:0/2299374271 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dabe00640 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2d3e90 0x55ac4a42d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7db1400640 1 -- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2d3e90 msgr2=0x55ac4a42d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7db1400640 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2d3e90 0x55ac4a42d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7db1400640 1 -- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2bd960 msgr2=0x55ac4a3de8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7db1400640 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2bd960 0x55ac4a3de8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7db1400640 1 -- 172.21.15.89:0/2299374271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac4a1b6fc0 con 0x55ac4a2de3f0 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7db1400640 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2de3f0 0x55ac4a42d950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7da401b9a0 tx=0x7f7da4002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2358a06b11b5c77c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7d95600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7d95600640 1 -- 172.21.15.89:0/2299374271 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da40bf060 con 0x55ac4a2de3f0 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7d95600640 1 -- 172.21.15.89:0/2299374271 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f7da4003980 con 0x55ac4a2de3f0 2024-08-31T04:07:52.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 -- 172.21.15.89:0/2299374271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d980831e0 con 0x55ac4a2de3f0 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7d95600640 1 -- 172.21.15.89:0/2299374271 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7da40011d0 con 0x55ac4a2de3f0 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 10 client.4986 fetch_fsmap learned FSMap version 9 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 -- 172.21.15.89:0/2299374271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ac4a1afe00 con 0x55ac4a2de3f0 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7d95600640 1 -- 172.21.15.89:0/2299374271 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d980831e0 con 0x55ac4a2de3f0 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7d95600640 1 -- 172.21.15.89:0/2299374271 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7da40b9040 con 0x55ac4a2de3f0 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 10 client.4986 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 10 client.4986 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 20 client.4986 populate_metadata read hostname 'smithi089' 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ac49eb7e20 0x55ac4a4584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 4 client.4986 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}] 2024-08-31T04:07:52.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.775+0000 7f7dbabef000 1 -- 172.21.15.89:0/2299374271 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}) -- 0x55ac4a234210 con 0x55ac49eb7e20 2024-08-31T04:07:52.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.779+0000 7f7db0a00640 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ac49eb7e20 0x55ac4a4584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:07:52.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.779+0000 7f7db0a00640 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ac49eb7e20 0x55ac4a4584e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf03be39a16f7be4 server_cookie=c4d5851128d3844e in_seq=0 out_seq=0 2024-08-31T04:07:52.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:52.779+0000 7f7d95600640 10 client.4986 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7d95600640 1 -- 172.21.15.89:0/2299374271 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ac4a234210 con 0x55ac49eb7e20 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7d95600640 10 client.4986 handle_command_reply: tid=0 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 client.4986 shutdown 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 -- 172.21.15.89:0/2299374271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2de3f0 msgr2=0x55ac4a42d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2de3f0 0x55ac4a42d950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7da401b9a0 tx=0x7f7da4002080 comp rx=0 tx=0).stop 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 -- 172.21.15.89:0/2299374271 shutdown_connections 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ac49eb7e20 0x55ac4a4584e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ac4a2de3f0 0x55ac4a42d950 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ac4a2d3e90 0x55ac4a42d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:57.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 --2- 172.21.15.89:0/2299374271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac4a2bd960 0x55ac4a3de8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 -- 172.21.15.89:0/2299374271 >> 172.21.15.89:0/2299374271 conn(0x55ac49ee5210 msgr2=0x55ac4a4212e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7d95600640 0 client.4986 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 -- 172.21.15.89:0/2299374271 shutdown_connections 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 1 -- 172.21.15.89:0/2299374271 wait complete. 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7dbabef000 20 client.4986 trim_cache size 0 max 16384 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 14, 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stdout: "26f2ea51": { 2024-08-31T04:07:57.155 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 14, 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 141.8, 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:57.156 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:57.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:57.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:57.157 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:07:57.157 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:07:57.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 -- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7d8c0720f0 msgr2=0x7f7d8c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:57.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7d8c0720f0 0x7f7d8c074600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009b70 tx=0x7f7d9c0091e0 comp rx=0 tx=0).stop 2024-08-31T04:07:57.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 -- 172.21.15.89:0/3130233272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7dac1df890 msgr2=0x7f7dac0b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:07:57.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7dac1df890 0x7f7dac0b2ad0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7d98004d90 tx=0x7f7d98001620 comp rx=0 tx=0).stop 2024-08-31T04:07:57.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 -- 172.21.15.89:0/3130233272 shutdown_connections 2024-08-31T04:07:57.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7d8c0720f0 0x7f7d8c074600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:57.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7dac1df890 0x7f7dac0b2ad0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:57.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dac1dfca0 0x7f7dac0b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:57.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 --2- 172.21.15.89:0/3130233272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d90004d50 0x7f7dac0c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:07:57.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 -- 172.21.15.89:0/3130233272 >> 172.21.15.89:0/3130233272 conn(0x7f7dac071900 msgr2=0x7f7dac0cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:07:57.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 -- 172.21.15.89:0/3130233272 shutdown_connections 2024-08-31T04:07:57.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:07:57.151+0000 7f7db1e00640 1 -- 172.21.15.89:0/3130233272 wait complete. 2024-08-31T04:07:57.190 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '26f2ea51', quiesce took 5.0 seconds. Will release after: 16.8 2024-08-31T04:07:59.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:07:59.980 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:08:13.992 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:08:14.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 -- 172.21.15.89:0/1927856718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c50d0 msgr2=0x7fe0b415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 --2- 172.21.15.89:0/1927856718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c50d0 0x7fe0b415d270 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40752d0 tx=0x7fe0ac01c8c0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 -- 172.21.15.89:0/1927856718 shutdown_connections 2024-08-31T04:08:14.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 --2- 172.21.15.89:0/1927856718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c50d0 0x7fe0b415d270 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 --2- 172.21.15.89:0/1927856718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0b40c3e40 0x7fe0b40cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 --2- 172.21.15.89:0/1927856718 >> v2:172.21.15.170:3300/0 conn(0x7fe0b40b4090 0x7fe0b40ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 -- 172.21.15.89:0/1927856718 >> 172.21.15.89:0/1927856718 conn(0x7fe0b4071a40 msgr2=0x7fe0b406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:08:14.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 -- 172.21.15.89:0/1927856718 shutdown_connections 2024-08-31T04:08:14.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 -- 172.21.15.89:0/1927856718 wait complete. 2024-08-31T04:08:14.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 Processor -- start 2024-08-31T04:08:14.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.155+0000 7fe0bac00640 1 -- start start 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0bac00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0b40b4090 0x7fe0b406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0bac00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c3e40 0x7fe0b414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0bac00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0b40c50d0 0x7fe0b414eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0bac00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b40cc410 con 0x7fe0b40c3e40 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0bac00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b40cc290 con 0x7fe0b40c50d0 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0bac00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b40cc590 con 0x7fe0b40b4090 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c3e40 0x7fe0b414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c3e40 0x7fe0b414e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50670/0 (socket says 172.21.15.89:50670) 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3400640 1 -- 172.21.15.89:0/2231318552 learned_addr learned my addr 172.21.15.89:0/2231318552 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3e00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0b40b4090 0x7fe0b406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b8c00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0b40c50d0 0x7fe0b414eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3400640 1 -- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0b40b4090 msgr2=0x7fe0b406f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3400640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0b40b4090 0x7fe0b406f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3400640 1 -- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0b40c50d0 msgr2=0x7fe0b414eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3400640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0b40c50d0 0x7fe0b414eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3400640 1 -- 172.21.15.89:0/2231318552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b40c9a80 con 0x7fe0b40c3e40 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3e00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0b40b4090 0x7fe0b406f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0b3400640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c3e40 0x7fe0b414e760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000d720 tx=0x7fe0a000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0abe00640 1 -- 172.21.15.89:0/2231318552 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0017070 con 0x7fe0b40c3e40 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0abe00640 1 -- 172.21.15.89:0/2231318552 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0a0005310 con 0x7fe0b40c3e40 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b414f1e0 con 0x7fe0b40c3e40 2024-08-31T04:08:14.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0abe00640 1 -- 172.21.15.89:0/2231318552 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0009820 con 0x7fe0b40c3e40 2024-08-31T04:08:14.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b41f9bb0 con 0x7fe0b40c3e40 2024-08-31T04:08:14.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.159+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b415d270 con 0x7fe0b40c3e40 2024-08-31T04:08:14.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.163+0000 7fe0abe00640 1 -- 172.21.15.89:0/2231318552 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe0a00099c0 con 0x7fe0b40c3e40 2024-08-31T04:08:14.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.163+0000 7fe0abe00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0940720c0 0x7fe0940745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.163+0000 7fe0abe00640 1 -- 172.21.15.89:0/2231318552 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7fe0a00931e0 con 0x7fe0b40c3e40 2024-08-31T04:08:14.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.163+0000 7fe0b3e00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0940720c0 0x7fe0940745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.163+0000 7fe0b3e00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0940720c0 0x7fe0940745d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009df0 tx=0x7fe0a40093e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:08:14.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.167+0000 7fe0abe00640 1 -- 172.21.15.89:0/2231318552 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe0a005e5d0 con 0x7fe0b40c3e40 2024-08-31T04:08:14.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.367+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0b41f9940 con 0x7fe0b40c3e40 2024-08-31T04:08:14.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.367+0000 7fe0abe00640 1 -- 172.21.15.89:0/2231318552 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fe0a005ded0 con 0x7fe0b40c3e40 2024-08-31T04:08:14.372 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:08:14.372 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:08:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:08:14.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0940720c0 msgr2=0x7fe0940745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0940720c0 0x7fe0940745d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009df0 tx=0x7fe0a40093e0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c3e40 msgr2=0x7fe0b414e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c3e40 0x7fe0b414e760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000d720 tx=0x7fe0a000dbe0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 shutdown_connections 2024-08-31T04:08:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe0940720c0 0x7fe0940745d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0b40c3e40 0x7fe0b414e760 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe0b40c50d0 0x7fe0b414eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 --2- 172.21.15.89:0/2231318552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe0b40b4090 0x7fe0b406f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 >> 172.21.15.89:0/2231318552 conn(0x7fe0b4071a40 msgr2=0x7fe0b414f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:08:14.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 shutdown_connections 2024-08-31T04:08:14.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.371+0000 7fe0bac00640 1 -- 172.21.15.89:0/2231318552 wait complete. 2024-08-31T04:08:14.393 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 26f2ea51 --release --await' 2024-08-31T04:08:14.393 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 26f2ea51 --release --await 2024-08-31T04:08:14.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.547+0000 7f7f5ec00640 1 -- 172.21.15.89:0/2486180944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580b2860 msgr2=0x7f7f580b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.547+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/2486180944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580b2860 0x7f7f580b2d20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7f580725d0 tx=0x7f7f4801c800 comp rx=0 tx=0).stop 2024-08-31T04:08:14.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.547+0000 7f7f5ec00640 1 -- 172.21.15.89:0/2486180944 shutdown_connections 2024-08-31T04:08:14.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.547+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/2486180944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f580c90e0 0x7f7f580747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.547+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/2486180944 >> v2:172.21.15.170:3300/0 conn(0x7f7f580c1ed0 0x7f7f58152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.547+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/2486180944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580b2860 0x7f7f580b2d20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.547+0000 7f7f5ec00640 1 -- 172.21.15.89:0/2486180944 >> 172.21.15.89:0/2486180944 conn(0x7f7f580c99b0 msgr2=0x7f7f580c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:08:14.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.547+0000 7f7f5ec00640 1 -- 172.21.15.89:0/2486180944 shutdown_connections 2024-08-31T04:08:14.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.547+0000 7f7f5ec00640 1 -- 172.21.15.89:0/2486180944 wait complete. 2024-08-31T04:08:14.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5ec00640 1 Processor -- start 2024-08-31T04:08:14.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5ec00640 1 -- start start 2024-08-31T04:08:14.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5ec00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f580b2860 0x7f7f581f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5ec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f580c1ed0 0x7f7f5814e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5ec00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580c90e0 0x7f7f5814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5ec00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7f580c32e0 con 0x7f7f580c90e0 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5ec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f580c3160 con 0x7f7f580c1ed0 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5ec00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7f581585d0 con 0x7f7f580b2860 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580c90e0 0x7f7f5814f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580c90e0 0x7f7f5814f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50686/0 (socket says 172.21.15.89:50686) 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f5cc00640 1 -- 172.21.15.89:0/3538617867 learned_addr learned my addr 172.21.15.89:0/3538617867 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.551+0000 7f7f57e00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f580b2860 0x7f7f581f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f4f400640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f580c1ed0 0x7f7f5814e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f5cc00640 1 -- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f580b2860 msgr2=0x7f7f581f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f580b2860 0x7f7f581f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f5cc00640 1 -- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f580c1ed0 msgr2=0x7f7f5814e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f580c1ed0 0x7f7f5814e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f5cc00640 1 -- 172.21.15.89:0/3538617867 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f581f5840 con 0x7f7f580c90e0 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580c90e0 0x7f7f5814f090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000e970 tx=0x7f7f5000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:08:14.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f54c00640 1 -- 172.21.15.89:0/3538617867 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50004d30 con 0x7f7f580c90e0 2024-08-31T04:08:14.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f54c00640 1 -- 172.21.15.89:0/3538617867 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f5000cb20 con 0x7f7f580c90e0 2024-08-31T04:08:14.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f54c00640 1 -- 172.21.15.89:0/3538617867 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50005020 con 0x7f7f580c90e0 2024-08-31T04:08:14.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f5ec00640 1 -- 172.21.15.89:0/3538617867 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f580c5a20 con 0x7f7f580c90e0 2024-08-31T04:08:14.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.555+0000 7f7f5ec00640 1 -- 172.21.15.89:0/3538617867 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f580c5ce0 con 0x7f7f580c90e0 2024-08-31T04:08:14.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f54c00640 1 -- 172.21.15.89:0/3538617867 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f7f500051c0 con 0x7f7f580c90e0 2024-08-31T04:08:14.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f54c00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7f340720c0 0x7f7f340745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f54c00640 1 -- 172.21.15.89:0/3538617867 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f7f50093800 con 0x7f7f580c90e0 2024-08-31T04:08:14.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f66402000 1 Processor -- start 2024-08-31T04:08:14.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f66402000 1 -- start start 2024-08-31T04:08:14.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f57e00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7f340720c0 0x7f7f340745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f57e00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7f340720c0 0x7f7f340745d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f480af000 tx=0x7f7f480a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:08:14.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f66402000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 0x560010b47e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f66402000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a13930 0x560010b4cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f66402000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b4d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f66402000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5600109f2f30 con 0x560010a04890 2024-08-31T04:08:14.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f66402000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560010968690 con 0x560010a29950 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f66402000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560010957c20 con 0x560010a13930 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f5cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b4d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f5cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b4d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50694/0 (socket says 172.21.15.89:50694) 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f5cc00640 1 -- 172.21.15.89:0/3426165924 learned_addr learned my addr 172.21.15.89:0/3426165924 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f57e00640 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 0x560010b47e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f4f400640 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a13930 0x560010b4cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f5cc00640 1 -- 172.21.15.89:0/3426165924 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a13930 msgr2=0x560010b4cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a13930 0x560010b4cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f5cc00640 1 -- 172.21.15.89:0/3426165924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 msgr2=0x560010b47e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 0x560010b47e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f5cc00640 1 -- 172.21.15.89:0/3426165924 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001090c8f0 con 0x560010a04890 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f57e00640 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 0x560010b47e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:08:14.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b4d010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7f5005ac30 tx=0x7f7f5005e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe4613acdc86c0a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:08:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f47e00640 1 -- 172.21.15.89:0/3426165924 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5004b020 con 0x560010a04890 2024-08-31T04:08:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f47e00640 1 -- 172.21.15.89:0/3426165924 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f50067040 con 0x560010a04890 2024-08-31T04:08:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.559+0000 7f7f47e00640 1 -- 172.21.15.89:0/3426165924 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50083020 con 0x560010a04890 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 -- 172.21.15.89:0/3426165924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 msgr2=0x560010b4d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b4d010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7f5005ac30 tx=0x7f7f5005e540 comp rx=0 tx=0).stop 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 -- 172.21.15.89:0/3426165924 shutdown_connections 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b4d010 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a13930 0x560010b4cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 --2- 172.21.15.89:0/3426165924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 0x560010b47e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 -- 172.21.15.89:0/3426165924 >> 172.21.15.89:0/3426165924 conn(0x560010a29540 msgr2=0x560010b4a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 -- 172.21.15.89:0/3426165924 shutdown_connections 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 -- 172.21.15.89:0/3426165924 wait complete. 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 -- start start 2024-08-31T04:08:14.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 Processor -- start 2024-08-31T04:08:14.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b47030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 0x560010b47570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a29950 0x560010b51bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5600108de500 con 0x560010a04890 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56001095bbd0 con 0x560010a13930 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5600108ffa30 con 0x560010a29950 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f66402000 10 client.0 _ll_register_callbacks cb 0x560010a0db00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b47030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f57e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b47030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50702/0 (socket says 172.21.15.89:50702) 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f57e00640 1 -- 172.21.15.89:0/829901678 learned_addr learned my addr 172.21.15.89:0/829901678 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a29950 0x560010b51bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.563+0000 7f7f4f400640 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 0x560010b47570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f57e00640 1 -- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a29950 msgr2=0x560010b51bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f57e00640 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a29950 0x560010b51bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f57e00640 1 -- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 msgr2=0x560010b47570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:08:14.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f57e00640 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 0x560010b47570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f57e00640 1 -- 172.21.15.89:0/829901678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600108f76a0 con 0x560010a04890 2024-08-31T04:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f57e00640 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b47030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f4801d0a0 tx=0x7f7f4801b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7801cfbd9dd5c89e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f44c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f44c00640 1 -- 172.21.15.89:0/829901678 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48005040 con 0x560010a04890 2024-08-31T04:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f44c00640 1 -- 172.21.15.89:0/829901678 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f7f480051e0 con 0x560010a04890 2024-08-31T04:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f66402000 1 -- 172.21.15.89:0/829901678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5600108f17e0 con 0x560010a04890 2024-08-31T04:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f44c00640 1 -- 172.21.15.89:0/829901678 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7f480ce050 con 0x560010a04890 2024-08-31T04:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f66402000 10 client.5004 fetch_fsmap learned FSMap version 9 2024-08-31T04:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f66402000 1 -- 172.21.15.89:0/829901678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5600109161c0 con 0x560010a04890 2024-08-31T04:08:14.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f44c00640 1 -- 172.21.15.89:0/829901678 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5600108f17e0 con 0x560010a04890 2024-08-31T04:08:14.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f44c00640 1 -- 172.21.15.89:0/829901678 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7f480d1020 con 0x560010a04890 2024-08-31T04:08:14.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f66402000 10 client.5004 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:08:14.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f66402000 10 client.5004 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:08:14.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f66402000 20 client.5004 populate_metadata read hostname 'smithi089' 2024-08-31T04:08:14.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f66402000 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600109edfc0 0x560010b52970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f66402000 4 client.5004 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:08:14.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f66402000 1 -- 172.21.15.89:0/829901678 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56001096a5e0 con 0x5600109edfc0 2024-08-31T04:08:14.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f4f400640 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600109edfc0 0x560010b52970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f4f400640 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600109edfc0 0x560010b52970 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d1fe9e47fea4b8c server_cookie=6212fa268f7faf79 in_seq=0 out_seq=0 2024-08-31T04:08:14.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.567+0000 7f7f44c00640 10 client.5004 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:08:14.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f44c00640 1 -- 172.21.15.89:0/829901678 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56001096a5e0 con 0x5600109edfc0 2024-08-31T04:08:14.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f44c00640 10 client.5004 handle_command_reply: tid=0 2024-08-31T04:08:14.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 client.5004 shutdown 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 -- 172.21.15.89:0/829901678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 msgr2=0x560010b47030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b47030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f4801d0a0 tx=0x7f7f4801b040 comp rx=0 tx=0).stop 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 -- 172.21.15.89:0/829901678 shutdown_connections 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600109edfc0 0x560010b52970 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a29950 0x560010b51bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 0x560010b47570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 --2- 172.21.15.89:0/829901678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a04890 0x560010b47030 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f44c00640 0 client.5004 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 -- 172.21.15.89:0/829901678 >> 172.21.15.89:0/829901678 conn(0x560010a29540 msgr2=0x560010b48040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 -- 172.21.15.89:0/829901678 shutdown_connections 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 1 -- 172.21.15.89:0/829901678 wait complete. 2024-08-31T04:08:14.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.571+0000 7f7f66402000 20 client.5004 trim_cache size 0 max 16384 2024-08-31T04:08:14.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.587+0000 7f7f66402000 1 Processor -- start 2024-08-31T04:08:14.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.587+0000 7f7f66402000 1 -- start start 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 0x560010b60380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a13930 0x560010b608c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 0x560010b60e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58204260 con 0x560010a13930 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58203140 con 0x560010a29950 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7f581570d0 con 0x560010a04890 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f4f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a13930 0x560010b608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f4f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a13930 0x560010b608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50706/0 (socket says 172.21.15.89:50706) 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f4f400640 1 -- 172.21.15.89:0/1250722291 learned_addr learned my addr 172.21.15.89:0/1250722291 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 0x560010b60e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f57e00640 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 0x560010b60380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f4f400640 1 -- 172.21.15.89:0/1250722291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 msgr2=0x560010b60380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:08:14.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f4f400640 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 0x560010b60380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f4f400640 1 -- 172.21.15.89:0/1250722291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 msgr2=0x560010b60e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:08:14.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f4f400640 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 0x560010b60e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f4f400640 1 -- 172.21.15.89:0/1250722291 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560010b51f40 con 0x560010a13930 2024-08-31T04:08:14.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f57e00640 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 0x560010b60380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:08:14.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f4f400640 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a13930 0x560010b608c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000fcb0 tx=0x7f7f400128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e8ee67b55692a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:08:14.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f47400640 1 -- 172.21.15.89:0/1250722291 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f40004020 con 0x560010a13930 2024-08-31T04:08:14.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f47400640 1 -- 172.21.15.89:0/1250722291 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f400041e0 con 0x560010a13930 2024-08-31T04:08:14.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f47400640 1 -- 172.21.15.89:0/1250722291 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f40003600 con 0x560010a13930 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 -- 172.21.15.89:0/1250722291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a13930 msgr2=0x560010b608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a13930 0x560010b608c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000fcb0 tx=0x7f7f400128e0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 -- 172.21.15.89:0/1250722291 shutdown_connections 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a13930 0x560010b608c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a29950 0x560010b60e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 --2- 172.21.15.89:0/1250722291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 0x560010b60380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 -- 172.21.15.89:0/1250722291 >> 172.21.15.89:0/1250722291 conn(0x560010a29540 msgr2=0x560010b08040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 -- 172.21.15.89:0/1250722291 shutdown_connections 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 -- 172.21.15.89:0/1250722291 wait complete. 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 -- start start 2024-08-31T04:08:14.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.591+0000 7f7f66402000 1 Processor -- start 2024-08-31T04:08:14.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 0x560010b66f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 0x560010b67440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a29950 0x560010bc4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58201d60 con 0x560010a29950 2024-08-31T04:08:14.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58202a70 con 0x560010a13930 2024-08-31T04:08:14.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7f582023a0 con 0x560010a04890 2024-08-31T04:08:14.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 10 client.0 _ll_register_callbacks cb 0x7f7f48009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:08:14.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f5cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a29950 0x560010bc4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f5cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a29950 0x560010bc4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50720/0 (socket says 172.21.15.89:50720) 2024-08-31T04:08:14.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f5cc00640 1 -- 172.21.15.89:0/4105902383 learned_addr learned my addr 172.21.15.89:0/4105902383 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:08:14.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f57e00640 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 0x560010b66f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f4f400640 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 0x560010b67440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f5cc00640 1 -- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 msgr2=0x560010b66f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:08:14.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 0x560010b66f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f5cc00640 1 -- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 msgr2=0x560010b67440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:08:14.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 0x560010b67440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f5cc00640 1 -- 172.21.15.89:0/4105902383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600109dc2f0 con 0x560010a29950 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f5cc00640 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a29950 0x560010bc4960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7f5005b8b0 tx=0x7f7f50083490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983a87b8f4614e2b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f44c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f44c00640 1 -- 172.21.15.89:0/4105902383 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5004b030 con 0x560010a29950 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f44c00640 1 -- 172.21.15.89:0/4105902383 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f7f50059fb0 con 0x560010a29950 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 -- 172.21.15.89:0/4105902383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f400041e0 con 0x560010a29950 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f44c00640 1 -- 172.21.15.89:0/4105902383 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7f50083040 con 0x560010a29950 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 10 client.5010 fetch_fsmap learned FSMap version 9 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 -- 172.21.15.89:0/4105902383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5600108e1b30 con 0x560010a29950 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f44c00640 1 -- 172.21.15.89:0/4105902383 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f400041e0 con 0x560010a29950 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f44c00640 1 -- 172.21.15.89:0/4105902383 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7f5000f040 con 0x560010a29950 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 10 client.5010 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:08:14.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 10 client.5010 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:08:14.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 20 client.5010 populate_metadata read hostname 'smithi089' 2024-08-31T04:08:14.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600105e9e80 0x560010bc4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:08:14.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 4 client.5010 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "26f2ea51", "release": true, "await": true}] 2024-08-31T04:08:14.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f66402000 1 -- 172.21.15.89:0/4105902383 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "26f2ea51", "release": true, "await": true}) -- 0x560010966080 con 0x5600105e9e80 2024-08-31T04:08:14.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.595+0000 7f7f57e00640 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600105e9e80 0x560010bc4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:08:14.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.599+0000 7f7f57e00640 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600105e9e80 0x560010bc4ea0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51aa0a619e7a8df server_cookie=9f938feca35050bd in_seq=0 out_seq=0 2024-08-31T04:08:14.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.599+0000 7f7f44c00640 10 client.5010 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:08:14.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f44c00640 1 -- 172.21.15.89:0/4105902383 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560010966080 con 0x5600105e9e80 2024-08-31T04:08:14.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f44c00640 10 client.5010 handle_command_reply: tid=0 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 client.5010 shutdown 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 -- 172.21.15.89:0/4105902383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a29950 msgr2=0x560010bc4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a29950 0x560010bc4960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7f5005b8b0 tx=0x7f7f50083490 comp rx=0 tx=0).stop 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 -- 172.21.15.89:0/4105902383 shutdown_connections 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600105e9e80 0x560010bc4ea0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560010a29950 0x560010bc4960 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560010a13930 0x560010b67440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 --2- 172.21.15.89:0/4105902383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560010a04890 0x560010b66f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f44c00640 0 client.5010 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 -- 172.21.15.89:0/4105902383 >> 172.21.15.89:0/4105902383 conn(0x560010a29540 msgr2=0x560010b51340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 -- 172.21.15.89:0/4105902383 shutdown_connections 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 1 -- 172.21.15.89:0/4105902383 wait complete. 2024-08-31T04:08:14.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f66402000 20 client.5010 trim_cache size 0 max 16384 2024-08-31T04:08:14.869 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:08:14.869 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:08:14.869 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:08:14.869 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 16, 2024-08-31T04:08:14.869 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:08:14.869 INFO:teuthology.orchestra.run.smithi089.stdout: "26f2ea51": { 2024-08-31T04:08:14.869 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 16, 2024-08-31T04:08:14.869 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:08:14.869 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 141.8, 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:08:14.870 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:08:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:08:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:08:14.871 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:08:14.871 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:08:14.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 -- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7f340720c0 msgr2=0x7f7f340745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7f340720c0 0x7f7f340745d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f480af000 tx=0x7f7f480a7040 comp rx=0 tx=0).stop 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 -- 172.21.15.89:0/3538617867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580c90e0 msgr2=0x7f7f5814f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580c90e0 0x7f7f5814f090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000e970 tx=0x7f7f5000ee30 comp rx=0 tx=0).stop 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 -- 172.21.15.89:0/3538617867 shutdown_connections 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7f340720c0 0x7f7f340745d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f580c90e0 0x7f7f5814f090 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f580c1ed0 0x7f7f5814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 --2- 172.21.15.89:0/3538617867 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f580b2860 0x7f7f581f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 -- 172.21.15.89:0/3538617867 >> 172.21.15.89:0/3538617867 conn(0x7f7f580c99b0 msgr2=0x7f7f58158930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 -- 172.21.15.89:0/3538617867 shutdown_connections 2024-08-31T04:08:14.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:08:14.863+0000 7f7f5ec00640 1 -- 172.21.15.89:0/3538617867 wait complete. 2024-08-31T04:08:14.887 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '26f2ea51', total seconds elapsed: 22.7 2024-08-31T04:08:16.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/19' 2024-08-31T04:08:16.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/15' 2024-08-31T04:08:16.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/31' 2024-08-31T04:08:16.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/36' 2024-08-31T04:08:16.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/20' 2024-08-31T04:08:16.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/12' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/39' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/10' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/34' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/38' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/11' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/16' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/32' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/30' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/14' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/18' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/13' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/33' 2024-08-31T04:08:16.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/17' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/35' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './100/37' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './100' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/19' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/15' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/31' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/36' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/20' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/12' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/39' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/10' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/34' 2024-08-31T04:08:16.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/38' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/11' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/16' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/32' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/30' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/14' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/18' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/13' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/33' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/17' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/35' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './101/37' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './101' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/19' 2024-08-31T04:08:16.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/15' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/31' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/36' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/20' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/12' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/39' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/10' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/34' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/38' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/11' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/16' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/32' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/30' 2024-08-31T04:08:16.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/14' 2024-08-31T04:08:16.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/18' 2024-08-31T04:08:16.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/13' 2024-08-31T04:08:16.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/33' 2024-08-31T04:08:16.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/17' 2024-08-31T04:08:16.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/35' 2024-08-31T04:08:16.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './102/37' 2024-08-31T04:08:16.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './102' 2024-08-31T04:08:16.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/19' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/15' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/31' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/36' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/20' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/12' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/39' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/10' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/34' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/38' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/11' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/16' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/32' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/30' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/14' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/18' 2024-08-31T04:08:16.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/13' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/33' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/17' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/35' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './103/37' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './103' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/19' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/15' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/31' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/36' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/20' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/12' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/39' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/10' 2024-08-31T04:08:16.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/34' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/38' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/11' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/16' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/32' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/30' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/14' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/18' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/13' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/33' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/17' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/35' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './104/37' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './104' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/19' 2024-08-31T04:08:16.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/15' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/31' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/36' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/20' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/12' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/39' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/10' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/34' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/38' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/11' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/16' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/32' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/30' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/14' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/18' 2024-08-31T04:08:16.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/13' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/33' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/17' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/35' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './105/37' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './105' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/19' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/15' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/31' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/36' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/20' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/12' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/39' 2024-08-31T04:08:16.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/10' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/34' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/38' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/11' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/16' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/32' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/30' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/14' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/18' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/13' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/33' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/17' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/35' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './106/37' 2024-08-31T04:08:16.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './106' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/19' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/15' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/31' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/36' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/20' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/12' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/39' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/10' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/34' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/38' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/11' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/16' 2024-08-31T04:08:16.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/32' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/30' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/14' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/18' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/13' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/33' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/17' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/35' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './107/37' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './107' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/19' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/15' 2024-08-31T04:08:16.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/31' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/36' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/20' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/12' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/39' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/10' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/34' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/38' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/11' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/16' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/32' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/30' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/14' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/18' 2024-08-31T04:08:16.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/13' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/33' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/17' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/35' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './108/37' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './108' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/19' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/15' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/31' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/36' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/20' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/12' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/39' 2024-08-31T04:08:16.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/10' 2024-08-31T04:08:16.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/34' 2024-08-31T04:08:16.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/38' 2024-08-31T04:08:16.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/11' 2024-08-31T04:08:16.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/16' 2024-08-31T04:08:16.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/32' 2024-08-31T04:08:16.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/30' 2024-08-31T04:08:18.763 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/14' 2024-08-31T04:08:18.763 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/18' 2024-08-31T04:08:18.763 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/13' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/33' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/17' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/35' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './109/37' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './109' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/19' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/15' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/31' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/36' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/20' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/12' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/39' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/10' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/34' 2024-08-31T04:08:18.764 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/38' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/11' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/16' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/32' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/30' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/14' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/18' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/13' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/33' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/17' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/35' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './110/37' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './110' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/19' 2024-08-31T04:08:18.765 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/15' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/31' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/36' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/20' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/12' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/39' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/10' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/34' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/38' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/11' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/16' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/32' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/30' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/14' 2024-08-31T04:08:18.766 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/18' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/13' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/33' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/17' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/35' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './111/37' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './111' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/19' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/15' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/31' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/36' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/20' 2024-08-31T04:08:18.767 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/12' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/39' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/10' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/34' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/38' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/11' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/16' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/32' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/30' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/14' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/18' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/13' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/33' 2024-08-31T04:08:18.768 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/17' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/35' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './112/37' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './112' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/19' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/15' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/31' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/36' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/20' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/12' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/39' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/10' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/34' 2024-08-31T04:08:18.769 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/38' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/11' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/16' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/32' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/30' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/14' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/18' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/13' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/33' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/17' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/35' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed './113/37' 2024-08-31T04:08:18.770 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './113' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/19' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/15' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/31' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/36' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/20' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/12' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/39' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/10' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/34' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/38' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/11' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/16' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/32' 2024-08-31T04:08:18.771 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/30' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/14' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/18' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/13' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/33' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/17' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/35' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './114/37' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './114' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/19' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/15' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/31' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/36' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/20' 2024-08-31T04:08:18.772 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/12' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/39' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/10' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/34' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/38' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/11' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/16' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/32' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/30' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/14' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/18' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/13' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/33' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/17' 2024-08-31T04:08:18.773 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/35' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './115/37' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './115' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/19' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/15' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/31' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/36' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/20' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/12' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/39' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/10' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/34' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/38' 2024-08-31T04:08:18.774 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/11' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/16' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/32' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/30' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/14' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/18' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/13' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/33' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/17' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/35' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './116/37' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './116' 2024-08-31T04:08:18.775 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/19' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/15' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/31' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/36' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/20' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/12' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/39' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/10' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/34' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/38' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/11' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/16' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/32' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/30' 2024-08-31T04:08:18.776 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/14' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/18' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/13' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/33' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/17' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/35' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './117/37' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './117' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/19' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/15' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/31' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/36' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/20' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/12' 2024-08-31T04:08:18.777 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/39' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/10' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/34' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/38' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/11' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/16' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/32' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/30' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/14' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/18' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/13' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/33' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/17' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/35' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed './118/37' 2024-08-31T04:08:18.778 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './118' 2024-08-31T04:08:18.779 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/19' 2024-08-31T04:08:18.779 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/15' 2024-08-31T04:08:18.779 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/31' 2024-08-31T04:08:18.779 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/36' 2024-08-31T04:08:18.779 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/20' 2024-08-31T04:08:18.779 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/12' 2024-08-31T04:08:22.828 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/39' 2024-08-31T04:08:22.828 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/10' 2024-08-31T04:08:22.828 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/34' 2024-08-31T04:08:22.828 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/38' 2024-08-31T04:08:22.828 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/11' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/16' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/32' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/30' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/14' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/18' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/13' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/33' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/17' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/35' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './119/37' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './119' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/19' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/15' 2024-08-31T04:08:22.829 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/31' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/36' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/20' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/12' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/39' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/10' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/34' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/38' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/11' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/16' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/32' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/30' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/14' 2024-08-31T04:08:22.830 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/18' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/13' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/33' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/17' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/35' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './120/37' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './120' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/19' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/15' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/31' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/36' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/20' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/12' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/39' 2024-08-31T04:08:22.831 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/10' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/34' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/38' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/11' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/16' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/32' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/30' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/14' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/18' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/13' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/33' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/17' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/35' 2024-08-31T04:08:22.832 INFO:tasks.workunit.client.0.smithi089.stdout:removed './121/37' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './121' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/19' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/15' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/31' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/36' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/20' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/12' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/39' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/10' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/34' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/38' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/11' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/16' 2024-08-31T04:08:22.833 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/32' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/30' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/14' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/18' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/13' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/33' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/17' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/35' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './122/37' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './122' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/19' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/15' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/31' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/36' 2024-08-31T04:08:22.834 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/20' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/12' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/39' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/10' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/34' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/38' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/11' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/16' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/32' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/30' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/14' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/18' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/13' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/33' 2024-08-31T04:08:22.835 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/17' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/35' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './123/37' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './123' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/19' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/15' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/31' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/36' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/20' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/12' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/39' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/10' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/34' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/38' 2024-08-31T04:08:22.836 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/11' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/16' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/32' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/30' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/14' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/18' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/13' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/33' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/17' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/35' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './124/37' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './124' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/19' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/15' 2024-08-31T04:08:22.837 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/31' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/36' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/20' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/12' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/39' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/10' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/34' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/38' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/11' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/16' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/32' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/30' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/14' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/18' 2024-08-31T04:08:22.838 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/13' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/33' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/17' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/35' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './125/37' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './125' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/19' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/15' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/31' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/36' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/20' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/12' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/39' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/10' 2024-08-31T04:08:22.839 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/34' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/38' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/11' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/16' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/32' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/30' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/14' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/18' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/13' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/33' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/17' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/35' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './126/37' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './126' 2024-08-31T04:08:22.840 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/19' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/15' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/31' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/36' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/20' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/12' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/39' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/10' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/34' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/38' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/11' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/16' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/32' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/30' 2024-08-31T04:08:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/14' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/18' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/13' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/33' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/17' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/35' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './127/37' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './127' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/19' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/15' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/31' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/36' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/20' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/12' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/39' 2024-08-31T04:08:22.842 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/10' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/34' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/38' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/11' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/16' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/32' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/30' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/14' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/18' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/13' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/33' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/17' 2024-08-31T04:08:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/35' 2024-08-31T04:08:25.585 INFO:tasks.workunit.client.0.smithi089.stdout:removed './128/37' 2024-08-31T04:08:25.585 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './128' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/19' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/15' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/31' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/36' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/20' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/12' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/39' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/10' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/34' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/38' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/11' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/16' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/32' 2024-08-31T04:08:25.586 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/30' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/14' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/18' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/13' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/33' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/17' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/35' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './129/37' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './129' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/19' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/15' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/31' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/36' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/20' 2024-08-31T04:08:25.587 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/12' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/39' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/10' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/34' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/38' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/11' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/16' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/32' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/30' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/14' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/18' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/13' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/33' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/17' 2024-08-31T04:08:25.588 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/35' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './130/37' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './130' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/19' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/15' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/31' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/36' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/20' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/12' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/39' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/10' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/34' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/38' 2024-08-31T04:08:25.589 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/11' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/16' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/32' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/30' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/14' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/18' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/13' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/33' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/17' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/35' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './131/37' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './131' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/19' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/15' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/31' 2024-08-31T04:08:25.590 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/36' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/20' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/12' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/39' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/10' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/34' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/38' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/11' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/16' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/32' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/30' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/14' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/18' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/13' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/33' 2024-08-31T04:08:25.591 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/17' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/35' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './132/37' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './132' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/19' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/15' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/31' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/36' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/20' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/12' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/39' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/10' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/34' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/38' 2024-08-31T04:08:25.592 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/11' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/16' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/32' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/30' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/14' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/18' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/13' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/33' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/17' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/35' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './133/37' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './133' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/19' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/15' 2024-08-31T04:08:25.593 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/31' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/36' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/20' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/12' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/39' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/10' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/34' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/38' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/11' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/16' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/32' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/30' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/14' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/18' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/13' 2024-08-31T04:08:25.594 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/33' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/17' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/35' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './134/37' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './134' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/19' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/15' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/31' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/36' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/20' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/12' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/39' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/10' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/34' 2024-08-31T04:08:25.595 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/38' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/11' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/16' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/32' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/30' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/14' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/18' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/13' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/33' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/17' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/35' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './135/37' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './135' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/19' 2024-08-31T04:08:25.596 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/15' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/31' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/36' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/20' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/12' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/39' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/10' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/34' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/38' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/11' 2024-08-31T04:08:25.597 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/16' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/32' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/30' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/14' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/18' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/13' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/33' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/17' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/35' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed './136/37' 2024-08-31T04:08:25.598 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './136' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/19' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/15' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/31' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/36' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/20' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/12' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/39' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/10' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/34' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/38' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/11' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/16' 2024-08-31T04:08:25.599 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/32' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/30' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/14' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/18' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/13' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/33' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/17' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/35' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './137/37' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './137' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/19' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/15' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/31' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/36' 2024-08-31T04:08:25.600 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/20' 2024-08-31T04:08:25.601 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/12' 2024-08-31T04:08:25.601 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/39' 2024-08-31T04:08:25.601 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/10' 2024-08-31T04:08:25.601 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/34' 2024-08-31T04:08:25.601 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/38' 2024-08-31T04:08:25.601 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/11' 2024-08-31T04:08:25.601 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/16' 2024-08-31T04:08:28.686 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/32' 2024-08-31T04:08:28.686 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/30' 2024-08-31T04:08:28.686 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/14' 2024-08-31T04:08:28.686 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/18' 2024-08-31T04:08:28.686 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/13' 2024-08-31T04:08:28.686 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/33' 2024-08-31T04:08:28.686 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/17' 2024-08-31T04:08:28.686 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/35' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './138/37' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './138' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/19' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/15' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/31' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/36' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/20' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/12' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/39' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/10' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/34' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/38' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/11' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/16' 2024-08-31T04:08:28.687 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/32' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/30' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/14' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/18' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/13' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/33' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/17' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/35' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './139/37' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './139' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/19' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/15' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/31' 2024-08-31T04:08:28.688 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/36' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/20' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/12' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/39' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/10' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/34' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/38' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/11' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/16' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/32' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/30' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/14' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/18' 2024-08-31T04:08:28.689 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/13' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/33' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/17' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/35' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './140/37' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './140' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/19' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/15' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/31' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/36' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/20' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/12' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/39' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/10' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/34' 2024-08-31T04:08:28.690 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/38' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/11' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/16' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/32' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/30' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/14' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/18' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/13' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/33' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/17' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/35' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './141/37' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './141' 2024-08-31T04:08:28.691 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/19' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/15' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/31' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/36' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/20' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/12' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/39' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/10' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/34' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/38' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/11' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/16' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/32' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/30' 2024-08-31T04:08:28.692 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/14' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/18' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/13' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/33' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/17' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/35' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './142/37' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './142' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/19' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/15' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/31' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/36' 2024-08-31T04:08:28.693 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/20' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/12' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/39' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/10' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/34' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/38' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/11' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/16' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/32' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/30' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/14' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/18' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/13' 2024-08-31T04:08:28.694 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/33' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/17' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/35' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './143/37' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './143' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/19' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/15' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/31' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/36' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/20' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/12' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/39' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/10' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/34' 2024-08-31T04:08:28.695 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/38' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/11' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/16' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/32' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/30' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/14' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/18' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/13' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/33' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/17' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/35' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './144/37' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './144' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/19' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/15' 2024-08-31T04:08:28.696 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/31' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/36' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/20' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/12' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/39' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/10' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/34' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/38' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/11' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/16' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/32' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/30' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/14' 2024-08-31T04:08:28.697 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/18' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/13' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/33' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/17' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/35' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './145/37' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './145' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/19' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/15' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/31' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/36' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/20' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/12' 2024-08-31T04:08:28.698 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/39' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/10' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/34' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/38' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/11' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/16' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/32' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/30' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/14' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/18' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/13' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/33' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/17' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/35' 2024-08-31T04:08:28.699 INFO:tasks.workunit.client.0.smithi089.stdout:removed './146/37' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './146' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/19' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/15' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/31' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/36' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/20' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/12' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/39' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/10' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/34' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/38' 2024-08-31T04:08:28.700 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/11' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/16' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/32' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/30' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/14' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/18' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/13' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/33' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/17' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/35' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './147/37' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './147' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/19' 2024-08-31T04:08:28.701 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/15' 2024-08-31T04:08:28.702 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/31' 2024-08-31T04:08:28.702 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/36' 2024-08-31T04:08:30.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:08:30.035 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:08:31.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/20' 2024-08-31T04:08:31.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/12' 2024-08-31T04:08:31.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/39' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/10' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/34' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/38' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/11' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/16' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/32' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/30' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/14' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/18' 2024-08-31T04:08:31.237 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/13' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/33' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/17' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/35' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './148/37' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './148' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/19' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/15' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/31' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/36' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/20' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/12' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/39' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/10' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/34' 2024-08-31T04:08:31.238 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/38' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/11' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/16' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/32' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/30' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/14' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/18' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/13' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/33' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/17' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/35' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './149/37' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './149' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/19' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/15' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/31' 2024-08-31T04:08:31.239 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/36' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/20' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/12' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/39' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/10' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/34' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/38' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/11' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/16' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/32' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/30' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/14' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/18' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/13' 2024-08-31T04:08:31.240 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/33' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/17' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/35' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './150/37' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './150' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/19' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/15' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/31' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/36' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/20' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/12' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/39' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/10' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/34' 2024-08-31T04:08:31.241 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/38' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/11' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/16' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/32' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/30' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/14' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/18' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/13' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/33' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/17' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/35' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './151/37' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './151' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/19' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/15' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/31' 2024-08-31T04:08:31.242 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/36' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/20' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/12' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/39' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/10' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/34' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/38' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/11' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/16' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/32' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/30' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/14' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/18' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/13' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/33' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/17' 2024-08-31T04:08:31.243 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/35' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './152/37' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './152' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/19' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/15' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/31' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/36' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/20' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/12' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/39' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/10' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/34' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/38' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/11' 2024-08-31T04:08:31.244 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/16' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/32' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/30' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/14' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/18' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/13' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/33' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/17' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/35' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './153/37' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './153' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/19' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/15' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/31' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/36' 2024-08-31T04:08:31.245 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/20' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/12' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/39' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/10' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/34' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/38' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/11' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/16' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/32' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/30' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/14' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/18' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/13' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/33' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/17' 2024-08-31T04:08:31.246 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/35' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './154/37' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './154' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/19' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/15' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/31' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/36' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/20' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/12' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/39' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/10' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/34' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/38' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/11' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/16' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/32' 2024-08-31T04:08:31.247 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/30' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/14' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/18' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/13' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/33' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/17' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/35' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './155/37' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './155' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/19' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/15' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/31' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/36' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/20' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/12' 2024-08-31T04:08:31.248 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/39' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/10' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/34' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/38' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/11' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/16' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/32' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/30' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/14' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/18' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/13' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/33' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/17' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/35' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './156/37' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './156' 2024-08-31T04:08:31.249 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/19' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/15' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/31' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/36' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/20' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/12' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/39' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/10' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/34' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/38' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/11' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/16' 2024-08-31T04:08:31.250 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/32' 2024-08-31T04:08:31.251 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/30' 2024-08-31T04:08:31.251 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/14' 2024-08-31T04:08:31.251 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/18' 2024-08-31T04:08:31.251 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/13' 2024-08-31T04:08:31.251 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/33' 2024-08-31T04:08:33.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/17' 2024-08-31T04:08:33.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/35' 2024-08-31T04:08:33.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './157/37' 2024-08-31T04:08:33.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './157' 2024-08-31T04:08:33.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/19' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/15' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/31' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/36' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/20' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/12' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/39' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/10' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/34' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/38' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/11' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/16' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/32' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/30' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/14' 2024-08-31T04:08:33.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/18' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/13' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/33' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/17' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/35' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './158/37' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './158' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/19' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/15' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/31' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/36' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/20' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/12' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/39' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/10' 2024-08-31T04:08:33.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/34' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/38' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/11' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/16' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/32' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/30' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/14' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/18' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/13' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/33' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/17' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/35' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './159/37' 2024-08-31T04:08:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './159' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/19' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/15' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/31' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/36' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/20' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/12' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/39' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/10' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/34' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/38' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/11' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/16' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/32' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/30' 2024-08-31T04:08:33.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/14' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/18' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/13' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/33' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/17' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/35' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './160/37' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './160' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/19' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/15' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/31' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/36' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/20' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/12' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/39' 2024-08-31T04:08:33.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/10' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/34' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/38' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/11' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/16' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/32' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/30' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/14' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/18' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/13' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/33' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/17' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/35' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './161/37' 2024-08-31T04:08:33.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './161' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/19' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/15' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/31' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/36' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/20' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/12' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/39' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/10' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/34' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/38' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/11' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/16' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/32' 2024-08-31T04:08:33.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/30' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/14' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/18' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/13' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/33' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/17' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/35' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './162/37' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './162' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/19' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/15' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/31' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/36' 2024-08-31T04:08:33.889 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/20' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/12' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/39' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/10' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/34' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/38' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/11' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/16' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/32' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/30' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/14' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/18' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/13' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/33' 2024-08-31T04:08:33.890 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/17' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/35' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './163/37' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './163' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/19' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/15' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/31' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/36' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/20' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/12' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/39' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/10' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/34' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/38' 2024-08-31T04:08:33.891 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/11' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/16' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/32' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/30' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/14' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/18' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/13' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/33' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/17' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/35' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed './164/37' 2024-08-31T04:08:33.892 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './164' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/19' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/15' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/31' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/36' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/20' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/12' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/39' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/10' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/34' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/38' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/11' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/16' 2024-08-31T04:08:33.893 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/32' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/30' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/14' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/18' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/13' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/33' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/17' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/35' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './165/37' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './165' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/19' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/15' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/31' 2024-08-31T04:08:33.894 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/36' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/20' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/12' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/39' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/10' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/34' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/38' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/11' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/16' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/32' 2024-08-31T04:08:33.895 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/30' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/14' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/18' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/13' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/33' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/17' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/35' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './166/37' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './166' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/19' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/15' 2024-08-31T04:08:33.896 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/31' 2024-08-31T04:08:33.897 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/36' 2024-08-31T04:08:33.897 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/20' 2024-08-31T04:08:33.897 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/12' 2024-08-31T04:08:33.897 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/39' 2024-08-31T04:08:33.897 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/10' 2024-08-31T04:08:33.897 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/34' 2024-08-31T04:08:33.897 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/38' 2024-08-31T04:08:38.221 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/11' 2024-08-31T04:08:38.221 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/16' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/32' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/30' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/14' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/18' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/13' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/33' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/17' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/35' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './167/37' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './167' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/19' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/15' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/31' 2024-08-31T04:08:38.222 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/36' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/20' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/12' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/39' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/10' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/34' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/38' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/11' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/16' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/32' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/30' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/14' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/18' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/13' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/33' 2024-08-31T04:08:38.223 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/17' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/35' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './168/37' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './168' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/19' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/15' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/31' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/36' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/20' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/12' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/39' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/10' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/34' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/38' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/11' 2024-08-31T04:08:38.224 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/16' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/32' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/30' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/14' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/18' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/13' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/33' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/17' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/35' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './169/37' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './169' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/19' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/15' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/31' 2024-08-31T04:08:38.225 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/36' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/20' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/12' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/39' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/10' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/34' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/38' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/11' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/16' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/32' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/30' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/14' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/18' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/13' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/33' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/17' 2024-08-31T04:08:38.226 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/35' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './170/37' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './170' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/19' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/15' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/31' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/36' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/20' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/12' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/39' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/10' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/34' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/38' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/11' 2024-08-31T04:08:38.227 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/16' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/32' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/30' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/14' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/18' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/13' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/33' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/17' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/35' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './171/37' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './171' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/19' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/15' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/31' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/36' 2024-08-31T04:08:38.228 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/20' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/12' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/39' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/10' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/34' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/38' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/11' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/16' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/32' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/30' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/14' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/18' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/13' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/33' 2024-08-31T04:08:38.229 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/17' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/35' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './172/37' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './172' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/19' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/15' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/31' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/36' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/20' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/12' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/39' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/10' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/34' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/38' 2024-08-31T04:08:38.230 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/11' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/16' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/32' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/30' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/14' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/18' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/13' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/33' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/17' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/35' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './173/37' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './173' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/19' 2024-08-31T04:08:38.231 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/15' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/31' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/36' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/20' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/12' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/39' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/10' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/34' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/38' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/11' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/16' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/32' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/30' 2024-08-31T04:08:38.232 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/14' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/18' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/13' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/33' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/17' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/35' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './174/37' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './174' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/19' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/15' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/31' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/36' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/20' 2024-08-31T04:08:38.233 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/12' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/39' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/10' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/34' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/38' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/11' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/16' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/32' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/30' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/14' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/18' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/13' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/33' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/17' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/35' 2024-08-31T04:08:38.234 INFO:tasks.workunit.client.0.smithi089.stdout:removed './175/37' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './175' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/19' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/15' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/31' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/36' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/20' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/12' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/39' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/10' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/34' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/38' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/11' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/16' 2024-08-31T04:08:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/32' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/30' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/14' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/18' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/13' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/33' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/17' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/35' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './176/37' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './176' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/19' 2024-08-31T04:08:38.236 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/15' 2024-08-31T04:08:39.363 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/31' 2024-08-31T04:08:39.363 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/36' 2024-08-31T04:08:39.363 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/20' 2024-08-31T04:08:39.363 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/12' 2024-08-31T04:08:39.363 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/39' 2024-08-31T04:08:39.363 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/10' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/34' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/38' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/11' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/16' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/32' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/30' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/14' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/18' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/13' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/33' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/17' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/35' 2024-08-31T04:08:39.364 INFO:tasks.workunit.client.0.smithi089.stdout:removed './177/37' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './177' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/19' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/15' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/31' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/36' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/20' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/12' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/39' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/10' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/34' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/38' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/11' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/16' 2024-08-31T04:08:39.365 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/32' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/30' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/14' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/18' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/13' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/33' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/17' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/35' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './178/37' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './178' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/19' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/15' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/31' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/36' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/20' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/12' 2024-08-31T04:08:39.366 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/39' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/10' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/34' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/38' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/11' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/16' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/32' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/30' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/14' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/18' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/13' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/33' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/17' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/35' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './179/37' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './179' 2024-08-31T04:08:39.367 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/19' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/15' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/31' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/36' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/20' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/12' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/39' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/10' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/34' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/38' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/11' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/16' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/32' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/30' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/14' 2024-08-31T04:08:39.368 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/18' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/13' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/33' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/17' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/35' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './180/37' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './180' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/19' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/15' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/31' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/36' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/20' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/12' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/39' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/10' 2024-08-31T04:08:39.369 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/34' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/38' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/11' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/16' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/32' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/30' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/14' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/18' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/13' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/33' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/17' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/35' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './181/37' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './181' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/19' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/15' 2024-08-31T04:08:39.370 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/31' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/36' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/20' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/12' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/39' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/10' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/34' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/38' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/11' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/16' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/32' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/30' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/14' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/18' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/13' 2024-08-31T04:08:39.371 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/33' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/17' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/35' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './182/37' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './182' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/19' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/15' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/31' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/36' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/20' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/12' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/39' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/10' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/34' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/38' 2024-08-31T04:08:39.372 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/11' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/16' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/32' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/30' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/14' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/18' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/13' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/33' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/17' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/35' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './183/37' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './183' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/19' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/15' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/31' 2024-08-31T04:08:39.373 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/36' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/20' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/12' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/39' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/10' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/34' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/38' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/11' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/16' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/32' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/30' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/14' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/18' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/13' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/33' 2024-08-31T04:08:39.374 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/17' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/35' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './184/37' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './184' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/19' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/15' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/31' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/36' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/20' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/12' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/39' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/10' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/34' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/38' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/11' 2024-08-31T04:08:39.375 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/16' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/32' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/30' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/14' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/18' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/13' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/33' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/17' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/35' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './185/37' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './185' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/19' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/15' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/31' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/36' 2024-08-31T04:08:39.376 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/20' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/12' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/39' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/10' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/34' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/38' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/11' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/16' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/32' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/30' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/14' 2024-08-31T04:08:39.377 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/18' 2024-08-31T04:08:44.120 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/13' 2024-08-31T04:08:44.120 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/33' 2024-08-31T04:08:44.120 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/17' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/35' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './186/37' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './186' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/19' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/15' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/31' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/36' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/20' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/12' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/39' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/10' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/34' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/38' 2024-08-31T04:08:44.121 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/11' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/16' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/32' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/30' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/14' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/18' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/13' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/33' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/17' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/35' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './187/37' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './187' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/19' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/15' 2024-08-31T04:08:44.122 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/31' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/36' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/20' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/12' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/39' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/10' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/34' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/38' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/11' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/16' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/32' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/30' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/14' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/18' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/13' 2024-08-31T04:08:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/33' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/17' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/35' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './188/37' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './188' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/19' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/15' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/31' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/36' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/20' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/12' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/39' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/10' 2024-08-31T04:08:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/34' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/38' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/11' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/16' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/32' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/30' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/14' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/18' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/13' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/33' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/17' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/35' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed './189/37' 2024-08-31T04:08:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './189' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/19' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/15' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/31' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/36' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/20' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/12' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/39' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/10' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/34' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/38' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/11' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/16' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/32' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/30' 2024-08-31T04:08:44.126 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/14' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/18' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/13' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/33' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/17' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/35' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './190/37' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './190' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/19' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/15' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/31' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/36' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/20' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/12' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/39' 2024-08-31T04:08:44.127 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/10' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/34' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/38' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/11' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/16' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/32' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/30' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/14' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/18' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/13' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/33' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/17' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/35' 2024-08-31T04:08:44.128 INFO:tasks.workunit.client.0.smithi089.stdout:removed './191/37' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './191' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/19' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/15' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/31' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/36' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/20' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/12' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/39' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/10' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/34' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/38' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/11' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/16' 2024-08-31T04:08:44.129 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/32' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/30' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/14' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/18' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/13' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/33' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/17' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/35' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './192/37' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './192' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/19' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/15' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/31' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/36' 2024-08-31T04:08:44.130 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/20' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/12' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/39' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/10' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/34' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/38' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/11' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/16' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/32' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/30' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/14' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/18' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/13' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/33' 2024-08-31T04:08:44.131 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/17' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/35' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './193/37' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './193' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/19' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/15' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/31' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/36' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/20' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/12' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/39' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/10' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/34' 2024-08-31T04:08:44.132 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/38' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/11' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/16' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/32' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/30' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/14' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/18' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/13' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/33' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/17' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/35' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './194/37' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './194' 2024-08-31T04:08:44.133 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/19' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/15' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/31' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/36' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/20' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/12' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/39' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/10' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/34' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/38' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/11' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/16' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/32' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/30' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/14' 2024-08-31T04:08:44.134 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/18' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/13' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/33' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/17' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/35' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './195/37' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './195' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/19' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/15' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/31' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/36' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/20' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/12' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/39' 2024-08-31T04:08:44.135 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/10' 2024-08-31T04:08:47.642 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/34' 2024-08-31T04:08:47.642 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/38' 2024-08-31T04:08:47.642 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/11' 2024-08-31T04:08:47.642 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/16' 2024-08-31T04:08:47.642 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/32' 2024-08-31T04:08:47.642 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/30' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/14' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/18' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/13' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/33' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/17' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/35' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './196/37' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './196' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/19' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/15' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/31' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/36' 2024-08-31T04:08:47.643 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/20' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/12' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/39' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/10' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/34' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/38' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/11' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/16' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/32' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/30' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/14' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/18' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/13' 2024-08-31T04:08:47.644 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/33' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/17' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/35' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './197/37' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './197' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/19' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/15' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/31' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/36' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/20' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/12' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/39' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/10' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/34' 2024-08-31T04:08:47.645 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/38' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/11' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/16' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/32' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/30' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/14' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/18' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/13' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/33' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/17' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/35' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './198/37' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './198' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/19' 2024-08-31T04:08:47.646 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/15' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/31' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/36' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/20' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/12' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/39' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/10' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/34' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/38' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/11' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/16' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/32' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/30' 2024-08-31T04:08:47.647 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/14' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/18' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/13' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/33' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/17' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/35' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './199/37' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './199' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/21' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/27' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/31' 2024-08-31T04:08:47.648 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/36' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/20' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/39' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/34' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/38' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/28' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/24' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/29' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/32' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/22' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/25' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/30' 2024-08-31T04:08:47.649 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/33' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/23' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/35' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/26' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './200/37' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './200' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/21' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/27' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/31' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/36' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/20' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/39' 2024-08-31T04:08:47.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/34' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/38' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/28' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/24' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/29' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/32' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/22' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/25' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/30' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/33' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/23' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/35' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/26' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './201/37' 2024-08-31T04:08:47.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './201' 2024-08-31T04:08:47.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/21' 2024-08-31T04:08:47.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/27' 2024-08-31T04:08:47.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/31' 2024-08-31T04:08:47.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/36' 2024-08-31T04:08:47.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/20' 2024-08-31T04:08:47.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/39' 2024-08-31T04:08:47.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/34' 2024-08-31T04:08:47.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/38' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/28' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/24' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/29' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/32' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/22' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/25' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/30' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/33' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/23' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/35' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/26' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './202/37' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './202' 2024-08-31T04:08:47.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/21' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/27' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/31' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/36' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/20' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/39' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/34' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/38' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/28' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/24' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/29' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/32' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/22' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/25' 2024-08-31T04:08:47.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/30' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/33' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/23' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/35' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/26' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './203/37' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './203' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/21' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/27' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/31' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/36' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/20' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/39' 2024-08-31T04:08:47.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/34' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/38' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/28' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/24' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/29' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/32' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/22' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/25' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/30' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/33' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/23' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/35' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/26' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './204/37' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './204' 2024-08-31T04:08:47.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/21' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/27' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/31' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/36' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/20' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/39' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/34' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/38' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/28' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/24' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/29' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/32' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/22' 2024-08-31T04:08:47.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/25' 2024-08-31T04:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/30' 2024-08-31T04:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/33' 2024-08-31T04:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/23' 2024-08-31T04:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/35' 2024-08-31T04:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/26' 2024-08-31T04:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './205/37' 2024-08-31T04:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './205' 2024-08-31T04:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/21' 2024-08-31T04:08:47.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/27' 2024-08-31T04:08:47.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/31' 2024-08-31T04:08:47.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/36' 2024-08-31T04:08:47.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/20' 2024-08-31T04:08:47.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/39' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/34' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/38' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/28' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/24' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/29' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/32' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/22' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/25' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/30' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/33' 2024-08-31T04:08:50.162 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/23' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/35' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/26' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './206/37' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './206' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/21' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/27' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/31' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/36' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/20' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/39' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/34' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/38' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/28' 2024-08-31T04:08:50.163 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/24' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/29' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/32' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/22' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/25' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/30' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/33' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/23' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/35' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/26' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './207/37' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './207' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/21' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/27' 2024-08-31T04:08:50.164 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/31' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/36' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/20' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/39' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/34' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/38' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/28' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/24' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/29' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/32' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/22' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/25' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/30' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/33' 2024-08-31T04:08:50.165 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/23' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/35' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/26' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './208/37' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './208' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/21' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/27' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/31' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/36' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/20' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/39' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/34' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/38' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/28' 2024-08-31T04:08:50.166 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/24' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/29' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/32' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/22' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/25' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/30' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/33' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/23' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/35' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/26' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './209/37' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './209' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/21' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/27' 2024-08-31T04:08:50.167 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/31' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/36' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/20' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/39' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/34' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/38' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/28' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/24' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/29' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/32' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/22' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/25' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/30' 2024-08-31T04:08:50.168 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/33' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/23' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/35' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/26' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './210/37' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './210' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/21' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/27' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/31' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/36' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/20' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/39' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/34' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/38' 2024-08-31T04:08:50.169 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/28' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/24' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/29' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/32' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/22' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/25' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/30' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/33' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/23' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/35' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/26' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './211/37' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './211' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/21' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/27' 2024-08-31T04:08:50.170 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/31' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/36' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/20' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/39' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/34' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/38' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/28' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/24' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/29' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/32' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/22' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/25' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/30' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/33' 2024-08-31T04:08:50.171 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/23' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/35' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/26' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './212/37' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './212' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/21' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/27' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/31' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/36' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/20' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/39' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/34' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/38' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/28' 2024-08-31T04:08:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/24' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/29' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/32' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/22' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/25' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/30' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/33' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/23' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/35' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/26' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './213/37' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './213' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/21' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/27' 2024-08-31T04:08:50.173 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/31' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/36' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/20' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/39' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/34' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/38' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/28' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/24' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/29' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/32' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/22' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/25' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/30' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/33' 2024-08-31T04:08:50.174 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/23' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/35' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/26' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './214/37' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './214' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/21' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/27' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/31' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/36' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/20' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/39' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/34' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/38' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/28' 2024-08-31T04:08:50.175 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/24' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/29' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/32' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/22' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/25' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/30' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/33' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/23' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/35' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/26' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './215/37' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './215' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/21' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/27' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/31' 2024-08-31T04:08:50.176 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/36' 2024-08-31T04:08:50.177 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/20' 2024-08-31T04:08:50.177 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/39' 2024-08-31T04:08:50.177 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/34' 2024-08-31T04:08:50.177 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/38' 2024-08-31T04:08:55.716 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/28' 2024-08-31T04:08:55.716 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/24' 2024-08-31T04:08:55.716 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/29' 2024-08-31T04:08:55.716 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/32' 2024-08-31T04:08:55.716 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/22' 2024-08-31T04:08:55.716 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/25' 2024-08-31T04:08:55.716 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/30' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/33' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/23' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/35' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/26' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './216/37' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './216' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/21' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/27' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/31' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/36' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/20' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/39' 2024-08-31T04:08:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/34' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/38' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/28' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/24' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/29' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/32' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/22' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/25' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/30' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/33' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/23' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/35' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/26' 2024-08-31T04:08:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:removed './217/37' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './217' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/21' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/27' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/31' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/36' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/20' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/39' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/34' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/38' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/28' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/24' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/29' 2024-08-31T04:08:55.719 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/32' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/22' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/25' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/30' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/33' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/23' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/35' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/26' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './218/37' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './218' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/21' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/27' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/31' 2024-08-31T04:08:55.720 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/36' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/20' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/39' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/34' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/38' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/28' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/24' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/29' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/32' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/22' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/25' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/30' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/33' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/23' 2024-08-31T04:08:55.721 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/35' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/26' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './219/37' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './219' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/21' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/27' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/31' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/36' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/20' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/39' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/34' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/38' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/28' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/24' 2024-08-31T04:08:55.722 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/29' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/32' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/22' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/25' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/30' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/33' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/23' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/35' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/26' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './220/37' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './220' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/21' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/27' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/31' 2024-08-31T04:08:55.723 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/36' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/20' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/39' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/34' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/38' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/28' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/24' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/29' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/32' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/22' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/25' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/30' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/33' 2024-08-31T04:08:55.724 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/23' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/35' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/26' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './221/37' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './221' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/21' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/27' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/31' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/36' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/20' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/39' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/34' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/38' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/28' 2024-08-31T04:08:55.725 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/24' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/29' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/32' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/22' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/25' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/30' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/33' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/23' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/35' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/26' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './222/37' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './222' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/21' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/27' 2024-08-31T04:08:55.726 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/31' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/36' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/20' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/39' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/34' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/38' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/28' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/24' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/29' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/32' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/22' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/25' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/30' 2024-08-31T04:08:55.727 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/33' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/23' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/35' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/26' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './223/37' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './223' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/21' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/27' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/31' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/36' 2024-08-31T04:08:55.728 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/20' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/39' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/34' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/38' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/28' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/24' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/29' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/32' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/22' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/25' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/30' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/33' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/23' 2024-08-31T04:08:55.729 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/35' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/26' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './224/37' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './224' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/21' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/27' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/31' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/36' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/20' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/39' 2024-08-31T04:08:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/34' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/38' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/28' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/24' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/29' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/32' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/22' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/25' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/30' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/33' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/23' 2024-08-31T04:08:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/35' 2024-08-31T04:08:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/26' 2024-08-31T04:08:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './225/37' 2024-08-31T04:08:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './225' 2024-08-31T04:08:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/21' 2024-08-31T04:08:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/27' 2024-08-31T04:08:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/31' 2024-08-31T04:08:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/36' 2024-08-31T04:08:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/20' 2024-08-31T04:08:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/39' 2024-08-31T04:08:55.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/34' 2024-08-31T04:08:55.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/38' 2024-08-31T04:08:55.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/28' 2024-08-31T04:08:55.733 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/24' 2024-08-31T04:09:00.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:09:00.149 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:09:00.913 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/29' 2024-08-31T04:09:00.913 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/32' 2024-08-31T04:09:00.913 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/22' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/25' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/30' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/33' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/23' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/35' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/26' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './226/37' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './226' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/21' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/27' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/31' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/36' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/20' 2024-08-31T04:09:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/39' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/34' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/38' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/28' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/24' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/29' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/32' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/22' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/25' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/30' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/33' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/23' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/35' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/26' 2024-08-31T04:09:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:removed './227/37' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './227' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/21' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/27' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/31' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/36' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/20' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/39' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/34' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/38' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/28' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/24' 2024-08-31T04:09:00.916 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/29' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/32' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/22' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/25' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/30' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/33' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/23' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/35' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/26' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './228/37' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './228' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/21' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/27' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/31' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/36' 2024-08-31T04:09:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/20' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/39' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/34' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/38' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/28' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/24' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/29' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/32' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/22' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/25' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/30' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/33' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/23' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/35' 2024-08-31T04:09:00.918 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/26' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './229/37' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './229' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/21' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/27' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/31' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/36' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/20' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/39' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/34' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/38' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/28' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/24' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/29' 2024-08-31T04:09:00.919 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/32' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/22' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/25' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/30' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/33' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/23' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/35' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/26' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed './230/37' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './230' 2024-08-31T04:09:00.920 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/21' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/27' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/31' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/36' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/20' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/39' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/34' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/38' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/28' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/24' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/29' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/32' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/22' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/25' 2024-08-31T04:09:00.921 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/30' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/33' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/23' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/35' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/26' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './231/37' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './231' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/21' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/27' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/31' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/36' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/20' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/39' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/34' 2024-08-31T04:09:00.922 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/38' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/28' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/24' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/29' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/32' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/22' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/25' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/30' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/33' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/23' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/35' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/26' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './232/37' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './232' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/21' 2024-08-31T04:09:00.923 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/27' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/31' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/36' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/20' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/39' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/34' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/38' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/28' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/24' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/29' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/32' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/22' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/25' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/30' 2024-08-31T04:09:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/33' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/23' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/35' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/26' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './233/37' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './233' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/21' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/27' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/31' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/36' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/20' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/39' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/34' 2024-08-31T04:09:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/38' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/28' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/24' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/29' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/32' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/22' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/25' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/30' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/33' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/23' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/35' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/26' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './234/37' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './234' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/21' 2024-08-31T04:09:00.926 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/27' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/31' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/36' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/20' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/39' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/34' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/38' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/28' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/24' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/29' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/32' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/22' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/25' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/30' 2024-08-31T04:09:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/33' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/23' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/35' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/26' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './235/37' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './235' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/21' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/27' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/31' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/36' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/20' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/39' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/34' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/38' 2024-08-31T04:09:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/28' 2024-08-31T04:09:00.929 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/24' 2024-08-31T04:09:00.929 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/29' 2024-08-31T04:09:00.929 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/32' 2024-08-31T04:09:04.101 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/22' 2024-08-31T04:09:04.101 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/25' 2024-08-31T04:09:04.101 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/30' 2024-08-31T04:09:04.101 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/33' 2024-08-31T04:09:04.101 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/23' 2024-08-31T04:09:04.101 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/35' 2024-08-31T04:09:04.101 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/26' 2024-08-31T04:09:04.101 INFO:tasks.workunit.client.0.smithi089.stdout:removed './236/37' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './236' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/21' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/27' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/31' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/36' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/20' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/39' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/34' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/38' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/28' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/24' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/29' 2024-08-31T04:09:04.102 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/32' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/22' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/25' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/30' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/33' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/23' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/35' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/26' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './237/37' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './237' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/21' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/27' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/31' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/36' 2024-08-31T04:09:04.103 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/20' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/39' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/34' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/38' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/28' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/24' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/29' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/32' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/22' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/25' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/30' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/33' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/23' 2024-08-31T04:09:04.104 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/35' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/26' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './238/37' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './238' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/21' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/27' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/31' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/36' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/20' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/39' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/34' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/38' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/28' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/24' 2024-08-31T04:09:04.105 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/29' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/32' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/22' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/25' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/30' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/33' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/23' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/35' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/26' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './239/37' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './239' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/21' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/27' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/31' 2024-08-31T04:09:04.106 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/36' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/20' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/39' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/34' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/38' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/28' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/24' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/29' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/32' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/22' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/25' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/30' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/33' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/23' 2024-08-31T04:09:04.107 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/35' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/26' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './240/37' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './240' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/21' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/27' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/31' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/36' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/20' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/39' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/34' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/38' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/28' 2024-08-31T04:09:04.108 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/24' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/29' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/32' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/22' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/25' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/30' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/33' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/23' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/35' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/26' 2024-08-31T04:09:04.109 INFO:tasks.workunit.client.0.smithi089.stdout:removed './241/37' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './241' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/21' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/27' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/31' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/36' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/20' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/39' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/34' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/38' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/28' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/24' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/29' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/32' 2024-08-31T04:09:04.110 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/22' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/25' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/30' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/33' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/23' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/35' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/26' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './242/37' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './242' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/21' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/27' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/31' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/36' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/20' 2024-08-31T04:09:04.111 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/39' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/34' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/38' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/28' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/24' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/29' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/32' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/22' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/25' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/30' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/33' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/23' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/35' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/26' 2024-08-31T04:09:04.112 INFO:tasks.workunit.client.0.smithi089.stdout:removed './243/37' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './243' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/21' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/27' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/31' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/36' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/20' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/39' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/34' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/38' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/28' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/24' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/29' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/32' 2024-08-31T04:09:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/22' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/25' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/30' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/33' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/23' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/35' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/26' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './244/37' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './244' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/21' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/27' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/31' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/36' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/20' 2024-08-31T04:09:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/39' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/34' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/38' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/28' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/24' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/29' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/32' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/22' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/25' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/30' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/33' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/23' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/35' 2024-08-31T04:09:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/26' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './245/37' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './245' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/21' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/27' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/31' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/36' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/20' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/39' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/34' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/38' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/28' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/24' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/29' 2024-08-31T04:09:04.116 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/32' 2024-08-31T04:09:04.117 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/22' 2024-08-31T04:09:08.001 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/25' 2024-08-31T04:09:08.001 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/30' 2024-08-31T04:09:08.001 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/33' 2024-08-31T04:09:08.001 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/23' 2024-08-31T04:09:08.001 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/35' 2024-08-31T04:09:08.001 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/26' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './246/37' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './246' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/21' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/27' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/31' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/36' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/20' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/39' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/34' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/38' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/28' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/24' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/29' 2024-08-31T04:09:08.002 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/32' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/22' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/25' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/30' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/33' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/23' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/35' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/26' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './247/37' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './247' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/21' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/27' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/31' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/36' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/20' 2024-08-31T04:09:08.003 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/39' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/34' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/38' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/28' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/24' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/29' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/32' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/22' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/25' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/30' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/33' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/23' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/35' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/26' 2024-08-31T04:09:08.004 INFO:tasks.workunit.client.0.smithi089.stdout:removed './248/37' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './248' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/21' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/27' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/31' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/36' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/20' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/39' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/34' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/38' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/28' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/24' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/29' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/32' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/22' 2024-08-31T04:09:08.005 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/25' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/30' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/33' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/23' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/35' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/26' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './249/37' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './249' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/21' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/27' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/31' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/36' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/20' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/39' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/34' 2024-08-31T04:09:08.006 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/38' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/28' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/24' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/29' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/32' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/22' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/25' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/30' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/33' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/23' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/35' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/26' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './250/37' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './250' 2024-08-31T04:09:08.007 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/21' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/27' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/31' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/36' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/20' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/39' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/34' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/38' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/28' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/24' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/29' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/32' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/22' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/25' 2024-08-31T04:09:08.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/30' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/33' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/23' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/35' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/26' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './251/37' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './251' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/21' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/27' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/31' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/36' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/20' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/39' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/34' 2024-08-31T04:09:08.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/38' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/28' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/24' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/29' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/32' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/22' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/25' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/30' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/33' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/23' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/35' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/26' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './252/37' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './252' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/21' 2024-08-31T04:09:08.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/27' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/31' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/36' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/20' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/39' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/34' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/38' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/28' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/24' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/29' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/32' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/22' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/25' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/30' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/33' 2024-08-31T04:09:08.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/23' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/35' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/26' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './253/37' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './253' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/21' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/27' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/31' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/36' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/20' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/39' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/34' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/38' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/28' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/24' 2024-08-31T04:09:08.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/29' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/32' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/22' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/25' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/30' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/33' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/23' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/35' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/26' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './254/37' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './254' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/21' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/27' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/31' 2024-08-31T04:09:08.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/36' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/20' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/39' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/34' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/38' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/28' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/24' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/29' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/32' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/22' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/25' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/30' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/33' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/23' 2024-08-31T04:09:08.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/35' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/26' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './255/37' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './255' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/21' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/27' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/31' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/36' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/20' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/39' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/34' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/38' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/28' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/24' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/29' 2024-08-31T04:09:08.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/32' 2024-08-31T04:09:08.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/22' 2024-08-31T04:09:08.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/25' 2024-08-31T04:09:08.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/30' 2024-08-31T04:09:10.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/33' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/23' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/35' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/26' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './256/37' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './256' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/21' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/27' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/31' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/36' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/20' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/39' 2024-08-31T04:09:10.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/34' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/38' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/28' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/24' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/29' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/32' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/22' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/25' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/30' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/33' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/23' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/35' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/26' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './257/37' 2024-08-31T04:09:10.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './257' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/21' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/27' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/31' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/36' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/20' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/39' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/34' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/38' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/28' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/24' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/29' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/32' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/22' 2024-08-31T04:09:10.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/25' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/30' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/33' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/23' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/35' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/26' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './258/37' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './258' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/21' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/27' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/31' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/36' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/20' 2024-08-31T04:09:10.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/39' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/34' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/38' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/28' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/24' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/29' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/32' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/22' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/25' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/30' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/33' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/23' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/35' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/26' 2024-08-31T04:09:10.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './259/37' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './259' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/21' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/27' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/31' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/36' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/20' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/39' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/34' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/38' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/28' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/24' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/29' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/32' 2024-08-31T04:09:10.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/22' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/25' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/30' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/33' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/23' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/35' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/26' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './260/37' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './260' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/21' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/27' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/31' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/36' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/20' 2024-08-31T04:09:10.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/39' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/34' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/38' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/28' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/24' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/29' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/32' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/22' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/25' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/30' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/33' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/23' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/35' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/26' 2024-08-31T04:09:10.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './261/37' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './261' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/21' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/27' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/31' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/36' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/20' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/39' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/34' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/38' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/28' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/24' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/29' 2024-08-31T04:09:10.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/32' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/22' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/25' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/30' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/33' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/23' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/35' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/26' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './262/37' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './262' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/21' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/27' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/31' 2024-08-31T04:09:10.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/36' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/20' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/39' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/34' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/38' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/28' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/24' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/29' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/32' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/22' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/25' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/30' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/33' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/23' 2024-08-31T04:09:10.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/35' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/26' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './263/37' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './263' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/21' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/27' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/31' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/36' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/20' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/39' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/34' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/38' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/28' 2024-08-31T04:09:10.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/24' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/29' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/32' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/22' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/25' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/30' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/33' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/23' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/35' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/26' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './264/37' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './264' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/21' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/27' 2024-08-31T04:09:10.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/31' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/36' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/20' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/39' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/34' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/38' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/28' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/24' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/29' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/32' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/22' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/25' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/30' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/33' 2024-08-31T04:09:10.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/23' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/35' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/26' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './265/37' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './265' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/21' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/27' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/31' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/36' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/20' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/39' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/34' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/38' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/28' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/24' 2024-08-31T04:09:10.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/29' 2024-08-31T04:09:10.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/32' 2024-08-31T04:09:10.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/22' 2024-08-31T04:09:10.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/25' 2024-08-31T04:09:10.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/30' 2024-08-31T04:09:10.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/33' 2024-08-31T04:09:10.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/23' 2024-08-31T04:09:17.864 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/35' 2024-08-31T04:09:17.864 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/26' 2024-08-31T04:09:17.864 INFO:tasks.workunit.client.0.smithi089.stdout:removed './266/37' 2024-08-31T04:09:17.864 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './266' 2024-08-31T04:09:17.864 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/21' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/27' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/31' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/36' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/20' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/39' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/34' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/38' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/28' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/24' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/29' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/32' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/22' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/25' 2024-08-31T04:09:17.865 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/30' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/33' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/23' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/35' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/26' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './267/37' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './267' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/21' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/27' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/31' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/36' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/20' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/39' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/34' 2024-08-31T04:09:17.866 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/38' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/28' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/24' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/29' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/32' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/22' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/25' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/30' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/33' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/23' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/35' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/26' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './268/37' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './268' 2024-08-31T04:09:17.867 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/21' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/27' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/31' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/36' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/20' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/39' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/34' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/38' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/28' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/24' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/29' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/32' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/22' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/25' 2024-08-31T04:09:17.868 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/30' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/33' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/23' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/35' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/26' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './269/37' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './269' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/21' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/27' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/31' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/36' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/20' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/39' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/34' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/38' 2024-08-31T04:09:17.869 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/28' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/24' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/29' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/32' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/22' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/25' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/30' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/33' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/23' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/35' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/26' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './270/37' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './270' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/21' 2024-08-31T04:09:17.870 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/27' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/31' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/36' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/20' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/39' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/34' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/38' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/28' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/24' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/29' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/32' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/22' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/25' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/30' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/33' 2024-08-31T04:09:17.871 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/23' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/35' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/26' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './271/37' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './271' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/21' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/27' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/31' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/36' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/20' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/39' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/34' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/38' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/28' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/24' 2024-08-31T04:09:17.872 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/29' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/32' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/22' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/25' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/30' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/33' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/23' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/35' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/26' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './272/37' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './272' 2024-08-31T04:09:17.873 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/21' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/27' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/31' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/36' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/20' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/39' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/34' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/38' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/28' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/24' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/29' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/32' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/22' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/25' 2024-08-31T04:09:17.874 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/30' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/33' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/23' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/35' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/26' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './273/37' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './273' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/21' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/27' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/31' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/36' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/20' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/39' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/34' 2024-08-31T04:09:17.875 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/38' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/28' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/24' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/29' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/32' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/22' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/25' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/30' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/33' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/23' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/35' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/26' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './274/37' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './274' 2024-08-31T04:09:17.876 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/21' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/27' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/31' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/36' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/20' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/39' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/34' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/38' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/28' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/24' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/29' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/32' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/22' 2024-08-31T04:09:17.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/25' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/30' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/33' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/23' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/35' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/26' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './275/37' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './275' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/21' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/27' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/31' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/36' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/20' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/39' 2024-08-31T04:09:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/34' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/38' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/28' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/24' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/29' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/32' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/22' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/25' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/30' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/33' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/23' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/35' 2024-08-31T04:09:17.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/26' 2024-08-31T04:09:21.741 INFO:tasks.workunit.client.0.smithi089.stdout:removed './276/37' 2024-08-31T04:09:21.741 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './276' 2024-08-31T04:09:21.741 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/21' 2024-08-31T04:09:21.741 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/27' 2024-08-31T04:09:21.741 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/31' 2024-08-31T04:09:21.741 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/36' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/20' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/39' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/34' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/38' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/28' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/24' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/29' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/32' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/22' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/25' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/30' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/33' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/23' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/35' 2024-08-31T04:09:21.742 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/26' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './277/37' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './277' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/21' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/27' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/31' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/36' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/20' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/39' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/34' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/38' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/28' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/24' 2024-08-31T04:09:21.743 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/29' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/32' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/22' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/25' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/30' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/33' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/23' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/35' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/26' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './278/37' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './278' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/21' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/27' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/31' 2024-08-31T04:09:21.744 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/36' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/20' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/39' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/34' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/38' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/28' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/24' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/29' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/32' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/22' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/25' 2024-08-31T04:09:21.745 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/30' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/33' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/23' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/35' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/26' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './279/37' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './279' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/21' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/27' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/31' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/36' 2024-08-31T04:09:21.746 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/20' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/39' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/34' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/38' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/28' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/24' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/29' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/32' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/22' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/25' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/30' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/33' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/23' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/35' 2024-08-31T04:09:21.747 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/26' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './280/37' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './280' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/21' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/27' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/31' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/36' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/20' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/39' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/34' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/38' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/28' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/24' 2024-08-31T04:09:21.748 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/29' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/32' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/22' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/25' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/30' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/33' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/23' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/35' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/26' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './281/37' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './281' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/21' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/27' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/31' 2024-08-31T04:09:21.749 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/36' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/20' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/39' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/34' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/38' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/28' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/24' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/29' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/32' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/22' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/25' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/30' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/33' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/23' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/35' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/26' 2024-08-31T04:09:21.750 INFO:tasks.workunit.client.0.smithi089.stdout:removed './282/37' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './282' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/21' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/27' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/31' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/36' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/20' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/39' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/34' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/38' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/28' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/24' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/29' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/32' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/22' 2024-08-31T04:09:21.751 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/25' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/30' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/33' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/23' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/35' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/26' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './283/37' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './283' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/21' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/27' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/31' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/36' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/20' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/39' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/34' 2024-08-31T04:09:21.752 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/38' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/28' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/24' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/29' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/32' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/22' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/25' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/30' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/33' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/23' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/35' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/26' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './284/37' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './284' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/21' 2024-08-31T04:09:21.753 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/27' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/31' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/36' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/20' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/39' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/34' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/38' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/28' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/24' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/29' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/32' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/22' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/25' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/30' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/33' 2024-08-31T04:09:21.754 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/23' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/35' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/26' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './285/37' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './285' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/21' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/27' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/31' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/36' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/20' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/39' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/34' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/38' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/28' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/24' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/29' 2024-08-31T04:09:21.755 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/32' 2024-08-31T04:09:21.756 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/22' 2024-08-31T04:09:21.756 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/25' 2024-08-31T04:09:21.756 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/30' 2024-08-31T04:09:21.756 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/33' 2024-08-31T04:09:21.756 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/23' 2024-08-31T04:09:21.756 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/35' 2024-08-31T04:09:21.756 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/26' 2024-08-31T04:09:21.756 INFO:tasks.workunit.client.0.smithi089.stdout:removed './286/37' 2024-08-31T04:09:21.756 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './286' 2024-08-31T04:09:25.556 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/21' 2024-08-31T04:09:25.556 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/27' 2024-08-31T04:09:25.556 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/31' 2024-08-31T04:09:25.556 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/36' 2024-08-31T04:09:25.556 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/20' 2024-08-31T04:09:25.556 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/39' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/34' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/38' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/28' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/24' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/29' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/32' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/22' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/25' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/30' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/33' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/23' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/35' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/26' 2024-08-31T04:09:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:removed './287/37' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './287' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/21' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/27' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/31' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/36' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/20' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/39' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/34' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/38' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/28' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/24' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/29' 2024-08-31T04:09:25.558 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/32' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/22' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/25' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/30' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/33' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/23' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/35' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/26' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed './288/37' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './288' 2024-08-31T04:09:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/21' 2024-08-31T04:09:25.560 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/27' 2024-08-31T04:09:25.560 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/31' 2024-08-31T04:09:25.560 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/36' 2024-08-31T04:09:25.560 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/20' 2024-08-31T04:09:25.560 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/39' 2024-08-31T04:09:25.560 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/34' 2024-08-31T04:09:25.560 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/38' 2024-08-31T04:09:25.560 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/28' 2024-08-31T04:09:25.560 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/24' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/29' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/32' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/22' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/25' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/30' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/33' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/23' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/35' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/26' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './289/37' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './289' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/21' 2024-08-31T04:09:25.561 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/27' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/31' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/36' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/20' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/39' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/34' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/38' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/28' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/24' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/29' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/32' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/22' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/25' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/30' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/33' 2024-08-31T04:09:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/23' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/35' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/26' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './290/37' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './290' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/21' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/27' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/31' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/36' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/20' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/39' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/34' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/38' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/28' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/24' 2024-08-31T04:09:25.563 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/29' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/32' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/22' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/25' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/30' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/33' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/23' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/35' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/26' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './291/37' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './291' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/21' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/27' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/31' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/36' 2024-08-31T04:09:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/20' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/39' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/34' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/38' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/28' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/24' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/29' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/32' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/22' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/25' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/30' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/33' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/23' 2024-08-31T04:09:25.565 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/35' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/26' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './292/37' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './292' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/21' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/27' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/31' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/36' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/20' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/39' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/34' 2024-08-31T04:09:25.566 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/38' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/28' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/24' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/29' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/32' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/22' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/25' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/30' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/33' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/23' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/35' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/26' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './293/37' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './293' 2024-08-31T04:09:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/21' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/27' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/31' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/36' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/20' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/39' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/34' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/38' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/28' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/24' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/29' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/32' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/22' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/25' 2024-08-31T04:09:25.568 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/30' 2024-08-31T04:09:25.569 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/33' 2024-08-31T04:09:25.569 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/23' 2024-08-31T04:09:25.569 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/35' 2024-08-31T04:09:25.569 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/26' 2024-08-31T04:09:25.569 INFO:tasks.workunit.client.0.smithi089.stdout:removed './294/37' 2024-08-31T04:09:25.569 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './294' 2024-08-31T04:09:25.569 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/21' 2024-08-31T04:09:25.569 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/27' 2024-08-31T04:09:25.569 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/31' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/36' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/20' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/39' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/34' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/38' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/28' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/24' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/29' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/32' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/22' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/25' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/30' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/33' 2024-08-31T04:09:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/23' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/35' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/26' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './295/37' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './295' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/21' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/27' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/31' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/36' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/20' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/39' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/34' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/38' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/28' 2024-08-31T04:09:25.571 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/24' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/29' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/32' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/22' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/25' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/30' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/33' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/23' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/35' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/26' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './296/37' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './296' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/21' 2024-08-31T04:09:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/27' 2024-08-31T04:09:27.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/31' 2024-08-31T04:09:27.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/36' 2024-08-31T04:09:27.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/20' 2024-08-31T04:09:27.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/39' 2024-08-31T04:09:27.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/34' 2024-08-31T04:09:27.877 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/38' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/28' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/24' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/29' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/32' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/22' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/25' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/30' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/33' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/23' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/35' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/26' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './297/37' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './297' 2024-08-31T04:09:27.878 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/21' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/27' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/31' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/36' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/20' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/39' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/34' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/38' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/28' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/24' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/29' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/32' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/22' 2024-08-31T04:09:27.879 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/25' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/30' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/33' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/23' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/35' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/26' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './298/37' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './298' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/21' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/27' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/31' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/36' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/20' 2024-08-31T04:09:27.880 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/39' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/34' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/38' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/28' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/24' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/29' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/32' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/22' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/25' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/30' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/33' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/23' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/35' 2024-08-31T04:09:27.881 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/26' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './299/37' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './299' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/19' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/15' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/20' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/12' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/10' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/11' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/16' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/14' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/18' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/13' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/166/17' 2024-08-31T04:09:27.882 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/166' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/19' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/15' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/20' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/12' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/10' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/11' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/16' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/14' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/18' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/13' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/147/17' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/147' 2024-08-31T04:09:27.883 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/19' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/15' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/20' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/12' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/10' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/11' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/16' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/14' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/18' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/13' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/151/17' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/151' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/19' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/15' 2024-08-31T04:09:27.884 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/20' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/12' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/10' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/11' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/16' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/14' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/18' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/13' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/170/17' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/170' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/19' 2024-08-31T04:09:27.885 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/15' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/20' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/12' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/10' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/11' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/16' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/14' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/18' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/13' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/167/17' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/167' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/19' 2024-08-31T04:09:27.886 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/15' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/20' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/12' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/10' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/11' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/16' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/14' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/18' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/13' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/140/17' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/140' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/19' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/15' 2024-08-31T04:09:27.887 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/20' 2024-08-31T04:09:27.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/12' 2024-08-31T04:09:27.888 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/10' 2024-08-31T04:09:30.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:09:30.279 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:09:30.976 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/11' 2024-08-31T04:09:30.976 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/16' 2024-08-31T04:09:30.976 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/14' 2024-08-31T04:09:30.977 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/18' 2024-08-31T04:09:30.977 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/13' 2024-08-31T04:09:30.977 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/142/17' 2024-08-31T04:09:30.977 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/142' 2024-08-31T04:09:30.978 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/19' 2024-08-31T04:09:30.978 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/15' 2024-08-31T04:09:30.978 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/20' 2024-08-31T04:09:30.978 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/12' 2024-08-31T04:09:30.978 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/10' 2024-08-31T04:09:30.978 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/11' 2024-08-31T04:09:30.978 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/16' 2024-08-31T04:09:30.978 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/14' 2024-08-31T04:09:30.979 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/18' 2024-08-31T04:09:30.979 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/13' 2024-08-31T04:09:30.979 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/150/17' 2024-08-31T04:09:30.979 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/150' 2024-08-31T04:09:30.979 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/19' 2024-08-31T04:09:30.979 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/15' 2024-08-31T04:09:30.980 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/20' 2024-08-31T04:09:30.980 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/12' 2024-08-31T04:09:30.980 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/10' 2024-08-31T04:09:30.980 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/11' 2024-08-31T04:09:30.980 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/16' 2024-08-31T04:09:30.980 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/14' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/18' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/13' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/105/17' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/105' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/19' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/15' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/20' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/12' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/10' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/11' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/16' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/14' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/18' 2024-08-31T04:09:30.981 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/13' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/149/17' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/149' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/19' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/15' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/20' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/12' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/10' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/11' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/16' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/14' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/18' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/13' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/109/17' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/109' 2024-08-31T04:09:30.982 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/19' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/15' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/20' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/12' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/10' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/11' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/16' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/14' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/18' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/13' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/158/17' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/158' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/19' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/15' 2024-08-31T04:09:30.983 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/20' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/12' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/10' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/11' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/16' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/14' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/18' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/13' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/106/17' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/106' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/19' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/15' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/20' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/12' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/10' 2024-08-31T04:09:30.984 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/11' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/16' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/14' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/18' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/13' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/189/17' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/189' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/19' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/15' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/20' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/12' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/10' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/11' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/16' 2024-08-31T04:09:30.985 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/14' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/18' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/13' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/133/17' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/133' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/19' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/15' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/20' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/12' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/10' 2024-08-31T04:09:30.986 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/11' 2024-08-31T04:09:33.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/16' 2024-08-31T04:09:33.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/14' 2024-08-31T04:09:33.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/18' 2024-08-31T04:09:33.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/13' 2024-08-31T04:09:33.008 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/173/17' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/173' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/19' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/15' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/20' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/12' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/10' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/11' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/16' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/14' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/18' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/13' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/174/17' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/174' 2024-08-31T04:09:33.009 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/19' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/15' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/20' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/12' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/10' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/11' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/16' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/14' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/18' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/13' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/155/17' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/155' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/19' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/15' 2024-08-31T04:09:33.010 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/20' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/12' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/10' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/11' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/16' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/14' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/18' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/13' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/114/17' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/114' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/19' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/15' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/20' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/12' 2024-08-31T04:09:33.011 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/10' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/11' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/16' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/14' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/18' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/13' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/159/17' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/159' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/19' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/15' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/20' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/12' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/10' 2024-08-31T04:09:33.012 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/11' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/16' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/14' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/18' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/13' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/187/17' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/187' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/19' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/15' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/20' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/12' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/10' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/11' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/16' 2024-08-31T04:09:33.013 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/14' 2024-08-31T04:09:33.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/18' 2024-08-31T04:09:33.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/13' 2024-08-31T04:09:33.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/185/17' 2024-08-31T04:09:33.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/185' 2024-08-31T04:09:33.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/19' 2024-08-31T04:09:33.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/15' 2024-08-31T04:09:33.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/20' 2024-08-31T04:09:33.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/12' 2024-08-31T04:09:33.014 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/10' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/11' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/16' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/14' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/18' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/13' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/120/17' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/120' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/19' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/15' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/20' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/12' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/10' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/11' 2024-08-31T04:09:33.015 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/16' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/14' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/18' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/13' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/110/17' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/110' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/19' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/15' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/20' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/12' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/10' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/11' 2024-08-31T04:09:33.016 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/16' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/14' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/18' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/13' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/137/17' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/137' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/19' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/15' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/20' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/12' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/10' 2024-08-31T04:09:33.789 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/11' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/16' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/14' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/18' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/13' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/198/17' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/198' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/19' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/15' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/20' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/12' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/10' 2024-08-31T04:09:33.790 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/11' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/16' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/14' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/18' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/13' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/136/17' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/136' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/19' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/15' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/20' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/12' 2024-08-31T04:09:33.791 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/10' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/11' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/16' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/14' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/18' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/13' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/125/17' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/125' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/19' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/15' 2024-08-31T04:09:33.792 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/20' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/12' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/10' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/11' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/16' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/14' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/18' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/13' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/194/17' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/194' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/19' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/15' 2024-08-31T04:09:33.793 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/20' 2024-08-31T04:09:33.794 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/12' 2024-08-31T04:09:33.794 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/10' 2024-08-31T04:09:33.794 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/11' 2024-08-31T04:09:33.794 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/16' 2024-08-31T04:09:33.794 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/14' 2024-08-31T04:09:33.794 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/18' 2024-08-31T04:09:33.794 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/13' 2024-08-31T04:09:33.795 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/119/17' 2024-08-31T04:09:33.795 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/119' 2024-08-31T04:09:33.795 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/19' 2024-08-31T04:09:33.795 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/15' 2024-08-31T04:09:33.795 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/20' 2024-08-31T04:09:33.795 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/12' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/10' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/11' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/16' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/14' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/18' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/13' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/157/17' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/157' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/19' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/15' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/20' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/12' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/10' 2024-08-31T04:09:33.796 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/11' 2024-08-31T04:09:33.797 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/16' 2024-08-31T04:09:33.797 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/14' 2024-08-31T04:09:33.797 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/18' 2024-08-31T04:09:33.797 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/13' 2024-08-31T04:09:33.797 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/172/17' 2024-08-31T04:09:33.797 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/172' 2024-08-31T04:09:33.797 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/19' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/15' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/20' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/12' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/10' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/11' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/16' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/14' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/18' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/13' 2024-08-31T04:09:33.798 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/186/17' 2024-08-31T04:09:33.799 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/186' 2024-08-31T04:09:33.799 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/19' 2024-08-31T04:09:33.799 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/15' 2024-08-31T04:09:33.799 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/20' 2024-08-31T04:09:33.799 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/12' 2024-08-31T04:09:33.799 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/10' 2024-08-31T04:09:33.799 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/11' 2024-08-31T04:09:33.799 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/16' 2024-08-31T04:09:33.799 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/14' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/18' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/13' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/190/17' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/190' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/19' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/15' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/20' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/12' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/10' 2024-08-31T04:09:34.954 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/11' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/16' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/14' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/18' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/13' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/104/17' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/104' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/19' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/15' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/20' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/12' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/10' 2024-08-31T04:09:34.955 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/11' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/16' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/14' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/18' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/13' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/164/17' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/164' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/19' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/15' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/20' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/12' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/10' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/11' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/16' 2024-08-31T04:09:34.956 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/14' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/18' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/13' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/112/17' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/112' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/19' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/15' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/20' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/12' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/10' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/11' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/16' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/14' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/18' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/13' 2024-08-31T04:09:34.957 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/100/17' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/100' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/19' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/15' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/20' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/12' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/10' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/11' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/16' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/14' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/18' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/13' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/134/17' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/134' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/19' 2024-08-31T04:09:34.958 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/15' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/20' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/12' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/10' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/11' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/16' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/14' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/18' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/13' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/115/17' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/115' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/19' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/15' 2024-08-31T04:09:34.959 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/20' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/12' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/10' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/11' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/16' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/14' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/18' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/13' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/116/17' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/116' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/19' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/15' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/20' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/12' 2024-08-31T04:09:34.960 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/10' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/11' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/16' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/14' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/18' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/13' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/195/17' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/195' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/19' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/15' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/20' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/12' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/10' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/11' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/16' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/14' 2024-08-31T04:09:34.961 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/18' 2024-08-31T04:09:35.859 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.7 2024-08-31T04:09:35.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:09:36.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.022+0000 7f771c000640 1 -- 172.21.15.89:0/4105408229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc0040c0 msgr2=0x7f76fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.022+0000 7f771c000640 1 --2- 172.21.15.89:0/4105408229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc0040c0 0x7f76fc004810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f77140c25b0 tx=0x7f770001cd00 comp rx=0 tx=0).stop 2024-08-31T04:09:36.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.022+0000 7f771a000640 1 -- 172.21.15.89:0/4105408229 reap_dead start 2024-08-31T04:09:36.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.022+0000 7f771c000640 1 -- 172.21.15.89:0/4105408229 shutdown_connections 2024-08-31T04:09:36.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.022+0000 7f771c000640 1 -- 172.21.15.89:0/4105408229 >> 172.21.15.89:0/4105408229 conn(0x7f77140ccf20 msgr2=0x7f77140cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:09:36.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.022+0000 7f771c000640 1 -- 172.21.15.89:0/4105408229 shutdown_connections 2024-08-31T04:09:36.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.022+0000 7f771c000640 1 -- 172.21.15.89:0/4105408229 wait complete. 2024-08-31T04:09:36.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.022+0000 7f771c000640 1 Processor -- start 2024-08-31T04:09:36.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.022+0000 7f771c000640 1 -- start start 2024-08-31T04:09:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771c000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc0040c0 0x7f77141f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771c000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77140c53a0 0x7f77140737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771c000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f771414ebc0 0x7f771414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771c000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f77140c8030 con 0x7f771414ebc0 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771c000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f77140c3150 con 0x7f77140c53a0 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771c000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7714074e30 con 0x7f76fc0040c0 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f771414ebc0 0x7f771414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f771414ebc0 0x7f771414efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59216/0 (socket says 172.21.15.89:59216) 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771a000640 1 -- 172.21.15.89:0/1036047557 learned_addr learned my addr 172.21.15.89:0/1036047557 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f7718c00640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77140c53a0 0x7f77140737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f7719600640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc0040c0 0x7f77141f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771a000640 1 -- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc0040c0 msgr2=0x7f77141f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771a000640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc0040c0 0x7f77141f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771a000640 1 -- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77140c53a0 msgr2=0x7f77140737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771a000640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77140c53a0 0x7f77140737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771a000640 1 -- 172.21.15.89:0/1036047557 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77141f3f80 con 0x7f771414ebc0 2024-08-31T04:09:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771a000640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f771414ebc0 0x7f771414efd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f77140cadf0 tx=0x7f770c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:09:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f7711600640 1 -- 172.21.15.89:0/1036047557 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c017070 con 0x7f771414ebc0 2024-08-31T04:09:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f7711600640 1 -- 172.21.15.89:0/1036047557 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f770c00a5b0 con 0x7f771414ebc0 2024-08-31T04:09:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77140c66f0 con 0x7f771414ebc0 2024-08-31T04:09:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f7711600640 1 -- 172.21.15.89:0/1036047557 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c005e60 con 0x7f771414ebc0 2024-08-31T04:09:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77140c6cb0 con 0x7f771414ebc0 2024-08-31T04:09:36.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7714152a10 con 0x7f771414ebc0 2024-08-31T04:09:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.026+0000 7f7711600640 1 -- 172.21.15.89:0/1036047557 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f770c01a070 con 0x7f771414ebc0 2024-08-31T04:09:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.030+0000 7f7711600640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f76f40720c0 0x7f76f40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.030+0000 7f7711600640 1 -- 172.21.15.89:0/1036047557 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f770c0921c0 con 0x7f771414ebc0 2024-08-31T04:09:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.030+0000 7f7719600640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f76f40720c0 0x7f76f40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.030+0000 7f7719600640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f76f40720c0 0x7f76f40745d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7708001230 tx=0x7f7708009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:09:36.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.034+0000 7f7711600640 1 -- 172.21.15.89:0/1036047557 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f770c05d080 con 0x7f771414ebc0 2024-08-31T04:09:36.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77140c2420 con 0x7f771414ebc0 2024-08-31T04:09:36.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f7711600640 1 -- 172.21.15.89:0/1036047557 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f770c061840 con 0x7f771414ebc0 2024-08-31T04:09:36.237 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:09:36.237 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:09:36.237 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:09:36.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f76f40720c0 msgr2=0x7f76f40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f76f40720c0 0x7f76f40745d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7708001230 tx=0x7f7708009040 comp rx=0 tx=0).stop 2024-08-31T04:09:36.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f771414ebc0 msgr2=0x7f771414efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f771414ebc0 0x7f771414efd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f77140cadf0 tx=0x7f770c00cb90 comp rx=0 tx=0).stop 2024-08-31T04:09:36.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 shutdown_connections 2024-08-31T04:09:36.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f76f40720c0 0x7f76f40745d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f771414ebc0 0x7f771414efd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77140c53a0 0x7f77140737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 --2- 172.21.15.89:0/1036047557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76fc0040c0 0x7f77141f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 >> 172.21.15.89:0/1036047557 conn(0x7f77140ccf20 msgr2=0x7f77140c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:09:36.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 shutdown_connections 2024-08-31T04:09:36.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.234+0000 7f771c000640 1 -- 172.21.15.89:0/1036047557 wait complete. 2024-08-31T04:09:36.259 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 152.7 --await-for 45.0' 2024-08-31T04:09:36.259 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 152.7 --await-for 45.0 2024-08-31T04:09:36.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.426+0000 7f9d84400640 1 -- 172.21.15.89:0/2954845379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d64004d50 msgr2=0x7f9d64005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.426+0000 7f9d84400640 1 --2- 172.21.15.89:0/2954845379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d64004d50 0x7f9d64005220 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c06a190 tx=0x7f9d7401d150 comp rx=0 tx=0).stop 2024-08-31T04:09:36.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.426+0000 7f9d82400640 1 -- 172.21.15.89:0/2954845379 reap_dead start 2024-08-31T04:09:36.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.426+0000 7f9d84400640 1 -- 172.21.15.89:0/2954845379 shutdown_connections 2024-08-31T04:09:36.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.426+0000 7f9d84400640 1 -- 172.21.15.89:0/2954845379 >> 172.21.15.89:0/2954845379 conn(0x7f9d7c0c99b0 msgr2=0x7f9d7c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:09:36.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.426+0000 7f9d84400640 1 -- 172.21.15.89:0/2954845379 shutdown_connections 2024-08-31T04:09:36.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.426+0000 7f9d84400640 1 -- 172.21.15.89:0/2954845379 wait complete. 2024-08-31T04:09:36.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.426+0000 7f9d84400640 1 Processor -- start 2024-08-31T04:09:36.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.426+0000 7f9d84400640 1 -- start start 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d84400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d64004d50 0x7f9d7c154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d84400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d7c153000 0x7f9d7c154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d84400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d7c1ed600 0x7f9d7c1eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d84400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0c2770 con 0x7f9d7c153000 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d84400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0c2490 con 0x7f9d64004d50 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d84400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c1521d0 con 0x7f9d7c1ed600 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d7c153000 0x7f9d7c154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d7c153000 0x7f9d7c154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59236/0 (socket says 172.21.15.89:59236) 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81000640 1 -- 172.21.15.89:0/2891721631 learned_addr learned my addr 172.21.15.89:0/2891721631 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:09:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d82400640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d7c1ed600 0x7f9d7c1eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81a00640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d64004d50 0x7f9d7c154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81000640 1 -- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d7c1ed600 msgr2=0x7f9d7c1eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81000640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d7c1ed600 0x7f9d7c1eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81000640 1 -- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d64004d50 msgr2=0x7f9d7c154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81000640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d64004d50 0x7f9d7c154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81000640 1 -- 172.21.15.89:0/2891721631 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c156cf0 con 0x7f9d7c153000 2024-08-31T04:09:36.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d81000640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d7c153000 0x7f9d7c154d80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800e640 tx=0x7f9d6800eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:09:36.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d79600640 1 -- 172.21.15.89:0/2891721631 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68015070 con 0x7f9d7c153000 2024-08-31T04:09:36.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d79600640 1 -- 172.21.15.89:0/2891721631 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d6800ca00 con 0x7f9d7c153000 2024-08-31T04:09:36.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d84400640 1 -- 172.21.15.89:0/2891721631 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7c1575e0 con 0x7f9d7c153000 2024-08-31T04:09:36.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d79600640 1 -- 172.21.15.89:0/2891721631 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6800ce50 con 0x7f9d7c153000 2024-08-31T04:09:36.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.430+0000 7f9d84400640 1 -- 172.21.15.89:0/2891721631 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7c152800 con 0x7f9d7c153000 2024-08-31T04:09:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.434+0000 7f9d79600640 1 -- 172.21.15.89:0/2891721631 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f9d68018070 con 0x7f9d7c153000 2024-08-31T04:09:36.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.434+0000 7f9d79600640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9d5c072260 0x7f9d5c074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.434+0000 7f9d79600640 1 -- 172.21.15.89:0/2891721631 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f9d68093420 con 0x7f9d7c153000 2024-08-31T04:09:36.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.434+0000 7f9d8bae1000 1 Processor -- start 2024-08-31T04:09:36.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.434+0000 7f9d81a00640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9d5c072260 0x7f9d5c074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.434+0000 7f9d8bae1000 1 -- start start 2024-08-31T04:09:36.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.434+0000 7f9d81a00640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9d5c072260 0x7f9d5c074770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d70005fd0 tx=0x7f9d70005f40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e0dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158dd6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cb3960 0x556158dd7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556158c2c820 con 0x556158cc9e90 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556158c1bdb0 con 0x556158cd43f0 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x556158c1fd60 con 0x556158cb3960 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158dd6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158dd6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59238/0 (socket says 172.21.15.89:59238) 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81000640 1 -- 172.21.15.89:0/3348906265 learned_addr learned my addr 172.21.15.89:0/3348906265 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d82400640 1 --2- 172.21.15.89:0/3348906265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cb3960 0x556158dd7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81a00640 1 --2- 172.21.15.89:0/3348906265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e0dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81000640 1 -- 172.21.15.89:0/3348906265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cb3960 msgr2=0x556158dd7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:09:36.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81000640 1 --2- 172.21.15.89:0/3348906265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cb3960 0x556158dd7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81000640 1 -- 172.21.15.89:0/3348906265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 msgr2=0x556158e0dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:09:36.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81000640 1 --2- 172.21.15.89:0/3348906265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e0dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81000640 1 -- 172.21.15.89:0/3348906265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556158bb6b70 con 0x556158cc9e90 2024-08-31T04:09:36.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d81000640 1 --2- 172.21.15.89:0/3348906265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158dd6ce0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9d6805a230 tx=0x7f9d6805e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625c1a098ff41062 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d6e000640 1 -- 172.21.15.89:0/3348906265 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6801f070 con 0x556158cc9e90 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d6e000640 1 -- 172.21.15.89:0/3348906265 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d68062a20 con 0x556158cc9e90 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d6e000640 1 -- 172.21.15.89:0/3348906265 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68067440 con 0x556158cc9e90 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 -- 172.21.15.89:0/3348906265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 msgr2=0x556158dd6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/3348906265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158dd6ce0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9d6805a230 tx=0x7f9d6805e9f0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 -- 172.21.15.89:0/3348906265 shutdown_connections 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/3348906265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158dd6ce0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/3348906265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cb3960 0x556158dd7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/3348906265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e0dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 -- 172.21.15.89:0/3348906265 >> 172.21.15.89:0/3348906265 conn(0x5561588db210 msgr2=0x556158e10990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 -- 172.21.15.89:0/3348906265 shutdown_connections 2024-08-31T04:09:36.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.438+0000 7f9d8bae1000 1 -- 172.21.15.89:0/3348906265 wait complete. 2024-08-31T04:09:36.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 -- start start 2024-08-31T04:09:36.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 Processor -- start 2024-08-31T04:09:36.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e0cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cc9e90 0x556158e0cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e0d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5561588e2b10 con 0x556158cb3960 2024-08-31T04:09:36.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556158ba26f0 con 0x556158cd43f0 2024-08-31T04:09:36.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x556158c24390 con 0x556158cc9e90 2024-08-31T04:09:36.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 10 client.0 _ll_register_callbacks cb 0x556158bc3b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:09:36.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d81a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e0cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d81a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e0cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59250/0 (socket says 172.21.15.89:59250) 2024-08-31T04:09:36.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d81a00640 1 -- 172.21.15.89:0/2216655166 learned_addr learned my addr 172.21.15.89:0/2216655166 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:09:36.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d82400640 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e0d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d81a00640 1 -- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cc9e90 msgr2=0x556158e0cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:09:36.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d81a00640 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cc9e90 0x556158e0cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d81a00640 1 -- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 msgr2=0x556158e0d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:09:36.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d81a00640 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e0d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d81a00640 1 -- 172.21.15.89:0/2216655166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556158bda380 con 0x556158cb3960 2024-08-31T04:09:36.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d81a00640 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e0cab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9d700126d0 tx=0x7f9d700046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbe2f783f452704 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d62a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d62a00640 1 -- 172.21.15.89:0/2216655166 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7001f780 con 0x556158cb3960 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d62a00640 1 -- 172.21.15.89:0/2216655166 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f9d7001f920 con 0x556158cb3960 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2216655166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556158c2ad20 con 0x556158cb3960 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d62a00640 1 -- 172.21.15.89:0/2216655166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9d7001fb20 con 0x556158cb3960 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 10 client.5028 fetch_fsmap learned FSMap version 9 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2216655166 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x556158ca0e40 con 0x556158cb3960 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.442+0000 7f9d62a00640 1 -- 172.21.15.89:0/2216655166 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556158c2ad20 con 0x556158cb3960 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d62a00640 1 -- 172.21.15.89:0/2216655166 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9d70031050 con 0x556158cb3960 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d8bae1000 10 client.5028 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d8bae1000 10 client.5028 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d8bae1000 20 client.5028 populate_metadata read hostname 'smithi089' 2024-08-31T04:09:36.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5561588bfdc0 0x556158e2c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d8bae1000 4 client.5028 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:09:36.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2216655166 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556158c2e770 con 0x5561588bfdc0 2024-08-31T04:09:36.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d81000640 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5561588bfdc0 0x556158e2c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d81000640 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5561588bfdc0 0x556158e2c3f0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a785c33ddf9f1e5 server_cookie=c5dd2e8260bf5306 in_seq=0 out_seq=0 2024-08-31T04:09:36.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.446+0000 7f9d62a00640 10 client.5028 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.450+0000 7f9d62a00640 1 -- 172.21.15.89:0/2216655166 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556158c2e770 con 0x5561588bfdc0 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.450+0000 7f9d62a00640 10 client.5028 handle_command_reply: tid=0 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.450+0000 7f9d8bae1000 1 client.5028 shutdown 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2216655166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 msgr2=0x556158e0cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e0cab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9d700126d0 tx=0x7f9d700046d0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2216655166 shutdown_connections 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5561588bfdc0 0x556158e2c3f0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e0d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cc9e90 0x556158e0cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d62a00640 0 client.5028 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2216655166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e0cab0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2216655166 >> 172.21.15.89:0/2216655166 conn(0x5561588db210 msgr2=0x556158e0f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:09:36.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2216655166 shutdown_connections 2024-08-31T04:09:36.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2216655166 wait complete. 2024-08-31T04:09:36.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.454+0000 7f9d8bae1000 20 client.5028 trim_cache size 0 max 16384 2024-08-31T04:09:36.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.470+0000 7f9d8bae1000 1 Processor -- start 2024-08-31T04:09:36.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.470+0000 7f9d8bae1000 1 -- start start 2024-08-31T04:09:36.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.470+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e1c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cc9e90 0x556158e1c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e2c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c1fa1f0 con 0x556158cb3960 2024-08-31T04:09:36.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c1fb500 con 0x556158cd43f0 2024-08-31T04:09:36.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c1fa840 con 0x556158cc9e90 2024-08-31T04:09:36.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e1c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59260/0 (socket says 172.21.15.89:59260) 2024-08-31T04:09:36.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81a00640 1 -- 172.21.15.89:0/1264988818 learned_addr learned my addr 172.21.15.89:0/1264988818 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:09:36.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d82400640 1 --2- 172.21.15.89:0/1264988818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e2c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81000640 1 --2- 172.21.15.89:0/1264988818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cc9e90 0x556158e1c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81a00640 1 -- 172.21.15.89:0/1264988818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cc9e90 msgr2=0x556158e1c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:09:36.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81a00640 1 --2- 172.21.15.89:0/1264988818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cc9e90 0x556158e1c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81a00640 1 -- 172.21.15.89:0/1264988818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 msgr2=0x556158e2c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:09:36.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81a00640 1 --2- 172.21.15.89:0/1264988818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e2c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81a00640 1 -- 172.21.15.89:0/1264988818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556158c785b0 con 0x556158cb3960 2024-08-31T04:09:36.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d81a00640 1 --2- 172.21.15.89:0/1264988818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e1c100 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000f940 tx=0x7f9d70004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d09228c916fbf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d6d600640 1 -- 172.21.15.89:0/1264988818 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7001f580 con 0x556158cb3960 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d6d600640 1 -- 172.21.15.89:0/1264988818 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d70038070 con 0x556158cb3960 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d6d600640 1 -- 172.21.15.89:0/1264988818 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d70033610 con 0x556158cb3960 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 -- 172.21.15.89:0/1264988818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 msgr2=0x556158e1c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/1264988818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e1c100 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000f940 tx=0x7f9d70004740 comp rx=0 tx=0).stop 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 -- 172.21.15.89:0/1264988818 shutdown_connections 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/1264988818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cd43f0 0x556158e2c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/1264988818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cc9e90 0x556158e1c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/1264988818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cb3960 0x556158e1c100 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 -- 172.21.15.89:0/1264988818 >> 172.21.15.89:0/1264988818 conn(0x5561588db210 msgr2=0x556158e1b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 -- 172.21.15.89:0/1264988818 shutdown_connections 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 -- 172.21.15.89:0/1264988818 wait complete. 2024-08-31T04:09:36.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 -- start start 2024-08-31T04:09:36.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.474+0000 7f9d8bae1000 1 Processor -- start 2024-08-31T04:09:36.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cb3960 0x556158e91d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158e92260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cd43f0 0x556158e927a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556158b9deb0 con 0x556158cc9e90 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c1fae90 con 0x556158cb3960 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x556158bc3f20 con 0x556158cd43f0 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 10 client.0 _ll_register_callbacks cb 0x7f9d70011b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158e92260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158e92260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59262/0 (socket says 172.21.15.89:59262) 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81000640 1 -- 172.21.15.89:0/2563611566 learned_addr learned my addr 172.21.15.89:0/2563611566 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81a00640 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cb3960 0x556158e91d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d82400640 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cd43f0 0x556158e927a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81000640 1 -- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cd43f0 msgr2=0x556158e927a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81000640 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cd43f0 0x556158e927a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81000640 1 -- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cb3960 msgr2=0x556158e91d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:09:36.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81000640 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cb3960 0x556158e91d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81000640 1 -- 172.21.15.89:0/2563611566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556158bacfc0 con 0x556158cc9e90 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81000640 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158e92260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9d68004fb0 tx=0x7f9d6805a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb17c5c81f184718 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d62a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d62a00640 1 -- 172.21.15.89:0/2563611566 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6801f040 con 0x556158cc9e90 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d62a00640 1 -- 172.21.15.89:0/2563611566 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f9d680930b0 con 0x556158cc9e90 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2563611566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d70038070 con 0x556158cc9e90 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d62a00640 1 -- 172.21.15.89:0/2563611566 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9d6805a070 con 0x556158cc9e90 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 10 client.5034 fetch_fsmap learned FSMap version 9 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2563611566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x556158ba5e00 con 0x556158cc9e90 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d62a00640 1 -- 172.21.15.89:0/2563611566 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d70038070 con 0x556158cc9e90 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d62a00640 1 -- 172.21.15.89:0/2563611566 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9d6805a440 con 0x556158cc9e90 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 10 client.5034 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 10 client.5034 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:09:36.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 20 client.5034 populate_metadata read hostname 'smithi089' 2024-08-31T04:09:36.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5561588ade20 0x556158e2fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:09:36.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 4 client.5034 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.7, "await_for": 45.0}] 2024-08-31T04:09:36.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2563611566 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.7, "await_for": 45.0}) -- 0x556158c2a210 con 0x5561588ade20 2024-08-31T04:09:36.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81a00640 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5561588ade20 0x556158e2fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:09:36.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d81a00640 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5561588ade20 0x556158e2fd80 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a61f1dc4713cdfe4 server_cookie=4bc1f4bc264e46a6 in_seq=0 out_seq=0 2024-08-31T04:09:36.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:36.478+0000 7f9d62a00640 10 client.5034 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d62a00640 1 -- 172.21.15.89:0/2563611566 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556158c2a210 con 0x5561588ade20 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d62a00640 10 client.5034 handle_command_reply: tid=0 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 client.5034 shutdown 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2563611566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 msgr2=0x556158e92260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158e92260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9d68004fb0 tx=0x7f9d6805a840 comp rx=0 tx=0).stop 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2563611566 shutdown_connections 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5561588ade20 0x556158e2fd80 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556158cc9e90 0x556158e92260 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556158cd43f0 0x556158e927a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:41.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 --2- 172.21.15.89:0/2563611566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556158cb3960 0x556158e91d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:41.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2563611566 >> 172.21.15.89:0/2563611566 conn(0x5561588db210 msgr2=0x556158dcfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:09:41.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d62a00640 0 client.5034 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:09:41.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2563611566 shutdown_connections 2024-08-31T04:09:41.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 1 -- 172.21.15.89:0/2563611566 wait complete. 2024-08-31T04:09:41.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d8bae1000 20 client.5034 trim_cache size 0 max 16384 2024-08-31T04:09:41.223 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:09:41.223 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 18, 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "101f19b4": { 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 18, 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 152.7, 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:09:41.224 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:09:41.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 -- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9d5c072260 msgr2=0x7f9d5c074770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:41.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9d5c072260 0x7f9d5c074770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d70005fd0 tx=0x7f9d70005f40 comp rx=0 tx=0).stop 2024-08-31T04:09:41.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 -- 172.21.15.89:0/2891721631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d7c153000 msgr2=0x7f9d7c154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:09:41.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d7c153000 0x7f9d7c154d80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800e640 tx=0x7f9d6800eb00 comp rx=0 tx=0).stop 2024-08-31T04:09:41.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 -- 172.21.15.89:0/2891721631 shutdown_connections 2024-08-31T04:09:41.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9d5c072260 0x7f9d5c074770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:41.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d7c153000 0x7f9d7c154d80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:41.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d7c1ed600 0x7f9d7c1eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:41.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 --2- 172.21.15.89:0/2891721631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d64004d50 0x7f9d7c154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:09:41.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 -- 172.21.15.89:0/2891721631 >> 172.21.15.89:0/2891721631 conn(0x7f9d7c0c99b0 msgr2=0x7f9d7c150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:09:41.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 -- 172.21.15.89:0/2891721631 shutdown_connections 2024-08-31T04:09:41.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:09:41.218+0000 7f9d84400640 1 -- 172.21.15.89:0/2891721631 wait complete. 2024-08-31T04:09:41.247 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '101f19b4', quiesce took 5.4 seconds. Will release after: 27.300000000000004 2024-08-31T04:10:00.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:10:00.376 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:10:08.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:10:08.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.709+0000 7f7076400640 1 -- 172.21.15.89:0/3925514678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f707015bc70 msgr2=0x7f7070152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.709+0000 7f7076400640 1 --2- 172.21.15.89:0/3925514678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f707015bc70 0x7f7070152a10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7060009c80 tx=0x7f706001f5a0 comp rx=0 tx=0).stop 2024-08-31T04:10:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.709+0000 7f7076400640 1 -- 172.21.15.89:0/3925514678 shutdown_connections 2024-08-31T04:10:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.709+0000 7f7076400640 1 --2- 172.21.15.89:0/3925514678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f707015bc70 0x7f7070152a10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.709+0000 7f7076400640 1 -- 172.21.15.89:0/3925514678 >> 172.21.15.89:0/3925514678 conn(0x7f70700ccf20 msgr2=0x7f70700cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:10:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.709+0000 7f7076400640 1 -- 172.21.15.89:0/3925514678 shutdown_connections 2024-08-31T04:10:08.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.709+0000 7f7076400640 1 -- 172.21.15.89:0/3925514678 wait complete. 2024-08-31T04:10:08.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f7076400640 1 Processor -- start 2024-08-31T04:10:08.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f7076400640 1 -- start start 2024-08-31T04:10:08.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f7076400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70700c1f40 0x7f70700c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:08.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f7076400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70700c9330 0x7f70700aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:08.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f7076400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f707015bc70 0x7f70700c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:08.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f7076400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f70700c8030 con 0x7f70700c1f40 2024-08-31T04:10:08.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f7076400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f70700c3150 con 0x7f707015bc70 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f7076400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7070074e30 con 0x7f70700c9330 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f706f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70700c1f40 0x7f70700c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f706f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70700c1f40 0x7f70700c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59694/0 (socket says 172.21.15.89:59694) 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f706f400640 1 -- 172.21.15.89:0/1636994266 learned_addr learned my addr 172.21.15.89:0/1636994266 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f706fe00640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f707015bc70 0x7f70700c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.713+0000 7f706ea00640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70700c9330 0x7f70700aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f706f400640 1 -- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70700c9330 msgr2=0x7f70700aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f706f400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70700c9330 0x7f70700aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f706f400640 1 -- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f707015bc70 msgr2=0x7f70700c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f706f400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f707015bc70 0x7f70700c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:08.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f706f400640 1 -- 172.21.15.89:0/1636994266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70700c5df0 con 0x7f70700c1f40 2024-08-31T04:10:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f706fe00640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f707015bc70 0x7f70700c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:10:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f706f400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70700c1f40 0x7f70700c58b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f70600262f0 tx=0x7f7060009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:10:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f7067400640 1 -- 172.21.15.89:0/1636994266 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060004c50 con 0x7f70700c1f40 2024-08-31T04:10:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f7067400640 1 -- 172.21.15.89:0/1636994266 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70600af5d0 con 0x7f70700c1f40 2024-08-31T04:10:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70701f5480 con 0x7f70700c1f40 2024-08-31T04:10:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f7067400640 1 -- 172.21.15.89:0/1636994266 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70600afae0 con 0x7f70700c1f40 2024-08-31T04:10:08.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70700c4dd0 con 0x7f70700c1f40 2024-08-31T04:10:08.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7070152a10 con 0x7f70700c1f40 2024-08-31T04:10:08.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f7067400640 1 -- 172.21.15.89:0/1636994266 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f70600afc80 con 0x7f70700c1f40 2024-08-31T04:10:08.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.717+0000 7f7067400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f70500720c0 0x7f70500745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:08.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.721+0000 7f7067400640 1 -- 172.21.15.89:0/1636994266 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f70601320a0 con 0x7f70700c1f40 2024-08-31T04:10:08.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.721+0000 7f706ea00640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f70500720c0 0x7f70500745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:08.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.721+0000 7f706ea00640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f70500720c0 0x7f70500745d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7070150650 tx=0x7f705c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:10:08.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.725+0000 7f7067400640 1 -- 172.21.15.89:0/1636994266 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f70600ac050 con 0x7f70700c1f40 2024-08-31T04:10:08.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70701560a0 con 0x7f70700c1f40 2024-08-31T04:10:08.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7067400640 1 -- 172.21.15.89:0/1636994266 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f7060019100 con 0x7f70700c1f40 2024-08-31T04:10:08.933 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:10:08.933 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:10:08.933 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:10:08.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f70500720c0 msgr2=0x7f70500745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:08.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f70500720c0 0x7f70500745d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7070150650 tx=0x7f705c009040 comp rx=0 tx=0).stop 2024-08-31T04:10:08.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70700c1f40 msgr2=0x7f70700c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:08.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70700c1f40 0x7f70700c58b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f70600262f0 tx=0x7f7060009370 comp rx=0 tx=0).stop 2024-08-31T04:10:08.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 shutdown_connections 2024-08-31T04:10:08.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f70500720c0 0x7f70500745d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:08.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f707015bc70 0x7f70700c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:08.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70700c9330 0x7f70700aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:08.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 --2- 172.21.15.89:0/1636994266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70700c1f40 0x7f70700c58b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:08.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 >> 172.21.15.89:0/1636994266 conn(0x7f70700ccf20 msgr2=0x7f7070151940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:10:08.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.929+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 shutdown_connections 2024-08-31T04:10:08.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:08.933+0000 7f7076400640 1 -- 172.21.15.89:0/1636994266 wait complete. 2024-08-31T04:10:08.958 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 101f19b4 --release --await' 2024-08-31T04:10:08.958 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 101f19b4 --release --await 2024-08-31T04:10:09.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.113+0000 7f794ee00640 1 -- 172.21.15.89:0/3101709192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 msgr2=0x7f79480c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:09.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.113+0000 7f794ee00640 1 --2- 172.21.15.89:0/3101709192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 0x7f79480c1ed0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7934009900 tx=0x7f793401c850 comp rx=0 tx=0).stop 2024-08-31T04:10:09.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.113+0000 7f794ee00640 1 -- 172.21.15.89:0/3101709192 shutdown_connections 2024-08-31T04:10:09.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.113+0000 7f794ee00640 1 --2- 172.21.15.89:0/3101709192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79480c90e0 0x7f79480747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.113+0000 7f794ee00640 1 --2- 172.21.15.89:0/3101709192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 0x7f79480c1ed0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.113+0000 7f794ee00640 1 -- 172.21.15.89:0/3101709192 >> 172.21.15.89:0/3101709192 conn(0x7f79480c99b0 msgr2=0x7f79480c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:10:09.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.113+0000 7f794ee00640 1 -- 172.21.15.89:0/3101709192 shutdown_connections 2024-08-31T04:10:09.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.113+0000 7f794ee00640 1 -- 172.21.15.89:0/3101709192 wait complete. 2024-08-31T04:10:09.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 Processor -- start 2024-08-31T04:10:09.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 -- start start 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79480b2860 0x7f79481f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 0x7f7948148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79480c90e0 0x7f7948151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7948165770 con 0x7f79480b2d20 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f79481658f0 con 0x7f79480c90e0 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7948165a70 con 0x7f79480b2860 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 0x7f7948148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 0x7f7948148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59714/0 (socket says 172.21.15.89:59714) 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947400640 1 -- 172.21.15.89:0/139151864 learned_addr learned my addr 172.21.15.89:0/139151864 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:10:09.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947e00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79480b2860 0x7f79481f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ce00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79480c90e0 0x7f7948151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947400640 1 -- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79480b2860 msgr2=0x7f79481f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947400640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79480b2860 0x7f79481f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947400640 1 -- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79480c90e0 msgr2=0x7f7948151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947400640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79480c90e0 0x7f7948151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947400640 1 -- 172.21.15.89:0/139151864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794814da00 con 0x7f79480b2d20 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947e00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79480b2860 0x7f79481f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f7947400640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 0x7f7948148cc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f793401d0f0 tx=0x7f7934005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f793fe00640 1 -- 172.21.15.89:0/139151864 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340ac070 con 0x7f79480b2d20 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f793fe00640 1 -- 172.21.15.89:0/139151864 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7934004340 con 0x7f79480b2d20 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 -- 172.21.15.89:0/139151864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794814dca0 con 0x7f79480b2d20 2024-08-31T04:10:09.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f793fe00640 1 -- 172.21.15.89:0/139151864 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340052a0 con 0x7f79480b2d20 2024-08-31T04:10:09.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.117+0000 7f794ee00640 1 -- 172.21.15.89:0/139151864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79481f5a20 con 0x7f79480b2d20 2024-08-31T04:10:09.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.121+0000 7f793fe00640 1 -- 172.21.15.89:0/139151864 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f79340af070 con 0x7f79480b2d20 2024-08-31T04:10:09.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.121+0000 7f793fe00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79280720f0 0x7f7928074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.121+0000 7f793fe00640 1 -- 172.21.15.89:0/139151864 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f793412d1d0 con 0x7f79480b2d20 2024-08-31T04:10:09.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.121+0000 7f7947e00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79280720f0 0x7f7928074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.121+0000 7f79563c9000 1 Processor -- start 2024-08-31T04:10:09.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.121+0000 7f79563c9000 1 -- start start 2024-08-31T04:10:09.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947e00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79280720f0 0x7f7928074600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79380098b0 tx=0x7f7938008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:10:09.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 0x5633bc33de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc342ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc1fa890 0x5633bc343010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5633bc1e8f30 con 0x5633bc209930 2024-08-31T04:10:09.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5633bc15e690 con 0x5633bc21f950 2024-08-31T04:10:09.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5633bc14dc20 con 0x5633bc1fa890 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc342ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc342ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59724/0 (socket says 172.21.15.89:59724) 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947400640 1 -- 172.21.15.89:0/3605635321 learned_addr learned my addr 172.21.15.89:0/3605635321 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f794ce00640 1 --2- 172.21.15.89:0/3605635321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc1fa890 0x5633bc343010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947e00640 1 --2- 172.21.15.89:0/3605635321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 0x5633bc33de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947400640 1 -- 172.21.15.89:0/3605635321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc1fa890 msgr2=0x5633bc343010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947400640 1 --2- 172.21.15.89:0/3605635321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc1fa890 0x5633bc343010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947400640 1 -- 172.21.15.89:0/3605635321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 msgr2=0x5633bc33de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947400640 1 --2- 172.21.15.89:0/3605635321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 0x5633bc33de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947400640 1 -- 172.21.15.89:0/3605635321 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633bc1028f0 con 0x5633bc209930 2024-08-31T04:10:09.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f7947400640 1 --2- 172.21.15.89:0/3605635321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc342ad0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f79340f7e60 tx=0x7f79340f78e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fab67939d8e77fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f793cc00640 1 -- 172.21.15.89:0/3605635321 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340bf070 con 0x5633bc209930 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f793cc00640 1 -- 172.21.15.89:0/3605635321 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79340f85d0 con 0x5633bc209930 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f793cc00640 1 -- 172.21.15.89:0/3605635321 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340f7ed0 con 0x5633bc209930 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 -- 172.21.15.89:0/3605635321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 msgr2=0x5633bc342ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 --2- 172.21.15.89:0/3605635321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc342ad0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f79340f7e60 tx=0x7f79340f78e0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 -- 172.21.15.89:0/3605635321 shutdown_connections 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 --2- 172.21.15.89:0/3605635321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc342ad0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 --2- 172.21.15.89:0/3605635321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc1fa890 0x5633bc343010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 --2- 172.21.15.89:0/3605635321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 0x5633bc33de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 -- 172.21.15.89:0/3605635321 >> 172.21.15.89:0/3605635321 conn(0x5633bc21f540 msgr2=0x5633bc340890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 -- 172.21.15.89:0/3605635321 shutdown_connections 2024-08-31T04:10:09.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 -- 172.21.15.89:0/3605635321 wait complete. 2024-08-31T04:10:09.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 -- start start 2024-08-31T04:10:09.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.125+0000 7f79563c9000 1 Processor -- start 2024-08-31T04:10:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 0x5633bc33d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc33d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 0x5633bc347bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5633bc0d4500 con 0x5633bc209930 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5633bc151bd0 con 0x5633bc1fa890 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5633bc0f5a30 con 0x5633bc21f950 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 10 client.0 _ll_register_callbacks cb 0x5633bc203b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc33d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 0x5633bc33d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc33d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59726/0 (socket says 172.21.15.89:59726) 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947400640 1 -- 172.21.15.89:0/2904067692 learned_addr learned my addr 172.21.15.89:0/2904067692 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f794ce00640 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 0x5633bc347bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947400640 1 -- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 msgr2=0x5633bc347bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947400640 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 0x5633bc347bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947400640 1 -- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 msgr2=0x5633bc33d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947400640 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 0x5633bc33d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947400640 1 -- 172.21.15.89:0/2904067692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633bc0ed6a0 con 0x5633bc209930 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947400640 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc33d570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7934009900 tx=0x7f79340fc5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39a6b75efa43e1f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7931600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7931600640 1 -- 172.21.15.89:0/2904067692 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340bf040 con 0x5633bc209930 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7931600640 1 -- 172.21.15.89:0/2904067692 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f7934100cd0 con 0x5633bc209930 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 -- 172.21.15.89:0/2904067692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5633bc0e77e0 con 0x5633bc209930 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7931600640 1 -- 172.21.15.89:0/2904067692 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f79340f85d0 con 0x5633bc209930 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 10 client.5055 fetch_fsmap learned FSMap version 9 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 -- 172.21.15.89:0/2904067692 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5633bc10c1c0 con 0x5633bc209930 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7931600640 1 -- 172.21.15.89:0/2904067692 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5633bc0e77e0 con 0x5633bc209930 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7931600640 1 -- 172.21.15.89:0/2904067692 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f79340f7130 con 0x5633bc209930 2024-08-31T04:10:09.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 10 client.5055 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:10:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 10 client.5055 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:10:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 20 client.5055 populate_metadata read hostname 'smithi089' 2024-08-31T04:10:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5633bc1e3fc0 0x5633bc348970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 4 client.5055 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:10:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f79563c9000 1 -- 172.21.15.89:0/2904067692 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633bc1605e0 con 0x5633bc1e3fc0 2024-08-31T04:10:09.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.129+0000 7f7947e00640 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5633bc1e3fc0 0x5633bc348970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f7947e00640 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5633bc1e3fc0 0x5633bc348970 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=109f373e474bc9a server_cookie=34e84a34a91f0a3e in_seq=0 out_seq=0 2024-08-31T04:10:09.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f7931600640 10 client.5055 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:10:09.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f7931600640 1 -- 172.21.15.89:0/2904067692 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5633bc1605e0 con 0x5633bc1e3fc0 2024-08-31T04:10:09.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f7931600640 10 client.5055 handle_command_reply: tid=0 2024-08-31T04:10:09.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 client.5055 shutdown 2024-08-31T04:10:09.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 -- 172.21.15.89:0/2904067692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 msgr2=0x5633bc33d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc33d570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7934009900 tx=0x7f79340fc5c0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 -- 172.21.15.89:0/2904067692 shutdown_connections 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5633bc1e3fc0 0x5633bc348970 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc33d570 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 0x5633bc347bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 --2- 172.21.15.89:0/2904067692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 0x5633bc33d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 -- 172.21.15.89:0/2904067692 >> 172.21.15.89:0/2904067692 conn(0x5633bc21f540 msgr2=0x5633bc33e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f7931600640 0 client.5055 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 -- 172.21.15.89:0/2904067692 shutdown_connections 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 1 -- 172.21.15.89:0/2904067692 wait complete. 2024-08-31T04:10:09.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.133+0000 7f79563c9000 20 client.5055 trim_cache size 0 max 16384 2024-08-31T04:10:09.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f79563c9000 1 Processor -- start 2024-08-31T04:10:09.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f79563c9000 1 -- start start 2024-08-31T04:10:09.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f79563c9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 0x5633bc356380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f79563c9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc3568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f79563c9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 0x5633bc356e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f79563c9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f79482044e0 con 0x5633bc209930 2024-08-31T04:10:09.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f79563c9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f79482033c0 con 0x5633bc1fa890 2024-08-31T04:10:09.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f79563c9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7948201a00 con 0x5633bc21f950 2024-08-31T04:10:09.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc3568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc3568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59736/0 (socket says 172.21.15.89:59736) 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947400640 1 -- 172.21.15.89:0/3390094737 learned_addr learned my addr 172.21.15.89:0/3390094737 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947e00640 1 --2- 172.21.15.89:0/3390094737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 0x5633bc356380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f794ce00640 1 --2- 172.21.15.89:0/3390094737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 0x5633bc356e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947400640 1 -- 172.21.15.89:0/3390094737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 msgr2=0x5633bc356e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947400640 1 --2- 172.21.15.89:0/3390094737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 0x5633bc356e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947400640 1 -- 172.21.15.89:0/3390094737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 msgr2=0x5633bc356380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947400640 1 --2- 172.21.15.89:0/3390094737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 0x5633bc356380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947400640 1 -- 172.21.15.89:0/3390094737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633bc347f40 con 0x5633bc209930 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7947400640 1 --2- 172.21.15.89:0/3390094737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc3568c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f79340981b0 tx=0x7f79340fc630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166ff81c4854a668 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7933e00640 1 -- 172.21.15.89:0/3390094737 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340bf070 con 0x5633bc209930 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7933e00640 1 -- 172.21.15.89:0/3390094737 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79340a6790 con 0x5633bc209930 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.153+0000 7f7933e00640 1 -- 172.21.15.89:0/3390094737 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340f7ed0 con 0x5633bc209930 2024-08-31T04:10:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 -- 172.21.15.89:0/3390094737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 msgr2=0x5633bc3568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 --2- 172.21.15.89:0/3390094737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc3568c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f79340981b0 tx=0x7f79340fc630 comp rx=0 tx=0).stop 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 -- 172.21.15.89:0/3390094737 shutdown_connections 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 --2- 172.21.15.89:0/3390094737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc209930 0x5633bc3568c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 --2- 172.21.15.89:0/3390094737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc21f950 0x5633bc356e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 --2- 172.21.15.89:0/3390094737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc1fa890 0x5633bc356380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 -- 172.21.15.89:0/3390094737 >> 172.21.15.89:0/3390094737 conn(0x5633bc21f540 msgr2=0x5633bc353380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 -- 172.21.15.89:0/3390094737 shutdown_connections 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 -- 172.21.15.89:0/3390094737 wait complete. 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 -- start start 2024-08-31T04:10:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 Processor -- start 2024-08-31T04:10:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc1fa890 0x5633bc359ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc209930 0x5633bc35a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 0x5633bc35a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7948202050 con 0x5633bc1fa890 2024-08-31T04:10:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7948202cf0 con 0x5633bc21f950 2024-08-31T04:10:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f79482026a0 con 0x5633bc209930 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f79563c9000 10 client.0 _ll_register_callbacks cb 0x7f7940009500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc1fa890 0x5633bc359ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc1fa890 0x5633bc359ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59746/0 (socket says 172.21.15.89:59746) 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947e00640 1 -- 172.21.15.89:0/2444444239 learned_addr learned my addr 172.21.15.89:0/2444444239 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947400640 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc209930 0x5633bc35a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f794ce00640 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 0x5633bc35a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947e00640 1 -- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc209930 msgr2=0x5633bc35a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947e00640 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc209930 0x5633bc35a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947e00640 1 -- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 msgr2=0x5633bc35a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947e00640 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 0x5633bc35a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947e00640 1 -- 172.21.15.89:0/2444444239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633bc1d22f0 con 0x5633bc1fa890 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7947e00640 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc1fa890 0x5633bc359ed0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f793800dec0 tx=0x7f7938004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e72c874e9ea642 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:10:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.157+0000 7f7931600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f7931600640 1 -- 172.21.15.89:0/2444444239 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938014bc0 con 0x5633bc1fa890 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f7931600640 1 -- 172.21.15.89:0/2444444239 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f793800f040 con 0x5633bc1fa890 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f79563c9000 1 -- 172.21.15.89:0/2444444239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79340a6790 con 0x5633bc1fa890 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f7931600640 1 -- 172.21.15.89:0/2444444239 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7938014d60 con 0x5633bc1fa890 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f79563c9000 10 client.5061 fetch_fsmap learned FSMap version 9 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f79563c9000 1 -- 172.21.15.89:0/2444444239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5633bc0d7b30 con 0x5633bc1fa890 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f7931600640 1 -- 172.21.15.89:0/2444444239 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79340a6790 con 0x5633bc1fa890 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f7931600640 1 -- 172.21.15.89:0/2444444239 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7938039050 con 0x5633bc1fa890 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f79563c9000 10 client.5061 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f79563c9000 10 client.5061 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f79563c9000 20 client.5061 populate_metadata read hostname 'smithi089' 2024-08-31T04:10:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f79563c9000 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5633bbddfe80 0x5633bc35ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:10:09.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f79563c9000 4 client.5061 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "101f19b4", "release": true, "await": true}] 2024-08-31T04:10:09.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f79563c9000 1 -- 172.21.15.89:0/2444444239 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "101f19b4", "release": true, "await": true}) -- 0x5633bc15c080 con 0x5633bbddfe80 2024-08-31T04:10:09.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f7947400640 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5633bbddfe80 0x5633bc35ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:10:09.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f7947400640 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5633bbddfe80 0x5633bc35ae90 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b91c6d5a0e2f7515 server_cookie=6efb7c8a456e999f in_seq=0 out_seq=0 2024-08-31T04:10:09.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.161+0000 7f7931600640 10 client.5061 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:10:09.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f7931600640 1 -- 172.21.15.89:0/2444444239 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5633bc15c080 con 0x5633bbddfe80 2024-08-31T04:10:09.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f7931600640 10 client.5061 handle_command_reply: tid=0 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 client.5061 shutdown 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 -- 172.21.15.89:0/2444444239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc1fa890 msgr2=0x5633bc359ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc1fa890 0x5633bc359ed0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f793800dec0 tx=0x7f7938004690 comp rx=0 tx=0).stop 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 -- 172.21.15.89:0/2444444239 shutdown_connections 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5633bbddfe80 0x5633bc35ae90 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5633bc21f950 0x5633bc35a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5633bc209930 0x5633bc35a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f7931600640 0 client.5061 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 --2- 172.21.15.89:0/2444444239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5633bc1fa890 0x5633bc359ed0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 -- 172.21.15.89:0/2444444239 >> 172.21.15.89:0/2444444239 conn(0x5633bc21f540 msgr2=0x5633bc353380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 -- 172.21.15.89:0/2444444239 shutdown_connections 2024-08-31T04:10:09.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 1 -- 172.21.15.89:0/2444444239 wait complete. 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f79563c9000 20 client.5061 trim_cache size 0 max 16384 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 20, 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stdout: "101f19b4": { 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 20, 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:10:09.227 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 152.7, 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:10:09.228 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:10:09.229 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:10:09.229 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:10:09.229 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:10:09.229 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:10:09.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 -- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79280720f0 msgr2=0x7f7928074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:09.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79280720f0 0x7f7928074600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79380098b0 tx=0x7f7938008040 comp rx=0 tx=0).stop 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 -- 172.21.15.89:0/139151864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 msgr2=0x7f7948148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 0x7f7948148cc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f793401d0f0 tx=0x7f7934005e90 comp rx=0 tx=0).stop 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 -- 172.21.15.89:0/139151864 shutdown_connections 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79280720f0 0x7f7928074600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79480b2d20 0x7f7948148cc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79480c90e0 0x7f7948151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 --2- 172.21.15.89:0/139151864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79480b2860 0x7f79481f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 -- 172.21.15.89:0/139151864 >> 172.21.15.89:0/139151864 conn(0x7f79480c99b0 msgr2=0x7f794814bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 -- 172.21.15.89:0/139151864 shutdown_connections 2024-08-31T04:10:09.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:10:09.221+0000 7f794ee00640 1 -- 172.21.15.89:0/139151864 wait complete. 2024-08-31T04:10:09.246 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '101f19b4', total seconds elapsed: 33.4 2024-08-31T04:10:09.437 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/13' 2024-08-31T04:10:09.437 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/138/17' 2024-08-31T04:10:09.437 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/138' 2024-08-31T04:10:09.437 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/19' 2024-08-31T04:10:09.437 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/15' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/20' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/12' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/10' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/11' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/16' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/14' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/18' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/13' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/135/17' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/135' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/19' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/15' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/20' 2024-08-31T04:10:09.438 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/12' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/10' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/11' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/16' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/14' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/18' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/13' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/117/17' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/117' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/19' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/15' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/20' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/12' 2024-08-31T04:10:09.439 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/10' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/11' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/16' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/14' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/18' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/13' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/143/17' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/143' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/19' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/15' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/20' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/12' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/10' 2024-08-31T04:10:09.440 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/11' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/16' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/14' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/18' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/13' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/180/17' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/180' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/19' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/15' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/20' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/12' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/10' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/11' 2024-08-31T04:10:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/16' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/14' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/18' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/13' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/126/17' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/126' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/19' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/15' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/20' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/12' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/10' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/11' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/16' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/14' 2024-08-31T04:10:09.442 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/18' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/13' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/161/17' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/161' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/19' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/15' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/20' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/12' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/10' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/11' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/16' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/14' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/18' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/13' 2024-08-31T04:10:09.443 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/176/17' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/176' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/19' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/15' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/20' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/12' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/10' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/11' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/16' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/14' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/18' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/13' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/111/17' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/111' 2024-08-31T04:10:09.444 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/19' 2024-08-31T04:10:09.445 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/15' 2024-08-31T04:10:09.445 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/20' 2024-08-31T04:10:09.445 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/12' 2024-08-31T04:10:09.445 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/10' 2024-08-31T04:10:09.445 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/11' 2024-08-31T04:10:09.445 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/16' 2024-08-31T04:10:09.445 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/14' 2024-08-31T04:10:09.445 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/18' 2024-08-31T04:10:09.445 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/13' 2024-08-31T04:10:10.390 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/191/17' 2024-08-31T04:10:10.390 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/191' 2024-08-31T04:10:10.390 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/19' 2024-08-31T04:10:10.390 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/15' 2024-08-31T04:10:10.390 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/20' 2024-08-31T04:10:10.390 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/12' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/10' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/11' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/16' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/14' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/18' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/13' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/184/17' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/184' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/19' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/15' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/20' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/12' 2024-08-31T04:10:10.391 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/10' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/11' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/16' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/14' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/18' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/13' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/192/17' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/192' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/19' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/15' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/20' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/12' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/10' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/11' 2024-08-31T04:10:10.392 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/16' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/14' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/18' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/13' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/103/17' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/103' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/19' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/15' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/20' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/12' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/10' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/11' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/16' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/14' 2024-08-31T04:10:10.393 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/18' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/13' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/128/17' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/128' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/19' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/15' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/20' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/12' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/10' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/11' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/16' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/14' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/18' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/13' 2024-08-31T04:10:10.394 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/144/17' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/144' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/19' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/15' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/20' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/12' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/10' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/11' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/16' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/14' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/18' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/13' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/146/17' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/146' 2024-08-31T04:10:10.395 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/19' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/15' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/20' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/12' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/10' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/11' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/16' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/14' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/18' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/13' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/141/17' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/141' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/19' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/15' 2024-08-31T04:10:10.396 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/20' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/12' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/10' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/11' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/16' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/14' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/18' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/13' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/182/17' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/182' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/19' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/15' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/20' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/12' 2024-08-31T04:10:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/10' 2024-08-31T04:10:10.398 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/11' 2024-08-31T04:10:10.398 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/16' 2024-08-31T04:10:10.398 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/14' 2024-08-31T04:10:10.398 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/18' 2024-08-31T04:10:10.398 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/13' 2024-08-31T04:10:10.398 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/107/17' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/107' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/19' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/15' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/20' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/12' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/10' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/11' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/16' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/14' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/18' 2024-08-31T04:10:11.650 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/13' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/178/17' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/178' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/19' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/15' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/20' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/12' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/10' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/11' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/16' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/14' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/18' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/13' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/156/17' 2024-08-31T04:10:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/156' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/19' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/15' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/20' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/12' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/10' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/11' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/16' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/14' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/18' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/13' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/131/17' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/131' 2024-08-31T04:10:11.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/19' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/15' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/20' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/12' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/10' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/11' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/16' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/14' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/18' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/13' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/123/17' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/123' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/19' 2024-08-31T04:10:11.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/15' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/20' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/12' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/10' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/11' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/16' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/14' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/18' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/13' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/160/17' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/160' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/19' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/15' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/20' 2024-08-31T04:10:11.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/12' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/10' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/11' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/16' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/14' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/18' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/13' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/165/17' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/165' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/19' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/15' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/20' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/12' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/10' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/11' 2024-08-31T04:10:11.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/16' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/14' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/18' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/13' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/101/17' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/101' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/19' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/15' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/20' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/12' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/10' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/11' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/16' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/14' 2024-08-31T04:10:11.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/18' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/13' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/148/17' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/148' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/19' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/15' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/20' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/12' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/10' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/11' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/16' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/14' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/18' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/13' 2024-08-31T04:10:11.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/168/17' 2024-08-31T04:10:11.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/168' 2024-08-31T04:10:13.185 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/19' 2024-08-31T04:10:13.185 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/15' 2024-08-31T04:10:13.185 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/20' 2024-08-31T04:10:13.185 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/12' 2024-08-31T04:10:13.185 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/10' 2024-08-31T04:10:13.185 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/11' 2024-08-31T04:10:13.185 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/16' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/14' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/18' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/13' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/179/17' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/179' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/19' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/15' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/20' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/12' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/10' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/11' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/16' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/14' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/18' 2024-08-31T04:10:13.186 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/13' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/132/17' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/132' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/19' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/15' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/20' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/12' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/10' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/11' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/16' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/14' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/18' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/13' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/199/17' 2024-08-31T04:10:13.187 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/199' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/19' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/15' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/20' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/12' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/10' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/11' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/16' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/14' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/18' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/13' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/163/17' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/163' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/19' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/15' 2024-08-31T04:10:13.188 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/20' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/12' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/10' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/11' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/16' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/14' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/18' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/13' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/153/17' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/153' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/19' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/15' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/20' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/12' 2024-08-31T04:10:13.189 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/10' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/11' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/16' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/14' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/18' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/13' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/122/17' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/122' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/19' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/15' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/20' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/12' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/10' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/11' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/16' 2024-08-31T04:10:13.190 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/14' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/18' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/13' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/162/17' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/162' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/19' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/15' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/20' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/12' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/10' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/11' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/16' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/14' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/18' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/13' 2024-08-31T04:10:13.191 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/197/17' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/197' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/19' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/15' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/20' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/12' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/10' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/11' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/16' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/14' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/18' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/13' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/113/17' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/113' 2024-08-31T04:10:13.192 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/19' 2024-08-31T04:10:14.504 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/15' 2024-08-31T04:10:14.504 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/20' 2024-08-31T04:10:14.505 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/12' 2024-08-31T04:10:14.505 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/10' 2024-08-31T04:10:14.505 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/11' 2024-08-31T04:10:14.505 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/16' 2024-08-31T04:10:14.505 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/14' 2024-08-31T04:10:14.505 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/18' 2024-08-31T04:10:14.506 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/13' 2024-08-31T04:10:14.506 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/152/17' 2024-08-31T04:10:14.506 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/152' 2024-08-31T04:10:14.506 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/19' 2024-08-31T04:10:14.506 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/15' 2024-08-31T04:10:14.506 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/20' 2024-08-31T04:10:14.507 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/12' 2024-08-31T04:10:14.507 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/10' 2024-08-31T04:10:14.507 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/11' 2024-08-31T04:10:14.507 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/16' 2024-08-31T04:10:14.507 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/14' 2024-08-31T04:10:14.507 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/18' 2024-08-31T04:10:14.508 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/13' 2024-08-31T04:10:14.508 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/121/17' 2024-08-31T04:10:14.508 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/121' 2024-08-31T04:10:14.508 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/19' 2024-08-31T04:10:14.509 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/15' 2024-08-31T04:10:14.509 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/20' 2024-08-31T04:10:14.509 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/12' 2024-08-31T04:10:14.509 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/10' 2024-08-31T04:10:14.509 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/11' 2024-08-31T04:10:14.509 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/16' 2024-08-31T04:10:14.510 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/14' 2024-08-31T04:10:14.510 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/18' 2024-08-31T04:10:14.510 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/13' 2024-08-31T04:10:14.510 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/118/17' 2024-08-31T04:10:14.510 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/118' 2024-08-31T04:10:14.510 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/19' 2024-08-31T04:10:14.511 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/15' 2024-08-31T04:10:14.511 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/20' 2024-08-31T04:10:14.511 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/12' 2024-08-31T04:10:14.511 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/10' 2024-08-31T04:10:14.511 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/11' 2024-08-31T04:10:14.511 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/16' 2024-08-31T04:10:14.512 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/14' 2024-08-31T04:10:14.512 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/18' 2024-08-31T04:10:14.512 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/13' 2024-08-31T04:10:14.512 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/196/17' 2024-08-31T04:10:14.512 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/196' 2024-08-31T04:10:14.512 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/19' 2024-08-31T04:10:14.513 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/15' 2024-08-31T04:10:14.513 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/20' 2024-08-31T04:10:14.513 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/12' 2024-08-31T04:10:14.513 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/10' 2024-08-31T04:10:14.513 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/11' 2024-08-31T04:10:14.513 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/16' 2024-08-31T04:10:14.513 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/14' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/18' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/13' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/124/17' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/124' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/19' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/15' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/20' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/12' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/10' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/11' 2024-08-31T04:10:14.514 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/16' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/14' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/18' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/13' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/188/17' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/188' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/19' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/15' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/20' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/12' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/10' 2024-08-31T04:10:14.515 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/11' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/16' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/14' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/18' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/13' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/145/17' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/145' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/19' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/15' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/20' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/12' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/10' 2024-08-31T04:10:14.516 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/11' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/16' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/14' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/18' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/13' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/130/17' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/130' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/19' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/15' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/20' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/12' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/10' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/11' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/16' 2024-08-31T04:10:14.517 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/14' 2024-08-31T04:10:14.518 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/18' 2024-08-31T04:10:14.518 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/13' 2024-08-31T04:10:14.518 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/193/17' 2024-08-31T04:10:14.518 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/193' 2024-08-31T04:10:14.518 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/19' 2024-08-31T04:10:14.518 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/15' 2024-08-31T04:10:17.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/20' 2024-08-31T04:10:17.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/12' 2024-08-31T04:10:17.651 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/10' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/11' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/16' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/14' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/18' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/13' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/175/17' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/175' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/19' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/15' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/20' 2024-08-31T04:10:17.652 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/12' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/10' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/11' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/16' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/14' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/18' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/13' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/181/17' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/181' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/19' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/15' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/20' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/12' 2024-08-31T04:10:17.653 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/10' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/11' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/16' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/14' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/18' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/13' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/127/17' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/127' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/19' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/15' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/20' 2024-08-31T04:10:17.654 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/12' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/10' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/11' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/16' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/14' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/18' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/13' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/108/17' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/108' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/19' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/15' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/20' 2024-08-31T04:10:17.655 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/12' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/10' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/11' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/16' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/14' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/18' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/13' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/183/17' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/183' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/19' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/15' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/20' 2024-08-31T04:10:17.656 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/12' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/10' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/11' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/16' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/14' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/18' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/13' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/177/17' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/177' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/19' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/15' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/20' 2024-08-31T04:10:17.657 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/12' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/10' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/11' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/16' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/14' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/18' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/13' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/169/17' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/169' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/19' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/15' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/20' 2024-08-31T04:10:17.658 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/12' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/10' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/11' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/16' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/14' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/18' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/13' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/154/17' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/154' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/19' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/15' 2024-08-31T04:10:17.659 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/20' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/12' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/10' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/11' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/16' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/14' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/18' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/13' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/171/17' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/171' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/19' 2024-08-31T04:10:17.660 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/15' 2024-08-31T04:10:17.661 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/20' 2024-08-31T04:10:18.320 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/12' 2024-08-31T04:10:18.320 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/10' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/11' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/16' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/14' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/18' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/13' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/139/17' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/139' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/19' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/15' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/20' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/12' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/10' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/11' 2024-08-31T04:10:18.321 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/16' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/14' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/18' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/13' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/102/17' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/102' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/19' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/15' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/20' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/12' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/10' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/11' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/16' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/14' 2024-08-31T04:10:18.322 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/18' 2024-08-31T04:10:18.323 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/13' 2024-08-31T04:10:18.323 INFO:tasks.workunit.client.0.smithi089.stdout:removed './copyofsnap1/test1/129/17' 2024-08-31T04:10:18.323 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1/129' 2024-08-31T04:10:18.323 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1/test1' 2024-08-31T04:10:18.323 INFO:tasks.workunit.client.0.smithi089.stdout:removed directory './copyofsnap1' 2024-08-31T04:10:18.323 INFO:tasks.workunit.client.0.smithi089.stdout:OK 2024-08-31T04:10:18.324 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T04:10:18.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T04:10:18.360 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2024-08-31T04:10:18.360 DEBUG:teuthology.orchestra.run.smithi089:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2024-08-31T04:10:18.420 INFO:tasks.workunit.client.0.smithi089.stderr:+ set -e 2024-08-31T04:10:18.420 INFO:tasks.workunit.client.0.smithi089.stderr:+ touch foo 2024-08-31T04:10:18.423 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod +x foo 2024-08-31T04:10:18.424 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/s 2024-08-31T04:10:18.442 INFO:tasks.workunit.client.0.smithi089.stderr:+ find .snap/s/foo -executable 2024-08-31T04:10:18.442 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep foo 2024-08-31T04:10:18.446 INFO:tasks.workunit.client.0.smithi089.stdout:.snap/s/foo 2024-08-31T04:10:18.446 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir .snap/s 2024-08-31T04:10:18.455 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm foo 2024-08-31T04:10:18.460 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo OK 2024-08-31T04:10:18.461 INFO:tasks.workunit.client.0.smithi089.stdout:OK 2024-08-31T04:10:18.461 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T04:10:18.462 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T04:10:18.533 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2024-08-31T04:10:18.533 DEBUG:teuthology.orchestra.run.smithi089:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2024-08-31T04:10:18.596 INFO:tasks.workunit.client.0.smithi089.stderr:+ set -e 2024-08-31T04:10:18.596 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir foo 2024-08-31T04:10:18.601 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo x 2024-08-31T04:10:18.602 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:19.090 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir foo/.snap/ss 2024-08-31T04:10:19.101 INFO:tasks.workunit.client.0.smithi089.stderr:+ ln foo/x foo/xx 2024-08-31T04:10:19.105 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat foo/.snap/ss/x 2024-08-31T04:10:19.117 INFO:tasks.workunit.client.0.smithi089.stdout:x 2024-08-31T04:10:19.117 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir foo/.snap/ss 2024-08-31T04:10:19.130 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo a 2024-08-31T04:10:19.133 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo b 2024-08-31T04:10:19.134 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir foo/.snap/s 2024-08-31T04:10:19.148 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat foo/.snap/s/a 2024-08-31T04:10:19.164 INFO:tasks.workunit.client.0.smithi089.stderr:+ r=a 2024-08-31T04:10:19.165 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ -z a ] 2024-08-31T04:10:19.165 INFO:tasks.workunit.client.0.smithi089.stderr:+ ln foo/b foo/b2 2024-08-31T04:10:19.168 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat foo/.snap/s/b 2024-08-31T04:10:19.187 INFO:tasks.workunit.client.0.smithi089.stdout:b 2024-08-31T04:10:19.187 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo this used to hang: 2024-08-31T04:10:19.188 INFO:tasks.workunit.client.0.smithi089.stdout:this used to hang: 2024-08-31T04:10:19.188 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo more 2024-08-31T04:10:19.189 INFO:tasks.workunit.client.0.smithi089.stdout:oh, it didn't hang! good job. 2024-08-31T04:10:19.189 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo oh, it didn't hang! good job. 2024-08-31T04:10:19.189 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat foo/b 2024-08-31T04:10:19.190 INFO:tasks.workunit.client.0.smithi089.stdout:b 2024-08-31T04:10:19.190 INFO:tasks.workunit.client.0.smithi089.stdout:more 2024-08-31T04:10:19.190 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir foo/.snap/s 2024-08-31T04:10:19.196 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm -r foo 2024-08-31T04:10:19.232 INFO:tasks.workunit.client.0.smithi089.stdout:OK 2024-08-31T04:10:19.233 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo OK 2024-08-31T04:10:19.233 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T04:10:19.234 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T04:10:19.307 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2024-08-31T04:10:19.308 DEBUG:teuthology.orchestra.run.smithi089:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2024-08-31T04:10:19.369 INFO:tasks.workunit.client.0.smithi089.stderr:+ set -e 2024-08-31T04:10:19.369 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:19.372 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/bar 2024-08-31T04:10:19.389 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/foo 2024-08-31T04:10:19.402 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/foo 2024-08-31T04:10:19.411 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:19.418 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/bar/a 2024-08-31T04:10:19.425 INFO:tasks.workunit.client.0.smithi089.stdout: File: .snap/bar/a 2024-08-31T04:10:19.425 INFO:tasks.workunit.client.0.smithi089.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-31T04:10:19.425 INFO:tasks.workunit.client.0.smithi089.stdout:Device: feh/254d Inode: 1099511633797 Links: 2 2024-08-31T04:10:19.425 INFO:tasks.workunit.client.0.smithi089.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2024-08-31T04:10:19.426 INFO:tasks.workunit.client.0.smithi089.stdout:Access: 2024-08-31 04:10:19.365669963 +0000 2024-08-31T04:10:19.426 INFO:tasks.workunit.client.0.smithi089.stdout:Modify: 2024-08-31 04:10:19.365669963 +0000 2024-08-31T04:10:19.426 INFO:tasks.workunit.client.0.smithi089.stdout:Change: 2024-08-31 04:10:19.365669963 +0000 2024-08-31T04:10:19.426 INFO:tasks.workunit.client.0.smithi089.stdout: Birth: 2024-08-31 04:10:19.365669963 +0000 2024-08-31T04:10:19.426 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir .snap/bar 2024-08-31T04:10:19.438 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo OK 2024-08-31T04:10:19.439 INFO:tasks.workunit.client.0.smithi089.stdout:OK 2024-08-31T04:10:19.440 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T04:10:19.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T04:10:19.515 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2024-08-31T04:10:19.516 DEBUG:teuthology.orchestra.run.smithi089:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2024-08-31T04:10:19.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ set -e 2024-08-31T04:10:19.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ seq 1 20 2024-08-31T04:10:19.579 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:19.584 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:19.588 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:19.605 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:19.615 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:19.615 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:19.615 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:19.790 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:19.805 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:19.805 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:19.805 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:19.805 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:19.805 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:19.805 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:19.805 INFO:tasks.workunit.client.0.smithi089.stdout: 40038 ? 00:00:00 ps 2024-08-31T04:10:19.818 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:19.873 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:19.878 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:20.139 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:20.144 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:20.148 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:20.163 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:20.173 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:20.173 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:20.174 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:20.264 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:20.278 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:20.278 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:20.278 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:20.278 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:20.278 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:20.278 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:20.278 INFO:tasks.workunit.client.0.smithi089.stdout: 40048 ? 00:00:00 ps 2024-08-31T04:10:20.279 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:20.298 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:20.303 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:20.314 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:20.318 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:20.320 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:20.335 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:20.343 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:20.344 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:20.344 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:20.406 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:20.420 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:20.420 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:20.420 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:20.420 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:20.420 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:20.420 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:20.421 INFO:tasks.workunit.client.0.smithi089.stdout: 40058 ? 00:00:00 ps 2024-08-31T04:10:20.421 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:20.437 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:20.441 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:20.454 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:20.457 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:20.460 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:20.474 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:20.483 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:20.483 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:20.484 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:20.530 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:20.544 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:20.544 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:20.544 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:20.544 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:20.544 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:20.544 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:20.545 INFO:tasks.workunit.client.0.smithi089.stdout: 40068 ? 00:00:00 ps 2024-08-31T04:10:20.545 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:20.598 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:20.602 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:20.614 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:20.618 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:20.621 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:20.636 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:20.645 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:20.645 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:20.645 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:20.790 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:20.804 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:20.804 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:20.804 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:20.805 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:20.805 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:20.805 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:20.805 INFO:tasks.workunit.client.0.smithi089.stdout: 40078 ? 00:00:00 ps 2024-08-31T04:10:20.806 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:20.830 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:20.837 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:20.852 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:20.856 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:20.858 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:20.872 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:20.880 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:20.880 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:20.881 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:20.931 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:20.945 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:20.945 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:20.946 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:20.946 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:20.946 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:20.946 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:20.946 INFO:tasks.workunit.client.0.smithi089.stdout: 40088 ? 00:00:00 ps 2024-08-31T04:10:20.947 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:20.965 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:20.971 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:20.986 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:20.991 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:20.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:21.010 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:21.019 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:21.019 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:21.020 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:21.074 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:21.088 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:21.088 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:21.088 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:21.089 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:21.089 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:21.089 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:21.089 INFO:tasks.workunit.client.0.smithi089.stdout: 40098 ? 00:00:00 ps 2024-08-31T04:10:21.090 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:21.109 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:21.116 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:21.131 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:21.137 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:21.140 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:21.156 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:21.167 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:21.167 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:21.168 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:21.215 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:21.228 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:21.228 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:21.229 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:21.229 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:21.229 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:21.229 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:21.229 INFO:tasks.workunit.client.0.smithi089.stdout: 40108 ? 00:00:00 ps 2024-08-31T04:10:21.230 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:21.248 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:21.253 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:21.264 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:21.269 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:21.271 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:21.286 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:21.296 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:21.296 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:21.297 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:21.383 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:21.397 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:21.397 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:21.397 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:21.397 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:21.397 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:21.397 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:21.397 INFO:tasks.workunit.client.0.smithi089.stdout: 40118 ? 00:00:00 ps 2024-08-31T04:10:21.398 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:21.416 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:21.420 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:21.433 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:21.437 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:21.440 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:21.456 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:21.466 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:21.466 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:21.467 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:21.507 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:21.521 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:21.521 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:21.521 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:21.521 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:21.521 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:21.521 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:21.521 INFO:tasks.workunit.client.0.smithi089.stdout: 40128 ? 00:00:00 ps 2024-08-31T04:10:21.522 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:21.540 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:21.545 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:21.557 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:21.561 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:21.563 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:21.612 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:21.650 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:21.650 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:21.652 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:21.959 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:21.977 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:21.977 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:21.977 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:21.977 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:21.977 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:21.977 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:21.977 INFO:tasks.workunit.client.0.smithi089.stdout: 40138 ? 00:00:00 ps 2024-08-31T04:10:21.978 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:21.989 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:21.991 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:21.997 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:22.000 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:22.001 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:22.010 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:22.016 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:22.016 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:22.017 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:22.217 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:22.232 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:22.232 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:22.232 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:22.232 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:22.232 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:22.232 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:22.232 INFO:tasks.workunit.client.0.smithi089.stdout: 40148 ? 00:00:00 ps 2024-08-31T04:10:22.233 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:22.251 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:22.256 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:22.268 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:22.272 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:22.274 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:22.288 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:22.298 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:22.298 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:22.299 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:22.358 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:22.371 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:22.371 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:22.372 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:22.372 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:22.372 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:22.372 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:22.372 INFO:tasks.workunit.client.0.smithi089.stdout: 40158 ? 00:00:00 ps 2024-08-31T04:10:22.373 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:22.391 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:22.395 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:22.406 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:22.410 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:22.412 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:22.427 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:22.438 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:22.438 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:22.439 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:22.500 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:22.514 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:22.514 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:22.514 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:22.514 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:22.514 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:22.514 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:22.514 INFO:tasks.workunit.client.0.smithi089.stdout: 40168 ? 00:00:00 ps 2024-08-31T04:10:22.515 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:22.539 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:22.546 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:22.560 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:22.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:22.568 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:22.623 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:22.663 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:22.663 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:22.667 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:22.900 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:22.914 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:22.914 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:22.914 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:22.914 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:22.914 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:22.914 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:22.914 INFO:tasks.workunit.client.0.smithi089.stdout: 40178 ? 00:00:00 ps 2024-08-31T04:10:22.915 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:22.937 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:22.942 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:22.954 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:22.959 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:22.961 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:22.980 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:22.991 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:22.991 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:22.992 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:23.126 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:23.140 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:23.140 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:23.141 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:23.141 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:23.141 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:23.141 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:23.141 INFO:tasks.workunit.client.0.smithi089.stdout: 40188 ? 00:00:00 ps 2024-08-31T04:10:23.142 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:23.163 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:23.167 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:23.180 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:23.185 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:23.187 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:23.205 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:23.216 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:23.216 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:23.217 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:23.285 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:23.298 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:23.298 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:23.298 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:23.298 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:23.298 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:23.298 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:23.298 INFO:tasks.workunit.client.0.smithi089.stdout: 40198 ? 00:00:00 ps 2024-08-31T04:10:23.299 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:23.321 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:23.325 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:23.605 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:23.613 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:23.622 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:23.659 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:23.678 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:23.678 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:23.679 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:23.969 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:23.983 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:23.983 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:23.983 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:23.983 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:23.983 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:23.983 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:23.984 INFO:tasks.workunit.client.0.smithi089.stdout: 40208 ? 00:00:00 ps 2024-08-31T04:10:23.984 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:24.009 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:24.017 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:24.034 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:24.039 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:24.043 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:24.064 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:24.077 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:24.077 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:24.078 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:24.218 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:24.232 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:24.232 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:24.232 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:24.232 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:24.232 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:24.233 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:24.233 INFO:tasks.workunit.client.0.smithi089.stdout: 40218 ? 00:00:00 ps 2024-08-31T04:10:24.234 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:24.258 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:24.265 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:24.282 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a 2024-08-31T04:10:24.289 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/one 2024-08-31T04:10:24.291 INFO:tasks.workunit.client.0.smithi089.stderr:+ cat 2024-08-31T04:10:24.309 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir a/.snap/two 2024-08-31T04:10:24.702 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 2024-08-31T04:10:24.702 INFO:tasks.workunit.client.0.smithi089.stderr:+ chmod 777 a/foo 2024-08-31T04:10:24.703 INFO:tasks.workunit.client.0.smithi089.stderr:+ sync 2024-08-31T04:10:24.836 INFO:tasks.workunit.client.0.smithi089.stderr:+ ps 2024-08-31T04:10:24.864 INFO:tasks.workunit.client.0.smithi089.stdout: PID TTY TIME CMD 2024-08-31T04:10:24.865 INFO:tasks.workunit.client.0.smithi089.stdout: 1321 ? 00:00:00 systemd 2024-08-31T04:10:24.865 INFO:tasks.workunit.client.0.smithi089.stdout: 1322 ? 00:00:00 (sd-pam) 2024-08-31T04:10:24.865 INFO:tasks.workunit.client.0.smithi089.stdout: 18384 ? 00:00:01 sshd 2024-08-31T04:10:24.865 INFO:tasks.workunit.client.0.smithi089.stdout: 40027 ? 00:00:00 timeout 2024-08-31T04:10:24.865 INFO:tasks.workunit.client.0.smithi089.stdout: 40030 ? 00:00:00 snaptest-double 2024-08-31T04:10:24.865 INFO:tasks.workunit.client.0.smithi089.stdout: 40228 ? 00:00:00 ps 2024-08-31T04:10:24.867 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a/.snap/one a/.snap/two 2024-08-31T04:10:24.908 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm a/foo 2024-08-31T04:10:24.912 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir a 2024-08-31T04:10:24.924 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo OK 2024-08-31T04:10:24.925 INFO:tasks.workunit.client.0.smithi089.stdout:OK 2024-08-31T04:10:24.925 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T04:10:24.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T04:10:24.999 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2024-08-31T04:10:25.000 DEBUG:teuthology.orchestra.run.smithi089:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2024-08-31T04:10:25.060 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/foo 2024-08-31T04:10:25.077 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo We want ENOENT, not ESTALE, here. 2024-08-31T04:10:25.077 INFO:tasks.workunit.client.0.smithi089.stdout:We want ENOENT, not ESTALE, here. 2024-08-31T04:10:25.077 INFO:tasks.workunit.client.0.smithi089.stderr:+ seq 1 100 2024-08-31T04:10:25.078 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/1 2024-08-31T04:10:25.078 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.082 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2024-08-31T04:10:25.083 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/2 2024-08-31T04:10:25.083 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.084 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2024-08-31T04:10:25.086 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/3 2024-08-31T04:10:25.086 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.087 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2024-08-31T04:10:25.088 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/4 2024-08-31T04:10:25.088 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.090 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2024-08-31T04:10:25.091 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/5 2024-08-31T04:10:25.091 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.093 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2024-08-31T04:10:25.093 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/6 2024-08-31T04:10:25.094 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.095 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2024-08-31T04:10:25.096 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/7 2024-08-31T04:10:25.096 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.098 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2024-08-31T04:10:25.099 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/8 2024-08-31T04:10:25.099 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.100 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2024-08-31T04:10:25.101 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/9 2024-08-31T04:10:25.101 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.103 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2024-08-31T04:10:25.104 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/10 2024-08-31T04:10:25.104 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.106 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2024-08-31T04:10:25.107 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/11 2024-08-31T04:10:25.107 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.109 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2024-08-31T04:10:25.110 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/12 2024-08-31T04:10:25.110 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.112 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2024-08-31T04:10:25.112 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/13 2024-08-31T04:10:25.112 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.114 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2024-08-31T04:10:25.115 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/14 2024-08-31T04:10:25.115 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.117 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2024-08-31T04:10:25.118 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/15 2024-08-31T04:10:25.118 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.119 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2024-08-31T04:10:25.120 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/16 2024-08-31T04:10:25.120 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.122 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2024-08-31T04:10:25.123 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/17 2024-08-31T04:10:25.123 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.124 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2024-08-31T04:10:25.125 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/18 2024-08-31T04:10:25.125 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.127 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2024-08-31T04:10:25.128 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/19 2024-08-31T04:10:25.128 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.130 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2024-08-31T04:10:25.131 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/20 2024-08-31T04:10:25.131 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.132 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2024-08-31T04:10:25.133 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/21 2024-08-31T04:10:25.133 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.135 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2024-08-31T04:10:25.136 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/22 2024-08-31T04:10:25.136 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.138 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2024-08-31T04:10:25.139 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/23 2024-08-31T04:10:25.139 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.141 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2024-08-31T04:10:25.142 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/24 2024-08-31T04:10:25.142 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.143 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2024-08-31T04:10:25.144 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/25 2024-08-31T04:10:25.145 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.146 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2024-08-31T04:10:25.147 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/26 2024-08-31T04:10:25.147 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.149 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2024-08-31T04:10:25.150 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/27 2024-08-31T04:10:25.150 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.405 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2024-08-31T04:10:25.406 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/28 2024-08-31T04:10:25.406 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.407 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2024-08-31T04:10:25.408 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/29 2024-08-31T04:10:25.409 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.410 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2024-08-31T04:10:25.411 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/30 2024-08-31T04:10:25.411 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.413 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2024-08-31T04:10:25.414 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/31 2024-08-31T04:10:25.414 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.415 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2024-08-31T04:10:25.416 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/32 2024-08-31T04:10:25.416 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.418 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2024-08-31T04:10:25.419 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/33 2024-08-31T04:10:25.419 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.421 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2024-08-31T04:10:25.422 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/34 2024-08-31T04:10:25.422 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.424 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2024-08-31T04:10:25.425 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/35 2024-08-31T04:10:25.425 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.427 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2024-08-31T04:10:25.428 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/36 2024-08-31T04:10:25.428 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.429 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2024-08-31T04:10:25.430 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/37 2024-08-31T04:10:25.430 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.432 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2024-08-31T04:10:25.433 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/38 2024-08-31T04:10:25.433 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.434 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2024-08-31T04:10:25.435 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/39 2024-08-31T04:10:25.435 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.437 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2024-08-31T04:10:25.438 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/40 2024-08-31T04:10:25.438 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.439 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2024-08-31T04:10:25.440 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/41 2024-08-31T04:10:25.440 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.442 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2024-08-31T04:10:25.443 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/42 2024-08-31T04:10:25.443 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.445 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2024-08-31T04:10:25.446 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/43 2024-08-31T04:10:25.446 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.447 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2024-08-31T04:10:25.448 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/44 2024-08-31T04:10:25.448 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.450 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2024-08-31T04:10:25.451 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/45 2024-08-31T04:10:25.451 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.453 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2024-08-31T04:10:25.453 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/46 2024-08-31T04:10:25.454 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.455 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2024-08-31T04:10:25.456 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/47 2024-08-31T04:10:25.456 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.458 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2024-08-31T04:10:25.459 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/48 2024-08-31T04:10:25.459 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.461 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2024-08-31T04:10:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/49 2024-08-31T04:10:25.462 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.463 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2024-08-31T04:10:25.464 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/50 2024-08-31T04:10:25.464 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.465 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2024-08-31T04:10:25.466 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/51 2024-08-31T04:10:25.466 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.468 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2024-08-31T04:10:25.469 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/52 2024-08-31T04:10:25.469 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.470 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2024-08-31T04:10:25.471 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/53 2024-08-31T04:10:25.471 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.473 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2024-08-31T04:10:25.474 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/54 2024-08-31T04:10:25.474 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.476 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2024-08-31T04:10:25.477 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/55 2024-08-31T04:10:25.477 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.478 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2024-08-31T04:10:25.479 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/56 2024-08-31T04:10:25.479 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.481 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2024-08-31T04:10:25.482 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/57 2024-08-31T04:10:25.482 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.483 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2024-08-31T04:10:25.484 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/58 2024-08-31T04:10:25.484 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.486 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2024-08-31T04:10:25.487 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/59 2024-08-31T04:10:25.487 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.489 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2024-08-31T04:10:25.490 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/60 2024-08-31T04:10:25.490 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.492 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2024-08-31T04:10:25.492 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/61 2024-08-31T04:10:25.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.494 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2024-08-31T04:10:25.495 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/62 2024-08-31T04:10:25.495 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.497 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2024-08-31T04:10:25.498 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/63 2024-08-31T04:10:25.498 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.499 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2024-08-31T04:10:25.500 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/64 2024-08-31T04:10:25.500 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.502 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2024-08-31T04:10:25.503 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/65 2024-08-31T04:10:25.503 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.505 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2024-08-31T04:10:25.506 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/66 2024-08-31T04:10:25.506 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.508 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2024-08-31T04:10:25.508 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/67 2024-08-31T04:10:25.508 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.510 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2024-08-31T04:10:25.511 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/68 2024-08-31T04:10:25.511 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.513 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2024-08-31T04:10:25.514 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/69 2024-08-31T04:10:25.514 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.516 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2024-08-31T04:10:25.516 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/70 2024-08-31T04:10:25.517 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.518 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2024-08-31T04:10:25.520 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/71 2024-08-31T04:10:25.520 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.521 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2024-08-31T04:10:25.522 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/72 2024-08-31T04:10:25.522 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.524 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2024-08-31T04:10:25.525 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/73 2024-08-31T04:10:25.525 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.527 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2024-08-31T04:10:25.527 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/74 2024-08-31T04:10:25.527 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.529 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2024-08-31T04:10:25.530 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/75 2024-08-31T04:10:25.530 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.532 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2024-08-31T04:10:25.533 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/76 2024-08-31T04:10:25.533 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.534 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2024-08-31T04:10:25.535 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/77 2024-08-31T04:10:25.535 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.537 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2024-08-31T04:10:25.538 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/78 2024-08-31T04:10:25.538 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.540 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2024-08-31T04:10:25.541 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/79 2024-08-31T04:10:25.541 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.543 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2024-08-31T04:10:25.544 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/80 2024-08-31T04:10:25.544 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.545 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2024-08-31T04:10:25.546 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/81 2024-08-31T04:10:25.547 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.548 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2024-08-31T04:10:25.549 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/82 2024-08-31T04:10:25.549 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.551 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2024-08-31T04:10:25.552 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/83 2024-08-31T04:10:25.552 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.556 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2024-08-31T04:10:25.557 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/84 2024-08-31T04:10:25.557 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.557 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2024-08-31T04:10:25.558 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/85 2024-08-31T04:10:25.558 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.559 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2024-08-31T04:10:25.560 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/86 2024-08-31T04:10:25.560 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.562 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2024-08-31T04:10:25.563 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/87 2024-08-31T04:10:25.563 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.564 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2024-08-31T04:10:25.565 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/88 2024-08-31T04:10:25.565 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.567 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2024-08-31T04:10:25.568 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/89 2024-08-31T04:10:25.568 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.570 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2024-08-31T04:10:25.571 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/90 2024-08-31T04:10:25.571 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.572 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2024-08-31T04:10:25.573 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/91 2024-08-31T04:10:25.573 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.575 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2024-08-31T04:10:25.576 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/92 2024-08-31T04:10:25.576 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.577 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2024-08-31T04:10:25.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/93 2024-08-31T04:10:25.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.580 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2024-08-31T04:10:25.581 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/94 2024-08-31T04:10:25.582 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.837 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2024-08-31T04:10:25.838 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/95 2024-08-31T04:10:25.838 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.839 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2024-08-31T04:10:25.840 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/96 2024-08-31T04:10:25.841 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.842 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2024-08-31T04:10:25.843 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/97 2024-08-31T04:10:25.843 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.845 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2024-08-31T04:10:25.845 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/98 2024-08-31T04:10:25.846 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.847 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2024-08-31T04:10:25.848 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/99 2024-08-31T04:10:25.848 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.850 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2024-08-31T04:10:25.851 INFO:tasks.workunit.client.0.smithi089.stderr:+ stat .snap/foo/100 2024-08-31T04:10:25.851 INFO:tasks.workunit.client.0.smithi089.stderr:+ grep No such file 2024-08-31T04:10:25.852 INFO:tasks.workunit.client.0.smithi089.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2024-08-31T04:10:25.853 INFO:tasks.workunit.client.0.smithi089.stderr:+ rmdir .snap/foo 2024-08-31T04:10:25.891 INFO:tasks.workunit.client.0.smithi089.stdout:OK 2024-08-31T04:10:25.892 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo OK 2024-08-31T04:10:25.893 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T04:10:25.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T04:10:25.968 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2024-08-31T04:10:25.968 DEBUG:teuthology.orchestra.run.smithi089:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2024-08-31T04:10:26.028 INFO:tasks.workunit.client.0.smithi089.stderr:+ set -e 2024-08-31T04:10:26.028 INFO:tasks.workunit.client.0.smithi089.stderr:+ sudo git config --global http.sslVerify false 2024-08-31T04:10:26.044 INFO:tasks.workunit.client.0.smithi089.stderr:+ sudo git config --global http.postBuffer 1048576000 2024-08-31T04:10:26.057 INFO:tasks.workunit.client.0.smithi089.stderr:+ retried=false 2024-08-31T04:10:26.057 INFO:tasks.workunit.client.0.smithi089.stderr:+ trap -- retry EXIT 2024-08-31T04:10:26.058 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm -rf ceph 2024-08-31T04:10:26.058 INFO:tasks.workunit.client.0.smithi089.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2024-08-31T04:10:26.064 INFO:tasks.workunit.client.0.smithi089.stderr:Cloning into 'ceph'... 2024-08-31T04:10:30.487 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:10:30.491 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:11:00.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:11:00.580 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:11:09.975 INFO:tasks.quiescer.fs.[cephfs]:Total duration (56.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:11:09.975 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.0 2024-08-31T04:11:09.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:11:10.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.232+0000 7fb1a1000640 1 -- 172.21.15.89:0/3826974009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 msgr2=0x7fb19c166250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:10.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.232+0000 7fb1a1000640 1 --2- 172.21.15.89:0/3826974009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 0x7fb19c166250 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0cc880 tx=0x7fb19401f370 comp rx=0 tx=0).stop 2024-08-31T04:11:10.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.232+0000 7fb1a1000640 1 -- 172.21.15.89:0/3826974009 shutdown_connections 2024-08-31T04:11:10.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.232+0000 7fb1a1000640 1 --2- 172.21.15.89:0/3826974009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 0x7fb19c166250 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.232+0000 7fb1a1000640 1 --2- 172.21.15.89:0/3826974009 >> v2:172.21.15.170:3300/0 conn(0x7fb19c155e10 0x7fb19c15b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.232+0000 7fb1a1000640 1 -- 172.21.15.89:0/3826974009 >> 172.21.15.89:0/3826974009 conn(0x7fb19c06cc30 msgr2=0x7fb19c06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:10.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.232+0000 7fb1a1000640 1 -- 172.21.15.89:0/3826974009 shutdown_connections 2024-08-31T04:11:10.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.232+0000 7fb1a1000640 1 -- 172.21.15.89:0/3826974009 wait complete. 2024-08-31T04:11:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.236+0000 7fb1a1000640 1 Processor -- start 2024-08-31T04:11:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.236+0000 7fb1a1000640 1 -- start start 2024-08-31T04:11:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.236+0000 7fb1a1000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0c5990 0x7fb19c154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.236+0000 7fb1a1000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb19c155e10 0x7fb19c14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.236+0000 7fb1a1000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 0x7fb19c14dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb1a1000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c15eec0 con 0x7fb19c15f9a0 2024-08-31T04:11:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb1a1000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c0ca9c0 con 0x7fb19c0c5990 2024-08-31T04:11:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb1a1000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb19c15f1a0 con 0x7fb19c155e10 2024-08-31T04:11:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 0x7fb19c14dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0c5990 0x7fb19c154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 0x7fb19c14dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53960/0 (socket says 172.21.15.89:53960) 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19be00640 1 -- 172.21.15.89:0/75589554 learned_addr learned my addr 172.21.15.89:0/75589554 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19aa00640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb19c155e10 0x7fb19c14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19be00640 1 -- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb19c155e10 msgr2=0x7fb19c14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19be00640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb19c155e10 0x7fb19c14d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19be00640 1 -- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0c5990 msgr2=0x7fb19c154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19be00640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0c5990 0x7fb19c154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19be00640 1 -- 172.21.15.89:0/75589554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c15cf10 con 0x7fb19c15f9a0 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb19be00640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 0x7fb19c14dbb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1940260c0 tx=0x7fb194005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb193400640 1 -- 172.21.15.89:0/75589554 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1940b4040 con 0x7fb19c15f9a0 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb193400640 1 -- 172.21.15.89:0/75589554 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1940bf070 con 0x7fb19c15f9a0 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19c15d1f0 con 0x7fb19c15f9a0 2024-08-31T04:11:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb193400640 1 -- 172.21.15.89:0/75589554 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1940afb90 con 0x7fb19c15f9a0 2024-08-31T04:11:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb19c0c8840 con 0x7fb19c15f9a0 2024-08-31T04:11:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.240+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb19c06dd40 con 0x7fb19c15f9a0 2024-08-31T04:11:10.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.244+0000 7fb193400640 1 -- 172.21.15.89:0/75589554 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb194004040 con 0x7fb19c15f9a0 2024-08-31T04:11:10.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.244+0000 7fb193400640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb17c0720c0 0x7fb17c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:10.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.244+0000 7fb193400640 1 -- 172.21.15.89:0/75589554 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb1941310a0 con 0x7fb19c15f9a0 2024-08-31T04:11:10.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.244+0000 7fb19b400640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb17c0720c0 0x7fb17c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.248+0000 7fb19b400640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb17c0720c0 0x7fb17c0745d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009b40 tx=0x7fb18c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:10.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.256+0000 7fb193400640 1 -- 172.21.15.89:0/75589554 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb194018ed0 con 0x7fb19c15f9a0 2024-08-31T04:11:10.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.668+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb19c15c840 con 0x7fb19c15f9a0 2024-08-31T04:11:10.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.668+0000 7fb193400640 1 -- 172.21.15.89:0/75589554 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fb1940fbe20 con 0x7fb19c15f9a0 2024-08-31T04:11:10.671 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:11:10.671 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:11:10.671 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:11:10.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb17c0720c0 msgr2=0x7fb17c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:10.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb17c0720c0 0x7fb17c0745d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009b40 tx=0x7fb18c0091e0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 msgr2=0x7fb19c14dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 0x7fb19c14dbb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1940260c0 tx=0x7fb194005c60 comp rx=0 tx=0).stop 2024-08-31T04:11:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 shutdown_connections 2024-08-31T04:11:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb17c0720c0 0x7fb17c0745d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb19c15f9a0 0x7fb19c14dbb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb19c155e10 0x7fb19c14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 --2- 172.21.15.89:0/75589554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0c5990 0x7fb19c154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 >> 172.21.15.89:0/75589554 conn(0x7fb19c06cc30 msgr2=0x7fb19c06f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 shutdown_connections 2024-08-31T04:11:10.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.672+0000 7fb1a1000640 1 -- 172.21.15.89:0/75589554 wait complete. 2024-08-31T04:11:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0' 2024-08-31T04:11:10.706 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0 2024-08-31T04:11:10.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.984+0000 7f38f5c00640 1 -- 172.21.15.89:0/1437658273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f00c9d60 msgr2=0x7f38f0152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:10.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.984+0000 7f38f5c00640 1 --2- 172.21.15.89:0/1437658273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f00c9d60 0x7f38f0152640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38e0009840 tx=0x7f38e001f010 comp rx=0 tx=0).stop 2024-08-31T04:11:10.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.988+0000 7f38f5c00640 1 -- 172.21.15.89:0/1437658273 shutdown_connections 2024-08-31T04:11:10.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.988+0000 7f38f5c00640 1 --2- 172.21.15.89:0/1437658273 >> v2:172.21.15.170:3300/0 conn(0x7f38f0158c80 0x7f38f0159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.988+0000 7f38f5c00640 1 --2- 172.21.15.89:0/1437658273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f00c9d60 0x7f38f0152640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.988+0000 7f38f5c00640 1 -- 172.21.15.89:0/1437658273 >> 172.21.15.89:0/1437658273 conn(0x7f38f00cde30 msgr2=0x7f38f00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:10.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.988+0000 7f38f5c00640 1 -- 172.21.15.89:0/1437658273 shutdown_connections 2024-08-31T04:11:10.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.988+0000 7f38f5c00640 1 -- 172.21.15.89:0/1437658273 wait complete. 2024-08-31T04:11:10.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.988+0000 7f38f5c00640 1 Processor -- start 2024-08-31T04:11:10.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38f5c00640 1 -- start start 2024-08-31T04:11:10.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38f5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00c4be0 0x7f38f00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:10.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38f5c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f00c9d60 0x7f38f0148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:10.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38f5c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0158c80 0x7f38f006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:10.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38f5c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f38f00c88d0 con 0x7f38f00c9d60 2024-08-31T04:11:10.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38f5c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38f00c32b0 con 0x7f38f00c4be0 2024-08-31T04:11:10.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38f5c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f38f00c8bb0 con 0x7f38f0158c80 2024-08-31T04:11:10.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38efe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00c4be0 0x7f38f00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:10.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38f5200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0158c80 0x7f38f006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:10.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38efe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00c4be0 0x7f38f00cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:51278/0 (socket says 172.21.15.89:51278) 2024-08-31T04:11:10.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38f5200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0158c80 0x7f38f006cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:54220/0 (socket says 172.21.15.89:54220) 2024-08-31T04:11:10.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38efe00640 1 -- 172.21.15.89:0/140250865 learned_addr learned my addr 172.21.15.89:0/140250865 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:10.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38ef400640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f00c9d60 0x7f38f0148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:10.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38efe00640 1 -- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0158c80 msgr2=0x7f38f006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:10.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38efe00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0158c80 0x7f38f006cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38efe00640 1 -- 172.21.15.89:0/140250865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f00c9d60 msgr2=0x7f38f0148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:10.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38efe00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f00c9d60 0x7f38f0148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:10.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.992+0000 7f38efe00640 1 -- 172.21.15.89:0/140250865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f00cd090 con 0x7f38f00c4be0 2024-08-31T04:11:10.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.996+0000 7f38efe00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00c4be0 0x7f38f00cd570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38e0009930 tx=0x7f38e0004620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:10.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.996+0000 7f38e7e00640 1 -- 172.21.15.89:0/140250865 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e00b5040 con 0x7f38f00c4be0 2024-08-31T04:11:10.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.996+0000 7f38f5c00640 1 -- 172.21.15.89:0/140250865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f00c6fa0 con 0x7f38f00c4be0 2024-08-31T04:11:10.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.996+0000 7f38e7e00640 1 -- 172.21.15.89:0/140250865 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38e00a8c20 con 0x7f38f00c4be0 2024-08-31T04:11:10.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.996+0000 7f38e7e00640 1 -- 172.21.15.89:0/140250865 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0003800 con 0x7f38f00c4be0 2024-08-31T04:11:10.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:10.996+0000 7f38f5c00640 1 -- 172.21.15.89:0/140250865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f01578a0 con 0x7f38f00c4be0 2024-08-31T04:11:11.000 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.000+0000 7f38e7e00640 1 -- 172.21.15.89:0/140250865 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f38e00c0030 con 0x7f38f00c4be0 2024-08-31T04:11:11.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.000+0000 7f38fe791000 1 Processor -- start 2024-08-31T04:11:11.002 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.000+0000 7f38fe791000 1 -- start start 2024-08-31T04:11:11.002 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.000+0000 7f38e7e00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d00720f0 0x7f38d0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.002 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.000+0000 7f38e7e00640 1 -- 172.21.15.89:0/140250865 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f38e01300e0 con 0x7f38f00c4be0 2024-08-31T04:11:11.002 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.000+0000 7f38f5200640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d00720f0 0x7f38d0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38f5200640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d00720f0 0x7f38d0074600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38f0149310 tx=0x7f38e8009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:11.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38fe791000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38fe791000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cdd15ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38fe791000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 0x55b7cdd16220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38fe791000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b7cdb6b820 con 0x55b7cdc08e90 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38efe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38fe791000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b7cdb5adb0 con 0x55b7cdbf2960 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38fe791000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b7cdb5ed60 con 0x55b7cdc133f0 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38ef400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cdd15ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38efe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:54228/0 (socket says 172.21.15.89:54228) 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38efe00640 1 -- 172.21.15.89:0/4215484373 learned_addr learned my addr 172.21.15.89:0/4215484373 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38f5200640 1 --2- 172.21.15.89:0/4215484373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 0x55b7cdd16220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38efe00640 1 -- 172.21.15.89:0/4215484373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 msgr2=0x55b7cdd16220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38efe00640 1 --2- 172.21.15.89:0/4215484373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 0x55b7cdd16220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38efe00640 1 -- 172.21.15.89:0/4215484373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 msgr2=0x55b7cdd15ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:11.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38efe00640 1 --2- 172.21.15.89:0/4215484373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cdd15ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38efe00640 1 -- 172.21.15.89:0/4215484373 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7cdaf5b70 con 0x55b7cdc133f0 2024-08-31T04:11:11.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38ef400640 1 --2- 172.21.15.89:0/4215484373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cdd15ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:11:11.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38efe00640 1 --2- 172.21.15.89:0/4215484373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd500a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38e00f7570 tx=0x7f38e00fae10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc7749bd855504e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:11.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38e4c00640 1 -- 172.21.15.89:0/4215484373 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e00faf80 con 0x55b7cdc133f0 2024-08-31T04:11:11.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.004+0000 7f38e4c00640 1 -- 172.21.15.89:0/4215484373 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38e00ff740 con 0x55b7cdc133f0 2024-08-31T04:11:11.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38e4c00640 1 -- 172.21.15.89:0/4215484373 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0104160 con 0x55b7cdc133f0 2024-08-31T04:11:11.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 -- 172.21.15.89:0/4215484373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 msgr2=0x55b7cdd500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:11.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 --2- 172.21.15.89:0/4215484373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd500a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38e00f7570 tx=0x7f38e00fae10 comp rx=0 tx=0).stop 2024-08-31T04:11:11.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 -- 172.21.15.89:0/4215484373 shutdown_connections 2024-08-31T04:11:11.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 --2- 172.21.15.89:0/4215484373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cdd15ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 --2- 172.21.15.89:0/4215484373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 0x55b7cdd16220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 --2- 172.21.15.89:0/4215484373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd500a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 -- 172.21.15.89:0/4215484373 >> 172.21.15.89:0/4215484373 conn(0x55b7cd81a210 msgr2=0x55b7cdd4f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:11.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 -- 172.21.15.89:0/4215484373 shutdown_connections 2024-08-31T04:11:11.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 -- 172.21.15.89:0/4215484373 wait complete. 2024-08-31T04:11:11.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 -- start start 2024-08-31T04:11:11.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.008+0000 7f38fe791000 1 Processor -- start 2024-08-31T04:11:11.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cdd4c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cdd4ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd4cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b7cd821b10 con 0x55b7cdbf2960 2024-08-31T04:11:11.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b7cdae16f0 con 0x55b7cdc08e90 2024-08-31T04:11:11.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b7cdb63390 con 0x55b7cdc133f0 2024-08-31T04:11:11.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 10 client.0 _ll_register_callbacks cb 0x55b7cdb02b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:11:11.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38efe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cdd4c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38ef400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cdd4ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38ef400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cdd4ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:51296/0 (socket says 172.21.15.89:51296) 2024-08-31T04:11:11.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38ef400640 1 -- 172.21.15.89:0/1817568610 learned_addr learned my addr 172.21.15.89:0/1817568610 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:11.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38f5200640 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd4cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38efe00640 1 -- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 msgr2=0x55b7cdd4cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:11.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38efe00640 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd4cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38efe00640 1 -- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 msgr2=0x55b7cdd4ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:11.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38efe00640 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cdd4ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38efe00640 1 -- 172.21.15.89:0/1817568610 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7cdb19380 con 0x55b7cdbf2960 2024-08-31T04:11:11.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38ef400640 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cdd4ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:11:11.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38efe00640 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cdd4c4e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f38e012e230 tx=0x7f38e0005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f3573bc5fdb746 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:11.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38d9600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:11:11.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38d9600640 1 -- 172.21.15.89:0/1817568610 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0103ed0 con 0x55b7cdbf2960 2024-08-31T04:11:11.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38d9600640 1 -- 172.21.15.89:0/1817568610 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f38e00ff290 con 0x55b7cdbf2960 2024-08-31T04:11:11.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 1 -- 172.21.15.89:0/1817568610 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7cdb69d20 con 0x55b7cdbf2960 2024-08-31T04:11:11.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38d9600640 1 -- 172.21.15.89:0/1817568610 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f38e0104160 con 0x55b7cdbf2960 2024-08-31T04:11:11.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 10 client.5082 fetch_fsmap learned FSMap version 9 2024-08-31T04:11:11.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.012+0000 7f38fe791000 1 -- 172.21.15.89:0/1817568610 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b7cdbdfe40 con 0x55b7cdbf2960 2024-08-31T04:11:11.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38d9600640 1 -- 172.21.15.89:0/1817568610 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b7cdb69d20 con 0x55b7cdbf2960 2024-08-31T04:11:11.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38d9600640 1 -- 172.21.15.89:0/1817568610 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f38e00b8070 con 0x55b7cdbf2960 2024-08-31T04:11:11.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38fe791000 10 client.5082 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:11:11.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38fe791000 10 client.5082 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:11:11.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38fe791000 20 client.5082 populate_metadata read hostname 'smithi089' 2024-08-31T04:11:11.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38fe791000 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b7cd7fedc0 0x55b7cdd66f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38fe791000 4 client.5082 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:11:11.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38fe791000 1 -- 172.21.15.89:0/1817568610 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7cdb6d770 con 0x55b7cd7fedc0 2024-08-31T04:11:11.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38ef400640 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b7cd7fedc0 0x55b7cdd66f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38ef400640 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b7cd7fedc0 0x55b7cdd66f90 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfcdd4fb457f1522 server_cookie=c7822e5349593a20 in_seq=0 out_seq=0 2024-08-31T04:11:11.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.016+0000 7f38d9600640 10 client.5082 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:11.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38d9600640 1 -- 172.21.15.89:0/1817568610 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7cdb6d770 con 0x55b7cd7fedc0 2024-08-31T04:11:11.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38d9600640 10 client.5082 handle_command_reply: tid=0 2024-08-31T04:11:11.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 client.5082 shutdown 2024-08-31T04:11:11.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 -- 172.21.15.89:0/1817568610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 msgr2=0x55b7cdd4c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:11.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cdd4c4e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f38e012e230 tx=0x7f38e0005da0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 -- 172.21.15.89:0/1817568610 shutdown_connections 2024-08-31T04:11:11.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b7cd7fedc0 0x55b7cdd66f90 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cdc133f0 0x55b7cdd4cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38d9600640 0 client.5082 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:11.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cdd4ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 --2- 172.21.15.89:0/1817568610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cdd4c4e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 -- 172.21.15.89:0/1817568610 >> 172.21.15.89:0/1817568610 conn(0x55b7cd81a210 msgr2=0x55b7cdd4ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:11.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 -- 172.21.15.89:0/1817568610 shutdown_connections 2024-08-31T04:11:11.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 1 -- 172.21.15.89:0/1817568610 wait complete. 2024-08-31T04:11:11.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.020+0000 7f38fe791000 20 client.5082 trim_cache size 0 max 16384 2024-08-31T04:11:11.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.056+0000 7f38fe791000 1 Processor -- start 2024-08-31T04:11:11.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.056+0000 7f38fe791000 1 -- start start 2024-08-31T04:11:11.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 0x55b7cddc1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cddc24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f38f00c68a0 con 0x55b7cdc08e90 2024-08-31T04:11:11.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38f01ff520 con 0x55b7cdbf2960 2024-08-31T04:11:11.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f38f01fe7d0 con 0x55b7cd7fedc0 2024-08-31T04:11:11.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38f5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cddc24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38f5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cddc24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54000/0 (socket says 172.21.15.89:54000) 2024-08-31T04:11:11.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38f5200640 1 -- 172.21.15.89:0/891255912 learned_addr learned my addr 172.21.15.89:0/891255912 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:11.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38efe00640 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 0x55b7cddc1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38ef400640 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38f5200640 1 -- 172.21.15.89:0/891255912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 msgr2=0x55b7cddc1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:11.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38f5200640 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 0x55b7cddc1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38f5200640 1 -- 172.21.15.89:0/891255912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 msgr2=0x55b7cddc1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:11.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38f5200640 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38f5200640 1 -- 172.21.15.89:0/891255912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7cdbb75b0 con 0x55b7cdc08e90 2024-08-31T04:11:11.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38ef400640 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:11:11.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38f5200640 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cddc24b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f38e801e7f0 tx=0x7f38e8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d1c0a95839de96 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:11.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38dbe00640 1 -- 172.21.15.89:0/891255912 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e801ee30 con 0x55b7cdc08e90 2024-08-31T04:11:11.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38dbe00640 1 -- 172.21.15.89:0/891255912 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38e8003980 con 0x55b7cdc08e90 2024-08-31T04:11:11.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38dbe00640 1 -- 172.21.15.89:0/891255912 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8003c10 con 0x55b7cdc08e90 2024-08-31T04:11:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 -- 172.21.15.89:0/891255912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 msgr2=0x55b7cddc24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cddc24b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f38e801e7f0 tx=0x7f38e8014000 comp rx=0 tx=0).stop 2024-08-31T04:11:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 -- 172.21.15.89:0/891255912 shutdown_connections 2024-08-31T04:11:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdc08e90 0x55b7cddc24b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 --2- 172.21.15.89:0/891255912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 0x55b7cddc1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 -- 172.21.15.89:0/891255912 >> 172.21.15.89:0/891255912 conn(0x55b7cd81a210 msgr2=0x55b7cdd137d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 -- 172.21.15.89:0/891255912 shutdown_connections 2024-08-31T04:11:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.060+0000 7f38fe791000 1 -- 172.21.15.89:0/891255912 wait complete. 2024-08-31T04:11:11.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.064+0000 7f38fe791000 1 -- start start 2024-08-31T04:11:11.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.064+0000 7f38fe791000 1 Processor -- start 2024-08-31T04:11:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 0x55b7cddc1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cddc22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b7cdadceb0 con 0x55b7cdbf2960 2024-08-31T04:11:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38f01fee80 con 0x55b7cdc08e90 2024-08-31T04:11:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b7cdb02f20 con 0x55b7cd7fedc0 2024-08-31T04:11:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 10 client.0 _ll_register_callbacks cb 0x7f38dc007ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:11:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38ef400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38ef400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54004/0 (socket says 172.21.15.89:54004) 2024-08-31T04:11:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38ef400640 1 -- 172.21.15.89:0/3698222381 learned_addr learned my addr 172.21.15.89:0/3698222381 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38f5200640 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cddc22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38efe00640 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 0x55b7cddc1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38ef400640 1 -- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 msgr2=0x55b7cddc1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38ef400640 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 0x55b7cddc1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38ef400640 1 -- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 msgr2=0x55b7cddc22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38ef400640 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cddc22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38ef400640 1 -- 172.21.15.89:0/3698222381 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7cdaebfc0 con 0x55b7cdbf2960 2024-08-31T04:11:11.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38ef400640 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1d60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0166f0 tx=0x7f38dc0167e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2c46acf8f8ba92 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:11.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38d9600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38d9600640 1 -- 172.21.15.89:0/3698222381 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc006ab0 con 0x55b7cdbf2960 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38d9600640 1 -- 172.21.15.89:0/3698222381 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f38dc006c50 con 0x55b7cdbf2960 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 -- 172.21.15.89:0/3698222381 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38e8003980 con 0x55b7cdbf2960 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38d9600640 1 -- 172.21.15.89:0/3698222381 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f38dc006e50 con 0x55b7cdbf2960 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 10 client.5088 fetch_fsmap learned FSMap version 9 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 -- 172.21.15.89:0/3698222381 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b7cdae4e00 con 0x55b7cdbf2960 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38d9600640 1 -- 172.21.15.89:0/3698222381 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38e8003980 con 0x55b7cdbf2960 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38d9600640 1 -- 172.21.15.89:0/3698222381 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f38dc025020 con 0x55b7cdbf2960 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 10 client.5088 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 10 client.5088 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 20 client.5088 populate_metadata read hostname 'smithi089' 2024-08-31T04:11:11.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b7cd818470 0x55b7cdd55b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:11.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 4 client.5088 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}] 2024-08-31T04:11:11.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.068+0000 7f38fe791000 1 -- 172.21.15.89:0/3698222381 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}) -- 0x55b7cdb69210 con 0x55b7cd818470 2024-08-31T04:11:11.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.072+0000 7f38efe00640 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b7cd818470 0x55b7cdd55b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:11.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.072+0000 7f38efe00640 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b7cd818470 0x55b7cdd55b40 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b19c8e4a742b5a7 server_cookie=cc2454dc19f07d7b in_seq=0 out_seq=0 2024-08-31T04:11:11.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.072+0000 7f38d9600640 10 client.5088 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38d9600640 1 -- 172.21.15.89:0/3698222381 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b7cdb69210 con 0x55b7cd818470 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38d9600640 10 client.5088 handle_command_reply: tid=0 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 client.5088 shutdown 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 -- 172.21.15.89:0/3698222381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 msgr2=0x55b7cddc1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1d60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0166f0 tx=0x7f38dc0167e0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 -- 172.21.15.89:0/3698222381 shutdown_connections 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b7cd818470 0x55b7cdd55b40 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7cdbf2960 0x55b7cddc1d60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b7cdc08e90 0x55b7cddc22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 --2- 172.21.15.89:0/3698222381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b7cd7fedc0 0x55b7cddc1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 -- 172.21.15.89:0/3698222381 >> 172.21.15.89:0/3698222381 conn(0x55b7cd81a210 msgr2=0x55b7cdd4d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:11.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38d9600640 0 client.5088 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:11.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 -- 172.21.15.89:0/3698222381 shutdown_connections 2024-08-31T04:11:11.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 1 -- 172.21.15.89:0/3698222381 wait complete. 2024-08-31T04:11:11.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38fe791000 20 client.5088 trim_cache size 0 max 16384 2024-08-31T04:11:11.610 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:11:11.610 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 22, 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "fb8322ec": { 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 22, 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 148.0, 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:11:11.611 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:11.612 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:11:11.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 -- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d00720f0 msgr2=0x7f38d0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:11.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d00720f0 0x7f38d0074600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38f0149310 tx=0x7f38e8009500 comp rx=0 tx=0).stop 2024-08-31T04:11:11.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 -- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00c4be0 msgr2=0x7f38f00cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:11.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00c4be0 0x7f38f00cd570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38e0009930 tx=0x7f38e0004620 comp rx=0 tx=0).stop 2024-08-31T04:11:11.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 -- 172.21.15.89:0/140250865 shutdown_connections 2024-08-31T04:11:11.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38d00720f0 0x7f38d0074600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38f00c9d60 0x7f38f0148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38f0158c80 0x7f38f006cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 --2- 172.21.15.89:0/140250865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38f00c4be0 0x7f38f00cd570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:11.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 -- 172.21.15.89:0/140250865 >> 172.21.15.89:0/140250865 conn(0x7f38f00cde30 msgr2=0x7f38f00726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:11.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 -- 172.21.15.89:0/140250865 shutdown_connections 2024-08-31T04:11:11.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:11.608+0000 7f38f5c00640 1 -- 172.21.15.89:0/140250865 wait complete. 2024-08-31T04:11:11.645 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fb8322ec', quiesce took 1.7 seconds. Will release after: 26.3 2024-08-31T04:11:30.643 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:11:30.648 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:11:37.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:11:38.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.112+0000 7fd590c00640 1 -- 172.21.15.89:0/3789369093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5700039f0 msgr2=0x7fd570003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.112+0000 7fd590c00640 1 --2- 172.21.15.89:0/3789369093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5700039f0 0x7fd570003e20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009b40 tx=0x7fd57c01d250 comp rx=0 tx=0).stop 2024-08-31T04:11:38.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.112+0000 7fd58a800640 1 -- 172.21.15.89:0/3789369093 reap_dead start 2024-08-31T04:11:38.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.112+0000 7fd590c00640 1 -- 172.21.15.89:0/3789369093 shutdown_connections 2024-08-31T04:11:38.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.112+0000 7fd590c00640 1 -- 172.21.15.89:0/3789369093 >> 172.21.15.89:0/3789369093 conn(0x7fd58c0ccf20 msgr2=0x7fd58c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.112+0000 7fd590c00640 1 -- 172.21.15.89:0/3789369093 shutdown_connections 2024-08-31T04:11:38.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.112+0000 7fd590c00640 1 -- 172.21.15.89:0/3789369093 wait complete. 2024-08-31T04:11:38.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd590c00640 1 Processor -- start 2024-08-31T04:11:38.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd590c00640 1 -- start start 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd590c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5700039f0 0x7fd58c1efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd590c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd58c156cd0 0x7fd58c14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd590c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd58c1e5060 0x7fd58c1e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd590c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c0c8030 con 0x7fd58c1e5060 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd590c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c0c3150 con 0x7fd5700039f0 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd590c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd58c074e30 con 0x7fd58c156cd0 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd58a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd58c1e5060 0x7fd58c1e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd58a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd58c1e5060 0x7fd58c1e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50472/0 (socket says 172.21.15.89:50472) 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd58a800640 1 -- 172.21.15.89:0/1929586858 learned_addr learned my addr 172.21.15.89:0/1929586858 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:38.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd589e00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5700039f0 0x7fd58c1efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd581400640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd58c156cd0 0x7fd58c14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd58a800640 1 -- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd58c156cd0 msgr2=0x7fd58c14fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd58a800640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd58c156cd0 0x7fd58c14fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd58a800640 1 -- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5700039f0 msgr2=0x7fd58c1efd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd58a800640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5700039f0 0x7fd58c1efd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd58a800640 1 -- 172.21.15.89:0/1929586858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58c0b32a0 con 0x7fd58c1e5060 2024-08-31T04:11:38.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd589e00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5700039f0 0x7fd58c1efd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:11:38.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.116+0000 7fd58a800640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd58c1e5060 0x7fd58c1e5470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0b2780 tx=0x7fd58400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.120+0000 7fd582a00640 1 -- 172.21.15.89:0/1929586858 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584013650 con 0x7fd58c1e5060 2024-08-31T04:11:38.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.120+0000 7fd582a00640 1 -- 172.21.15.89:0/1929586858 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5840138e0 con 0x7fd58c1e5060 2024-08-31T04:11:38.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.120+0000 7fd582a00640 1 -- 172.21.15.89:0/1929586858 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584013d30 con 0x7fd58c1e5060 2024-08-31T04:11:38.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.120+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58c06a7d0 con 0x7fd58c1e5060 2024-08-31T04:11:38.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.120+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd58c1514e0 con 0x7fd58c1e5060 2024-08-31T04:11:38.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.120+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58c152a10 con 0x7fd58c1e5060 2024-08-31T04:11:38.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.120+0000 7fd582a00640 1 -- 172.21.15.89:0/1929586858 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd584020470 con 0x7fd58c1e5060 2024-08-31T04:11:38.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.124+0000 7fd582a00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5680720f0 0x7fd568074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.124+0000 7fd582a00640 1 -- 172.21.15.89:0/1929586858 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fd584097060 con 0x7fd58c1e5060 2024-08-31T04:11:38.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.124+0000 7fd589e00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5680720f0 0x7fd568074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.124+0000 7fd589e00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5680720f0 0x7fd568074600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0ad000 tx=0x7fd57c019ff0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.128+0000 7fd582a00640 1 -- 172.21.15.89:0/1929586858 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd5840624b0 con 0x7fd58c1e5060 2024-08-31T04:11:38.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.324+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd58c0b2ae0 con 0x7fd58c1e5060 2024-08-31T04:11:38.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd582a00640 1 -- 172.21.15.89:0/1929586858 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fd584061db0 con 0x7fd58c1e5060 2024-08-31T04:11:38.327 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:11:38.327 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:11:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:11:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5680720f0 msgr2=0x7fd568074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5680720f0 0x7fd568074600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0ad000 tx=0x7fd57c019ff0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd58c1e5060 msgr2=0x7fd58c1e5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd58c1e5060 0x7fd58c1e5470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0b2780 tx=0x7fd58400f6c0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 shutdown_connections 2024-08-31T04:11:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5680720f0 0x7fd568074600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd58c1e5060 0x7fd58c1e5470 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd58c156cd0 0x7fd58c14fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 --2- 172.21.15.89:0/1929586858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5700039f0 0x7fd58c1efd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 >> 172.21.15.89:0/1929586858 conn(0x7fd58c0ccf20 msgr2=0x7fd58c0714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 shutdown_connections 2024-08-31T04:11:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.328+0000 7fd590c00640 1 -- 172.21.15.89:0/1929586858 wait complete. 2024-08-31T04:11:38.349 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id fb8322ec --release --await' 2024-08-31T04:11:38.349 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id fb8322ec --release --await 2024-08-31T04:11:38.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.508+0000 7f1be5400640 1 -- 172.21.15.89:0/1849017249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bc4004d50 msgr2=0x7f1bc4005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.508+0000 7f1be5400640 1 --2- 172.21.15.89:0/1849017249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bc4004d50 0x7f1bc4005160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1be0073650 tx=0x7f1bd801d210 comp rx=0 tx=0).stop 2024-08-31T04:11:38.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.508+0000 7f1bdf200640 1 -- 172.21.15.89:0/1849017249 reap_dead start 2024-08-31T04:11:38.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.508+0000 7f1be5400640 1 -- 172.21.15.89:0/1849017249 shutdown_connections 2024-08-31T04:11:38.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.508+0000 7f1be5400640 1 -- 172.21.15.89:0/1849017249 >> 172.21.15.89:0/1849017249 conn(0x7f1be00c99b0 msgr2=0x7f1be00c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.508+0000 7f1be5400640 1 -- 172.21.15.89:0/1849017249 shutdown_connections 2024-08-31T04:11:38.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.508+0000 7f1be5400640 1 -- 172.21.15.89:0/1849017249 wait complete. 2024-08-31T04:11:38.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1be5400640 1 Processor -- start 2024-08-31T04:11:38.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1be5400640 1 -- start start 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1be5400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc4004d50 0x7f1be01f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1be5400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be015ae10 0x7f1be015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1be5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1be014d2e0 0x7f1be014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1be5400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00c3160 con 0x7f1be015ae10 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1be5400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00c8c50 con 0x7f1be014d2e0 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1be5400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1be00c32e0 con 0x7f1bc4004d50 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bdde00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be015ae10 0x7f1be015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bdde00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be015ae10 0x7f1be015bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50488/0 (socket says 172.21.15.89:50488) 2024-08-31T04:11:38.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bdde00640 1 -- 172.21.15.89:0/4001106582 learned_addr learned my addr 172.21.15.89:0/4001106582 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bde800640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc4004d50 0x7f1be01f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bdf200640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1be014d2e0 0x7f1be014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bdde00640 1 -- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc4004d50 msgr2=0x7f1be01f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bdde00640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc4004d50 0x7f1be01f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bdde00640 1 -- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1be014d2e0 msgr2=0x7f1be014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bdde00640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1be014d2e0 0x7f1be014d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.512+0000 7f1bdde00640 1 -- 172.21.15.89:0/4001106582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be015bff0 con 0x7f1be015ae10 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.516+0000 7f1bdde00640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be015ae10 0x7f1be015bab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc011ab0 tx=0x7f1bcc011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.516+0000 7f1bd6a00640 1 -- 172.21.15.89:0/4001106582 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc01e070 con 0x7f1be015ae10 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.516+0000 7f1bd6a00640 1 -- 172.21.15.89:0/4001106582 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bcc00fc70 con 0x7f1be015ae10 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.516+0000 7f1bd6a00640 1 -- 172.21.15.89:0/4001106582 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc019410 con 0x7f1be015ae10 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.516+0000 7f1be5400640 1 -- 172.21.15.89:0/4001106582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be014b9c0 con 0x7f1be015ae10 2024-08-31T04:11:38.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.516+0000 7f1be5400640 1 -- 172.21.15.89:0/4001106582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be00c6a30 con 0x7f1be015ae10 2024-08-31T04:11:38.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.516+0000 7f1bd6a00640 1 -- 172.21.15.89:0/4001106582 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f1bcc021070 con 0x7f1be015ae10 2024-08-31T04:11:38.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.516+0000 7f1bd6a00640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1bc00720c0 0x7f1bc00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.516+0000 7f1bd6a00640 1 -- 172.21.15.89:0/4001106582 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f1bcc093810 con 0x7f1be015ae10 2024-08-31T04:11:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 Processor -- start 2024-08-31T04:11:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bde800640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1bc00720c0 0x7f1bc00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 -- start start 2024-08-31T04:11:38.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bde800640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1bc00720c0 0x7f1bc00745d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00044f0 tx=0x7f1bd00021a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad0950d950 0x55ad0962be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094f7930 0x55ad09630ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad09631010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ad094d6f30 con 0x55ad094e8890 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ad0944c690 con 0x55ad0950d950 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ad0943bc20 con 0x55ad094f7930 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdf200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad09631010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdf200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad09631010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50496/0 (socket says 172.21.15.89:50496) 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdf200640 1 -- 172.21.15.89:0/249589179 learned_addr learned my addr 172.21.15.89:0/249589179 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bde800640 1 --2- 172.21.15.89:0/249589179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad0950d950 0x55ad0962be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdde00640 1 --2- 172.21.15.89:0/249589179 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094f7930 0x55ad09630ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdf200640 1 -- 172.21.15.89:0/249589179 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094f7930 msgr2=0x55ad09630ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:38.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdf200640 1 --2- 172.21.15.89:0/249589179 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094f7930 0x55ad09630ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdf200640 1 -- 172.21.15.89:0/249589179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad0950d950 msgr2=0x55ad0962be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:38.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdf200640 1 --2- 172.21.15.89:0/249589179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad0950d950 0x55ad0962be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdf200640 1 -- 172.21.15.89:0/249589179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad093f08f0 con 0x55ad094e8890 2024-08-31T04:11:38.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bdf200640 1 --2- 172.21.15.89:0/249589179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad09631010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1bd801dab0 tx=0x7f1bc4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ef8164fe73d34f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bcb000640 1 -- 172.21.15.89:0/249589179 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8005030 con 0x55ad094e8890 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bcb000640 1 -- 172.21.15.89:0/249589179 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bd8000e50 con 0x55ad094e8890 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1bcb000640 1 -- 172.21.15.89:0/249589179 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8005520 con 0x55ad094e8890 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 -- 172.21.15.89:0/249589179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 msgr2=0x55ad09631010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 --2- 172.21.15.89:0/249589179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad09631010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1bd801dab0 tx=0x7f1bc4005840 comp rx=0 tx=0).stop 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 -- 172.21.15.89:0/249589179 shutdown_connections 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 --2- 172.21.15.89:0/249589179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad09631010 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 --2- 172.21.15.89:0/249589179 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094f7930 0x55ad09630ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 --2- 172.21.15.89:0/249589179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad0950d950 0x55ad0962be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 -- 172.21.15.89:0/249589179 >> 172.21.15.89:0/249589179 conn(0x55ad0950d540 msgr2=0x55ad0962e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 -- 172.21.15.89:0/249589179 shutdown_connections 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.520+0000 7f1becaa9000 1 -- 172.21.15.89:0/249589179 wait complete. 2024-08-31T04:11:38.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 -- start start 2024-08-31T04:11:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 Processor -- start 2024-08-31T04:11:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094e8890 0x55ad0962ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094f7930 0x55ad0962b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad0950d950 0x55ad0962b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ad093c2500 con 0x55ad0950d950 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ad0943fbd0 con 0x55ad094f7930 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ad093e3a30 con 0x55ad094e8890 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 10 client.0 _ll_register_callbacks cb 0x55ad094f1b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdf200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad0950d950 0x55ad0962b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdf200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad0950d950 0x55ad0962b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50510/0 (socket says 172.21.15.89:50510) 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdf200640 1 -- 172.21.15.89:0/556377579 learned_addr learned my addr 172.21.15.89:0/556377579 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdde00640 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094f7930 0x55ad0962b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bde800640 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094e8890 0x55ad0962ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdf200640 1 -- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094e8890 msgr2=0x55ad0962ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdf200640 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094e8890 0x55ad0962ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdf200640 1 -- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094f7930 msgr2=0x55ad0962b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdf200640 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094f7930 0x55ad0962b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdf200640 1 -- 172.21.15.89:0/556377579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad093db6a0 con 0x55ad0950d950 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bdf200640 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad0950d950 0x55ad0962b690 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1bd801cc80 tx=0x7f1bd80b8820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05c331b28d15f7d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bbf400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bbf400640 1 -- 172.21.15.89:0/556377579 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80c8060 con 0x55ad0950d950 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bbf400640 1 -- 172.21.15.89:0/556377579 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f1bd80b8a50 con 0x55ad0950d950 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 -- 172.21.15.89:0/556377579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ad093d57e0 con 0x55ad0950d950 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1bbf400640 1 -- 172.21.15.89:0/556377579 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1bd80ce050 con 0x55ad0950d950 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 10 client.5106 fetch_fsmap learned FSMap version 9 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.524+0000 7f1becaa9000 1 -- 172.21.15.89:0/556377579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ad093fa1c0 con 0x55ad0950d950 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1bbf400640 1 -- 172.21.15.89:0/556377579 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ad093d57e0 con 0x55ad0950d950 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1bbf400640 1 -- 172.21.15.89:0/556377579 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f1bd80d1020 con 0x55ad0950d950 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 10 client.5106 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:11:38.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 10 client.5106 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:11:38.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 20 client.5106 populate_metadata read hostname 'smithi089' 2024-08-31T04:11:38.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ad094d1fc0 0x55ad09645e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 4 client.5106 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:11:38.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 -- 172.21.15.89:0/556377579 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad0944e5e0 con 0x55ad094d1fc0 2024-08-31T04:11:38.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1bde800640 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ad094d1fc0 0x55ad09645e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1bde800640 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ad094d1fc0 0x55ad09645e00 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45e37d219ccb9e78 server_cookie=1aea4dfe2da42454 in_seq=0 out_seq=0 2024-08-31T04:11:38.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1bbf400640 10 client.5106 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:38.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1bbf400640 1 -- 172.21.15.89:0/556377579 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad0944e5e0 con 0x55ad094d1fc0 2024-08-31T04:11:38.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1bbf400640 10 client.5106 handle_command_reply: tid=0 2024-08-31T04:11:38.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 client.5106 shutdown 2024-08-31T04:11:38.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 -- 172.21.15.89:0/556377579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad0950d950 msgr2=0x55ad0962b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad0950d950 0x55ad0962b690 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1bd801cc80 tx=0x7f1bd80b8820 comp rx=0 tx=0).stop 2024-08-31T04:11:38.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 -- 172.21.15.89:0/556377579 shutdown_connections 2024-08-31T04:11:38.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ad094d1fc0 0x55ad09645e00 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad0950d950 0x55ad0962b690 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094f7930 0x55ad0962b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1bbf400640 0 client.5106 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:38.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 --2- 172.21.15.89:0/556377579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094e8890 0x55ad0962ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 -- 172.21.15.89:0/556377579 >> 172.21.15.89:0/556377579 conn(0x55ad0950d540 msgr2=0x55ad0962c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 -- 172.21.15.89:0/556377579 shutdown_connections 2024-08-31T04:11:38.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 1 -- 172.21.15.89:0/556377579 wait complete. 2024-08-31T04:11:38.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.528+0000 7f1becaa9000 20 client.5106 trim_cache size 0 max 16384 2024-08-31T04:11:38.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1becaa9000 1 Processor -- start 2024-08-31T04:11:38.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1becaa9000 1 -- start start 2024-08-31T04:11:38.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094e8890 0x55ad09643df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094f7930 0x55ad09644330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad0950d950 0x55ad09644870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1becaa9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1be02011a0 con 0x55ad094f7930 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1becaa9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1be0200080 con 0x55ad094e8890 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1becaa9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1be0071e90 con 0x55ad0950d950 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bdde00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094f7930 0x55ad09644330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bdde00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094f7930 0x55ad09644330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50516/0 (socket says 172.21.15.89:50516) 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bdde00640 1 -- 172.21.15.89:0/2858680656 learned_addr learned my addr 172.21.15.89:0/2858680656 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bde800640 1 --2- 172.21.15.89:0/2858680656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094e8890 0x55ad09643df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bdf200640 1 --2- 172.21.15.89:0/2858680656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad0950d950 0x55ad09644870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bdde00640 1 -- 172.21.15.89:0/2858680656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad0950d950 msgr2=0x55ad09644870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bdde00640 1 --2- 172.21.15.89:0/2858680656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad0950d950 0x55ad09644870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bdde00640 1 -- 172.21.15.89:0/2858680656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094e8890 msgr2=0x55ad09643df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:38.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bdde00640 1 --2- 172.21.15.89:0/2858680656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094e8890 0x55ad09643df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.548+0000 7f1bdde00640 1 -- 172.21.15.89:0/2858680656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad094c02f0 con 0x55ad094f7930 2024-08-31T04:11:38.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1bdde00640 1 --2- 172.21.15.89:0/2858680656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094f7930 0x55ad09644330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc091960 tx=0x7f1bcc05a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cd7967dc88cd4c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1bca600640 1 -- 172.21.15.89:0/2858680656 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc083070 con 0x55ad094f7930 2024-08-31T04:11:38.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1bca600640 1 -- 172.21.15.89:0/2858680656 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bcc067910 con 0x55ad094f7930 2024-08-31T04:11:38.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1bca600640 1 -- 172.21.15.89:0/2858680656 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc083210 con 0x55ad094f7930 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 -- 172.21.15.89:0/2858680656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094f7930 msgr2=0x55ad09644330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 --2- 172.21.15.89:0/2858680656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094f7930 0x55ad09644330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc091960 tx=0x7f1bcc05a5f0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 -- 172.21.15.89:0/2858680656 shutdown_connections 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 --2- 172.21.15.89:0/2858680656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094f7930 0x55ad09644330 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 --2- 172.21.15.89:0/2858680656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad0950d950 0x55ad09644870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 --2- 172.21.15.89:0/2858680656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad094e8890 0x55ad09643df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 -- 172.21.15.89:0/2858680656 >> 172.21.15.89:0/2858680656 conn(0x55ad0950d540 msgr2=0x55ad095ee890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 -- 172.21.15.89:0/2858680656 shutdown_connections 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 -- 172.21.15.89:0/2858680656 wait complete. 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 -- start start 2024-08-31T04:11:38.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 Processor -- start 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad096478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094f7930 0x55ad09647e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad0950d950 0x55ad09648370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1be01fecc0 con 0x55ad094e8890 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1be01ff9b0 con 0x55ad0950d950 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1be01ff2e0 con 0x55ad094f7930 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.552+0000 7f1becaa9000 10 client.0 _ll_register_callbacks cb 0x7f1bd0001ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bde800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad096478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bde800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad096478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50522/0 (socket says 172.21.15.89:50522) 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bde800640 1 -- 172.21.15.89:0/3330992898 learned_addr learned my addr 172.21.15.89:0/3330992898 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:38.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bde800640 1 -- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094f7930 msgr2=0x55ad09647e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:38.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bde800640 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094f7930 0x55ad09647e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bde800640 1 -- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad0950d950 msgr2=0x55ad09648370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:38.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bde800640 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad0950d950 0x55ad09648370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bde800640 1 -- 172.21.15.89:0/3330992898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad093c5b30 con 0x55ad094e8890 2024-08-31T04:11:38.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bde800640 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad096478f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00137c0 tx=0x7f1bd0015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26c803518faf287 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bbf400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:11:38.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bbf400640 1 -- 172.21.15.89:0/3330992898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0011810 con 0x55ad094e8890 2024-08-31T04:11:38.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bbf400640 1 -- 172.21.15.89:0/3330992898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f1bd0031d80 con 0x55ad094e8890 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1becaa9000 1 -- 172.21.15.89:0/3330992898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bcc067910 con 0x55ad094e8890 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bbf400640 1 -- 172.21.15.89:0/3330992898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1bd003a070 con 0x55ad094e8890 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1becaa9000 10 client.5112 fetch_fsmap learned FSMap version 9 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1becaa9000 1 -- 172.21.15.89:0/3330992898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ad093d2c70 con 0x55ad094e8890 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bbf400640 1 -- 172.21.15.89:0/3330992898 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bcc067910 con 0x55ad094e8890 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bbf400640 1 -- 172.21.15.89:0/3330992898 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f1bd0010040 con 0x55ad094e8890 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1becaa9000 10 client.5112 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1becaa9000 10 client.5112 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1becaa9000 20 client.5112 populate_metadata read hostname 'smithi089' 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1becaa9000 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ad090cde80 0x55ad096b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1becaa9000 4 client.5112 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fb8322ec", "release": true, "await": true}] 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1becaa9000 1 -- 172.21.15.89:0/3330992898 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fb8322ec", "release": true, "await": true}) -- 0x55ad0944a080 con 0x55ad090cde80 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bdde00640 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ad090cde80 0x55ad096b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bdde00640 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ad090cde80 0x55ad096b2770 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1175e6b661572f server_cookie=72a2caf6f0ecce3b in_seq=0 out_seq=0 2024-08-31T04:11:38.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.556+0000 7f1bbf400640 10 client.5112 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:38.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1bbf400640 1 -- 172.21.15.89:0/3330992898 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ad0944a080 con 0x55ad090cde80 2024-08-31T04:11:38.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1bbf400640 10 client.5112 handle_command_reply: tid=0 2024-08-31T04:11:38.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 client.5112 shutdown 2024-08-31T04:11:38.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 -- 172.21.15.89:0/3330992898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 msgr2=0x55ad096478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad096478f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00137c0 tx=0x7f1bd0015040 comp rx=0 tx=0).stop 2024-08-31T04:11:38.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 -- 172.21.15.89:0/3330992898 shutdown_connections 2024-08-31T04:11:38.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ad090cde80 0x55ad096b2770 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ad0950d950 0x55ad09648370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ad094f7930 0x55ad09647e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 --2- 172.21.15.89:0/3330992898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad094e8890 0x55ad096478f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 -- 172.21.15.89:0/3330992898 >> 172.21.15.89:0/3330992898 conn(0x55ad0950d540 msgr2=0x55ad095eb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1bbf400640 0 client.5112 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:38.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 -- 172.21.15.89:0/3330992898 shutdown_connections 2024-08-31T04:11:38.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 1 -- 172.21.15.89:0/3330992898 wait complete. 2024-08-31T04:11:38.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1becaa9000 20 client.5112 trim_cache size 0 max 16384 2024-08-31T04:11:38.566 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:11:38.566 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 24, 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "fb8322ec": { 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 24, 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 148.0, 2024-08-31T04:11:38.567 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:11:38.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 -- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1bc00720c0 msgr2=0x7f1bc00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1bc00720c0 0x7f1bc00745d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00044f0 tx=0x7f1bd00021a0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 -- 172.21.15.89:0/4001106582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be015ae10 msgr2=0x7f1be015bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be015ae10 0x7f1be015bab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc011ab0 tx=0x7f1bcc011f70 comp rx=0 tx=0).stop 2024-08-31T04:11:38.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 -- 172.21.15.89:0/4001106582 shutdown_connections 2024-08-31T04:11:38.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1bc00720c0 0x7f1bc00745d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be015ae10 0x7f1be015bab0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1be014d2e0 0x7f1be014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 --2- 172.21.15.89:0/4001106582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bc4004d50 0x7f1be01f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 -- 172.21.15.89:0/4001106582 >> 172.21.15.89:0/4001106582 conn(0x7f1be00c99b0 msgr2=0x7f1be00cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 -- 172.21.15.89:0/4001106582 shutdown_connections 2024-08-31T04:11:38.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.564+0000 7f1be5400640 1 -- 172.21.15.89:0/4001106582 wait complete. 2024-08-31T04:11:38.588 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fb8322ec', total seconds elapsed: 28.6 2024-08-31T04:11:38.588 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.0 2024-08-31T04:11:38.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:11:38.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 -- 172.21.15.89:0/425132316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0c4760 msgr2=0x7f2cbc0c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 --2- 172.21.15.89:0/425132316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0c4760 0x7f2cbc0c3f70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc15a9c0 tx=0x7f2cb001c800 comp rx=0 tx=0).stop 2024-08-31T04:11:38.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 -- 172.21.15.89:0/425132316 shutdown_connections 2024-08-31T04:11:38.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 --2- 172.21.15.89:0/425132316 >> v2:172.21.15.170:3300/0 conn(0x7f2cbc159a70 0x7f2cbc159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 --2- 172.21.15.89:0/425132316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0c4760 0x7f2cbc0c3f70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 -- 172.21.15.89:0/425132316 >> 172.21.15.89:0/425132316 conn(0x7f2cbc0717b0 msgr2=0x7f2cbc071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 -- 172.21.15.89:0/425132316 shutdown_connections 2024-08-31T04:11:38.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 -- 172.21.15.89:0/425132316 wait complete. 2024-08-31T04:11:38.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 Processor -- start 2024-08-31T04:11:38.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.748+0000 7f2cc4200640 1 -- start start 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc4200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cbc0c4760 0x7f2cbc14f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc4200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0ca930 0x7f2cbc1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc4200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cbc159a70 0x7f2cbc1406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc4200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc0b2aa0 con 0x7f2cbc0ca930 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc4200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc15a3c0 con 0x7f2cbc159a70 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc4200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2cbc0b2c20 con 0x7f2cbc0c4760 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc0e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0ca930 0x7f2cbc1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc0e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0ca930 0x7f2cbc1587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50546/0 (socket says 172.21.15.89:50546) 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc0e00640 1 -- 172.21.15.89:0/2304397591 learned_addr learned my addr 172.21.15.89:0/2304397591 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:38.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc1800640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cbc0c4760 0x7f2cbc14f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc2200640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cbc159a70 0x7f2cbc1406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc0e00640 1 -- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cbc0c4760 msgr2=0x7f2cbc14f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc0e00640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cbc0c4760 0x7f2cbc14f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc0e00640 1 -- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cbc159a70 msgr2=0x7f2cbc1406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc0e00640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cbc159a70 0x7f2cbc1406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc0e00640 1 -- 172.21.15.89:0/2304397591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc1596a0 con 0x7f2cbc0ca930 2024-08-31T04:11:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc2200640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cbc159a70 0x7f2cbc1406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:11:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc0e00640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0ca930 0x7f2cbc1587e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c460 tx=0x7f2ca800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cb9600640 1 -- 172.21.15.89:0/2304397591 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8016020 con 0x7f2cbc0ca930 2024-08-31T04:11:38.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cb9600640 1 -- 172.21.15.89:0/2304397591 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ca8012940 con 0x7f2cbc0ca930 2024-08-31T04:11:38.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cbc14dfc0 con 0x7f2cbc0ca930 2024-08-31T04:11:38.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cb9600640 1 -- 172.21.15.89:0/2304397591 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8012d90 con 0x7f2cbc0ca930 2024-08-31T04:11:38.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cbc14e2e0 con 0x7f2cbc0ca930 2024-08-31T04:11:38.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.752+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cbc0cad40 con 0x7f2cbc0ca930 2024-08-31T04:11:38.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.756+0000 7f2cb9600640 1 -- 172.21.15.89:0/2304397591 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2ca8019020 con 0x7f2cbc0ca930 2024-08-31T04:11:38.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.756+0000 7f2cb9600640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c9c0720c0 0x7f2c9c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:38.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.756+0000 7f2cb9600640 1 -- 172.21.15.89:0/2304397591 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2ca8092c70 con 0x7f2cbc0ca930 2024-08-31T04:11:38.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.756+0000 7f2cc1800640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c9c0720c0 0x7f2c9c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:38.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.756+0000 7f2cc1800640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c9c0720c0 0x7f2c9c0745d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00af000 tx=0x7f2cb001b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:38.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.760+0000 7f2cb9600640 1 -- 172.21.15.89:0/2304397591 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2ca8020030 con 0x7f2cbc0ca930 2024-08-31T04:11:38.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cbc157270 con 0x7f2cbc0ca930 2024-08-31T04:11:38.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cb9600640 1 -- 172.21.15.89:0/2304397591 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f2ca805e180 con 0x7f2cbc0ca930 2024-08-31T04:11:38.964 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:11:38.964 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:11:38.964 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:11:38.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c9c0720c0 msgr2=0x7f2c9c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c9c0720c0 0x7f2c9c0745d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00af000 tx=0x7f2cb001b040 comp rx=0 tx=0).stop 2024-08-31T04:11:38.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0ca930 msgr2=0x7f2cbc1587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:38.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0ca930 0x7f2cbc1587e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c460 tx=0x7f2ca800c920 comp rx=0 tx=0).stop 2024-08-31T04:11:38.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 shutdown_connections 2024-08-31T04:11:38.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2c9c0720c0 0x7f2c9c0745d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cbc0ca930 0x7f2cbc1587e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cbc159a70 0x7f2cbc1406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 --2- 172.21.15.89:0/2304397591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2cbc0c4760 0x7f2cbc14f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:38.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 >> 172.21.15.89:0/2304397591 conn(0x7f2cbc0717b0 msgr2=0x7f2cbc153420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:38.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 shutdown_connections 2024-08-31T04:11:38.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:38.964+0000 7f2cc4200640 1 -- 172.21.15.89:0/2304397591 wait complete. 2024-08-31T04:11:38.988 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0' 2024-08-31T04:11:38.989 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 148.0 --await-for 45.0 2024-08-31T04:11:39.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.164+0000 7f4121c00640 1 -- 172.21.15.89:0/529144360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4100004010 msgr2=0x7f4100004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:39.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.164+0000 7f4121c00640 1 --2- 172.21.15.89:0/529144360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4100004010 0x7f4100004810 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f411c1560d0 tx=0x7f410801cec0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.164+0000 7f411b400640 1 -- 172.21.15.89:0/529144360 reap_dead start 2024-08-31T04:11:39.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.164+0000 7f4121c00640 1 -- 172.21.15.89:0/529144360 shutdown_connections 2024-08-31T04:11:39.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.164+0000 7f4121c00640 1 -- 172.21.15.89:0/529144360 >> 172.21.15.89:0/529144360 conn(0x7f411c06dd40 msgr2=0x7f411c06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:39.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.164+0000 7f4121c00640 1 -- 172.21.15.89:0/529144360 shutdown_connections 2024-08-31T04:11:39.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.164+0000 7f4121c00640 1 -- 172.21.15.89:0/529144360 wait complete. 2024-08-31T04:11:39.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.164+0000 7f4121c00640 1 Processor -- start 2024-08-31T04:11:39.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.164+0000 7f4121c00640 1 -- start start 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4121c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4100004010 0x7f411c1f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4121c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f411c0cab30 0x7f411c14cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4121c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f411c14dce0 0x7f411c14e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4121c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f411c0c88c0 con 0x7f4100004010 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4121c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f411c159400 con 0x7f411c0cab30 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4121c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f411c0c35f0 con 0x7f411c14dce0 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4100004010 0x7f411c1f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4100004010 0x7f411c1f5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50558/0 (socket says 172.21.15.89:50558) 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411aa00640 1 -- 172.21.15.89:0/2821420097 learned_addr learned my addr 172.21.15.89:0/2821420097 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411b400640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f411c14dce0 0x7f411c14e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411a000640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f411c0cab30 0x7f411c14cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411aa00640 1 -- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f411c14dce0 msgr2=0x7f411c14e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:39.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411aa00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f411c14dce0 0x7f411c14e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411aa00640 1 -- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f411c0cab30 msgr2=0x7f411c14cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:39.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411aa00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f411c0cab30 0x7f411c14cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411aa00640 1 -- 172.21.15.89:0/2821420097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411c14d450 con 0x7f4100004010 2024-08-31T04:11:39.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f411aa00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4100004010 0x7f411c1f5920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f410c004eb0 tx=0x7f410c0015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:39.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4112a00640 1 -- 172.21.15.89:0/2821420097 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c015020 con 0x7f4100004010 2024-08-31T04:11:39.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4112a00640 1 -- 172.21.15.89:0/2821420097 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f410c011960 con 0x7f4100004010 2024-08-31T04:11:39.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4112a00640 1 -- 172.21.15.89:0/2821420097 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c011d70 con 0x7f4100004010 2024-08-31T04:11:39.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4121c00640 1 -- 172.21.15.89:0/2821420097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411c14a570 con 0x7f4100004010 2024-08-31T04:11:39.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.168+0000 7f4121c00640 1 -- 172.21.15.89:0/2821420097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f411c1f4e40 con 0x7f4100004010 2024-08-31T04:11:39.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4112a00640 1 -- 172.21.15.89:0/2821420097 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f410c018020 con 0x7f4100004010 2024-08-31T04:11:39.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4112a00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f40fc0720f0 0x7f40fc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4112a00640 1 -- 172.21.15.89:0/2821420097 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f410c093a10 con 0x7f4100004010 2024-08-31T04:11:39.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4129426000 1 Processor -- start 2024-08-31T04:11:39.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4129426000 1 -- start start 2024-08-31T04:11:39.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f40fc0720f0 0x7f40fc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f40fc0720f0 0x7f40fc074600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41080ac000 tx=0x7f4108019d00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:39.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4129426000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb1863f0 0x564bdb2bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4129426000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb17be90 0x564bdb288ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4129426000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 0x564bdb289220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4129426000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564bdb0de820 con 0x564bdb17be90 2024-08-31T04:11:39.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4129426000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564bdb0cddb0 con 0x564bdb165960 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f4129426000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564bdb0d1d60 con 0x564bdb1863f0 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb17be90 0x564bdb288ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb17be90 0x564bdb288ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50566/0 (socket says 172.21.15.89:50566) 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 -- 172.21.15.89:0/1156166091 learned_addr learned my addr 172.21.15.89:0/1156166091 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411aa00640 1 --2- 172.21.15.89:0/1156166091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb1863f0 0x564bdb2bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411b400640 1 --2- 172.21.15.89:0/1156166091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 0x564bdb289220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 -- 172.21.15.89:0/1156166091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb1863f0 msgr2=0x564bdb2bfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 --2- 172.21.15.89:0/1156166091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb1863f0 0x564bdb2bfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 -- 172.21.15.89:0/1156166091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 msgr2=0x564bdb289220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 --2- 172.21.15.89:0/1156166091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 0x564bdb289220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.172+0000 7f411a000640 1 -- 172.21.15.89:0/1156166091 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bdb068b70 con 0x564bdb17be90 2024-08-31T04:11:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f411a000640 1 --2- 172.21.15.89:0/1156166091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb17be90 0x564bdb288ce0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4108098a90 tx=0x7f41080b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6befbe1ce1ce218 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4107400640 1 -- 172.21.15.89:0/1156166091 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41080039f0 con 0x564bdb17be90 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4107400640 1 -- 172.21.15.89:0/1156166091 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4108003c80 con 0x564bdb17be90 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4107400640 1 -- 172.21.15.89:0/1156166091 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41080b9660 con 0x564bdb17be90 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 -- 172.21.15.89:0/1156166091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb17be90 msgr2=0x564bdb288ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 --2- 172.21.15.89:0/1156166091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb17be90 0x564bdb288ce0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4108098a90 tx=0x7f41080b7000 comp rx=0 tx=0).stop 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 -- 172.21.15.89:0/1156166091 shutdown_connections 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 --2- 172.21.15.89:0/1156166091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb17be90 0x564bdb288ce0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 --2- 172.21.15.89:0/1156166091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 0x564bdb289220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 --2- 172.21.15.89:0/1156166091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb1863f0 0x564bdb2bfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 -- 172.21.15.89:0/1156166091 >> 172.21.15.89:0/1156166091 conn(0x564bdad8d210 msgr2=0x564bdb2c2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 -- 172.21.15.89:0/1156166091 shutdown_connections 2024-08-31T04:11:39.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 -- 172.21.15.89:0/1156166091 wait complete. 2024-08-31T04:11:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 -- start start 2024-08-31T04:11:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.176+0000 7f4129426000 1 Processor -- start 2024-08-31T04:11:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 0x564bdb2be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 0x564bdb2bee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2bf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564bdad94b10 con 0x564bdb1863f0 2024-08-31T04:11:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564bdb0546f0 con 0x564bdb17be90 2024-08-31T04:11:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564bdb0d6390 con 0x564bdb165960 2024-08-31T04:11:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 10 client.0 _ll_register_callbacks cb 0x564bdb075b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:11:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2bf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50572/0 (socket says 172.21.15.89:50572) 2024-08-31T04:11:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411b400640 1 -- 172.21.15.89:0/2351694783 learned_addr learned my addr 172.21.15.89:0/2351694783 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411aa00640 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 0x564bdb2be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411a000640 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 0x564bdb2bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411b400640 1 -- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 msgr2=0x564bdb2be8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411b400640 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 0x564bdb2be8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411b400640 1 -- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 msgr2=0x564bdb2bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411b400640 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 0x564bdb2bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411b400640 1 -- 172.21.15.89:0/2351694783 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bdb08c380 con 0x564bdb1863f0 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411b400640 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2bf370 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f411c0c9200 tx=0x7f411400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c08cf65dcade65d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f40fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f40fbe00640 1 -- 172.21.15.89:0/2351694783 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114009e10 con 0x564bdb1863f0 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 -- 172.21.15.89:0/2351694783 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564bdb0dcd20 con 0x564bdb1863f0 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f40fbe00640 1 -- 172.21.15.89:0/2351694783 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f4114004b30 con 0x564bdb1863f0 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f40fbe00640 1 -- 172.21.15.89:0/2351694783 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4114025050 con 0x564bdb1863f0 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 10 client.5133 fetch_fsmap learned FSMap version 9 2024-08-31T04:11:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 -- 172.21.15.89:0/2351694783 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564bdb152e40 con 0x564bdb1863f0 2024-08-31T04:11:39.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f40fbe00640 1 -- 172.21.15.89:0/2351694783 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564bdb0dcd20 con 0x564bdb1863f0 2024-08-31T04:11:39.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f40fbe00640 1 -- 172.21.15.89:0/2351694783 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f4114028020 con 0x564bdb1863f0 2024-08-31T04:11:39.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 10 client.5133 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:11:39.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 10 client.5133 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:11:39.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 20 client.5133 populate_metadata read hostname 'smithi089' 2024-08-31T04:11:39.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x564bdad71dc0 0x564bdb2d9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 4 client.5133 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:11:39.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f4129426000 1 -- 172.21.15.89:0/2351694783 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bdb0e0770 con 0x564bdad71dc0 2024-08-31T04:11:39.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411aa00640 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x564bdad71dc0 0x564bdb2d9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f411aa00640 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x564bdad71dc0 0x564bdb2d9f90 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3fb78ee15957431 server_cookie=8b56c7402f0db2f8 in_seq=0 out_seq=0 2024-08-31T04:11:39.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.180+0000 7f40fbe00640 10 client.5133 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:39.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f40fbe00640 1 -- 172.21.15.89:0/2351694783 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564bdb0e0770 con 0x564bdad71dc0 2024-08-31T04:11:39.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f40fbe00640 10 client.5133 handle_command_reply: tid=0 2024-08-31T04:11:39.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 client.5133 shutdown 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 -- 172.21.15.89:0/2351694783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 msgr2=0x564bdb2bf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2bf370 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f411c0c9200 tx=0x7f411400f790 comp rx=0 tx=0).stop 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 -- 172.21.15.89:0/2351694783 shutdown_connections 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x564bdad71dc0 0x564bdb2d9f90 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2bf370 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 0x564bdb2bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 --2- 172.21.15.89:0/2351694783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 0x564bdb2be8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f40fbe00640 0 client.5133 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 -- 172.21.15.89:0/2351694783 >> 172.21.15.89:0/2351694783 conn(0x564bdad8d210 msgr2=0x564bdb2c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 -- 172.21.15.89:0/2351694783 shutdown_connections 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 1 -- 172.21.15.89:0/2351694783 wait complete. 2024-08-31T04:11:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.184+0000 7f4129426000 20 client.5133 trim_cache size 0 max 16384 2024-08-31T04:11:39.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4129426000 1 Processor -- start 2024-08-31T04:11:39.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4129426000 1 -- start start 2024-08-31T04:11:39.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4129426000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 0x564bdb32e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4129426000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb17be90 0x564bdb2812a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4129426000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2817e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4129426000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f411c1fe7e0 con 0x564bdb1863f0 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4129426000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f411c1ffba0 con 0x564bdb165960 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4129426000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f411c1fee30 con 0x564bdb17be90 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2817e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2817e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50582/0 (socket says 172.21.15.89:50582) 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411b400640 1 -- 172.21.15.89:0/4179599722 learned_addr learned my addr 172.21.15.89:0/4179599722 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411aa00640 1 --2- 172.21.15.89:0/4179599722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 0x564bdb32e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411a000640 1 --2- 172.21.15.89:0/4179599722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb17be90 0x564bdb2812a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411b400640 1 -- 172.21.15.89:0/4179599722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb17be90 msgr2=0x564bdb2812a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411b400640 1 --2- 172.21.15.89:0/4179599722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb17be90 0x564bdb2812a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411b400640 1 -- 172.21.15.89:0/4179599722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 msgr2=0x564bdb32e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411b400640 1 --2- 172.21.15.89:0/4179599722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 0x564bdb32e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411b400640 1 -- 172.21.15.89:0/4179599722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bdb12a5b0 con 0x564bdb1863f0 2024-08-31T04:11:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f411b400640 1 --2- 172.21.15.89:0/4179599722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2817e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4114011860 tx=0x7f4114004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ecbefd442b5a6f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4106a00640 1 -- 172.21.15.89:0/4179599722 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114009c10 con 0x564bdb1863f0 2024-08-31T04:11:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4106a00640 1 -- 172.21.15.89:0/4179599722 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4114030070 con 0x564bdb1863f0 2024-08-31T04:11:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.204+0000 7f4106a00640 1 -- 172.21.15.89:0/4179599722 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114020460 con 0x564bdb1863f0 2024-08-31T04:11:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 -- 172.21.15.89:0/4179599722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 msgr2=0x564bdb2817e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 --2- 172.21.15.89:0/4179599722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2817e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4114011860 tx=0x7f4114004a50 comp rx=0 tx=0).stop 2024-08-31T04:11:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 -- 172.21.15.89:0/4179599722 shutdown_connections 2024-08-31T04:11:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 --2- 172.21.15.89:0/4179599722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb2817e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 --2- 172.21.15.89:0/4179599722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb17be90 0x564bdb2812a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 --2- 172.21.15.89:0/4179599722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb165960 0x564bdb32e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 -- 172.21.15.89:0/4179599722 >> 172.21.15.89:0/4179599722 conn(0x564bdad8d210 msgr2=0x564bdb2bf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 -- 172.21.15.89:0/4179599722 shutdown_connections 2024-08-31T04:11:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 -- 172.21.15.89:0/4179599722 wait complete. 2024-08-31T04:11:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 -- start start 2024-08-31T04:11:39.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 Processor -- start 2024-08-31T04:11:39.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 0x564bdb2df560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 0x564bdb2dfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb339d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564bdb04feb0 con 0x564bdb1863f0 2024-08-31T04:11:39.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f411c1ff4d0 con 0x564bdb17be90 2024-08-31T04:11:39.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564bdb075f20 con 0x564bdb165960 2024-08-31T04:11:39.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f4129426000 10 client.0 _ll_register_callbacks cb 0x7f4114009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:11:39.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.208+0000 7f411b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb339d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411aa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 0x564bdb2df560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 0x564bdb2dfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb339d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50594/0 (socket says 172.21.15.89:50594) 2024-08-31T04:11:39.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411b400640 1 -- 172.21.15.89:0/2116138185 learned_addr learned my addr 172.21.15.89:0/2116138185 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:11:39.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411b400640 1 -- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 msgr2=0x564bdb2df560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:39.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411b400640 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 0x564bdb2df560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411b400640 1 -- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 msgr2=0x564bdb2dfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411b400640 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 0x564bdb2dfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411b400640 1 -- 172.21.15.89:0/2116138185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bdb05efc0 con 0x564bdb1863f0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411b400640 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb339d00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4114000f90 tx=0x7f4114005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bb8af42a53bebf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f40fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f40fbe00640 1 -- 172.21.15.89:0/2116138185 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411403a060 con 0x564bdb1863f0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f4129426000 1 -- 172.21.15.89:0/2116138185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4114030070 con 0x564bdb1863f0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f40fbe00640 1 -- 172.21.15.89:0/2116138185 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f4114020400 con 0x564bdb1863f0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f40fbe00640 1 -- 172.21.15.89:0/2116138185 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4114040050 con 0x564bdb1863f0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f4129426000 10 client.5139 fetch_fsmap learned FSMap version 9 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f4129426000 1 -- 172.21.15.89:0/2116138185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564bdb057e00 con 0x564bdb1863f0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f40fbe00640 1 -- 172.21.15.89:0/2116138185 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4114030070 con 0x564bdb1863f0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f40fbe00640 1 -- 172.21.15.89:0/2116138185 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f4114043020 con 0x564bdb1863f0 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f4129426000 10 client.5139 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:11:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f4129426000 10 client.5139 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:11:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f4129426000 20 client.5139 populate_metadata read hostname 'smithi089' 2024-08-31T04:11:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f4129426000 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x564bdad5fe20 0x564bdb33a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:11:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f4129426000 4 client.5139 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}] 2024-08-31T04:11:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f4129426000 1 -- 172.21.15.89:0/2116138185 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.0, "await_for": 45.0}) -- 0x564bdb0dc210 con 0x564bdad5fe20 2024-08-31T04:11:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411aa00640 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x564bdad5fe20 0x564bdb33a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:11:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f40fbe00640 10 client.5139 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.212+0000 7f411aa00640 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x564bdad5fe20 0x564bdb33a240 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62ceb6b0573e8c78 server_cookie=d4f9c9dde2845f1f in_seq=0 out_seq=0 2024-08-31T04:11:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f40fbe00640 1 -- 172.21.15.89:0/2116138185 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564bdb0dc210 con 0x564bdad5fe20 2024-08-31T04:11:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f40fbe00640 10 client.5139 handle_command_reply: tid=0 2024-08-31T04:11:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 client.5139 shutdown 2024-08-31T04:11:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 -- 172.21.15.89:0/2116138185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 msgr2=0x564bdb339d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb339d00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4114000f90 tx=0x7f4114005f20 comp rx=0 tx=0).stop 2024-08-31T04:11:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 -- 172.21.15.89:0/2116138185 shutdown_connections 2024-08-31T04:11:39.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x564bdad5fe20 0x564bdb33a240 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564bdb1863f0 0x564bdb339d00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564bdb17be90 0x564bdb2dfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f40fbe00640 0 client.5139 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:11:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 --2- 172.21.15.89:0/2116138185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564bdb165960 0x564bdb2df560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 -- 172.21.15.89:0/2116138185 >> 172.21.15.89:0/2116138185 conn(0x564bdad8d210 msgr2=0x564bdb331010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 -- 172.21.15.89:0/2116138185 shutdown_connections 2024-08-31T04:11:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 1 -- 172.21.15.89:0/2116138185 wait complete. 2024-08-31T04:11:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.252+0000 7f4129426000 20 client.5139 trim_cache size 0 max 16384 2024-08-31T04:11:39.255 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 26, 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "7e079d46": { 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 26, 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:11:39.256 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 148.0, 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:11:39.257 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:11:39.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 -- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f40fc0720f0 msgr2=0x7f40fc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:39.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f40fc0720f0 0x7f40fc074600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41080ac000 tx=0x7f4108019d00 comp rx=0 tx=0).stop 2024-08-31T04:11:39.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 -- 172.21.15.89:0/2821420097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4100004010 msgr2=0x7f411c1f5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:11:39.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4100004010 0x7f411c1f5920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f410c004eb0 tx=0x7f410c0015e0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 -- 172.21.15.89:0/2821420097 shutdown_connections 2024-08-31T04:11:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f40fc0720f0 0x7f40fc074600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f411c14dce0 0x7f411c14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f411c0cab30 0x7f411c14cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 --2- 172.21.15.89:0/2821420097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4100004010 0x7f411c1f5920 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:11:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 -- 172.21.15.89:0/2821420097 >> 172.21.15.89:0/2821420097 conn(0x7f411c06dd40 msgr2=0x7f411c14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:11:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 -- 172.21.15.89:0/2821420097 shutdown_connections 2024-08-31T04:11:39.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:11:39.256+0000 7f4121c00640 1 -- 172.21.15.89:0/2821420097 wait complete. 2024-08-31T04:11:39.274 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7e079d46', quiesce took 0.7 seconds. Will release after: 27.3 2024-08-31T04:12:00.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:12:00.941 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:12:06.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:12:06.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.739+0000 7f78b1400640 1 -- 172.21.15.89:0/3621935574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac15bc70 msgr2=0x7f78ac152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.739+0000 7f78b1400640 1 --2- 172.21.15.89:0/3621935574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac15bc70 0x7f78ac152a10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f78ac070b70 tx=0x7f789c01f0b0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.739+0000 7f78b1400640 1 -- 172.21.15.89:0/3621935574 shutdown_connections 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.739+0000 7f78b1400640 1 --2- 172.21.15.89:0/3621935574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78ac0c7920 0x7f78ac0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.739+0000 7f78b1400640 1 --2- 172.21.15.89:0/3621935574 >> v2:172.21.15.170:3300/0 conn(0x7f78ac0c1f40 0x7f78ac0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.739+0000 7f78b1400640 1 --2- 172.21.15.89:0/3621935574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac15bc70 0x7f78ac152a10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.739+0000 7f78b1400640 1 -- 172.21.15.89:0/3621935574 >> 172.21.15.89:0/3621935574 conn(0x7f78ac0ccf20 msgr2=0x7f78ac0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.739+0000 7f78b1400640 1 -- 172.21.15.89:0/3621935574 shutdown_connections 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.739+0000 7f78b1400640 1 -- 172.21.15.89:0/3621935574 wait complete. 2024-08-31T04:12:06.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 Processor -- start 2024-08-31T04:12:06.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 -- start start 2024-08-31T04:12:06.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78ac0c1f40 0x7f78ac1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:06.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac0c7920 0x7f78ac147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:06.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78ac15bc70 0x7f78ac145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac0710c0 con 0x7f78ac0c7920 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac070f40 con 0x7f78ac15bc70 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac071240 con 0x7f78ac0c1f40 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac0c7920 0x7f78ac147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac0c7920 0x7f78ac147a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60054/0 (socket says 172.21.15.89:60054) 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a1e00640 1 -- 172.21.15.89:0/2351723619 learned_addr learned my addr 172.21.15.89:0/2351723619 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78aa800640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78ac0c1f40 0x7f78ac1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78ab200640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78ac15bc70 0x7f78ac145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a1e00640 1 -- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78ac0c1f40 msgr2=0x7f78ac1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a1e00640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78ac0c1f40 0x7f78ac1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a1e00640 1 -- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78ac15bc70 msgr2=0x7f78ac145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:06.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a1e00640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78ac15bc70 0x7f78ac145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a1e00640 1 -- 172.21.15.89:0/2351723619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac156c30 con 0x7f78ac0c7920 2024-08-31T04:12:06.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a1e00640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac0c7920 0x7f78ac147a70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7894005950 tx=0x7f789400cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:12:06.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a3400640 1 -- 172.21.15.89:0/2351723619 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894007bb0 con 0x7f78ac0c7920 2024-08-31T04:12:06.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a3400640 1 -- 172.21.15.89:0/2351723619 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7894007e40 con 0x7f78ac0c7920 2024-08-31T04:12:06.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ac15b690 con 0x7f78ac0c7920 2024-08-31T04:12:06.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78a3400640 1 -- 172.21.15.89:0/2351723619 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789400f690 con 0x7f78ac0c7920 2024-08-31T04:12:06.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac1598c0 con 0x7f78ac0c7920 2024-08-31T04:12:06.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.743+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ac0c7d30 con 0x7f78ac0c7920 2024-08-31T04:12:06.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.747+0000 7f78a3400640 1 -- 172.21.15.89:0/2351723619 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f789400f830 con 0x7f78ac0c7920 2024-08-31T04:12:06.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.747+0000 7f78a3400640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f78880720f0 0x7f7888074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:06.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.747+0000 7f78a3400640 1 -- 172.21.15.89:0/2351723619 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f7894093660 con 0x7f78ac0c7920 2024-08-31T04:12:06.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.747+0000 7f78aa800640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f78880720f0 0x7f7888074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:06.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.747+0000 7f78aa800640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f78880720f0 0x7f7888074600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f789c0b2000 tx=0x7f789c01d8f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:12:06.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.751+0000 7f78a3400640 1 -- 172.21.15.89:0/2351723619 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7894014030 con 0x7f78ac0c7920 2024-08-31T04:12:06.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.951+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78ac1560a0 con 0x7f78ac0c7920 2024-08-31T04:12:06.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.951+0000 7f78a3400640 1 -- 172.21.15.89:0/2351723619 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f789405eb40 con 0x7f78ac0c7920 2024-08-31T04:12:06.954 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:12:06.954 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:12:06.954 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:12:06.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f78880720f0 msgr2=0x7f7888074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:06.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f78880720f0 0x7f7888074600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f789c0b2000 tx=0x7f789c01d8f0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac0c7920 msgr2=0x7f78ac147a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:06.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac0c7920 0x7f78ac147a70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7894005950 tx=0x7f789400cdd0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 shutdown_connections 2024-08-31T04:12:06.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f78880720f0 0x7f7888074600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78ac0c7920 0x7f78ac147a70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78ac15bc70 0x7f78ac145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 --2- 172.21.15.89:0/2351723619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78ac0c1f40 0x7f78ac1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:06.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 >> 172.21.15.89:0/2351723619 conn(0x7f78ac0ccf20 msgr2=0x7f78ac15c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:12:06.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 shutdown_connections 2024-08-31T04:12:06.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:06.955+0000 7f78b1400640 1 -- 172.21.15.89:0/2351723619 wait complete. 2024-08-31T04:12:06.976 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 7e079d46 --release --await' 2024-08-31T04:12:06.977 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 7e079d46 --release --await 2024-08-31T04:12:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.135+0000 7f15e1000640 1 -- 172.21.15.89:0/3881408115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 msgr2=0x7f15dc0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:07.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.135+0000 7f15e1000640 1 --2- 172.21.15.89:0/3881408115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 0x7f15dc0b2d20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009bc0 tx=0x7f15cc01cae0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.135+0000 7f15e1000640 1 -- 172.21.15.89:0/3881408115 shutdown_connections 2024-08-31T04:12:07.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.135+0000 7f15e1000640 1 --2- 172.21.15.89:0/3881408115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15dc0c90e0 0x7f15dc0747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.135+0000 7f15e1000640 1 --2- 172.21.15.89:0/3881408115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 0x7f15dc0b2d20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.135+0000 7f15e1000640 1 -- 172.21.15.89:0/3881408115 >> 172.21.15.89:0/3881408115 conn(0x7f15dc0c99b0 msgr2=0x7f15dc0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:12:07.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.135+0000 7f15e1000640 1 -- 172.21.15.89:0/3881408115 shutdown_connections 2024-08-31T04:12:07.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.135+0000 7f15e1000640 1 -- 172.21.15.89:0/3881408115 wait complete. 2024-08-31T04:12:07.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 Processor -- start 2024-08-31T04:12:07.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 -- start start 2024-08-31T04:12:07.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 0x7f15dc147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15dc0c1ed0 0x7f15dc1456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15dc0c90e0 0x7f15dc071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc158750 con 0x7f15dc0b2860 2024-08-31T04:12:07.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1585d0 con 0x7f15dc0c90e0 2024-08-31T04:12:07.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc0736a0 con 0x7f15dc0c1ed0 2024-08-31T04:12:07.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 0x7f15dc147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 0x7f15dc147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60066/0 (socket says 172.21.15.89:60066) 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d9e00640 1 -- 172.21.15.89:0/81981510 learned_addr learned my addr 172.21.15.89:0/81981510 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d1400640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15dc0c1ed0 0x7f15dc1456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15da800640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15dc0c90e0 0x7f15dc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d9e00640 1 -- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15dc0c1ed0 msgr2=0x7f15dc1456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d9e00640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15dc0c1ed0 0x7f15dc1456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d9e00640 1 -- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15dc0c90e0 msgr2=0x7f15dc071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d9e00640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15dc0c90e0 0x7f15dc071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d9e00640 1 -- 172.21.15.89:0/81981510 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc14d8c0 con 0x7f15dc0b2860 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15da800640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15dc0c90e0 0x7f15dc071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d9e00640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 0x7f15dc147870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009b10 tx=0x7f15cc005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d2a00640 1 -- 172.21.15.89:0/81981510 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0b2040 con 0x7f15dc0b2860 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d2a00640 1 -- 172.21.15.89:0/81981510 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15cc004130 con 0x7f15dc0b2860 2024-08-31T04:12:07.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15d2a00640 1 -- 172.21.15.89:0/81981510 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc004560 con 0x7f15dc0b2860 2024-08-31T04:12:07.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 -- 172.21.15.89:0/81981510 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc1623c0 con 0x7f15dc0b2860 2024-08-31T04:12:07.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.139+0000 7f15e1000640 1 -- 172.21.15.89:0/81981510 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc1620e0 con 0x7f15dc0b2860 2024-08-31T04:12:07.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.143+0000 7f15d2a00640 1 -- 172.21.15.89:0/81981510 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f15cc0bd060 con 0x7f15dc0b2860 2024-08-31T04:12:07.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.143+0000 7f15d2a00640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f15b80720f0 0x7f15b8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.143+0000 7f15d2a00640 1 -- 172.21.15.89:0/81981510 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f15cc12cce0 con 0x7f15dc0b2860 2024-08-31T04:12:07.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.143+0000 7f15d1400640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f15b80720f0 0x7f15b8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.143+0000 7f15e8737000 1 Processor -- start 2024-08-31T04:12:07.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.143+0000 7f15e8737000 1 -- start start 2024-08-31T04:12:07.147 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15d1400640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f15b80720f0 0x7f15b8074600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0b2750 tx=0x7f15c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 0x55b1368dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367ab930 0x55b1368e4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368e5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b13678af30 con 0x55b13679c890 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b136700690 con 0x55b1367ab930 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b1366efc20 con 0x55b1367c1950 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15da800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368e5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15d9e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 0x55b1368dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15da800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368e5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60068/0 (socket says 172.21.15.89:60068) 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15da800640 1 -- 172.21.15.89:0/568578638 learned_addr learned my addr 172.21.15.89:0/568578638 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:12:07.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15d1400640 1 --2- 172.21.15.89:0/568578638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367ab930 0x55b1368e4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15da800640 1 -- 172.21.15.89:0/568578638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 msgr2=0x55b1368dfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:12:07.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15da800640 1 --2- 172.21.15.89:0/568578638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 0x55b1368dfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15da800640 1 -- 172.21.15.89:0/568578638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367ab930 msgr2=0x55b1368e4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:12:07.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15da800640 1 --2- 172.21.15.89:0/568578638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367ab930 0x55b1368e4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15da800640 1 -- 172.21.15.89:0/568578638 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1366a48f0 con 0x55b13679c890 2024-08-31T04:12:07.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15da800640 1 --2- 172.21.15.89:0/568578638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368e5010 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009af0 tx=0x7f15d4010370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab8a706d6da92bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:12:07.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15caa00640 1 -- 172.21.15.89:0/568578638 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d4010da0 con 0x55b13679c890 2024-08-31T04:12:07.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15caa00640 1 -- 172.21.15.89:0/568578638 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15d4004030 con 0x55b13679c890 2024-08-31T04:12:07.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15caa00640 1 -- 172.21.15.89:0/568578638 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d4004420 con 0x55b13679c890 2024-08-31T04:12:07.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 -- 172.21.15.89:0/568578638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 msgr2=0x55b1368e5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:07.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 --2- 172.21.15.89:0/568578638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368e5010 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009af0 tx=0x7f15d4010370 comp rx=0 tx=0).stop 2024-08-31T04:12:07.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 -- 172.21.15.89:0/568578638 shutdown_connections 2024-08-31T04:12:07.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 --2- 172.21.15.89:0/568578638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368e5010 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 --2- 172.21.15.89:0/568578638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367ab930 0x55b1368e4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 --2- 172.21.15.89:0/568578638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 0x55b1368dfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 -- 172.21.15.89:0/568578638 >> 172.21.15.89:0/568578638 conn(0x55b1367c1540 msgr2=0x55b1368e2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:12:07.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 -- 172.21.15.89:0/568578638 shutdown_connections 2024-08-31T04:12:07.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.147+0000 7f15e8737000 1 -- 172.21.15.89:0/568578638 wait complete. 2024-08-31T04:12:07.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 -- start start 2024-08-31T04:12:07.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 Processor -- start 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b13679c890 0x55b1368df030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368df570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 0x55b1368e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b136676500 con 0x55b1367ab930 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b1366f3bd0 con 0x55b13679c890 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b136697a30 con 0x55b1367c1950 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 10 client.0 _ll_register_callbacks cb 0x55b1367a5b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368df570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368df570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60072/0 (socket says 172.21.15.89:60072) 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d1400640 1 -- 172.21.15.89:0/1342442138 learned_addr learned my addr 172.21.15.89:0/1342442138 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d9e00640 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b13679c890 0x55b1368df030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15da800640 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 0x55b1368e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d1400640 1 -- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 msgr2=0x55b1368e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d1400640 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 0x55b1368e9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d1400640 1 -- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b13679c890 msgr2=0x55b1368df030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d1400640 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b13679c890 0x55b1368df030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d1400640 1 -- 172.21.15.89:0/1342442138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b13668f6a0 con 0x55b1367ab930 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d9e00640 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b13679c890 0x55b1368df030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15d1400640 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368df570 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15dc15cc80 tx=0x7f15c40137b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3d63fd47ed664a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15bf400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15bf400640 1 -- 172.21.15.89:0/1342442138 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4025020 con 0x55b1367ab930 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 -- 172.21.15.89:0/1342442138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b1366897e0 con 0x55b1367ab930 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15bf400640 1 -- 172.21.15.89:0/1342442138 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f15c4010040 con 0x55b1367ab930 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15bf400640 1 -- 172.21.15.89:0/1342442138 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f15c402f050 con 0x55b1367ab930 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 10 client.5160 fetch_fsmap learned FSMap version 9 2024-08-31T04:12:07.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.151+0000 7f15e8737000 1 -- 172.21.15.89:0/1342442138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b1366ae1c0 con 0x55b1367ab930 2024-08-31T04:12:07.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15bf400640 1 -- 172.21.15.89:0/1342442138 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b1366897e0 con 0x55b1367ab930 2024-08-31T04:12:07.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15bf400640 1 -- 172.21.15.89:0/1342442138 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f15c4032020 con 0x55b1367ab930 2024-08-31T04:12:07.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 10 client.5160 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:12:07.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 10 client.5160 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:12:07.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 20 client.5160 populate_metadata read hostname 'smithi089' 2024-08-31T04:12:07.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b136785fc0 0x55b1368ea970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 4 client.5160 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:12:07.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 -- 172.21.15.89:0/1342442138 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1367025e0 con 0x55b136785fc0 2024-08-31T04:12:07.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15d9e00640 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b136785fc0 0x55b1368ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15d9e00640 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b136785fc0 0x55b1368ea970 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5107d1d1eca2766b server_cookie=ed929986b0f3fa34 in_seq=0 out_seq=0 2024-08-31T04:12:07.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15bf400640 10 client.5160 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15bf400640 1 -- 172.21.15.89:0/1342442138 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1367025e0 con 0x55b136785fc0 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15bf400640 10 client.5160 handle_command_reply: tid=0 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 client.5160 shutdown 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 -- 172.21.15.89:0/1342442138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 msgr2=0x55b1368df570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368df570 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15dc15cc80 tx=0x7f15c40137b0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 -- 172.21.15.89:0/1342442138 shutdown_connections 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b136785fc0 0x55b1368ea970 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368df570 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367c1950 0x55b1368e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 --2- 172.21.15.89:0/1342442138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b13679c890 0x55b1368df030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15bf400640 0 client.5160 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.155+0000 7f15e8737000 1 -- 172.21.15.89:0/1342442138 >> 172.21.15.89:0/1342442138 conn(0x55b1367c1540 msgr2=0x55b1368e0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.159+0000 7f15e8737000 1 -- 172.21.15.89:0/1342442138 shutdown_connections 2024-08-31T04:12:07.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.159+0000 7f15e8737000 1 -- 172.21.15.89:0/1342442138 wait complete. 2024-08-31T04:12:07.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.159+0000 7f15e8737000 20 client.5160 trim_cache size 0 max 16384 2024-08-31T04:12:07.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15e8737000 1 Processor -- start 2024-08-31T04:12:07.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15e8737000 1 -- start start 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15e8737000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368ff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15e8737000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367ab930 0x55b1368ffb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15e8737000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 0x55b1368f8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15e8737000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc204320 con 0x55b13679c890 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15e8737000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc203200 con 0x55b1367c1950 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15e8737000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc201740 con 0x55b1367ab930 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15d9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15d9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368ff600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60078/0 (socket says 172.21.15.89:60078) 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15d9e00640 1 -- 172.21.15.89:0/1976272653 learned_addr learned my addr 172.21.15.89:0/1976272653 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15d1400640 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367ab930 0x55b1368ffb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.175+0000 7f15da800640 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 0x55b1368f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15d9e00640 1 -- 172.21.15.89:0/1976272653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367ab930 msgr2=0x55b1368ffb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15d9e00640 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367ab930 0x55b1368ffb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15d9e00640 1 -- 172.21.15.89:0/1976272653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 msgr2=0x55b1368f8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15d9e00640 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 0x55b1368f8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15d9e00640 1 -- 172.21.15.89:0/1976272653 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1368e9f40 con 0x55b13679c890 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15d1400640 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367ab930 0x55b1368ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15d9e00640 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368ff600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0f3bd0 tx=0x7f15cc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8e3a3488e85e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15ca000640 1 -- 172.21.15.89:0/1976272653 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc128070 con 0x55b13679c890 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15ca000640 1 -- 172.21.15.89:0/1976272653 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15cc0f8250 con 0x55b13679c890 2024-08-31T04:12:07.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15ca000640 1 -- 172.21.15.89:0/1976272653 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0f7b50 con 0x55b13679c890 2024-08-31T04:12:07.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 -- 172.21.15.89:0/1976272653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 msgr2=0x55b1368ff600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:07.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368ff600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0f3bd0 tx=0x7f15cc000f50 comp rx=0 tx=0).stop 2024-08-31T04:12:07.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 -- 172.21.15.89:0/1976272653 shutdown_connections 2024-08-31T04:12:07.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 0x55b1368f8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b1367ab930 0x55b1368ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 --2- 172.21.15.89:0/1976272653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b13679c890 0x55b1368ff600 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 -- 172.21.15.89:0/1976272653 >> 172.21.15.89:0/1976272653 conn(0x55b1367c1540 msgr2=0x55b1368a0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:12:07.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 -- 172.21.15.89:0/1976272653 shutdown_connections 2024-08-31T04:12:07.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 -- 172.21.15.89:0/1976272653 wait complete. 2024-08-31T04:12:07.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 -- start start 2024-08-31T04:12:07.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.179+0000 7f15e8737000 1 Processor -- start 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b13679c890 0x55b1368ff890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 0x55b1368fe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc201d90 con 0x55b1367ab930 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc202b30 con 0x55b1367c1950 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc202460 con 0x55b13679c890 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 10 client.0 _ll_register_callbacks cb 0x7f15c4015910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368ffdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60090/0 (socket says 172.21.15.89:60090) 2024-08-31T04:12:07.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d1400640 1 -- 172.21.15.89:0/2441310070 learned_addr learned my addr 172.21.15.89:0/2441310070 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d9e00640 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b13679c890 0x55b1368ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15da800640 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 0x55b1368fe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d1400640 1 -- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b13679c890 msgr2=0x55b1368ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d1400640 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b13679c890 0x55b1368ff890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d1400640 1 -- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 msgr2=0x55b1368fe9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d1400640 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 0x55b1368fe9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d1400640 1 -- 172.21.15.89:0/2441310070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1367742f0 con 0x55b1367ab930 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15d1400640 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368ffdd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f15c40156b0 tx=0x7f15c40045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475ce04c27a109c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15bf400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15bf400640 1 -- 172.21.15.89:0/2441310070 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4025040 con 0x55b1367ab930 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15bf400640 1 -- 172.21.15.89:0/2441310070 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f15c402a7c0 con 0x55b1367ab930 2024-08-31T04:12:07.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 1 -- 172.21.15.89:0/2441310070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15cc0f8250 con 0x55b1367ab930 2024-08-31T04:12:07.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15bf400640 1 -- 172.21.15.89:0/2441310070 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f15c4040050 con 0x55b1367ab930 2024-08-31T04:12:07.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 10 client.5166 fetch_fsmap learned FSMap version 9 2024-08-31T04:12:07.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.183+0000 7f15e8737000 1 -- 172.21.15.89:0/2441310070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b136679b30 con 0x55b1367ab930 2024-08-31T04:12:07.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15bf400640 1 -- 172.21.15.89:0/2441310070 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15cc0f8250 con 0x55b1367ab930 2024-08-31T04:12:07.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15bf400640 1 -- 172.21.15.89:0/2441310070 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f15c4043020 con 0x55b1367ab930 2024-08-31T04:12:07.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15e8737000 10 client.5166 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:12:07.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15e8737000 10 client.5166 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:12:07.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15e8737000 20 client.5166 populate_metadata read hostname 'smithi089' 2024-08-31T04:12:07.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15e8737000 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b136381e80 0x55b1368fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:12:07.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15e8737000 4 client.5166 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7e079d46", "release": true, "await": true}] 2024-08-31T04:12:07.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15e8737000 1 -- 172.21.15.89:0/2441310070 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7e079d46", "release": true, "await": true}) -- 0x55b1366fe080 con 0x55b136381e80 2024-08-31T04:12:07.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15d9e00640 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b136381e80 0x55b1368fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:12:07.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15d9e00640 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b136381e80 0x55b1368fc9c0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91a4c17d68a587b7 server_cookie=5705133ac0501fea in_seq=0 out_seq=0 2024-08-31T04:12:07.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.187+0000 7f15bf400640 10 client.5166 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:12:07.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15bf400640 1 -- 172.21.15.89:0/2441310070 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b1366fe080 con 0x55b136381e80 2024-08-31T04:12:07.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15bf400640 10 client.5166 handle_command_reply: tid=0 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 client.5166 shutdown 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 -- 172.21.15.89:0/2441310070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 msgr2=0x55b1368ffdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368ffdd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f15c40156b0 tx=0x7f15c40045c0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 -- 172.21.15.89:0/2441310070 shutdown_connections 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b136381e80 0x55b1368fc9c0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b1367ab930 0x55b1368ffdd0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1367c1950 0x55b1368fe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15bf400640 0 client.5166 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 --2- 172.21.15.89:0/2441310070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b13679c890 0x55b1368ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 -- 172.21.15.89:0/2441310070 >> 172.21.15.89:0/2441310070 conn(0x55b1367c1540 msgr2=0x55b1368e86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 -- 172.21.15.89:0/2441310070 shutdown_connections 2024-08-31T04:12:07.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 1 -- 172.21.15.89:0/2441310070 wait complete. 2024-08-31T04:12:07.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e8737000 20 client.5166 trim_cache size 0 max 16384 2024-08-31T04:12:07.201 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:12:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:12:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:12:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 28, 2024-08-31T04:12:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:12:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "7e079d46": { 2024-08-31T04:12:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 28, 2024-08-31T04:12:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 148.0, 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:12:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:12:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:12:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:12:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:12:07.203 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 -- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f15b80720f0 msgr2=0x7f15b8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f15b80720f0 0x7f15b8074600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0b2750 tx=0x7f15c4009040 comp rx=0 tx=0).stop 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 -- 172.21.15.89:0/81981510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 msgr2=0x7f15dc147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 0x7f15dc147870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009b10 tx=0x7f15cc005a60 comp rx=0 tx=0).stop 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 -- 172.21.15.89:0/81981510 shutdown_connections 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f15b80720f0 0x7f15b8074600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15dc0c90e0 0x7f15dc071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15dc0c1ed0 0x7f15dc1456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 --2- 172.21.15.89:0/81981510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15dc0b2860 0x7f15dc147870 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 -- 172.21.15.89:0/81981510 >> 172.21.15.89:0/81981510 conn(0x7f15dc0c99b0 msgr2=0x7f15dc14dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 -- 172.21.15.89:0/81981510 shutdown_connections 2024-08-31T04:12:07.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:12:07.199+0000 7f15e1000640 1 -- 172.21.15.89:0/81981510 wait complete. 2024-08-31T04:12:07.220 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7e079d46', total seconds elapsed: 28.6 2024-08-31T04:12:31.013 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:12:31.017 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:13:01.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:13:01.072 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:13:31.420 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:13:31.424 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:13:51.221 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 15.5 2024-08-31T04:13:51.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:13:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.390+0000 7f6e33c00640 1 -- 172.21.15.89:0/3010066691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e14004810 msgr2=0x7f6e14004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.390+0000 7f6e33c00640 1 --2- 172.21.15.89:0/3010066691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e14004810 0x7f6e14004c20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006fa0 tx=0x7f6e1801ce80 comp rx=0 tx=0).stop 2024-08-31T04:13:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.390+0000 7f6e33c00640 1 -- 172.21.15.89:0/3010066691 shutdown_connections 2024-08-31T04:13:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.390+0000 7f6e33c00640 1 --2- 172.21.15.89:0/3010066691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e14004810 0x7f6e14004c20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.390+0000 7f6e33c00640 1 -- 172.21.15.89:0/3010066691 >> 172.21.15.89:0/3010066691 conn(0x7f6e2c0ccf20 msgr2=0x7f6e2c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:13:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.390+0000 7f6e33c00640 1 -- 172.21.15.89:0/3010066691 shutdown_connections 2024-08-31T04:13:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.390+0000 7f6e33c00640 1 -- 172.21.15.89:0/3010066691 wait complete. 2024-08-31T04:13:51.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.390+0000 7f6e33c00640 1 Processor -- start 2024-08-31T04:13:51.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.390+0000 7f6e33c00640 1 -- start start 2024-08-31T04:13:51.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e33c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e14004810 0x7f6e2c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e33c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e2c14cbe0 0x7f6e2c149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e33c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c14a4f0 0x7f6e2c14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e33c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c158800 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e33c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c0c4040 con 0x7f6e14004810 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e33c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6e2c158980 con 0x7f6e2c14cbe0 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c14a4f0 0x7f6e2c14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c14a4f0 0x7f6e2c14a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44800/0 (socket says 172.21.15.89:44800) 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31c00640 1 -- 172.21.15.89:0/1223923913 learned_addr learned my addr 172.21.15.89:0/1223923913 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31200640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e14004810 0x7f6e2c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e2be00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e2c14cbe0 0x7f6e2c149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31c00640 1 -- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e2c14cbe0 msgr2=0x7f6e2c149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e2c14cbe0 0x7f6e2c149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31c00640 1 -- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e14004810 msgr2=0x7f6e2c1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e14004810 0x7f6e2c1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31c00640 1 -- 172.21.15.89:0/1223923913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c14dca0 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e31c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c14a4f0 0x7f6e2c14a900 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0c3430 tx=0x7f6e24010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e28c00640 1 -- 172.21.15.89:0/1223923913 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24003980 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e28c00640 1 -- 172.21.15.89:0/1223923913 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e24015070 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2c14df80 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e28c00640 1 -- 172.21.15.89:0/1223923913 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24004030 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2c14a060 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.394+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2c14c4b0 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.398+0000 7f6e28c00640 1 -- 172.21.15.89:0/1223923913 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6e240041d0 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.398+0000 7f6e28c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6e0c0720c0 0x7f6e0c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.398+0000 7f6e28c00640 1 -- 172.21.15.89:0/1223923913 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f6e24093a20 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.398+0000 7f6e31200640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6e0c0720c0 0x7f6e0c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.398+0000 7f6e31200640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6e0c0720c0 0x7f6e0c0745d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6e20000c10 tx=0x7f6e2000ad50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.402+0000 7f6e28c00640 1 -- 172.21.15.89:0/1223923913 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6e2405efa0 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.602+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e2c0c1f40 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.602+0000 7f6e28c00640 1 -- 172.21.15.89:0/1223923913 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f6e2405e8a0 con 0x7f6e2c14a4f0 2024-08-31T04:13:51.606 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:13:51.606 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:13:51.606 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6e0c0720c0 msgr2=0x7f6e0c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6e0c0720c0 0x7f6e0c0745d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6e20000c10 tx=0x7f6e2000ad50 comp rx=0 tx=0).stop 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c14a4f0 msgr2=0x7f6e2c14a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c14a4f0 0x7f6e2c14a900 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0c3430 tx=0x7f6e24010f40 comp rx=0 tx=0).stop 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 shutdown_connections 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6e0c0720c0 0x7f6e0c0745d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c14a4f0 0x7f6e2c14a900 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e2c14cbe0 0x7f6e2c149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 --2- 172.21.15.89:0/1223923913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e14004810 0x7f6e2c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 >> 172.21.15.89:0/1223923913 conn(0x7f6e2c0ccf20 msgr2=0x7f6e2c070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 shutdown_connections 2024-08-31T04:13:51.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.606+0000 7f6e33c00640 1 -- 172.21.15.89:0/1223923913 wait complete. 2024-08-31T04:13:51.630 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 135.5 --await-for 45.0' 2024-08-31T04:13:51.630 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 135.5 --await-for 45.0 2024-08-31T04:13:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.798+0000 7f39b0c00640 1 -- 172.21.15.89:0/2255622956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3990004810 msgr2=0x7f3990004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.798+0000 7f39b0c00640 1 --2- 172.21.15.89:0/2255622956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3990004810 0x7f3990004c20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f399800c2e0 tx=0x7f399801cee0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.798+0000 7f39b0c00640 1 -- 172.21.15.89:0/2255622956 shutdown_connections 2024-08-31T04:13:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.798+0000 7f39b0c00640 1 --2- 172.21.15.89:0/2255622956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3990004810 0x7f3990004c20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.798+0000 7f39b0c00640 1 -- 172.21.15.89:0/2255622956 >> 172.21.15.89:0/2255622956 conn(0x7f39ac0c99b0 msgr2=0x7f39ac0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:13:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.798+0000 7f39b0c00640 1 -- 172.21.15.89:0/2255622956 shutdown_connections 2024-08-31T04:13:51.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.798+0000 7f39b0c00640 1 -- 172.21.15.89:0/2255622956 wait complete. 2024-08-31T04:13:51.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.798+0000 7f39b0c00640 1 Processor -- start 2024-08-31T04:13:51.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.798+0000 7f39b0c00640 1 -- start start 2024-08-31T04:13:51.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39b0c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990004810 0x7f39ac149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39b0c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39ac148b80 0x7f39ac14a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39b0c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39ac073b80 0x7f39ac147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39b0c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac1521d0 con 0x7f39ac148b80 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39b0c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac0c2770 con 0x7f3990004810 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39b0c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39ac074de0 con 0x7f39ac073b80 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39ac148b80 0x7f39ac14a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39ac148b80 0x7f39ac14a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56622/0 (socket says 172.21.15.89:56622) 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9400640 1 -- 172.21.15.89:0/1949233581 learned_addr learned my addr 172.21.15.89:0/1949233581 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9e00640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990004810 0x7f39ac149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39aa800640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39ac073b80 0x7f39ac147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9400640 1 -- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39ac073b80 msgr2=0x7f39ac147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9400640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39ac073b80 0x7f39ac147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9400640 1 -- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990004810 msgr2=0x7f39ac149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9400640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990004810 0x7f39ac149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9400640 1 -- 172.21.15.89:0/1949233581 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac14aa10 con 0x7f39ac148b80 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a9400640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39ac148b80 0x7f39ac14a4d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f399801c9a0 tx=0x7f39980aea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a2000640 1 -- 172.21.15.89:0/1949233581 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998006cb0 con 0x7f39ac148b80 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a2000640 1 -- 172.21.15.89:0/1949233581 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3998001520 con 0x7f39ac148b80 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39b0c00640 1 -- 172.21.15.89:0/1949233581 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ac0cc510 con 0x7f39ac148b80 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39a2000640 1 -- 172.21.15.89:0/1949233581 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998001d30 con 0x7f39ac148b80 2024-08-31T04:13:51.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.802+0000 7f39b0c00640 1 -- 172.21.15.89:0/1949233581 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ac0cca90 con 0x7f39ac148b80 2024-08-31T04:13:51.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39a2000640 1 -- 172.21.15.89:0/1949233581 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f39980bf060 con 0x7f39ac148b80 2024-08-31T04:13:51.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39a2000640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f398c0720c0 0x7f398c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39a2000640 1 -- 172.21.15.89:0/1949233581 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f399812d6e0 con 0x7f39ac148b80 2024-08-31T04:13:51.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39b8185000 1 Processor -- start 2024-08-31T04:13:51.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39a9e00640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f398c0720c0 0x7f398c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39b8185000 1 -- start start 2024-08-31T04:13:51.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39a9e00640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f398c0720c0 0x7f398c0745d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f399c000f70 tx=0x7f399c000f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:51.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39b8185000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48dddb3f0 0x55a48dede4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39b8185000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 0x55a48df14900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39b8185000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df14e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39b8185000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a48dd33820 con 0x55a48ddba960 2024-08-31T04:13:51.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39b8185000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a48dd22db0 con 0x55a48dddb3f0 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39b8185000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a48dd26d60 con 0x55a48ddd0e90 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39aa800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df14e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39aa800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df14e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56626/0 (socket says 172.21.15.89:56626) 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39aa800640 1 -- 172.21.15.89:0/1864521327 learned_addr learned my addr 172.21.15.89:0/1864521327 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39a9400640 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 0x55a48df14900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39a9e00640 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48dddb3f0 0x55a48dede4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39aa800640 1 -- 172.21.15.89:0/1864521327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 msgr2=0x55a48df14900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39aa800640 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 0x55a48df14900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39aa800640 1 -- 172.21.15.89:0/1864521327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48dddb3f0 msgr2=0x55a48dede4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.806+0000 7f39aa800640 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48dddb3f0 0x55a48dede4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39aa800640 1 -- 172.21.15.89:0/1864521327 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a48dcbdb70 con 0x55a48ddba960 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39a9400640 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 0x55a48df14900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:13:51.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39aa800640 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df14e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0c7570 tx=0x7f39a400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6cc3bf959c3349 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:51.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f3996600640 1 -- 172.21.15.89:0/1864521327 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a400c7e0 con 0x55a48ddba960 2024-08-31T04:13:51.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f3996600640 1 -- 172.21.15.89:0/1864521327 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a401d070 con 0x55a48ddba960 2024-08-31T04:13:51.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f3996600640 1 -- 172.21.15.89:0/1864521327 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a400cc00 con 0x55a48ddba960 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 -- 172.21.15.89:0/1864521327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 msgr2=0x55a48df14e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df14e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0c7570 tx=0x7f39a400e820 comp rx=0 tx=0).stop 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 -- 172.21.15.89:0/1864521327 shutdown_connections 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df14e40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 0x55a48df14900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 --2- 172.21.15.89:0/1864521327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48dddb3f0 0x55a48dede4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 -- 172.21.15.89:0/1864521327 >> 172.21.15.89:0/1864521327 conn(0x55a48d9e2210 msgr2=0x55a48df17990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 -- 172.21.15.89:0/1864521327 shutdown_connections 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 -- 172.21.15.89:0/1864521327 wait complete. 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 -- start start 2024-08-31T04:13:51.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.810+0000 7f39b8185000 1 Processor -- start 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 0x55a48df14810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddd0e90 0x55a48df14d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 0x55a48df15290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a48d9e9b10 con 0x55a48ddd0e90 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a48dca96f0 con 0x55a48ddba960 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a48dd2b390 con 0x55a48dddb3f0 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 10 client.0 _ll_register_callbacks cb 0x55a48dccab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddd0e90 0x55a48df14d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddd0e90 0x55a48df14d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56640/0 (socket says 172.21.15.89:56640) 2024-08-31T04:13:51.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9400640 1 -- 172.21.15.89:0/3780709261 learned_addr learned my addr 172.21.15.89:0/3780709261 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39aa800640 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 0x55a48df15290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9e00640 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 0x55a48df14810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9400640 1 -- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 msgr2=0x55a48df15290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9400640 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 0x55a48df15290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9400640 1 -- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 msgr2=0x55a48df14810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9400640 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 0x55a48df14810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9400640 1 -- 172.21.15.89:0/3780709261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a48dce1380 con 0x55a48ddd0e90 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9400640 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddd0e90 0x55a48df14d50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f39980f8450 tx=0x7f399801b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc7126c8dfb89f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f398aa00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f398aa00640 1 -- 172.21.15.89:0/3780709261 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39980f8bc0 con 0x55a48ddd0e90 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f398aa00640 1 -- 172.21.15.89:0/3780709261 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f39980f4750 con 0x55a48ddd0e90 2024-08-31T04:13:51.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 -- 172.21.15.89:0/3780709261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a48dd31d20 con 0x55a48ddd0e90 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f398aa00640 1 -- 172.21.15.89:0/3780709261 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f39980f84c0 con 0x55a48ddd0e90 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 10 client.5184 fetch_fsmap learned FSMap version 9 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 -- 172.21.15.89:0/3780709261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a48dda7e40 con 0x55a48ddd0e90 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f398aa00640 1 -- 172.21.15.89:0/3780709261 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a48dd31d20 con 0x55a48ddd0e90 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f398aa00640 1 -- 172.21.15.89:0/3780709261 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f39980ff0b0 con 0x55a48ddd0e90 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 10 client.5184 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 10 client.5184 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 20 client.5184 populate_metadata read hostname 'smithi089' 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a48d9c6dc0 0x55a48df33a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 4 client.5184 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:13:51.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39b8185000 1 -- 172.21.15.89:0/3780709261 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a48dd35770 con 0x55a48d9c6dc0 2024-08-31T04:13:51.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9e00640 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a48d9c6dc0 0x55a48df33a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f398aa00640 10 client.5184 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:13:51.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.814+0000 7f39a9e00640 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a48d9c6dc0 0x55a48df33a20 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d886791f6a2254 server_cookie=e95f7e67534ecbe in_seq=0 out_seq=0 2024-08-31T04:13:51.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f398aa00640 1 -- 172.21.15.89:0/3780709261 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a48dd35770 con 0x55a48d9c6dc0 2024-08-31T04:13:51.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f398aa00640 10 client.5184 handle_command_reply: tid=0 2024-08-31T04:13:51.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 client.5184 shutdown 2024-08-31T04:13:51.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 -- 172.21.15.89:0/3780709261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddd0e90 msgr2=0x55a48df14d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddd0e90 0x55a48df14d50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f39980f8450 tx=0x7f399801b770 comp rx=0 tx=0).stop 2024-08-31T04:13:51.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 -- 172.21.15.89:0/3780709261 shutdown_connections 2024-08-31T04:13:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a48d9c6dc0 0x55a48df33a20 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddd0e90 0x55a48df14d50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 0x55a48df15290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f398aa00640 0 client.5184 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:13:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 --2- 172.21.15.89:0/3780709261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 0x55a48df14810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 -- 172.21.15.89:0/3780709261 >> 172.21.15.89:0/3780709261 conn(0x55a48d9e2210 msgr2=0x55a48df16340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:13:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 -- 172.21.15.89:0/3780709261 shutdown_connections 2024-08-31T04:13:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 1 -- 172.21.15.89:0/3780709261 wait complete. 2024-08-31T04:13:51.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.818+0000 7f39b8185000 20 client.5184 trim_cache size 0 max 16384 2024-08-31T04:13:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.834+0000 7f39b8185000 1 Processor -- start 2024-08-31T04:13:51.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.834+0000 7f39b8185000 1 -- start start 2024-08-31T04:13:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df8e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddd0e90 0x55a48df8e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 0x55a48df8ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac154260 con 0x55a48ddba960 2024-08-31T04:13:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac1fb6a0 con 0x55a48ddd0e90 2024-08-31T04:13:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39ac1fa9f0 con 0x55a48dddb3f0 2024-08-31T04:13:51.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df8e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df8e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56642/0 (socket says 172.21.15.89:56642) 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9e00640 1 -- 172.21.15.89:0/2135487201 learned_addr learned my addr 172.21.15.89:0/2135487201 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39aa800640 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 0x55a48df8ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9400640 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddd0e90 0x55a48df8e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9e00640 1 -- 172.21.15.89:0/2135487201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 msgr2=0x55a48df8ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9e00640 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 0x55a48df8ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9e00640 1 -- 172.21.15.89:0/2135487201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddd0e90 msgr2=0x55a48df8e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9e00640 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddd0e90 0x55a48df8e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9e00640 1 -- 172.21.15.89:0/2135487201 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a48dee35f0 con 0x55a48ddba960 2024-08-31T04:13:51.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39aa800640 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 0x55a48df8ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:13:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39a9e00640 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df8e2a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f399c015040 tx=0x7f399c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754e2b07e89f48e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f3995c00640 1 -- 172.21.15.89:0/2135487201 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c02c070 con 0x55a48ddba960 2024-08-31T04:13:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f3995c00640 1 -- 172.21.15.89:0/2135487201 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f399c01f7d0 con 0x55a48ddba960 2024-08-31T04:13:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f3995c00640 1 -- 172.21.15.89:0/2135487201 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c016070 con 0x55a48ddba960 2024-08-31T04:13:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 -- 172.21.15.89:0/2135487201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 msgr2=0x55a48df8e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df8e2a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f399c015040 tx=0x7f399c00c000 comp rx=0 tx=0).stop 2024-08-31T04:13:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 -- 172.21.15.89:0/2135487201 shutdown_connections 2024-08-31T04:13:51.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48dddb3f0 0x55a48df8ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddd0e90 0x55a48df8e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 --2- 172.21.15.89:0/2135487201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48ddba960 0x55a48df8e2a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 -- 172.21.15.89:0/2135487201 >> 172.21.15.89:0/2135487201 conn(0x55a48d9e2210 msgr2=0x55a48df26af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:13:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 -- 172.21.15.89:0/2135487201 shutdown_connections 2024-08-31T04:13:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 -- 172.21.15.89:0/2135487201 wait complete. 2024-08-31T04:13:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.838+0000 7f39b8185000 1 -- start start 2024-08-31T04:13:51.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 Processor -- start 2024-08-31T04:13:51.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 0x55a48df924f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 0x55a48df92a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48dddb3f0 0x55a48df92f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a48dca4eb0 con 0x55a48dddb3f0 2024-08-31T04:13:51.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac1fafd0 con 0x55a48ddba960 2024-08-31T04:13:51.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a48dccaf20 con 0x55a48ddd0e90 2024-08-31T04:13:51.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 10 client.0 _ll_register_callbacks cb 0x7f39980f4380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:13:51.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39aa800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48dddb3f0 0x55a48df92f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39aa800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48dddb3f0 0x55a48df92f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56646/0 (socket says 172.21.15.89:56646) 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39aa800640 1 -- 172.21.15.89:0/4292651155 learned_addr learned my addr 172.21.15.89:0/4292651155 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39a9e00640 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 0x55a48df924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39a9400640 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 0x55a48df92a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39aa800640 1 -- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 msgr2=0x55a48df92a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39aa800640 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 0x55a48df92a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39aa800640 1 -- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 msgr2=0x55a48df924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39aa800640 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 0x55a48df924f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39aa800640 1 -- 172.21.15.89:0/4292651155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a48dd7f5b0 con 0x55a48dddb3f0 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39a9e00640 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 0x55a48df924f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39aa800640 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48dddb3f0 0x55a48df92f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f39a401a040 tx=0x7f39a4003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762f1e2bc610fe31 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f398aa00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:13:51.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f398aa00640 1 -- 172.21.15.89:0/4292651155 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4004240 con 0x55a48dddb3f0 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f398aa00640 1 -- 172.21.15.89:0/4292651155 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f39a40043e0 con 0x55a48dddb3f0 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 -- 172.21.15.89:0/4292651155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f399c01f7d0 con 0x55a48dddb3f0 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f398aa00640 1 -- 172.21.15.89:0/4292651155 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f39a4033050 con 0x55a48dddb3f0 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 10 client.5190 fetch_fsmap learned FSMap version 9 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 -- 172.21.15.89:0/4292651155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a48dcb3fc0 con 0x55a48dddb3f0 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f398aa00640 1 -- 172.21.15.89:0/4292651155 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f399c01f7d0 con 0x55a48dddb3f0 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f398aa00640 1 -- 172.21.15.89:0/4292651155 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f39a4036020 con 0x55a48dddb3f0 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 10 client.5190 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 10 client.5190 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 20 client.5190 populate_metadata read hostname 'smithi089' 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a48d9b4e20 0x55a48df94110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 4 client.5190 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 135.5, "await_for": 45.0}] 2024-08-31T04:13:51.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.842+0000 7f39b8185000 1 -- 172.21.15.89:0/4292651155 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 135.5, "await_for": 45.0}) -- 0x55a48dd31210 con 0x55a48d9b4e20 2024-08-31T04:13:51.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.846+0000 7f39a9e00640 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a48d9b4e20 0x55a48df94110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:51.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.846+0000 7f398aa00640 10 client.5190 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:13:51.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:13:51.846+0000 7f39a9e00640 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a48d9b4e20 0x55a48df94110 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4151fe5656dad075 server_cookie=80d4bed29b27300a in_seq=0 out_seq=0 2024-08-31T04:14:01.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:14:01.479 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:14:04.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.678+0000 7f398aa00640 1 -- 172.21.15.89:0/4292651155 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a48dd31210 con 0x55a48d9b4e20 2024-08-31T04:14:04.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f398aa00640 10 client.5190 handle_command_reply: tid=0 2024-08-31T04:14:04.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 client.5190 shutdown 2024-08-31T04:14:04.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 -- 172.21.15.89:0/4292651155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48dddb3f0 msgr2=0x55a48df92f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:04.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48dddb3f0 0x55a48df92f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f39a401a040 tx=0x7f39a4003bb0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 -- 172.21.15.89:0/4292651155 shutdown_connections 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a48d9b4e20 0x55a48df94110 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a48dddb3f0 0x55a48df92f70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a48ddd0e90 0x55a48df92a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 --2- 172.21.15.89:0/4292651155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a48ddba960 0x55a48df924f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f398aa00640 0 client.5190 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 -- 172.21.15.89:0/4292651155 >> 172.21.15.89:0/4292651155 conn(0x55a48d9e2210 msgr2=0x55a48df26ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 -- 172.21.15.89:0/4292651155 shutdown_connections 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 1 -- 172.21.15.89:0/4292651155 wait complete. 2024-08-31T04:14:04.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b8185000 20 client.5190 trim_cache size 0 max 16384 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 30, 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "54360cbf": { 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 30, 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:14:04.684 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 135.5, 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:04.685 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:14:04.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 -- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f398c0720c0 msgr2=0x7f398c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:04.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f398c0720c0 0x7f398c0745d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f399c000f70 tx=0x7f399c000f00 comp rx=0 tx=0).stop 2024-08-31T04:14:04.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 -- 172.21.15.89:0/1949233581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39ac148b80 msgr2=0x7f39ac14a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:04.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39ac148b80 0x7f39ac14a4d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f399801c9a0 tx=0x7f39980aea20 comp rx=0 tx=0).stop 2024-08-31T04:14:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 -- 172.21.15.89:0/1949233581 shutdown_connections 2024-08-31T04:14:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f398c0720c0 0x7f398c0745d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39ac148b80 0x7f39ac14a4d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39ac073b80 0x7f39ac147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 --2- 172.21.15.89:0/1949233581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3990004810 0x7f39ac149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 -- 172.21.15.89:0/1949233581 >> 172.21.15.89:0/1949233581 conn(0x7f39ac0c99b0 msgr2=0x7f39ac155990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 -- 172.21.15.89:0/1949233581 shutdown_connections 2024-08-31T04:14:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:04.682+0000 7f39b0c00640 1 -- 172.21.15.89:0/1949233581 wait complete. 2024-08-31T04:14:04.703 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '54360cbf', quiesce took 13.5 seconds. Will release after: 2.0 2024-08-31T04:14:06.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:14:06.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.858+0000 7fc06d400640 1 -- 172.21.15.89:0/222964680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc04c004d50 msgr2=0x7fc04c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.858+0000 7fc06d400640 1 --2- 172.21.15.89:0/222964680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc04c004d50 0x7fc04c005160 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc068071aa0 tx=0x7fc06001d640 comp rx=0 tx=0).stop 2024-08-31T04:14:06.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.858+0000 7fc06ca00640 1 -- 172.21.15.89:0/222964680 reap_dead start 2024-08-31T04:14:06.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.858+0000 7fc06d400640 1 -- 172.21.15.89:0/222964680 shutdown_connections 2024-08-31T04:14:06.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.858+0000 7fc06d400640 1 -- 172.21.15.89:0/222964680 >> 172.21.15.89:0/222964680 conn(0x7fc068071f20 msgr2=0x7fc068072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:06.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 -- 172.21.15.89:0/222964680 shutdown_connections 2024-08-31T04:14:06.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 -- 172.21.15.89:0/222964680 wait complete. 2024-08-31T04:14:06.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 Processor -- start 2024-08-31T04:14:06.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 -- start start 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc04c004d50 0x7fc06814ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815cff0 0x7fc0680ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068147480 0x7fc068147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc068070980 con 0x7fc04c004d50 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc0680706a0 con 0x7fc06815cff0 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc06d400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc0680b9230 con 0x7fc068147480 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc067e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc04c004d50 0x7fc06814ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc067e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc04c004d50 0x7fc06814ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59484/0 (socket says 172.21.15.89:59484) 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.862+0000 7fc067e00640 1 -- 172.21.15.89:0/1456239273 learned_addr learned my addr 172.21.15.89:0/1456239273 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc05fe00640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815cff0 0x7fc0680ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc06ca00640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068147480 0x7fc068147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc067e00640 1 -- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068147480 msgr2=0x7fc068147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc067e00640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068147480 0x7fc068147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc067e00640 1 -- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815cff0 msgr2=0x7fc0680ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc067e00640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815cff0 0x7fc0680ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc067e00640 1 -- 172.21.15.89:0/1456239273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc068147dd0 con 0x7fc04c004d50 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc05fe00640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815cff0 0x7fc0680ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc067e00640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc04c004d50 0x7fc06814ad50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc058011ae0 tx=0x7fc058009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc064c00640 1 -- 172.21.15.89:0/1456239273 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05800fc70 con 0x7fc04c004d50 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc064c00640 1 -- 172.21.15.89:0/1456239273 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc05800fe10 con 0x7fc04c004d50 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06814cfa0 con 0x7fc04c004d50 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc064c00640 1 -- 172.21.15.89:0/1456239273 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058004280 con 0x7fc04c004d50 2024-08-31T04:14:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06815c510 con 0x7fc04c004d50 2024-08-31T04:14:06.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc068153850 con 0x7fc04c004d50 2024-08-31T04:14:06.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.866+0000 7fc064c00640 1 -- 172.21.15.89:0/1456239273 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc058003600 con 0x7fc04c004d50 2024-08-31T04:14:06.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.870+0000 7fc064c00640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0440720f0 0x7fc044074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.870+0000 7fc064c00640 1 -- 172.21.15.89:0/1456239273 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fc0580939f0 con 0x7fc04c004d50 2024-08-31T04:14:06.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.870+0000 7fc05fe00640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0440720f0 0x7fc044074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.870+0000 7fc05fe00640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0440720f0 0x7fc044074600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc050000fc0 tx=0x7fc050001440 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:06.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:06.874+0000 7fc064c00640 1 -- 172.21.15.89:0/1456239273 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc068147dd0 con 0x7fc04c004d50 2024-08-31T04:14:07.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0680c85e0 con 0x7fc04c004d50 2024-08-31T04:14:07.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc064c00640 1 -- 172.21.15.89:0/1456239273 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fc05805ef60 con 0x7fc04c004d50 2024-08-31T04:14:07.075 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:14:07.075 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:14:07.075 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0440720f0 msgr2=0x7fc044074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0440720f0 0x7fc044074600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc050000fc0 tx=0x7fc050001440 comp rx=0 tx=0).stop 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc04c004d50 msgr2=0x7fc06814ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc04c004d50 0x7fc06814ad50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc058011ae0 tx=0x7fc058009e90 comp rx=0 tx=0).stop 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 shutdown_connections 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc0440720f0 0x7fc044074600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068147480 0x7fc068147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815cff0 0x7fc0680ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 --2- 172.21.15.89:0/1456239273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc04c004d50 0x7fc06814ad50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 >> 172.21.15.89:0/1456239273 conn(0x7fc068071f20 msgr2=0x7fc068157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:07.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 shutdown_connections 2024-08-31T04:14:07.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.074+0000 7fc06d400640 1 -- 172.21.15.89:0/1456239273 wait complete. 2024-08-31T04:14:07.097 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 54360cbf --release --await' 2024-08-31T04:14:07.097 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 54360cbf --release --await 2024-08-31T04:14:07.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.254+0000 7f21ac800640 1 -- 172.21.15.89:0/1389258186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 msgr2=0x7f21a41538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.254+0000 7f21ac800640 1 --2- 172.21.15.89:0/1389258186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 0x7f21a41538e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2198009840 tx=0x7f219801c7f0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 -- 172.21.15.89:0/1389258186 shutdown_connections 2024-08-31T04:14:07.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 --2- 172.21.15.89:0/1389258186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 0x7f21a41538e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 -- 172.21.15.89:0/1389258186 >> 172.21.15.89:0/1389258186 conn(0x7f21a4073630 msgr2=0x7f21a4073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:07.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 -- 172.21.15.89:0/1389258186 shutdown_connections 2024-08-31T04:14:07.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 -- 172.21.15.89:0/1389258186 wait complete. 2024-08-31T04:14:07.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 Processor -- start 2024-08-31T04:14:07.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 -- start start 2024-08-31T04:14:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21a40c4790 0x7f21a4149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 0x7f21a40ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21a415ced0 0x7f21a4141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f21a4153fa0 con 0x7f21a40c4ce0 2024-08-31T04:14:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f21a4153e20 con 0x7f21a415ced0 2024-08-31T04:14:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.258+0000 7f21ac800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f21a40cab70 con 0x7f21a40c4790 2024-08-31T04:14:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 0x7f21a40ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 0x7f21a40ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59498/0 (socket says 172.21.15.89:59498) 2024-08-31T04:14:07.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9400640 1 -- 172.21.15.89:0/2099812590 learned_addr learned my addr 172.21.15.89:0/2099812590 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9e00640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21a40c4790 0x7f21a4149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21aa800640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21a415ced0 0x7f21a4141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9400640 1 -- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21a40c4790 msgr2=0x7f21a4149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9400640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21a40c4790 0x7f21a4149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9400640 1 -- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21a415ced0 msgr2=0x7f21a4141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9400640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21a415ced0 0x7f21a4141a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9400640 1 -- 172.21.15.89:0/2099812590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a40ccee0 con 0x7f21a40c4ce0 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21aa800640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21a415ced0 0x7f21a4141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21a9400640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 0x7f21a40ce600 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f219400c490 tx=0x7f219400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f219e000640 1 -- 172.21.15.89:0/2099812590 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21940052d0 con 0x7f21a40c4ce0 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21ac800640 1 -- 172.21.15.89:0/2099812590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a406f920 con 0x7f21a40c4ce0 2024-08-31T04:14:07.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f219e000640 1 -- 172.21.15.89:0/2099812590 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2194005470 con 0x7f21a40c4ce0 2024-08-31T04:14:07.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f219e000640 1 -- 172.21.15.89:0/2099812590 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194012890 con 0x7f21a40c4ce0 2024-08-31T04:14:07.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.262+0000 7f21ac800640 1 -- 172.21.15.89:0/2099812590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a40b4050 con 0x7f21a40c4ce0 2024-08-31T04:14:07.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f219e000640 1 -- 172.21.15.89:0/2099812590 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2194012a30 con 0x7f21a40c4ce0 2024-08-31T04:14:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f219e000640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21880720c0 0x7f21880745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21b3fe9000 1 Processor -- start 2024-08-31T04:14:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f219e000640 1 -- 172.21.15.89:0/2099812590 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2194092a00 con 0x7f21a40c4ce0 2024-08-31T04:14:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21b3fe9000 1 -- start start 2024-08-31T04:14:07.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9e00640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21880720c0 0x7f21880745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b575f950 0x5600b587de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b5882ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b573a890 0x5600b5883010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5600b5728f30 con 0x5600b5749930 2024-08-31T04:14:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5600b569e690 con 0x5600b575f950 2024-08-31T04:14:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5600b568dc20 con 0x5600b573a890 2024-08-31T04:14:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9e00640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21880720c0 0x7f21880745d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21980af000 tx=0x7f219801b030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b5882ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b5882ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59508/0 (socket says 172.21.15.89:59508) 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9400640 1 -- 172.21.15.89:0/2466931847 learned_addr learned my addr 172.21.15.89:0/2466931847 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21aa800640 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b573a890 0x5600b5883010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9e00640 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b575f950 0x5600b587de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9400640 1 -- 172.21.15.89:0/2466931847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b573a890 msgr2=0x5600b5883010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9400640 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b573a890 0x5600b5883010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9400640 1 -- 172.21.15.89:0/2466931847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b575f950 msgr2=0x5600b587de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9400640 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b575f950 0x5600b587de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9400640 1 -- 172.21.15.89:0/2466931847 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b56428f0 con 0x5600b5749930 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21aa800640 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b573a890 0x5600b5883010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.266+0000 7f21a9400640 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b5882ad0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f219405d810 tx=0x7f21940011f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4c19edcb471515 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f2192600640 1 -- 172.21.15.89:0/2466931847 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219405d880 con 0x5600b5749930 2024-08-31T04:14:07.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f2192600640 1 -- 172.21.15.89:0/2466931847 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2194062060 con 0x5600b5749930 2024-08-31T04:14:07.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f2192600640 1 -- 172.21.15.89:0/2466931847 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219405edb0 con 0x5600b5749930 2024-08-31T04:14:07.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 -- 172.21.15.89:0/2466931847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 msgr2=0x5600b5882ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b5882ad0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f219405d810 tx=0x7f21940011f0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 -- 172.21.15.89:0/2466931847 shutdown_connections 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b5882ad0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b573a890 0x5600b5883010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/2466931847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b575f950 0x5600b587de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 -- 172.21.15.89:0/2466931847 >> 172.21.15.89:0/2466931847 conn(0x5600b575f540 msgr2=0x5600b5880890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 -- 172.21.15.89:0/2466931847 shutdown_connections 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 -- 172.21.15.89:0/2466931847 wait complete. 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 -- start start 2024-08-31T04:14:07.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 Processor -- start 2024-08-31T04:14:07.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b587c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 0x5600b587cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b587d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5600b5614500 con 0x5600b573a890 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5600b5691bd0 con 0x5600b5749930 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5600b5635a30 con 0x5600b575f950 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.270+0000 7f21b3fe9000 10 client.0 _ll_register_callbacks cb 0x5600b5743b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b587c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b587c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59524/0 (socket says 172.21.15.89:59524) 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9e00640 1 -- 172.21.15.89:0/1185392691 learned_addr learned my addr 172.21.15.89:0/1185392691 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9400640 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 0x5600b587cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21aa800640 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b587d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9e00640 1 -- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 msgr2=0x5600b587d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9e00640 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b587d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9e00640 1 -- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 msgr2=0x5600b587cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9e00640 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 0x5600b587cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9e00640 1 -- 172.21.15.89:0/1185392691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b562d6a0 con 0x5600b573a890 2024-08-31T04:14:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9e00640 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b587c650 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2198019400 tx=0x7f219801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c002cce8efad8a26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f2186a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:14:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f2186a00640 1 -- 172.21.15.89:0/1185392691 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21980bf040 con 0x5600b573a890 2024-08-31T04:14:07.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f2186a00640 1 -- 172.21.15.89:0/1185392691 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f21980046d0 con 0x5600b573a890 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1185392691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5600b56277e0 con 0x5600b573a890 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f2186a00640 1 -- 172.21.15.89:0/1185392691 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f21980b2040 con 0x5600b573a890 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21b3fe9000 10 client.5211 fetch_fsmap learned FSMap version 9 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1185392691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5600b564c1c0 con 0x5600b573a890 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f2186a00640 1 -- 172.21.15.89:0/1185392691 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5600b56277e0 con 0x5600b573a890 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f2186a00640 1 -- 172.21.15.89:0/1185392691 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f21980048d0 con 0x5600b573a890 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21b3fe9000 10 client.5211 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21b3fe9000 10 client.5211 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21b3fe9000 20 client.5211 populate_metadata read hostname 'smithi089' 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600b5723fc0 0x5600b5898010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21b3fe9000 4 client.5211 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:14:07.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1185392691 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600b56a05e0 con 0x5600b5723fc0 2024-08-31T04:14:07.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9400640 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600b5723fc0 0x5600b5898010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f21a9400640 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600b5723fc0 0x5600b5898010 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9602f8b66223adac server_cookie=7649c142ef38e7f2 in_seq=0 out_seq=0 2024-08-31T04:14:07.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.274+0000 7f2186a00640 10 client.5211 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:14:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f2186a00640 1 -- 172.21.15.89:0/1185392691 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600b56a05e0 con 0x5600b5723fc0 2024-08-31T04:14:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f2186a00640 10 client.5211 handle_command_reply: tid=0 2024-08-31T04:14:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 client.5211 shutdown 2024-08-31T04:14:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1185392691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 msgr2=0x5600b587c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b587c650 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2198019400 tx=0x7f219801c7f0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1185392691 shutdown_connections 2024-08-31T04:14:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600b5723fc0 0x5600b5898010 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b587d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 0x5600b587cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f2186a00640 0 client.5211 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:14:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1185392691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b587c650 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1185392691 >> 172.21.15.89:0/1185392691 conn(0x5600b575f540 msgr2=0x5600b587e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1185392691 shutdown_connections 2024-08-31T04:14:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1185392691 wait complete. 2024-08-31T04:14:07.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.278+0000 7f21b3fe9000 20 client.5211 trim_cache size 0 max 16384 2024-08-31T04:14:07.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.294+0000 7f21b3fe9000 1 Processor -- start 2024-08-31T04:14:07.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 -- start start 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b573a890 0x5600b583dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b583e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b589b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f21a4203ab0 con 0x5600b5749930 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f21a4202990 con 0x5600b573a890 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f21a406e700 con 0x5600b575f950 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b583e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b583e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59530/0 (socket says 172.21.15.89:59530) 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9400640 1 -- 172.21.15.89:0/1357677726 learned_addr learned my addr 172.21.15.89:0/1357677726 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21aa800640 1 --2- 172.21.15.89:0/1357677726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b589b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9e00640 1 --2- 172.21.15.89:0/1357677726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b573a890 0x5600b583dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9400640 1 -- 172.21.15.89:0/1357677726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 msgr2=0x5600b589b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:07.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9400640 1 --2- 172.21.15.89:0/1357677726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b589b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9400640 1 -- 172.21.15.89:0/1357677726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b573a890 msgr2=0x5600b583dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:07.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9400640 1 --2- 172.21.15.89:0/1357677726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b573a890 0x5600b583dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9400640 1 -- 172.21.15.89:0/1357677726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b583fda0 con 0x5600b5749930 2024-08-31T04:14:07.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21a9400640 1 --2- 172.21.15.89:0/1357677726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b583e2d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f219405d810 tx=0x7f2194092040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8755643fd0fdcf37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:07.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f2191c00640 1 -- 172.21.15.89:0/1357677726 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219407b070 con 0x5600b5749930 2024-08-31T04:14:07.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f2191c00640 1 -- 172.21.15.89:0/1357677726 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f219405d880 con 0x5600b5749930 2024-08-31T04:14:07.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f2191c00640 1 -- 172.21.15.89:0/1357677726 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194062060 con 0x5600b5749930 2024-08-31T04:14:07.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1357677726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 msgr2=0x5600b583e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1357677726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b583e2d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f219405d810 tx=0x7f2194092040 comp rx=0 tx=0).stop 2024-08-31T04:14:07.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1357677726 shutdown_connections 2024-08-31T04:14:07.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1357677726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b5749930 0x5600b583e2d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1357677726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b589b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/1357677726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b573a890 0x5600b583dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1357677726 >> 172.21.15.89:0/1357677726 conn(0x5600b575f540 msgr2=0x5600b583d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:07.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1357677726 shutdown_connections 2024-08-31T04:14:07.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.298+0000 7f21b3fe9000 1 -- 172.21.15.89:0/1357677726 wait complete. 2024-08-31T04:14:07.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 -- start start 2024-08-31T04:14:07.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 Processor -- start 2024-08-31T04:14:07.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b58f9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 0x5600b58f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b58fa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f21a4201590 con 0x5600b573a890 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f21a42022c0 con 0x5600b5749930 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f21a4201c30 con 0x5600b575f950 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 10 client.0 _ll_register_callbacks cb 0x7f21980096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b58f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b58f9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59542/0 (socket says 172.21.15.89:59542) 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9e00640 1 -- 172.21.15.89:0/75584606 learned_addr learned my addr 172.21.15.89:0/75584606 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21aa800640 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b58fa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9400640 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 0x5600b58f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9e00640 1 -- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 msgr2=0x5600b58fa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9e00640 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b58fa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9e00640 1 -- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 msgr2=0x5600b58f9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:07.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9e00640 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 0x5600b58f9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9e00640 1 -- 172.21.15.89:0/75584606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b57122f0 con 0x5600b573a890 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21a9e00640 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b58f9910 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f21980983f0 tx=0x7f21980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c8a2cdcb5249d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f2186a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f2186a00640 1 -- 172.21.15.89:0/75584606 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21980dd060 con 0x5600b573a890 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f2186a00640 1 -- 172.21.15.89:0/75584606 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f21980046d0 con 0x5600b573a890 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 -- 172.21.15.89:0/75584606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f219405d880 con 0x5600b573a890 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f2186a00640 1 -- 172.21.15.89:0/75584606 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f21980e3050 con 0x5600b573a890 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 10 client.5217 fetch_fsmap learned FSMap version 9 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f21b3fe9000 1 -- 172.21.15.89:0/75584606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5600b5617b30 con 0x5600b573a890 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.302+0000 7f2186a00640 1 -- 172.21.15.89:0/75584606 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f219405d880 con 0x5600b573a890 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f2186a00640 1 -- 172.21.15.89:0/75584606 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f21980e6020 con 0x5600b573a890 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f21b3fe9000 10 client.5217 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:14:07.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f21b3fe9000 10 client.5217 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:14:07.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f21b3fe9000 20 client.5217 populate_metadata read hostname 'smithi089' 2024-08-31T04:14:07.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600b531fe80 0x5600b589a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:07.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f21b3fe9000 4 client.5217 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "54360cbf", "release": true, "await": true}] 2024-08-31T04:14:07.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f21b3fe9000 1 -- 172.21.15.89:0/75584606 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "54360cbf", "release": true, "await": true}) -- 0x5600b569c080 con 0x5600b531fe80 2024-08-31T04:14:07.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f21a9400640 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600b531fe80 0x5600b589a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:07.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f21a9400640 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600b531fe80 0x5600b589a810 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48e63ed0e4b46cca server_cookie=246f140b5f5e14d9 in_seq=0 out_seq=0 2024-08-31T04:14:07.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.306+0000 7f2186a00640 10 client.5217 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:14:07.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f2186a00640 1 -- 172.21.15.89:0/75584606 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5600b569c080 con 0x5600b531fe80 2024-08-31T04:14:07.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f2186a00640 10 client.5217 handle_command_reply: tid=0 2024-08-31T04:14:07.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 client.5217 shutdown 2024-08-31T04:14:07.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 -- 172.21.15.89:0/75584606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 msgr2=0x5600b58f9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b58f9910 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f21980983f0 tx=0x7f21980040c0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 -- 172.21.15.89:0/75584606 shutdown_connections 2024-08-31T04:14:07.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5600b531fe80 0x5600b589a810 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b575f950 0x5600b58fa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b5749930 0x5600b58f9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 --2- 172.21.15.89:0/75584606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5600b573a890 0x5600b58f9910 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 -- 172.21.15.89:0/75584606 >> 172.21.15.89:0/75584606 conn(0x5600b575f540 msgr2=0x5600b583e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:07.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f2186a00640 0 client.5217 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:14:07.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 -- 172.21.15.89:0/75584606 shutdown_connections 2024-08-31T04:14:07.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 1 -- 172.21.15.89:0/75584606 wait complete. 2024-08-31T04:14:07.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21b3fe9000 20 client.5217 trim_cache size 0 max 16384 2024-08-31T04:14:07.957 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:14:07.957 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 32, 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "54360cbf": { 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 32, 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 135.5, 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:14:07.958 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:14:07.959 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:14:07.959 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:14:07.959 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:14:07.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:07.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:07.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:07.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:07.959 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:07.959 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:14:07.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 -- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21880720c0 msgr2=0x7f21880745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21880720c0 0x7f21880745d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21980af000 tx=0x7f219801b030 comp rx=0 tx=0).stop 2024-08-31T04:14:07.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 -- 172.21.15.89:0/2099812590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 msgr2=0x7f21a40ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:07.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 0x7f21a40ce600 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f219400c490 tx=0x7f219400c950 comp rx=0 tx=0).stop 2024-08-31T04:14:07.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 -- 172.21.15.89:0/2099812590 shutdown_connections 2024-08-31T04:14:07.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f21880720c0 0x7f21880745d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a40c4ce0 0x7f21a40ce600 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21a415ced0 0x7f21a4141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 --2- 172.21.15.89:0/2099812590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21a40c4790 0x7f21a4149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:07.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 -- 172.21.15.89:0/2099812590 >> 172.21.15.89:0/2099812590 conn(0x7f21a4073630 msgr2=0x7f21a41598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:07.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 -- 172.21.15.89:0/2099812590 shutdown_connections 2024-08-31T04:14:07.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:07.954+0000 7f21ac800640 1 -- 172.21.15.89:0/2099812590 wait complete. 2024-08-31T04:14:07.977 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '54360cbf', total seconds elapsed: 16.8 2024-08-31T04:14:32.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:14:32.035 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:14:33.063 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 2% (258/12888) Updating files: 2% (371/12888) Updating files: 3% (387/12888) Updating files: 4% (516/12888) Updating files: 4% (543/12888) Updating files: 5% (645/12888) Updating files: 5% (724/12888) Updating files: 6% (774/12888) Updating files: 6% (814/12888) Updating files: 6% (823/12888) Updating files: 7% (903/12888) Updating files: 7% (960/12888) Updating files: 8% (1032/12888) Updating files: 8% (1053/12888) Updating files: 9% (1160/12888) Updating files: 9% (1203/12888) Updating files: 9% (1243/12888) Updating files: 10% (1289/12888) Updating files: 10% (1369/12888) Updating files: 11% (1418/12888) Updating files: 12% (1547/12888) Updating files: 12% (1566/12888) Updating files: 13% (1676/12888) Updating files: 13% (1728/12888) Updating files: 14% (1805/12888) Updating files: 14% (1811/12888) Updating files: 14% (1876/12888) Updating files: 14% (1915/12888) Updating files: 15% (1934/12888) Updating files: 15% (2053/12888) Updating files: 16% (2063/12888) Updating files: 16% (2113/12888) Updating files: 17% (2191/12888) Updating files: 18% (2320/12888) Updating files: 18% (2339/12888) Updating files: 18% (2407/12888) Updating files: 18% (2427/12888) Updating files: 19% (2449/12888) Updating files: 19% (2566/12888) Updating files: 20% (2578/12888) Updating files: 20% (2661/12888) Updating files: 21% (2707/12888) Updating files: 21% (2767/12888) Updating files: 21% (2780/12888) Updating files: 22% (2836/12888) Updating files: 22% (2876/12888) Updating files: 22% (2964/12888) Updating files: 23% (2965/12888) Updating files: 23% (3004/12888) Updating files: 23% (3081/12888) Updating files: 24% (3094/12888) Updating files: 24% (3107/12888) Updating files: 24% (3130/12888) Updating files: 25% (3222/12888) Updating files: 26% (3351/12888) Updating files: 26% (3406/12888) Updating files: 26% (3409/12888) Updating files: 26% (3431/12888) Updating files: 27% (3480/12888) Updating files: 27% (3503/12888) Updating files: 27% (3549/12888) Updating files: 28% (3609/12888) Updating files: 29% (3738/12888) Updating files: 29% (3790/12888) Updating files: 30% (3867/12888) Updating files: 30% (3893/12888) Updating files: 31% (3996/12888) Updating files: 31% (4077/12888) Updating files: 32% (4125/12888) Updating files: 32% (4159/12888) Updating files: 32% (4176/12888) Updating files: 33% (4254/12888) Updating files: 33% (4323/12888) Updating files: 34% (4382/12888) Updating files: 34% (4484/12888) Updating files: 35% (4511/12888) Updating files: 35% (4563/12888) Updating files: 36% (4640/12888) Updating files: 36% (4657/12888) Updating files: 36% (4715/12888) Updating files: 37% (4769/12888) Updating files: 37% (4864/12888) Updating files: 38% (4898/12888) Updating files: 39% (5027/12888) Updating files: 39% (5097/12888) Updating files: 40% (5156/12888) Updating files: 40% (5213/12888) Updating files: 41% (5285/12888) Updating files: 41% (5357/12888) Updating files: 42% (5413/12888) Updating files: 42% (5506/12888) Updating files: 42% (5520/12888) Updating files: 43% (5542/12888) Updating files: 43% (5630/12888) Updating files: 43% (5643/12888) Updating files: 44% (5671/12888) Updating files: 45% (5800/12888) Updating files: 45% (5801/12888) Updating files: 45% (5919/12888) Updating files: 46% (5929/12888) Updating files: 46% (6050/12888) Updating files: 47% (6058/12888) Updating files: 47% (6094/12888) Updating files: 48% (6187/12888) Updating files: 49% (6316/12888) Updating files: 49% (6353/12888) Updating files: 50% (6444/12888) Updating files: 50% (6532/12888) Updating files: 51% (6573/12888) Updating files: 51% (6602/12888) Updating files: 51% (6691/12888) Updating files: 52% (6702/12888) Updating files: 52% (6751/12888) Updating files: 53% (6831/12888) Updating files: 53% (6904/12888) Updating files: 53% (6946/12888) Updating files: 54% (6960/12888) Updating files: 54% (6990/12888) Updating files: 55% (7089/12888) Updating files: 55% (7106/12888) Updating files: 56% (7218/12888) Updating files: 56% (7291/12888) Updating files: 56% (7312/12888) Updating files: 57% (7347/12888) Updating files: 57% (7432/12888) Updating files: 58% (7476/12888) Updating files: 59% (7604/12888) Updating files: 59% (7620/12888) Updating files: 59% (7621/12888) Updating files: 60% (7733/12888) Updating files: 60% (7801/12888) Updating files: 60% (7802/12888) Updating files: 61% (7862/12888) Updating files: 61% (7865/12888) Updating files: 61% (7974/12888) Updating files: 62% (7991/12888) Updating files: 62% (8055/12888) Updating files: 63% (8120/12888) Updating files: 63% (8134/12888) Updating files: 63% (8138/12888) Updating files: 63% (8166/12888) Updating files: 64% (8249/12888) Updating files: 64% (8352/12888) Updating files: 65% (8378/12888) Updating files: 66% (8507/12888) Updating files: 66% (8508/12888) Updating files: 66% (8633/12888) Updating files: 67% (8635/12888) Updating files: 68% (8764/12888) Updating files: 68% (8828/12888) Updating files: 68% (8883/12888) Updating files: 69% (8893/12888) Updating files: 69% (9013/12888) Updating files: 70% (9022/12888) Updating files: 70% (9115/12888) Updating files: 70% (9142/12888) Updating files: 71% (9151/12888) Updating files: 71% (9260/12888) Updating files: 72% (9280/12888) Updating files: 72% (9328/12888) Updating files: 72% (9386/12888) Updating files: 73% (9409/12888) Updating files: 73% (9416/12888) Updating files: 74% (9538/12888) Updating files: 74% (9555/12888) Updating files: 75% (9666/12888) Updating files: 75% (9759/12888) Updating files: 75% (9792/12888) Updating files: 76% (9795/12888) Updating files: 76% (9826/12888) Updating files: 77% (9924/12888) Updating files: 77% (9954/12888) Updating files: 78% (10053/12888) Updating files: 78% (10161/12888) Updating files: 79% (10182/12888) Updating files: 79% (10286/12888) Updating files: 79% (10303/12888) Updating files: 80% (10311/12888) Updating files: 80% (10395/12888) Updating files: 81% (10440/12888) Updating files: 81% (10544/12888) Updating files: 82% (10569/12888) Updating files: 82% (10635/12888) Updating files: 83% (10698/12888) Updating files: 84% (10826/12888) Updating files: 84% (10891/12888) Updating files: 84% (10927/12888) Updating files: 85% (10955/12888) Updating files: 85% (11010/12888) Updating files: 86% (11084/12888) Updating files: 86% (11173/12888) Updating files: 87% (11213/12888) Updating files: 87% (11230/12888) Updating files: 87% (11281/12888) Updating files: 88% (11342/12888) Updating files: 88% (11428/12888) Updating files: 89% (11471/12888) Updating files: 89% (11506/12888) Updating files: 90% (11600/12888) Updating files: 90% (11713/12888) Updating files: 91% (11729/12888) Updating files: 92% (11857/12888) Updating files: 93% (11986/12888) Updating files: 93% (12003/12888) Updating files: 94% (12115/12888) Updating files: 94% (12233/12888) Updating files: 95% (12244/12888) Updating files: 95% (12281/12888) Updating files: 95% (12344/12888) Updating files: 96% (12373/12888) Updating files: 96% (12398/12888) Updating files: 97% (12502/12888) Updating files: 97% (12509/12888) Updating files: 97% (12528/12888) Updating files: 98% (12631/12888) Updating files: 98% (12635/12888) Updating files: 99% (12760/12888) Updating files: 99% (12814/12888) Updating files: 100% (12888/12888) Updating files: 100% (12888/12888), done. 2024-08-31T04:14:34.645 INFO:tasks.workunit.client.0.smithi089.stderr:+ trap - EXIT 2024-08-31T04:14:34.645 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ceph 2024-08-31T04:14:34.645 INFO:tasks.workunit.client.0.smithi089.stderr:+ seq 1 90 2024-08-31T04:14:34.646 INFO:tasks.workunit.client.0.smithi089.stderr:+ versions=1 2024-08-31T04:14:34.646 INFO:tasks.workunit.client.0.smithi089.stderr:2 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:3 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:4 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:5 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:6 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:7 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:8 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:9 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:10 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:11 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:12 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:13 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:14 2024-08-31T04:14:34.647 INFO:tasks.workunit.client.0.smithi089.stderr:15 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:16 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:17 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:18 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:19 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:20 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:21 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:22 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:23 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:24 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:25 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:26 2024-08-31T04:14:34.648 INFO:tasks.workunit.client.0.smithi089.stderr:27 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:28 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:29 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:30 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:31 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:32 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:33 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:34 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:35 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:36 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:37 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:38 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:39 2024-08-31T04:14:34.649 INFO:tasks.workunit.client.0.smithi089.stderr:40 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:41 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:42 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:43 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:44 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:45 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:46 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:47 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:48 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:49 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:50 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:51 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:52 2024-08-31T04:14:34.650 INFO:tasks.workunit.client.0.smithi089.stderr:53 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:54 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:55 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:56 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:57 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:58 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:59 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:60 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:61 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:62 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:63 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:64 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:65 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:66 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:67 2024-08-31T04:14:34.651 INFO:tasks.workunit.client.0.smithi089.stderr:68 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:69 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:70 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:71 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:72 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:73 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:74 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:75 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:76 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:77 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:78 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:79 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:80 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:81 2024-08-31T04:14:34.652 INFO:tasks.workunit.client.0.smithi089.stderr:82 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:83 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:84 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:85 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:86 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:87 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:88 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:89 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:90 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 1 -eq 48 ] 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.1 2024-08-31T04:14:34.653 INFO:tasks.workunit.client.0.smithi089.stdout:v0.1 2024-08-31T04:14:34.654 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.1 2024-08-31T04:14:34.654 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.1 2024-08-31T04:14:36.764 INFO:tasks.quiescer.fs.[cephfs]:Total duration (50.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:14:36.764 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.25 2024-08-31T04:14:36.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:14:36.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.917+0000 7fd94ca00640 1 -- 172.21.15.89:0/1904741373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd92c004030 msgr2=0x7fd92c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:36.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.917+0000 7fd94ca00640 1 --2- 172.21.15.89:0/1904741373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd92c004030 0x7fd92c004810 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd94815def0 tx=0x7fd93401d1b0 comp rx=0 tx=0).stop 2024-08-31T04:14:36.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.917+0000 7fd946800640 1 -- 172.21.15.89:0/1904741373 reap_dead start 2024-08-31T04:14:36.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.917+0000 7fd94ca00640 1 -- 172.21.15.89:0/1904741373 shutdown_connections 2024-08-31T04:14:36.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.917+0000 7fd94ca00640 1 -- 172.21.15.89:0/1904741373 >> 172.21.15.89:0/1904741373 conn(0x7fd9480ccf20 msgr2=0x7fd9480cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:36.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.917+0000 7fd94ca00640 1 -- 172.21.15.89:0/1904741373 shutdown_connections 2024-08-31T04:14:36.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.917+0000 7fd94ca00640 1 -- 172.21.15.89:0/1904741373 wait complete. 2024-08-31T04:14:36.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.917+0000 7fd94ca00640 1 Processor -- start 2024-08-31T04:14:36.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.917+0000 7fd94ca00640 1 -- start start 2024-08-31T04:14:36.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd94ca00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd92c004030 0x7fd9480cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:36.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd94ca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9481507d0 0x7fd948150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:36.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd94ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9481f5120 0x7fd9481f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:36.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd94ca00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd948159c90 con 0x7fd92c004030 2024-08-31T04:14:36.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd94ca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd9481599b0 con 0x7fd9481f5120 2024-08-31T04:14:36.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd94ca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd948159f70 con 0x7fd9481507d0 2024-08-31T04:14:36.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd92c004030 0x7fd9480cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd92c004030 0x7fd9480cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40474/0 (socket says 172.21.15.89:40474) 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945e00640 1 -- 172.21.15.89:0/714391197 learned_addr learned my addr 172.21.15.89:0/714391197 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945400640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9481507d0 0x7fd948150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd946800640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9481f5120 0x7fd9481f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945e00640 1 -- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9481507d0 msgr2=0x7fd948150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945e00640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9481507d0 0x7fd948150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945e00640 1 -- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9481f5120 msgr2=0x7fd9481f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945e00640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9481f5120 0x7fd9481f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945e00640 1 -- 172.21.15.89:0/714391197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94815cc30 con 0x7fd92c004030 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd945e00640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd92c004030 0x7fd9480cbae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd938010cf0 tx=0x7fd93800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:36.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd93e000640 1 -- 172.21.15.89:0/714391197 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938011640 con 0x7fd92c004030 2024-08-31T04:14:36.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd93e000640 1 -- 172.21.15.89:0/714391197 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd938011800 con 0x7fd92c004030 2024-08-31T04:14:36.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9480cc020 con 0x7fd92c004030 2024-08-31T04:14:36.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd93e000640 1 -- 172.21.15.89:0/714391197 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938011c50 con 0x7fd92c004030 2024-08-31T04:14:36.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94815bc90 con 0x7fd92c004030 2024-08-31T04:14:36.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.921+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd948071e40 con 0x7fd92c004030 2024-08-31T04:14:36.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.925+0000 7fd93e000640 1 -- 172.21.15.89:0/714391197 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd9380243f0 con 0x7fd92c004030 2024-08-31T04:14:36.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.925+0000 7fd93e000640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9280720f0 0x7fd928074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:36.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.925+0000 7fd93e000640 1 -- 172.21.15.89:0/714391197 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fd938093fb0 con 0x7fd92c004030 2024-08-31T04:14:36.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.925+0000 7fd945400640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9280720f0 0x7fd928074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:36.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.925+0000 7fd945400640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9280720f0 0x7fd928074600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ad000 tx=0x7fd934019f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:36.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:36.929+0000 7fd93e000640 1 -- 172.21.15.89:0/714391197 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd94815cc30 con 0x7fd92c004030 2024-08-31T04:14:37.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd948074c00 con 0x7fd92c004030 2024-08-31T04:14:37.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd93e000640 1 -- 172.21.15.89:0/714391197 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fd93805f400 con 0x7fd92c004030 2024-08-31T04:14:37.139 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:14:37.139 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:14:37.139 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:14:37.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9280720f0 msgr2=0x7fd928074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:37.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9280720f0 0x7fd928074600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ad000 tx=0x7fd934019f50 comp rx=0 tx=0).stop 2024-08-31T04:14:37.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd92c004030 msgr2=0x7fd9480cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:37.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd92c004030 0x7fd9480cbae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd938010cf0 tx=0x7fd93800e720 comp rx=0 tx=0).stop 2024-08-31T04:14:37.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 shutdown_connections 2024-08-31T04:14:37.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9280720f0 0x7fd928074600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9481f5120 0x7fd9481f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9481507d0 0x7fd948150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 --2- 172.21.15.89:0/714391197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd92c004030 0x7fd9480cbae0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 >> 172.21.15.89:0/714391197 conn(0x7fd9480ccf20 msgr2=0x7fd9480c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:37.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 shutdown_connections 2024-08-31T04:14:37.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.137+0000 7fd94ca00640 1 -- 172.21.15.89:0/714391197 wait complete. 2024-08-31T04:14:37.162 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0' 2024-08-31T04:14:37.162 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0 2024-08-31T04:14:37.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.329+0000 7ff3f8000640 1 -- 172.21.15.89:0/3882967681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00b2860 msgr2=0x7ff3f00b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:37.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.329+0000 7ff3f8000640 1 --2- 172.21.15.89:0/3882967681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00b2860 0x7ff3f00b2d20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009900 tx=0x7ff3e401c820 comp rx=0 tx=0).stop 2024-08-31T04:14:37.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.329+0000 7ff3f8000640 1 -- 172.21.15.89:0/3882967681 shutdown_connections 2024-08-31T04:14:37.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.329+0000 7ff3f8000640 1 --2- 172.21.15.89:0/3882967681 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3f00c90e0 0x7ff3f00747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.329+0000 7ff3f8000640 1 --2- 172.21.15.89:0/3882967681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00b2860 0x7ff3f00b2d20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.329+0000 7ff3f8000640 1 -- 172.21.15.89:0/3882967681 >> 172.21.15.89:0/3882967681 conn(0x7ff3f00c99b0 msgr2=0x7ff3f00c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:37.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.329+0000 7ff3f8000640 1 -- 172.21.15.89:0/3882967681 shutdown_connections 2024-08-31T04:14:37.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.329+0000 7ff3f8000640 1 -- 172.21.15.89:0/3882967681 wait complete. 2024-08-31T04:14:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f8000640 1 Processor -- start 2024-08-31T04:14:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f8000640 1 -- start start 2024-08-31T04:14:37.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f8000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3f00b2860 0x7ff3f00c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f8000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3f00c1ed0 0x7ff3f014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f8000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00c90e0 0x7ff3f00c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f8000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f0158750 con 0x7ff3f00c90e0 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f8000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f01585d0 con 0x7ff3f00b2860 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f8000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f0165770 con 0x7ff3f00c1ed0 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00c90e0 0x7ff3f00c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f5600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3f00b2860 0x7ff3f00c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00c90e0 0x7ff3f00c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40500/0 (socket says 172.21.15.89:40500) 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f6000640 1 -- 172.21.15.89:0/1088060276 learned_addr learned my addr 172.21.15.89:0/1088060276 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3f00c1ed0 0x7ff3f014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f6000640 1 -- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3f00c1ed0 msgr2=0x7ff3f014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f6000640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3f00c1ed0 0x7ff3f014dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f6000640 1 -- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3f00b2860 msgr2=0x7ff3f00c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f6000640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3f00b2860 0x7ff3f00c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f6000640 1 -- 172.21.15.89:0/1088060276 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f014e320 con 0x7ff3f00c90e0 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3f6000640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00c90e0 0x7ff3f00c4f40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800dac0 tx=0x7ff3e800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.333+0000 7ff3ed600640 1 -- 172.21.15.89:0/1088060276 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8017070 con 0x7ff3f00c90e0 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.337+0000 7ff3ed600640 1 -- 172.21.15.89:0/1088060276 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3e8004b30 con 0x7ff3f00c90e0 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.337+0000 7ff3f8000640 1 -- 172.21.15.89:0/1088060276 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f00c5980 con 0x7ff3f00c90e0 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.337+0000 7ff3ed600640 1 -- 172.21.15.89:0/1088060276 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800be60 con 0x7ff3f00c90e0 2024-08-31T04:14:37.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.337+0000 7ff3f8000640 1 -- 172.21.15.89:0/1088060276 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f01f6270 con 0x7ff3f00c90e0 2024-08-31T04:14:37.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.337+0000 7ff3ed600640 1 -- 172.21.15.89:0/1088060276 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff3e8003980 con 0x7ff3f00c90e0 2024-08-31T04:14:37.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.337+0000 7ff3ed600640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff3d00720f0 0x7ff3d0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3ed600640 1 -- 172.21.15.89:0/1088060276 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff3e8093560 con 0x7ff3f00c90e0 2024-08-31T04:14:37.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f5600640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff3d00720f0 0x7ff3d0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3ff816000 1 Processor -- start 2024-08-31T04:14:37.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3ff816000 1 -- start start 2024-08-31T04:14:37.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f5600640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff3d00720f0 0x7ff3d0074600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40af000 tx=0x7ff3e401b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:37.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa177bab0 0x560aa1cae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b6a840 0x560aa1cb24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b54800 0x560aa1cb29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3ff816000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560aa1acd8c0 con 0x560aa1b6a840 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3ff816000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560aa1abce50 con 0x560aa1b54800 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3ff816000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560aa1ac0e00 con 0x560aa177bab0 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b6a840 0x560aa1cb24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b6a840 0x560aa1cb24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40514/0 (socket says 172.21.15.89:40514) 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f4c00640 1 -- 172.21.15.89:0/4249600271 learned_addr learned my addr 172.21.15.89:0/4249600271 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f6000640 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b54800 0x560aa1cb29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f5600640 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa177bab0 0x560aa1cae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f4c00640 1 -- 172.21.15.89:0/4249600271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa177bab0 msgr2=0x560aa1cae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa177bab0 0x560aa1cae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f4c00640 1 -- 172.21.15.89:0/4249600271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b54800 msgr2=0x560aa1cb29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:37.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b54800 0x560aa1cb29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f4c00640 1 -- 172.21.15.89:0/4249600271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa1a5c850 con 0x560aa1b6a840 2024-08-31T04:14:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f6000640 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b54800 0x560aa1cb29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:14:37.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b6a840 0x560aa1cb24b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc001780 tx=0x7ff3dc007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e15d54c1e779731 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:37.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3e1c00640 1 -- 172.21.15.89:0/4249600271 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0052e0 con 0x560aa1b6a840 2024-08-31T04:14:37.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3e1c00640 1 -- 172.21.15.89:0/4249600271 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3dc018070 con 0x560aa1b6a840 2024-08-31T04:14:37.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.341+0000 7ff3e1c00640 1 -- 172.21.15.89:0/4249600271 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00fa10 con 0x560aa1b6a840 2024-08-31T04:14:37.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 -- 172.21.15.89:0/4249600271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b6a840 msgr2=0x560aa1cb24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:37.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b6a840 0x560aa1cb24b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc001780 tx=0x7ff3dc007e40 comp rx=0 tx=0).stop 2024-08-31T04:14:37.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 -- 172.21.15.89:0/4249600271 shutdown_connections 2024-08-31T04:14:37.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b6a840 0x560aa1cb24b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b54800 0x560aa1cb29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 --2- 172.21.15.89:0/4249600271 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa177bab0 0x560aa1cae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 -- 172.21.15.89:0/4249600271 >> 172.21.15.89:0/4249600271 conn(0x560aa1c41290 msgr2=0x560aa1cb1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:37.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 -- 172.21.15.89:0/4249600271 shutdown_connections 2024-08-31T04:14:37.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 -- 172.21.15.89:0/4249600271 wait complete. 2024-08-31T04:14:37.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 -- start start 2024-08-31T04:14:37.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 Processor -- start 2024-08-31T04:14:37.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 0x560aa1cbd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cbd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 0x560aa1c73ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560aa1a626f0 con 0x560aa1b54800 2024-08-31T04:14:37.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560aa1acc690 con 0x560aa177bab0 2024-08-31T04:14:37.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560aa1a3edf0 con 0x560aa1b6a840 2024-08-31T04:14:37.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3ff816000 10 client.0 _ll_register_callbacks cb 0x560aa1c5da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:14:37.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cbd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cbd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40522/0 (socket says 172.21.15.89:40522) 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f4c00640 1 -- 172.21.15.89:0/1459898614 learned_addr learned my addr 172.21.15.89:0/1459898614 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f5600640 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 0x560aa1cbd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f6000640 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 0x560aa1c73ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f4c00640 1 -- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 msgr2=0x560aa1c73ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 0x560aa1c73ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f4c00640 1 -- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 msgr2=0x560aa1cbd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 0x560aa1cbd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f4c00640 1 -- 172.21.15.89:0/1459898614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa1a67340 con 0x560aa1b54800 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cbd580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x560aa1b60150 tx=0x7ff3dc006a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6cb39a81544995 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.345+0000 7ff3d6000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3d6000640 1 -- 172.21.15.89:0/1459898614 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc021020 con 0x560aa1b54800 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3ff816000 1 -- 172.21.15.89:0/1459898614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560aa1a56960 con 0x560aa1b54800 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3d6000640 1 -- 172.21.15.89:0/1459898614 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff3dc007240 con 0x560aa1b54800 2024-08-31T04:14:37.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3d6000640 1 -- 172.21.15.89:0/1459898614 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff3dc02b050 con 0x560aa1b54800 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3ff816000 10 client.5235 fetch_fsmap learned FSMap version 9 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3ff816000 1 -- 172.21.15.89:0/1459898614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560aa1a57bd0 con 0x560aa1b54800 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3d6000640 1 -- 172.21.15.89:0/1459898614 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560aa1a56960 con 0x560aa1b54800 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3d6000640 1 -- 172.21.15.89:0/1459898614 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff3dc02e020 con 0x560aa1b54800 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3ff816000 10 client.5235 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3ff816000 10 client.5235 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3ff816000 20 client.5235 populate_metadata read hostname 'smithi089' 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560aa1760e20 0x560aa1c744f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3ff816000 4 client.5235 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3ff816000 1 -- 172.21.15.89:0/1459898614 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560aa1acf810 con 0x560aa1760e20 2024-08-31T04:14:37.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3f5600640 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560aa1760e20 0x560aa1c744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3f5600640 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560aa1760e20 0x560aa1c744f0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e4a8c15473ddc37 server_cookie=240cf2310badbd71 in_seq=0 out_seq=0 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.349+0000 7ff3d6000640 10 client.5235 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3d6000640 1 -- 172.21.15.89:0/1459898614 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560aa1acf810 con 0x560aa1760e20 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3d6000640 10 client.5235 handle_command_reply: tid=0 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 client.5235 shutdown 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 -- 172.21.15.89:0/1459898614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 msgr2=0x560aa1cbd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cbd580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x560aa1b60150 tx=0x7ff3dc006a10 comp rx=0 tx=0).stop 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 -- 172.21.15.89:0/1459898614 shutdown_connections 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560aa1760e20 0x560aa1c744f0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cbd580 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 0x560aa1c73ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1459898614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 0x560aa1cbd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3d6000640 0 client.5235 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:14:37.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 -- 172.21.15.89:0/1459898614 >> 172.21.15.89:0/1459898614 conn(0x560aa1c41290 msgr2=0x560aa1cb03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:37.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 -- 172.21.15.89:0/1459898614 shutdown_connections 2024-08-31T04:14:37.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 1 -- 172.21.15.89:0/1459898614 wait complete. 2024-08-31T04:14:37.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.353+0000 7ff3ff816000 20 client.5235 trim_cache size 0 max 16384 2024-08-31T04:14:37.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.369+0000 7ff3ff816000 1 Processor -- start 2024-08-31T04:14:37.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.369+0000 7ff3ff816000 1 -- start start 2024-08-31T04:14:37.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa177bab0 0x560aa1c737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b54800 0x560aa1cc2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b6a840 0x560aa1cc33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f0202c10 con 0x560aa177bab0 2024-08-31T04:14:37.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f0201ee0 con 0x560aa1b6a840 2024-08-31T04:14:37.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f0202540 con 0x560aa1b54800 2024-08-31T04:14:37.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa177bab0 0x560aa1c737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa177bab0 0x560aa1c737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40532/0 (socket says 172.21.15.89:40532) 2024-08-31T04:14:37.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f5600640 1 -- 172.21.15.89:0/2201338107 learned_addr learned my addr 172.21.15.89:0/2201338107 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b54800 0x560aa1cc2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f6000640 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b6a840 0x560aa1cc33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f5600640 1 -- 172.21.15.89:0/2201338107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b54800 msgr2=0x560aa1cc2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f5600640 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b54800 0x560aa1cc2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f5600640 1 -- 172.21.15.89:0/2201338107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b6a840 msgr2=0x560aa1cc33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f5600640 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b6a840 0x560aa1cc33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f5600640 1 -- 172.21.15.89:0/2201338107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa1b41b30 con 0x560aa177bab0 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f6000640 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b6a840 0x560aa1cc33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3f5600640 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa177bab0 0x560aa1c737f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff3e401aed0 tx=0x7ff3e40b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948aae0de72d337 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3e1200640 1 -- 172.21.15.89:0/2201338107 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e40044b0 con 0x560aa177bab0 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3e1200640 1 -- 172.21.15.89:0/2201338107 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3e40b3040 con 0x560aa177bab0 2024-08-31T04:14:37.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3e1200640 1 -- 172.21.15.89:0/2201338107 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e40052a0 con 0x560aa177bab0 2024-08-31T04:14:37.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 -- 172.21.15.89:0/2201338107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa177bab0 msgr2=0x560aa1c737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:37.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa177bab0 0x560aa1c737f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff3e401aed0 tx=0x7ff3e40b5000 comp rx=0 tx=0).stop 2024-08-31T04:14:37.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 -- 172.21.15.89:0/2201338107 shutdown_connections 2024-08-31T04:14:37.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa1b6a840 0x560aa1cc33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b54800 0x560aa1cc2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 --2- 172.21.15.89:0/2201338107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa177bab0 0x560aa1c737f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 -- 172.21.15.89:0/2201338107 >> 172.21.15.89:0/2201338107 conn(0x560aa1c41290 msgr2=0x560aa1cace50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:37.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 -- 172.21.15.89:0/2201338107 shutdown_connections 2024-08-31T04:14:37.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 -- 172.21.15.89:0/2201338107 wait complete. 2024-08-31T04:14:37.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 -- start start 2024-08-31T04:14:37.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.373+0000 7ff3ff816000 1 Processor -- start 2024-08-31T04:14:37.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 0x560aa1cc1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cc1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 0x560aa1cc22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560aa1ac0110 con 0x560aa1b54800 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560aa1a64f60 con 0x560aa177bab0 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560aa1ac5430 con 0x560aa1b6a840 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 10 client.0 _ll_register_callbacks cb 0x7ff3e4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cc1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cc1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40546/0 (socket says 172.21.15.89:40546) 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f4c00640 1 -- 172.21.15.89:0/1240210986 learned_addr learned my addr 172.21.15.89:0/1240210986 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f6000640 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 0x560aa1cc22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f5600640 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 0x560aa1cc1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f4c00640 1 -- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 msgr2=0x560aa1cc22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 0x560aa1cc22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f4c00640 1 -- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 msgr2=0x560aa1cc1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:14:37.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 0x560aa1cc1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f4c00640 1 -- 172.21.15.89:0/1240210986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa1a46ea0 con 0x560aa1b54800 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f6000640 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 0x560aa1cc22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f5600640 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 0x560aa1cc1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f4c00640 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cc1d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00f620 tx=0x7ff3dc007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a70ce689e3d2b31 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3d6000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3d6000640 1 -- 172.21.15.89:0/1240210986 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc021040 con 0x560aa1b54800 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3d6000640 1 -- 172.21.15.89:0/1240210986 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff3dc00fc40 con 0x560aa1b54800 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 -- 172.21.15.89:0/1240210986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e40b3040 con 0x560aa1b54800 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3d6000640 1 -- 172.21.15.89:0/1240210986 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff3dc00fe40 con 0x560aa1b54800 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 10 client.5241 fetch_fsmap learned FSMap version 9 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 -- 172.21.15.89:0/1240210986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560aa1a62c10 con 0x560aa1b54800 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3d6000640 1 -- 172.21.15.89:0/1240210986 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3e40b3040 con 0x560aa1b54800 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3d6000640 1 -- 172.21.15.89:0/1240210986 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff3dc037050 con 0x560aa1b54800 2024-08-31T04:14:37.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 10 client.5241 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:14:37.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 10 client.5241 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:14:37.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 20 client.5241 populate_metadata read hostname 'smithi089' 2024-08-31T04:14:37.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560aa174ee80 0x560aa1cc2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:37.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 4 client.5241 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}] 2024-08-31T04:14:37.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3ff816000 1 -- 172.21.15.89:0/1240210986 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}) -- 0x560aa1acb2b0 con 0x560aa174ee80 2024-08-31T04:14:37.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.377+0000 7ff3f5600640 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560aa174ee80 0x560aa1cc2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:37.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.381+0000 7ff3f5600640 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560aa174ee80 0x560aa1cc2810 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af9eadb6f6c59d3b server_cookie=c67b9cac20eaa9cd in_seq=0 out_seq=0 2024-08-31T04:14:37.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:37.381+0000 7ff3d6000640 10 client.5241 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:14:49.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3d6000640 1 -- 172.21.15.89:0/1240210986 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560aa1acb2b0 con 0x560aa174ee80 2024-08-31T04:14:49.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3d6000640 10 client.5241 handle_command_reply: tid=0 2024-08-31T04:14:49.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 client.5241 shutdown 2024-08-31T04:14:49.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 -- 172.21.15.89:0/1240210986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 msgr2=0x560aa1cc1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:49.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cc1d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00f620 tx=0x7ff3dc007b70 comp rx=0 tx=0).stop 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 -- 172.21.15.89:0/1240210986 shutdown_connections 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560aa174ee80 0x560aa1cc2810 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560aa1b54800 0x560aa1cc1d90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560aa1b6a840 0x560aa1cc22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 --2- 172.21.15.89:0/1240210986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560aa177bab0 0x560aa1cc1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 -- 172.21.15.89:0/1240210986 >> 172.21.15.89:0/1240210986 conn(0x560aa1c41290 msgr2=0x560aa1cad980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3d6000640 0 client.5241 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 -- 172.21.15.89:0/1240210986 shutdown_connections 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 1 -- 172.21.15.89:0/1240210986 wait complete. 2024-08-31T04:14:49.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.433+0000 7ff3ff816000 20 client.5241 trim_cache size 0 max 16384 2024-08-31T04:14:49.435 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:14:49.435 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:14:49.435 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:14:49.435 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 34, 2024-08-31T04:14:49.435 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:14:49.435 INFO:teuthology.orchestra.run.smithi089.stdout: "467d83c5": { 2024-08-31T04:14:49.435 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 34, 2024-08-31T04:14:49.435 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 145.2, 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:14:49.436 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:14:49.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:49.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:49.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:49.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:49.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:14:49.437 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:14:49.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 -- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff3d00720f0 msgr2=0x7ff3d0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:49.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff3d00720f0 0x7ff3d0074600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40af000 tx=0x7ff3e401b060 comp rx=0 tx=0).stop 2024-08-31T04:14:49.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 -- 172.21.15.89:0/1088060276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00c90e0 msgr2=0x7ff3f00c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:49.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00c90e0 0x7ff3f00c4f40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800dac0 tx=0x7ff3e800df80 comp rx=0 tx=0).stop 2024-08-31T04:14:49.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 -- 172.21.15.89:0/1088060276 shutdown_connections 2024-08-31T04:14:49.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff3d00720f0 0x7ff3d0074600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:49.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3f00c90e0 0x7ff3f00c4f40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:49.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3f00c1ed0 0x7ff3f014dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:49.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 --2- 172.21.15.89:0/1088060276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3f00b2860 0x7ff3f00c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:49.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 -- 172.21.15.89:0/1088060276 >> 172.21.15.89:0/1088060276 conn(0x7ff3f00c99b0 msgr2=0x7ff3f0074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:49.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 -- 172.21.15.89:0/1088060276 shutdown_connections 2024-08-31T04:14:49.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:14:49.437+0000 7ff3f8000640 1 -- 172.21.15.89:0/1088060276 wait complete. 2024-08-31T04:14:49.456 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '467d83c5', quiesce took 12.7 seconds. Will release after: 12.55 2024-08-31T04:15:02.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:15:02.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:15:02.117 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:15:02.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.177+0000 7f65f6c00640 1 -- 172.21.15.89:0/2096226888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65d4003a40 msgr2=0x7f65d4003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.177+0000 7f65f6c00640 1 --2- 172.21.15.89:0/2096226888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65d4003a40 0x7f65d4003eb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c310 tx=0x7f65e001f6c0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.177+0000 7f65f4c00640 1 -- 172.21.15.89:0/2096226888 reap_dead start 2024-08-31T04:15:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.177+0000 7f65f6c00640 1 -- 172.21.15.89:0/2096226888 shutdown_connections 2024-08-31T04:15:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.177+0000 7f65f6c00640 1 -- 172.21.15.89:0/2096226888 >> 172.21.15.89:0/2096226888 conn(0x7f65f00ccf20 msgr2=0x7f65f00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.177+0000 7f65f6c00640 1 -- 172.21.15.89:0/2096226888 shutdown_connections 2024-08-31T04:15:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.177+0000 7f65f6c00640 1 -- 172.21.15.89:0/2096226888 wait complete. 2024-08-31T04:15:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 Processor -- start 2024-08-31T04:15:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 -- start start 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65d4003a40 0x7f65f00cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65f0152300 0x7f65f00c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f0155d40 0x7f65f0156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f65f01599b0 con 0x7f65f0155d40 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65f015a2e0 con 0x7f65d4003a40 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f65f0159c90 con 0x7f65f0152300 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f0155d40 0x7f65f0156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f0155d40 0x7f65f0156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36850/0 (socket says 172.21.15.89:36850) 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f4c00640 1 -- 172.21.15.89:0/3891013975 learned_addr learned my addr 172.21.15.89:0/3891013975 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65efe00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65d4003a40 0x7f65f00cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65e7400640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65f0152300 0x7f65f00c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f4c00640 1 -- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65f0152300 msgr2=0x7f65f00c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f4c00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65f0152300 0x7f65f00c37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f4c00640 1 -- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65d4003a40 msgr2=0x7f65f00cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f4c00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65d4003a40 0x7f65f00cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f4c00640 1 -- 172.21.15.89:0/3891013975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f00cbb20 con 0x7f65f0155d40 2024-08-31T04:15:02.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f4c00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f0155d40 0x7f65f0156150 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f65f00c4a00 tx=0x7f65e800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:02.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65ecc00640 1 -- 172.21.15.89:0/3891013975 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8017070 con 0x7f65f0155d40 2024-08-31T04:15:02.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65ecc00640 1 -- 172.21.15.89:0/3891013975 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65e8005e40 con 0x7f65f0155d40 2024-08-31T04:15:02.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f01f27f0 con 0x7f65f0155d40 2024-08-31T04:15:02.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65ecc00640 1 -- 172.21.15.89:0/3891013975 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e800a8a0 con 0x7f65f0155d40 2024-08-31T04:15:02.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.181+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f01f2a90 con 0x7f65f0155d40 2024-08-31T04:15:02.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.185+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f0157220 con 0x7f65f0155d40 2024-08-31T04:15:02.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.185+0000 7f65ecc00640 1 -- 172.21.15.89:0/3891013975 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f65e801a070 con 0x7f65f0155d40 2024-08-31T04:15:02.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.185+0000 7f65ecc00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65cc0720c0 0x7f65cc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.185+0000 7f65ecc00640 1 -- 172.21.15.89:0/3891013975 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f65e8092360 con 0x7f65f0155d40 2024-08-31T04:15:02.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.185+0000 7f65efe00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65cc0720c0 0x7f65cc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.185+0000 7f65efe00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65cc0720c0 0x7f65cc0745d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f65e00b0000 tx=0x7f65e001c500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:02.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.189+0000 7f65ecc00640 1 -- 172.21.15.89:0/3891013975 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f65e805d160 con 0x7f65f0155d40 2024-08-31T04:15:02.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.389+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65f0159630 con 0x7f65f0155d40 2024-08-31T04:15:02.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.389+0000 7f65ecc00640 1 -- 172.21.15.89:0/3891013975 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f65e8061920 con 0x7f65f0155d40 2024-08-31T04:15:02.388 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:15:02.388 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:15:02.388 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65cc0720c0 msgr2=0x7f65cc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65cc0720c0 0x7f65cc0745d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f65e00b0000 tx=0x7f65e001c500 comp rx=0 tx=0).stop 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f0155d40 msgr2=0x7f65f0156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f0155d40 0x7f65f0156150 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f65f00c4a00 tx=0x7f65e800cb90 comp rx=0 tx=0).stop 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 shutdown_connections 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65cc0720c0 0x7f65cc0745d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f0155d40 0x7f65f0156150 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65f0152300 0x7f65f00c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 --2- 172.21.15.89:0/3891013975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65d4003a40 0x7f65f00cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 >> 172.21.15.89:0/3891013975 conn(0x7f65f00ccf20 msgr2=0x7f65f0157490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:02.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 shutdown_connections 2024-08-31T04:15:02.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.393+0000 7f65f6c00640 1 -- 172.21.15.89:0/3891013975 wait complete. 2024-08-31T04:15:02.410 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 467d83c5 --release --await' 2024-08-31T04:15:02.410 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 467d83c5 --release --await 2024-08-31T04:15:02.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.617+0000 7f8911600640 1 -- 172.21.15.89:0/3950425893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88f0003a60 msgr2=0x7f88f0003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.617+0000 7f8911600640 1 --2- 172.21.15.89:0/3950425893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88f0003a60 0x7f88f0003ed0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009ec0 tx=0x7f88fc01d5d0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.617+0000 7f8911600640 1 -- 172.21.15.89:0/3950425893 shutdown_connections 2024-08-31T04:15:02.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.617+0000 7f8911600640 1 --2- 172.21.15.89:0/3950425893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88f0003a60 0x7f88f0003ed0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.617+0000 7f8911600640 1 -- 172.21.15.89:0/3950425893 >> 172.21.15.89:0/3950425893 conn(0x7f890c0c99b0 msgr2=0x7f890c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:02.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.617+0000 7f8911600640 1 -- 172.21.15.89:0/3950425893 shutdown_connections 2024-08-31T04:15:02.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.617+0000 7f8911600640 1 -- 172.21.15.89:0/3950425893 wait complete. 2024-08-31T04:15:02.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f8911600640 1 Processor -- start 2024-08-31T04:15:02.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f8911600640 1 -- start start 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f8911600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88f0003a60 0x7f890c1f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f8911600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f890c0af2e0 0x7f890c0b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f8911600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890c0cc840 0x7f890c0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f8911600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f890c158750 con 0x7f890c0cc840 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f8911600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1585d0 con 0x7f890c0af2e0 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f8911600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f890c152780 con 0x7f88f0003a60 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f890b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890c0cc840 0x7f890c0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f890b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890c0cc840 0x7f890c0c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36878/0 (socket says 172.21.15.89:36878) 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f890b400640 1 -- 172.21.15.89:0/1284585423 learned_addr learned my addr 172.21.15.89:0/1284585423 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f8902000640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f890c0af2e0 0x7f890c0b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f890aa00640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88f0003a60 0x7f890c1f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f890b400640 1 -- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88f0003a60 msgr2=0x7f890c1f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f890b400640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88f0003a60 0x7f890c1f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f890b400640 1 -- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f890c0af2e0 msgr2=0x7f890c0b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f890b400640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f890c0af2e0 0x7f890c0b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.621+0000 7f890b400640 1 -- 172.21.15.89:0/1284585423 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c1f57c0 con 0x7f890c0cc840 2024-08-31T04:15:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f890b400640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890c0cc840 0x7f890c0c5b70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f890c0c3c70 tx=0x7f890400e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f8903400640 1 -- 172.21.15.89:0/1284585423 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904010890 con 0x7f890c0cc840 2024-08-31T04:15:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f8903400640 1 -- 172.21.15.89:0/1284585423 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8904016070 con 0x7f890c0cc840 2024-08-31T04:15:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f8911600640 1 -- 172.21.15.89:0/1284585423 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890c159940 con 0x7f890c0cc840 2024-08-31T04:15:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f8903400640 1 -- 172.21.15.89:0/1284585423 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904010de0 con 0x7f890c0cc840 2024-08-31T04:15:02.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f8911600640 1 -- 172.21.15.89:0/1284585423 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f890c0b0cb0 con 0x7f890c0cc840 2024-08-31T04:15:02.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f8903400640 1 -- 172.21.15.89:0/1284585423 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f890401b460 con 0x7f890c0cc840 2024-08-31T04:15:02.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f8903400640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88e80720c0 0x7f88e80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f8903400640 1 -- 172.21.15.89:0/1284585423 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f89040931e0 con 0x7f890c0cc840 2024-08-31T04:15:02.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.625+0000 7f8918bd8000 1 Processor -- start 2024-08-31T04:15:02.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 -- start start 2024-08-31T04:15:02.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88e80720c0 0x7f88e80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88e80720c0 0x7f88e80745d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0ad000 tx=0x7f88fc01a370 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x56057726ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577138930 0x560577271ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 0x560577272010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560577117f30 con 0x56057714e950 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56057708d690 con 0x560577129890 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56057707cc20 con 0x560577138930 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x56057726ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x56057726ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36886/0 (socket says 172.21.15.89:36886) 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 -- 172.21.15.89:0/4153494193 learned_addr learned my addr 172.21.15.89:0/4153494193 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8902000640 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577138930 0x560577271ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890b400640 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 0x560577272010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 -- 172.21.15.89:0/4153494193 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577138930 msgr2=0x560577271ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577138930 0x560577271ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 -- 172.21.15.89:0/4153494193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 msgr2=0x560577272010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:02.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 0x560577272010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 -- 172.21.15.89:0/4153494193 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605770318f0 con 0x56057714e950 2024-08-31T04:15:02.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8902000640 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577138930 0x560577271ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:02.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f890aa00640 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x56057726ce30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f88fc098ff0 tx=0x7f88fc0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c600bee21de82eeb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f88fb000640 1 -- 172.21.15.89:0/4153494193 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc0b0040 con 0x56057714e950 2024-08-31T04:15:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f88fb000640 1 -- 172.21.15.89:0/4153494193 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88fc0b1040 con 0x56057714e950 2024-08-31T04:15:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f88fb000640 1 -- 172.21.15.89:0/4153494193 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc005370 con 0x56057714e950 2024-08-31T04:15:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 -- 172.21.15.89:0/4153494193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 msgr2=0x56057726ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x56057726ce30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f88fc098ff0 tx=0x7f88fc0b7000 comp rx=0 tx=0).stop 2024-08-31T04:15:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 -- 172.21.15.89:0/4153494193 shutdown_connections 2024-08-31T04:15:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 0x560577272010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577138930 0x560577271ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 --2- 172.21.15.89:0/4153494193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x56057726ce30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 -- 172.21.15.89:0/4153494193 >> 172.21.15.89:0/4153494193 conn(0x56057714e540 msgr2=0x56057726f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:02.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 -- 172.21.15.89:0/4153494193 shutdown_connections 2024-08-31T04:15:02.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.629+0000 7f8918bd8000 1 -- 172.21.15.89:0/4153494193 wait complete. 2024-08-31T04:15:02.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 1 -- start start 2024-08-31T04:15:02.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 1 Processor -- start 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 0x560577230210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577230750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56057714e950 0x560577230c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560577003500 con 0x560577138930 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560577080bd0 con 0x56057714e950 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560577024a30 con 0x560577129890 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 10 client.0 _ll_register_callbacks cb 0x560577132b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8902000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577230750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8902000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577230750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36902/0 (socket says 172.21.15.89:36902) 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8902000640 1 -- 172.21.15.89:0/2765575426 learned_addr learned my addr 172.21.15.89:0/2765575426 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:02.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f890aa00640 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 0x560577230210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f890b400640 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56057714e950 0x560577230c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8902000640 1 -- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 msgr2=0x560577230210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8902000640 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 0x560577230210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8902000640 1 -- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56057714e950 msgr2=0x560577230c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8902000640 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56057714e950 0x560577230c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8902000640 1 -- 172.21.15.89:0/2765575426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057701c6a0 con 0x560577138930 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f890b400640 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56057714e950 0x560577230c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8902000640 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577230750 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f890c15cc80 tx=0x7f88f4004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ff6a7fb9565d5f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f88ef400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f88ef400640 1 -- 172.21.15.89:0/2765575426 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4013e40 con 0x560577138930 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f8918bd8000 1 -- 172.21.15.89:0/2765575426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605770167e0 con 0x560577138930 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.633+0000 7f88ef400640 1 -- 172.21.15.89:0/2765575426 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f88f4011460 con 0x560577138930 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f88ef400640 1 -- 172.21.15.89:0/2765575426 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f88f4022050 con 0x560577138930 2024-08-31T04:15:02.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 10 client.5259 fetch_fsmap learned FSMap version 9 2024-08-31T04:15:02.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 -- 172.21.15.89:0/2765575426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56057703b1c0 con 0x560577138930 2024-08-31T04:15:02.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f88ef400640 1 -- 172.21.15.89:0/2765575426 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5605770167e0 con 0x560577138930 2024-08-31T04:15:02.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f88ef400640 1 -- 172.21.15.89:0/2765575426 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f88f4025020 con 0x560577138930 2024-08-31T04:15:02.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 10 client.5259 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:15:02.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 10 client.5259 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:15:02.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 20 client.5259 populate_metadata read hostname 'smithi089' 2024-08-31T04:15:02.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560577112fc0 0x560577286940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 4 client.5259 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:15:02.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 -- 172.21.15.89:0/2765575426 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56057708f5e0 con 0x560577112fc0 2024-08-31T04:15:02.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f890aa00640 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560577112fc0 0x560577286940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f890aa00640 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560577112fc0 0x560577286940 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbea9eace10732f4 server_cookie=48f444f215e722a in_seq=0 out_seq=0 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f88ef400640 10 client.5259 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f88ef400640 1 -- 172.21.15.89:0/2765575426 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56057708f5e0 con 0x560577112fc0 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f88ef400640 10 client.5259 handle_command_reply: tid=0 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 client.5259 shutdown 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 -- 172.21.15.89:0/2765575426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 msgr2=0x560577230750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577230750 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f890c15cc80 tx=0x7f88f4004d50 comp rx=0 tx=0).stop 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 -- 172.21.15.89:0/2765575426 shutdown_connections 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560577112fc0 0x560577286940 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577230750 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56057714e950 0x560577230c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 --2- 172.21.15.89:0/2765575426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 0x560577230210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f88ef400640 0 client.5259 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:02.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.637+0000 7f8918bd8000 1 -- 172.21.15.89:0/2765575426 >> 172.21.15.89:0/2765575426 conn(0x56057714e540 msgr2=0x56057726d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:02.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.641+0000 7f8918bd8000 1 -- 172.21.15.89:0/2765575426 shutdown_connections 2024-08-31T04:15:02.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.641+0000 7f8918bd8000 1 -- 172.21.15.89:0/2765575426 wait complete. 2024-08-31T04:15:02.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.641+0000 7f8918bd8000 20 client.5259 trim_cache size 0 max 16384 2024-08-31T04:15:02.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8918bd8000 1 Processor -- start 2024-08-31T04:15:02.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8918bd8000 1 -- start start 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 0x560577289970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577289eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56057714e950 0x560577286940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8918bd8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f890c204ac0 con 0x560577138930 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8918bd8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f890c2039a0 con 0x560577129890 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8918bd8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f890c201f40 con 0x56057714e950 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8902000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577289eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8902000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577289eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36916/0 (socket says 172.21.15.89:36916) 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8902000640 1 -- 172.21.15.89:0/3185397803 learned_addr learned my addr 172.21.15.89:0/3185397803 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f890aa00640 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 0x560577289970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f890b400640 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56057714e950 0x560577286940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8902000640 1 -- 172.21.15.89:0/3185397803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56057714e950 msgr2=0x560577286940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8902000640 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56057714e950 0x560577286940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8902000640 1 -- 172.21.15.89:0/3185397803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 msgr2=0x560577289970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8902000640 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 0x560577289970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f8902000640 1 -- 172.21.15.89:0/3185397803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605771012f0 con 0x560577138930 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.657+0000 7f890aa00640 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 0x560577289970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8902000640 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577289eb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f88f4004f00 tx=0x7f88f4000fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fe74089eee370a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f88fa600640 1 -- 172.21.15.89:0/3185397803 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40118c0 con 0x560577138930 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f88fa600640 1 -- 172.21.15.89:0/3185397803 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88f4011cb0 con 0x560577138930 2024-08-31T04:15:02.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f88fa600640 1 -- 172.21.15.89:0/3185397803 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40042a0 con 0x560577138930 2024-08-31T04:15:02.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 -- 172.21.15.89:0/3185397803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 msgr2=0x560577289eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:02.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577289eb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f88f4004f00 tx=0x7f88f4000fa0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 -- 172.21.15.89:0/3185397803 shutdown_connections 2024-08-31T04:15:02.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560577138930 0x560577289eb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56057714e950 0x560577286940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 --2- 172.21.15.89:0/3185397803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577129890 0x560577289970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 -- 172.21.15.89:0/3185397803 >> 172.21.15.89:0/3185397803 conn(0x56057714e540 msgr2=0x560577236e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:02.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 -- 172.21.15.89:0/3185397803 shutdown_connections 2024-08-31T04:15:02.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 -- 172.21.15.89:0/3185397803 wait complete. 2024-08-31T04:15:02.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 -- start start 2024-08-31T04:15:02.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.661+0000 7f8918bd8000 1 Processor -- start 2024-08-31T04:15:02.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 0x56057728a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577138930 0x560577289430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x560577289970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f890c202530 con 0x56057714e950 2024-08-31T04:15:02.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f890c2032d0 con 0x560577138930 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f890c202c00 con 0x560577129890 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 10 client.0 _ll_register_callbacks cb 0x7f88f4006110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x560577289970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x560577289970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36930/0 (socket says 172.21.15.89:36930) 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890b400640 1 -- 172.21.15.89:0/1549482568 learned_addr learned my addr 172.21.15.89:0/1549482568 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890aa00640 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 0x56057728a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8902000640 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577138930 0x560577289430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890b400640 1 -- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 msgr2=0x56057728a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890b400640 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 0x56057728a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890b400640 1 -- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577138930 msgr2=0x560577289430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890b400640 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577138930 0x560577289430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890b400640 1 -- 172.21.15.89:0/1549482568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560577006b30 con 0x56057714e950 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890aa00640 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 0x56057728a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f88ef400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:15:02.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890b400640 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x560577289970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f890405a950 tx=0x7f890405e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ac44d0e9069837 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f88ef400640 1 -- 172.21.15.89:0/1549482568 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89040628c0 con 0x56057714e950 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f88ef400640 1 -- 172.21.15.89:0/1549482568 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8904065bb0 con 0x56057714e950 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 -- 172.21.15.89:0/1549482568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88f4011cb0 con 0x56057714e950 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f88ef400640 1 -- 172.21.15.89:0/1549482568 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f89040672e0 con 0x56057714e950 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 10 client.5265 fetch_fsmap learned FSMap version 9 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 -- 172.21.15.89:0/1549482568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560577013c70 con 0x56057714e950 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f88ef400640 1 -- 172.21.15.89:0/1549482568 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88f4011cb0 con 0x56057714e950 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f88ef400640 1 -- 172.21.15.89:0/1549482568 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8904087080 con 0x56057714e950 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 10 client.5265 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 10 client.5265 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 20 client.5265 populate_metadata read hostname 'smithi089' 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560576d0ee80 0x5605772ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 4 client.5265 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "467d83c5", "release": true, "await": true}] 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f8918bd8000 1 -- 172.21.15.89:0/1549482568 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "467d83c5", "release": true, "await": true}) -- 0x56057708b080 con 0x560576d0ee80 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890aa00640 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560576d0ee80 0x5605772ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:02.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f890aa00640 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560576d0ee80 0x5605772ace90 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b040e3b4276a831 server_cookie=479ccf9871905ba3 in_seq=0 out_seq=0 2024-08-31T04:15:02.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:02.665+0000 7f88ef400640 10 client.5265 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f88ef400640 1 -- 172.21.15.89:0/1549482568 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56057708b080 con 0x560576d0ee80 2024-08-31T04:15:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f88ef400640 10 client.5265 handle_command_reply: tid=0 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 client.5265 shutdown 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 -- 172.21.15.89:0/1549482568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 msgr2=0x560577289970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x560577289970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f890405a950 tx=0x7f890405e060 comp rx=0 tx=0).stop 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 -- 172.21.15.89:0/1549482568 shutdown_connections 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560576d0ee80 0x5605772ace90 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56057714e950 0x560577289970 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560577138930 0x560577289430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 --2- 172.21.15.89:0/1549482568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560577129890 0x56057728a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f88ef400640 0 client.5265 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 -- 172.21.15.89:0/1549482568 >> 172.21.15.89:0/1549482568 conn(0x56057714e540 msgr2=0x560577281720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.317+0000 7f8918bd8000 1 -- 172.21.15.89:0/1549482568 shutdown_connections 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8918bd8000 1 -- 172.21.15.89:0/1549482568 wait complete. 2024-08-31T04:15:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8918bd8000 20 client.5265 trim_cache size 0 max 16384 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 36, 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "467d83c5": { 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 36, 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:15:03.319 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 145.2, 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:03.320 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:15:03.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 -- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88e80720c0 msgr2=0x7f88e80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88e80720c0 0x7f88e80745d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0ad000 tx=0x7f88fc01a370 comp rx=0 tx=0).stop 2024-08-31T04:15:03.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 -- 172.21.15.89:0/1284585423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890c0cc840 msgr2=0x7f890c0c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890c0cc840 0x7f890c0c5b70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f890c0c3c70 tx=0x7f890400e9a0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 -- 172.21.15.89:0/1284585423 shutdown_connections 2024-08-31T04:15:03.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f88e80720c0 0x7f88e80745d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f890c0cc840 0x7f890c0c5b70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f890c0af2e0 0x7f890c0b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 --2- 172.21.15.89:0/1284585423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88f0003a60 0x7f890c1f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 -- 172.21.15.89:0/1284585423 >> 172.21.15.89:0/1284585423 conn(0x7f890c0c99b0 msgr2=0x7f890c074030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 -- 172.21.15.89:0/1284585423 shutdown_connections 2024-08-31T04:15:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.321+0000 7f8911600640 1 -- 172.21.15.89:0/1284585423 wait complete. 2024-08-31T04:15:03.341 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '467d83c5', total seconds elapsed: 26.6 2024-08-31T04:15:03.341 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.25 2024-08-31T04:15:03.341 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:15:03.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.500+0000 7fe4afe00640 1 -- 172.21.15.89:0/611548243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4a80c9330 msgr2=0x7fe4a8074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.500+0000 7fe4afe00640 1 --2- 172.21.15.89:0/611548243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4a80c9330 0x7fe4a8074720 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009bc0 tx=0x7fe4a001f3b0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.500+0000 7fe4afe00640 1 -- 172.21.15.89:0/611548243 shutdown_connections 2024-08-31T04:15:03.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.500+0000 7fe4afe00640 1 --2- 172.21.15.89:0/611548243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4a80c9330 0x7fe4a8074720 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.500+0000 7fe4afe00640 1 --2- 172.21.15.89:0/611548243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4a815bc70 0x7fe4a8152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.500+0000 7fe4afe00640 1 -- 172.21.15.89:0/611548243 >> 172.21.15.89:0/611548243 conn(0x7fe4a80ccf20 msgr2=0x7fe4a80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:03.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.500+0000 7fe4afe00640 1 -- 172.21.15.89:0/611548243 shutdown_connections 2024-08-31T04:15:03.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.500+0000 7fe4afe00640 1 -- 172.21.15.89:0/611548243 wait complete. 2024-08-31T04:15:03.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 Processor -- start 2024-08-31T04:15:03.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 -- start start 2024-08-31T04:15:03.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4a80c1f40 0x7fe4a80afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4a80c9330 0x7fe4a815b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4a815bc70 0x7fe4a8155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80c8030 con 0x7fe4a80c1f40 2024-08-31T04:15:03.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80c3150 con 0x7fe4a80c9330 2024-08-31T04:15:03.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a8074c60 con 0x7fe4a815bc70 2024-08-31T04:15:03.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4a80c1f40 0x7fe4a80afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4a80c1f40 0x7fe4a80afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36934/0 (socket says 172.21.15.89:36934) 2024-08-31T04:15:03.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ad400640 1 -- 172.21.15.89:0/4081473539 learned_addr learned my addr 172.21.15.89:0/4081473539 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:03.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ade00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4a815bc70 0x7fe4a8155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4aca00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4a80c9330 0x7fe4a815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ad400640 1 -- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4a815bc70 msgr2=0x7fe4a8155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ad400640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4a815bc70 0x7fe4a8155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ad400640 1 -- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4a80c9330 msgr2=0x7fe4a815b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ad400640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4a80c9330 0x7fe4a815b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ad400640 1 -- 172.21.15.89:0/4081473539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a80b02d0 con 0x7fe4a80c1f40 2024-08-31T04:15:03.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4ad400640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4a80c1f40 0x7fe4a80afd90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00e7a0 tx=0x7fe49c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:03.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4a5600640 1 -- 172.21.15.89:0/4081473539 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00ccc0 con 0x7fe4a80c1f40 2024-08-31T04:15:03.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4a5600640 1 -- 172.21.15.89:0/4081473539 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe49c010430 con 0x7fe4a80c1f40 2024-08-31T04:15:03.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4a5600640 1 -- 172.21.15.89:0/4081473539 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c010880 con 0x7fe4a80c1f40 2024-08-31T04:15:03.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a8155d90 con 0x7fe4a80c1f40 2024-08-31T04:15:03.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.504+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a81f30b0 con 0x7fe4a80c1f40 2024-08-31T04:15:03.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.508+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a8074720 con 0x7fe4a80c1f40 2024-08-31T04:15:03.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.508+0000 7fe4a5600640 1 -- 172.21.15.89:0/4081473539 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe49c01f020 con 0x7fe4a80c1f40 2024-08-31T04:15:03.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.508+0000 7fe4a5600640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4880720c0 0x7fe4880745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.508+0000 7fe4a5600640 1 -- 172.21.15.89:0/4081473539 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fe49c093700 con 0x7fe4a80c1f40 2024-08-31T04:15:03.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.508+0000 7fe4aca00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4880720c0 0x7fe4880745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.508+0000 7fe4aca00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4880720c0 0x7fe4880745d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80c6d20 tx=0x7fe494009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:03.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.512+0000 7fe4a5600640 1 -- 172.21.15.89:0/4081473539 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe49c05eb60 con 0x7fe4a80c1f40 2024-08-31T04:15:03.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4a81560a0 con 0x7fe4a80c1f40 2024-08-31T04:15:03.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4a5600640 1 -- 172.21.15.89:0/4081473539 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fe49c05e460 con 0x7fe4a80c1f40 2024-08-31T04:15:03.714 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:15:03.714 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:15:03.714 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:15:03.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4880720c0 msgr2=0x7fe4880745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4880720c0 0x7fe4880745d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80c6d20 tx=0x7fe494009040 comp rx=0 tx=0).stop 2024-08-31T04:15:03.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4a80c1f40 msgr2=0x7fe4a80afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4a80c1f40 0x7fe4a80afd90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00e7a0 tx=0x7fe49c00ec60 comp rx=0 tx=0).stop 2024-08-31T04:15:03.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 shutdown_connections 2024-08-31T04:15:03.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe4880720c0 0x7fe4880745d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4a815bc70 0x7fe4a8155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4a80c9330 0x7fe4a815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 --2- 172.21.15.89:0/4081473539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4a80c1f40 0x7fe4a80afd90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 >> 172.21.15.89:0/4081473539 conn(0x7fe4a80ccf20 msgr2=0x7fe4a80b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:03.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 shutdown_connections 2024-08-31T04:15:03.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.716+0000 7fe4afe00640 1 -- 172.21.15.89:0/4081473539 wait complete. 2024-08-31T04:15:03.737 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0' 2024-08-31T04:15:03.737 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 145.25 --await-for 45.0 2024-08-31T04:15:03.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.908+0000 7f9ef3200640 1 -- 172.21.15.89:0/3908978812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 msgr2=0x7f9eec0c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.908+0000 7f9ef3200640 1 --2- 172.21.15.89:0/3908978812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 0x7f9eec0c4e90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9eec074f70 tx=0x7f9edc01f0b0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 -- 172.21.15.89:0/3908978812 shutdown_connections 2024-08-31T04:15:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 --2- 172.21.15.89:0/3908978812 >> v2:172.21.15.170:3300/0 conn(0x7f9eec157fe0 0x7f9eec1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 --2- 172.21.15.89:0/3908978812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 0x7f9eec0c4e90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 -- 172.21.15.89:0/3908978812 >> 172.21.15.89:0/3908978812 conn(0x7f9eec0ca080 msgr2=0x7f9eec0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 -- 172.21.15.89:0/3908978812 shutdown_connections 2024-08-31T04:15:03.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 -- 172.21.15.89:0/3908978812 wait complete. 2024-08-31T04:15:03.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 Processor -- start 2024-08-31T04:15:03.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 -- start start 2024-08-31T04:15:03.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 0x7f9eec150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.912+0000 7f9ef3200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9eec151cd0 0x7f9eec14a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9eec157fe0 0x7f9eec0cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef3200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec158930 con 0x7f9eec0c4a80 2024-08-31T04:15:03.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec15be80 con 0x7f9eec157fe0 2024-08-31T04:15:03.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef3200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9eec06e490 con 0x7f9eec151cd0 2024-08-31T04:15:03.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 0x7f9eec150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 0x7f9eec150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36948/0 (socket says 172.21.15.89:36948) 2024-08-31T04:15:03.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1e00640 1 -- 172.21.15.89:0/3446997012 learned_addr learned my addr 172.21.15.89:0/3446997012 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:03.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1400640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9eec151cd0 0x7f9eec14a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef2800640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9eec157fe0 0x7f9eec0cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1e00640 1 -- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9eec151cd0 msgr2=0x7f9eec14a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9eec151cd0 0x7f9eec14a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1e00640 1 -- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9eec157fe0 msgr2=0x7f9eec0cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9eec157fe0 0x7f9eec0cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1e00640 1 -- 172.21.15.89:0/3446997012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec151160 con 0x7f9eec0c4a80 2024-08-31T04:15:03.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 0x7f9eec150c20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c3f0 tx=0x7f9ee000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:03.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ee6000640 1 -- 172.21.15.89:0/3446997012 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0017070 con 0x7f9eec0c4a80 2024-08-31T04:15:03.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ee6000640 1 -- 172.21.15.89:0/3446997012 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ee00053c0 con 0x7f9eec0c4a80 2024-08-31T04:15:03.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef3200640 1 -- 172.21.15.89:0/3446997012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eec1503e0 con 0x7f9eec0c4a80 2024-08-31T04:15:03.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ee6000640 1 -- 172.21.15.89:0/3446997012 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0003860 con 0x7f9eec0c4a80 2024-08-31T04:15:03.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ef3200640 1 -- 172.21.15.89:0/3446997012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eec0ccb00 con 0x7f9eec0c4a80 2024-08-31T04:15:03.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.916+0000 7f9ee6000640 1 -- 172.21.15.89:0/3446997012 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f9ee001a070 con 0x7f9eec0c4a80 2024-08-31T04:15:03.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9ee6000640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9ed00720f0 0x7f9ed0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9ee6000640 1 -- 172.21.15.89:0/3446997012 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f9ee0092260 con 0x7f9eec0c4a80 2024-08-31T04:15:03.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9ef1400640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9ed00720f0 0x7f9ed0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9efc07c000 1 Processor -- start 2024-08-31T04:15:03.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9efc07c000 1 -- start start 2024-08-31T04:15:03.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9ef1400640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9ed00720f0 0x7f9ed0074600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0b2000 tx=0x7f9edc0aa040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 0x5648b16c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1580840 0x5648b16c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9efc07c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5648b14e38c0 con 0x5648b156a800 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9efc07c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5648b14d2e50 con 0x5648b1580840 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.920+0000 7f9efc07c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5648b14d6e00 con 0x5648b1191ab0 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef2800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef2800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36950/0 (socket says 172.21.15.89:36950) 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef1e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 0x5648b16c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1580840 0x5648b16c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef2800640 1 -- 172.21.15.89:0/3972884096 learned_addr learned my addr 172.21.15.89:0/3972884096 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:03.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef2800640 1 -- 172.21.15.89:0/3972884096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 msgr2=0x5648b16c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:03.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef2800640 1 --2- 172.21.15.89:0/3972884096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 0x5648b16c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef2800640 1 -- 172.21.15.89:0/3972884096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1580840 msgr2=0x5648b16c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:03.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef2800640 1 --2- 172.21.15.89:0/3972884096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1580840 0x5648b16c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef2800640 1 -- 172.21.15.89:0/3972884096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b1472850 con 0x5648b156a800 2024-08-31T04:15:03.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9ef2800640 1 --2- 172.21.15.89:0/3972884096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c89f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800ae80 tx=0x7f9ee800e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77c90cda81dbce4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:03.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9eda600640 1 -- 172.21.15.89:0/3972884096 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8003d10 con 0x5648b156a800 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9eda600640 1 -- 172.21.15.89:0/3972884096 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ee8004050 con 0x5648b156a800 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9eda600640 1 -- 172.21.15.89:0/3972884096 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8004460 con 0x5648b156a800 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 -- 172.21.15.89:0/3972884096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 msgr2=0x5648b16c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 --2- 172.21.15.89:0/3972884096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c89f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800ae80 tx=0x7f9ee800e820 comp rx=0 tx=0).stop 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 -- 172.21.15.89:0/3972884096 shutdown_connections 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 --2- 172.21.15.89:0/3972884096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c89f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 --2- 172.21.15.89:0/3972884096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1580840 0x5648b16c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 --2- 172.21.15.89:0/3972884096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 0x5648b16c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 -- 172.21.15.89:0/3972884096 >> 172.21.15.89:0/3972884096 conn(0x5648b1657290 msgr2=0x5648b16c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 -- 172.21.15.89:0/3972884096 shutdown_connections 2024-08-31T04:15:03.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 -- 172.21.15.89:0/3972884096 wait complete. 2024-08-31T04:15:03.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 -- start start 2024-08-31T04:15:03.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.924+0000 7f9efc07c000 1 Processor -- start 2024-08-31T04:15:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 0x5648b1689ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5648b14786f0 con 0x5648b156a800 2024-08-31T04:15:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5648b14e2690 con 0x5648b1191ab0 2024-08-31T04:15:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5648b1454df0 con 0x5648b1580840 2024-08-31T04:15:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 10 client.0 _ll_register_callbacks cb 0x5648b1673a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:15:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16d3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36962/0 (socket says 172.21.15.89:36962) 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1400640 1 -- 172.21.15.89:0/766137864 learned_addr learned my addr 172.21.15.89:0/766137864 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef2800640 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 0x5648b1689ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1400640 1 -- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 msgr2=0x5648b1689ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1400640 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 0x5648b1689ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1400640 1 -- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 msgr2=0x5648b16d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1400640 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16d3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1400640 1 -- 172.21.15.89:0/766137864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b147d340 con 0x5648b156a800 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1400640 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16d3580 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009230 tx=0x7f9edc01d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f72dfb9ffb5668 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ecea00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ecea00640 1 -- 172.21.15.89:0/766137864 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0b5040 con 0x5648b156a800 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ecea00640 1 -- 172.21.15.89:0/766137864 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f9edc004850 con 0x5648b156a800 2024-08-31T04:15:03.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 -- 172.21.15.89:0/766137864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5648b146c960 con 0x5648b156a800 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ecea00640 1 -- 172.21.15.89:0/766137864 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9edc0d3050 con 0x5648b156a800 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 10 client.5280 fetch_fsmap learned FSMap version 9 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 -- 172.21.15.89:0/766137864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5648b146dbd0 con 0x5648b156a800 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ecea00640 1 -- 172.21.15.89:0/766137864 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5648b146c960 con 0x5648b156a800 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ecea00640 1 -- 172.21.15.89:0/766137864 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9edc0d6020 con 0x5648b156a800 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 10 client.5280 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 10 client.5280 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 20 client.5280 populate_metadata read hostname 'smithi089' 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5648b1176e20 0x5648b168a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 4 client.5280 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9efc07c000 1 -- 172.21.15.89:0/766137864 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648b14e5810 con 0x5648b1176e20 2024-08-31T04:15:03.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.928+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5648b1176e20 0x5648b168a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.932+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5648b1176e20 0x5648b168a4f0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6227fba3d55514b0 server_cookie=8171eb7bb6709485 in_seq=0 out_seq=0 2024-08-31T04:15:03.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.932+0000 7f9ecea00640 10 client.5280 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9ecea00640 1 -- 172.21.15.89:0/766137864 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648b14e5810 con 0x5648b1176e20 2024-08-31T04:15:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9ecea00640 10 client.5280 handle_command_reply: tid=0 2024-08-31T04:15:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 client.5280 shutdown 2024-08-31T04:15:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 -- 172.21.15.89:0/766137864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 msgr2=0x5648b16d3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16d3580 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009230 tx=0x7f9edc01d8f0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 -- 172.21.15.89:0/766137864 shutdown_connections 2024-08-31T04:15:03.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5648b1176e20 0x5648b168a4f0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16d3580 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 0x5648b1689ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9ecea00640 0 client.5280 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:03.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 --2- 172.21.15.89:0/766137864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 -- 172.21.15.89:0/766137864 >> 172.21.15.89:0/766137864 conn(0x5648b1657290 msgr2=0x5648b16c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:03.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 -- 172.21.15.89:0/766137864 shutdown_connections 2024-08-31T04:15:03.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 1 -- 172.21.15.89:0/766137864 wait complete. 2024-08-31T04:15:03.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.940+0000 7f9efc07c000 20 client.5280 trim_cache size 0 max 16384 2024-08-31T04:15:03.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9efc07c000 1 Processor -- start 2024-08-31T04:15:03.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9efc07c000 1 -- start start 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 0x5648b16e3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9efc07c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1ff3f0 con 0x5648b156a800 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9efc07c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1fe6c0 con 0x5648b1191ab0 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9efc07c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9eec1fed60 con 0x5648b1580840 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36968/0 (socket says 172.21.15.89:36968) 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1400640 1 -- 172.21.15.89:0/2758007446 learned_addr learned my addr 172.21.15.89:0/2758007446 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef2800640 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 0x5648b16e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1400640 1 -- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 msgr2=0x5648b16e3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:03.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1400640 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 0x5648b16e3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1400640 1 -- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 msgr2=0x5648b16c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:03.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1400640 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1400640 1 -- 172.21.15.89:0/2758007446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b1557b30 con 0x5648b156a800 2024-08-31T04:15:03.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:03.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef2800640 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 0x5648b16e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:03.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ef1400640 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c3390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0bb040 tx=0x7f9edc01be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9733d1c139530d13 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:03.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ed9c00640 1 -- 172.21.15.89:0/2758007446 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0db070 con 0x5648b156a800 2024-08-31T04:15:03.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ed9c00640 1 -- 172.21.15.89:0/2758007446 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9edc0c0070 con 0x5648b156a800 2024-08-31T04:15:03.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.960+0000 7f9ed9c00640 1 -- 172.21.15.89:0/2758007446 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0b5040 con 0x5648b156a800 2024-08-31T04:15:03.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 -- 172.21.15.89:0/2758007446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 msgr2=0x5648b16c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:03.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c3390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0bb040 tx=0x7f9edc01be50 comp rx=0 tx=0).stop 2024-08-31T04:15:03.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 -- 172.21.15.89:0/2758007446 shutdown_connections 2024-08-31T04:15:03.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b156a800 0x5648b16c3390 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1580840 0x5648b16e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 --2- 172.21.15.89:0/2758007446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b1191ab0 0x5648b16c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 -- 172.21.15.89:0/2758007446 >> 172.21.15.89:0/2758007446 conn(0x5648b1657290 msgr2=0x5648b16c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:03.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 -- 172.21.15.89:0/2758007446 shutdown_connections 2024-08-31T04:15:03.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 -- 172.21.15.89:0/2758007446 wait complete. 2024-08-31T04:15:03.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 -- start start 2024-08-31T04:15:03.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 Processor -- start 2024-08-31T04:15:03.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 0x5648b16d9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b156a800 0x5648b16d7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b1580840 0x5648b16d78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5648b14d6110 con 0x5648b1580840 2024-08-31T04:15:03.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5648b147af60 con 0x5648b156a800 2024-08-31T04:15:03.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5648b14db430 con 0x5648b1191ab0 2024-08-31T04:15:03.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9efc07c000 10 client.0 _ll_register_callbacks cb 0x7f9edc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:15:03.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9ef2800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b1580840 0x5648b16d78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9ef1e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 0x5648b16d9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9ef2800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b1580840 0x5648b16d78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36984/0 (socket says 172.21.15.89:36984) 2024-08-31T04:15:03.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.964+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b156a800 0x5648b16d7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ef2800640 1 -- 172.21.15.89:0/1683341227 learned_addr learned my addr 172.21.15.89:0/1683341227 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ef2800640 1 -- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 msgr2=0x5648b16d9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ef2800640 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 0x5648b16d9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ef2800640 1 -- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b156a800 msgr2=0x5648b16d7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ef2800640 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b156a800 0x5648b16d7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ef2800640 1 -- 172.21.15.89:0/1683341227 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b145cea0 con 0x5648b1580840 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ef2800640 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b1580840 0x5648b16d78b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800ae50 tx=0x7f9ee8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6038c273dbeafad4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ecea00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ecea00640 1 -- 172.21.15.89:0/1683341227 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8004b30 con 0x5648b1580840 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ecea00640 1 -- 172.21.15.89:0/1683341227 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f9ee8004cd0 con 0x5648b1580840 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9efc07c000 1 -- 172.21.15.89:0/1683341227 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9edc0c0070 con 0x5648b1580840 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ecea00640 1 -- 172.21.15.89:0/1683341227 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9ee80044a0 con 0x5648b1580840 2024-08-31T04:15:03.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9efc07c000 10 client.5286 fetch_fsmap learned FSMap version 9 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9efc07c000 1 -- 172.21.15.89:0/1683341227 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5648b1478c10 con 0x5648b1580840 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ecea00640 1 -- 172.21.15.89:0/1683341227 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9edc0c0070 con 0x5648b1580840 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ecea00640 1 -- 172.21.15.89:0/1683341227 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9ee8024070 con 0x5648b1580840 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9efc07c000 10 client.5286 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9efc07c000 10 client.5286 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9efc07c000 20 client.5286 populate_metadata read hostname 'smithi089' 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9efc07c000 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5648b1164e80 0x5648b16d7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9efc07c000 4 client.5286 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}] 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9efc07c000 1 -- 172.21.15.89:0/1683341227 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.25, "await_for": 45.0}) -- 0x5648b14e12b0 con 0x5648b1164e80 2024-08-31T04:15:03.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5648b1164e80 0x5648b16d7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:03.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ecea00640 10 client.5286 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:03.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:03.968+0000 7f9ef1e00640 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5648b1164e80 0x5648b16d7df0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee9f65ca8b53c6f server_cookie=1d6222f136400e1a in_seq=0 out_seq=0 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ecea00640 1 -- 172.21.15.89:0/1683341227 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5648b14e12b0 con 0x5648b1164e80 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ecea00640 10 client.5286 handle_command_reply: tid=0 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 client.5286 shutdown 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 -- 172.21.15.89:0/1683341227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b1580840 msgr2=0x5648b16d78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b1580840 0x5648b16d78b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800ae50 tx=0x7f9ee8004430 comp rx=0 tx=0).stop 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 -- 172.21.15.89:0/1683341227 shutdown_connections 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5648b1164e80 0x5648b16d7df0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5648b1580840 0x5648b16d78b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648b156a800 0x5648b16d7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 --2- 172.21.15.89:0/1683341227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648b1191ab0 0x5648b16d9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ecea00640 0 client.5286 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:07.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 -- 172.21.15.89:0/1683341227 >> 172.21.15.89:0/1683341227 conn(0x5648b1657290 msgr2=0x5648b168cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:07.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 -- 172.21.15.89:0/1683341227 shutdown_connections 2024-08-31T04:15:07.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 1 -- 172.21.15.89:0/1683341227 wait complete. 2024-08-31T04:15:07.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9efc07c000 20 client.5286 trim_cache size 0 max 16384 2024-08-31T04:15:07.525 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:15:07.525 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:15:07.525 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:15:07.525 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 38, 2024-08-31T04:15:07.525 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:15:07.525 INFO:teuthology.orchestra.run.smithi089.stdout: "a7b8f9d7": { 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 38, 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 145.2, 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:07.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:07.527 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:07.527 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:07.527 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:07.527 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:15:07.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 -- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9ed00720f0 msgr2=0x7f9ed0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9ed00720f0 0x7f9ed0074600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0b2000 tx=0x7f9edc0aa040 comp rx=0 tx=0).stop 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 -- 172.21.15.89:0/3446997012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 msgr2=0x7f9eec150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 0x7f9eec150c20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c3f0 tx=0x7f9ee000c8b0 comp rx=0 tx=0).stop 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 -- 172.21.15.89:0/3446997012 shutdown_connections 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9ed00720f0 0x7f9ed0074600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9eec157fe0 0x7f9eec0cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9eec151cd0 0x7f9eec14a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 --2- 172.21.15.89:0/3446997012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eec0c4a80 0x7f9eec150c20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.524+0000 7f9ef3200640 1 -- 172.21.15.89:0/3446997012 >> 172.21.15.89:0/3446997012 conn(0x7f9eec0ca080 msgr2=0x7f9eec1483d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.528+0000 7f9ef3200640 1 -- 172.21.15.89:0/3446997012 shutdown_connections 2024-08-31T04:15:07.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:07.528+0000 7f9ef3200640 1 -- 172.21.15.89:0/3446997012 wait complete. 2024-08-31T04:15:07.550 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a7b8f9d7', quiesce took 4.2 seconds. Will release after: 21.05 2024-08-31T04:15:28.601 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:15:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.768+0000 7f2deb400640 1 -- 172.21.15.89:0/3014271642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2de415bc70 msgr2=0x7f2de4152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.768+0000 7f2deb400640 1 --2- 172.21.15.89:0/3014271642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2de415bc70 0x7f2de4152a10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2de40c9020 tx=0x7f2dd401f390 comp rx=0 tx=0).stop 2024-08-31T04:15:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.768+0000 7f2deb400640 1 -- 172.21.15.89:0/3014271642 shutdown_connections 2024-08-31T04:15:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.768+0000 7f2deb400640 1 --2- 172.21.15.89:0/3014271642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2de40c1f40 0x7f2de40c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.768+0000 7f2deb400640 1 --2- 172.21.15.89:0/3014271642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2de415bc70 0x7f2de4152a10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.768+0000 7f2deb400640 1 -- 172.21.15.89:0/3014271642 >> 172.21.15.89:0/3014271642 conn(0x7f2de40ccf20 msgr2=0x7f2de40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.768+0000 7f2deb400640 1 -- 172.21.15.89:0/3014271642 shutdown_connections 2024-08-31T04:15:28.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.768+0000 7f2deb400640 1 -- 172.21.15.89:0/3014271642 wait complete. 2024-08-31T04:15:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2deb400640 1 Processor -- start 2024-08-31T04:15:28.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2deb400640 1 -- start start 2024-08-31T04:15:28.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2deb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de40c1f40 0x7f2de41f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:28.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2deb400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2de40c7920 0x7f2de41476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:28.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2deb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2de415bc70 0x7f2de40c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:28.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2deb400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4074fb0 con 0x7f2de40c1f40 2024-08-31T04:15:28.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2deb400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4074e30 con 0x7f2de415bc70 2024-08-31T04:15:28.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2deb400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2de40c7d30 con 0x7f2de40c7920 2024-08-31T04:15:28.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de8a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de40c1f40 0x7f2de41f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:28.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de8a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de40c1f40 0x7f2de41f2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45316/0 (socket says 172.21.15.89:45316) 2024-08-31T04:15:28.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de8a00640 1 -- 172.21.15.89:0/3889919798 learned_addr learned my addr 172.21.15.89:0/3889919798 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:28.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de3e00640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2de40c7920 0x7f2de41476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:28.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de9400640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2de415bc70 0x7f2de40c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de8a00640 1 -- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2de40c7920 msgr2=0x7f2de41476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de8a00640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2de40c7920 0x7f2de41476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de8a00640 1 -- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2de415bc70 msgr2=0x7f2de40c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de8a00640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2de415bc70 0x7f2de40c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de8a00640 1 -- 172.21.15.89:0/3889919798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de41f3460 con 0x7f2de40c1f40 2024-08-31T04:15:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.772+0000 7f2de8a00640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de40c1f40 0x7f2de41f2f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009b10 tx=0x7f2dd4005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2de0c00640 1 -- 172.21.15.89:0/3889919798 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40b4040 con 0x7f2de40c1f40 2024-08-31T04:15:28.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2de0c00640 1 -- 172.21.15.89:0/3889919798 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dd40af8a0 con 0x7f2de40c1f40 2024-08-31T04:15:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de414f900 con 0x7f2de40c1f40 2024-08-31T04:15:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2de0c00640 1 -- 172.21.15.89:0/3889919798 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40afcb0 con 0x7f2de40c1f40 2024-08-31T04:15:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de414dfe0 con 0x7f2de40c1f40 2024-08-31T04:15:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de414e210 con 0x7f2de40c1f40 2024-08-31T04:15:28.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2de0c00640 1 -- 172.21.15.89:0/3889919798 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2dd40c1020 con 0x7f2de40c1f40 2024-08-31T04:15:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2de0c00640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2dc40720c0 0x7f2dc40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:28.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2de0c00640 1 -- 172.21.15.89:0/3889919798 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2dd4130980 con 0x7f2de40c1f40 2024-08-31T04:15:28.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.776+0000 7f2de3e00640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2dc40720c0 0x7f2dc40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:28.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.780+0000 7f2de3e00640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2dc40720c0 0x7f2dc40745d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2de40ccec0 tx=0x7f2dd00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:28.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.780+0000 7f2de0c00640 1 -- 172.21.15.89:0/3889919798 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2de414e210 con 0x7f2de40c1f40 2024-08-31T04:15:28.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2de414fb20 con 0x7f2de40c1f40 2024-08-31T04:15:28.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2de0c00640 1 -- 172.21.15.89:0/3889919798 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f2dd40c8020 con 0x7f2de40c1f40 2024-08-31T04:15:28.987 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:15:28.987 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:15:28.987 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:15:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2dc40720c0 msgr2=0x7f2dc40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2dc40720c0 0x7f2dc40745d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2de40ccec0 tx=0x7f2dd00091e0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de40c1f40 msgr2=0x7f2de41f2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de40c1f40 0x7f2de41f2f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009b10 tx=0x7f2dd4005ae0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 shutdown_connections 2024-08-31T04:15:28.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2dc40720c0 0x7f2dc40745d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2de415bc70 0x7f2de40c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2de40c7920 0x7f2de41476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 --2- 172.21.15.89:0/3889919798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de40c1f40 0x7f2de41f2f20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 >> 172.21.15.89:0/3889919798 conn(0x7f2de40ccf20 msgr2=0x7f2de40716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 shutdown_connections 2024-08-31T04:15:28.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:28.988+0000 7f2deb400640 1 -- 172.21.15.89:0/3889919798 wait complete. 2024-08-31T04:15:29.008 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id a7b8f9d7 --release --await' 2024-08-31T04:15:29.009 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id a7b8f9d7 --release --await 2024-08-31T04:15:29.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 -- 172.21.15.89:0/3481440360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda00b1be0 msgr2=0x7feda0153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:29.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 --2- 172.21.15.89:0/3481440360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda00b1be0 0x7feda0153570 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7feda00741f0 tx=0x7fed8c01c8a0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 -- 172.21.15.89:0/3481440360 shutdown_connections 2024-08-31T04:15:29.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 --2- 172.21.15.89:0/3481440360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda0159c80 0x7feda015a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 --2- 172.21.15.89:0/3481440360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda00b1be0 0x7feda0153570 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 --2- 172.21.15.89:0/3481440360 >> v2:172.21.15.170:3300/0 conn(0x7feda00ca1a0 0x7feda015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 -- 172.21.15.89:0/3481440360 >> 172.21.15.89:0/3481440360 conn(0x7feda006ce00 msgr2=0x7feda006d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:29.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 -- 172.21.15.89:0/3481440360 shutdown_connections 2024-08-31T04:15:29.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 -- 172.21.15.89:0/3481440360 wait complete. 2024-08-31T04:15:29.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 Processor -- start 2024-08-31T04:15:29.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.172+0000 7fed9f200640 1 -- start start 2024-08-31T04:15:29.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9f200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda00b1be0 0x7feda01564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda00ca1a0 0x7feda01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9f200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda0159c80 0x7feda014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9f200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feda00cec70 con 0x7feda0159c80 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feda00ca600 con 0x7feda00ca1a0 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9f200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feda00cedf0 con 0x7feda00b1be0 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda0159c80 0x7feda014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda0159c80 0x7feda014c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45338/0 (socket says 172.21.15.89:45338) 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9e800640 1 -- 172.21.15.89:0/1259526304 learned_addr learned my addr 172.21.15.89:0/1259526304 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9d400640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda00ca1a0 0x7feda01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9de00640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda00b1be0 0x7feda01564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9e800640 1 -- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda00b1be0 msgr2=0x7feda01564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9e800640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda00b1be0 0x7feda01564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9e800640 1 -- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda00ca1a0 msgr2=0x7feda01548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9e800640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda00ca1a0 0x7feda01548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9e800640 1 -- 172.21.15.89:0/1259526304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda0154e10 con 0x7feda0159c80 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9de00640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda00b1be0 0x7feda01564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9d400640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda00ca1a0 0x7feda01548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9e800640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda0159c80 0x7feda014c950 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fed9800ea80 tx=0x7fed9800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed96000640 1 -- 172.21.15.89:0/1259526304 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9800cea0 con 0x7feda0159c80 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed96000640 1 -- 172.21.15.89:0/1259526304 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed98004b30 con 0x7feda0159c80 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9f200640 1 -- 172.21.15.89:0/1259526304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda00cd800 con 0x7feda0159c80 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed96000640 1 -- 172.21.15.89:0/1259526304 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98005020 con 0x7feda0159c80 2024-08-31T04:15:29.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.176+0000 7fed9f200640 1 -- 172.21.15.89:0/1259526304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda01f65c0 con 0x7feda0159c80 2024-08-31T04:15:29.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fed96000640 1 -- 172.21.15.89:0/1259526304 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fed980051c0 con 0x7feda0159c80 2024-08-31T04:15:29.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fed96000640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fed800720c0 0x7fed800745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fed96000640 1 -- 172.21.15.89:0/1259526304 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fed98093cb0 con 0x7feda0159c80 2024-08-31T04:15:29.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fed9de00640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fed800720c0 0x7fed800745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fedac52a000 1 Processor -- start 2024-08-31T04:15:29.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fedac52a000 1 -- start start 2024-08-31T04:15:29.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fed9de00640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fed800720c0 0x7fed800745d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed90005fd0 tx=0x7fed90005e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:29.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fedac52a000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 0x563934e59290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fedac52a000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 0x563934e5df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fedac52a000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e5e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fedac52a000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563934cfff30 con 0x563934d11890 2024-08-31T04:15:29.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fedac52a000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563934c75690 con 0x563934d36950 2024-08-31T04:15:29.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.180+0000 7fedac52a000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563934c64c20 con 0x563934d20930 2024-08-31T04:15:29.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e5e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e5e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45342/0 (socket says 172.21.15.89:45342) 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9e800640 1 -- 172.21.15.89:0/2948023137 learned_addr learned my addr 172.21.15.89:0/2948023137 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9de00640 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 0x563934e59290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9d400640 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 0x563934e5df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9e800640 1 -- 172.21.15.89:0/2948023137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 msgr2=0x563934e5df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9e800640 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 0x563934e5df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9e800640 1 -- 172.21.15.89:0/2948023137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 msgr2=0x563934e59290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9e800640 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 0x563934e59290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9e800640 1 -- 172.21.15.89:0/2948023137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563934c198f0 con 0x563934d11890 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9de00640 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 0x563934e59290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed9e800640 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e5e470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fed9805b100 tx=0x7fed9805ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9c7f41465ebe2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed8aa00640 1 -- 172.21.15.89:0/2948023137 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98083030 con 0x563934d11890 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed8aa00640 1 -- 172.21.15.89:0/2948023137 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed98060e50 con 0x563934d11890 2024-08-31T04:15:29.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fed8aa00640 1 -- 172.21.15.89:0/2948023137 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98063150 con 0x563934d11890 2024-08-31T04:15:29.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 -- 172.21.15.89:0/2948023137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 msgr2=0x563934e5e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:29.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e5e470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fed9805b100 tx=0x7fed9805ea10 comp rx=0 tx=0).stop 2024-08-31T04:15:29.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 -- 172.21.15.89:0/2948023137 shutdown_connections 2024-08-31T04:15:29.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e5e470 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 0x563934e5df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 --2- 172.21.15.89:0/2948023137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 0x563934e59290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 -- 172.21.15.89:0/2948023137 >> 172.21.15.89:0/2948023137 conn(0x563934d36540 msgr2=0x563934e5bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:29.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 -- 172.21.15.89:0/2948023137 shutdown_connections 2024-08-31T04:15:29.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 -- 172.21.15.89:0/2948023137 wait complete. 2024-08-31T04:15:29.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 -- start start 2024-08-31T04:15:29.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.184+0000 7fedac52a000 1 Processor -- start 2024-08-31T04:15:29.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d11890 0x563934e23910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d20930 0x563934e23e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 0x563934e24390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563934beb500 con 0x563934d20930 2024-08-31T04:15:29.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563934c68bd0 con 0x563934d11890 2024-08-31T04:15:29.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563934c0ca30 con 0x563934d36950 2024-08-31T04:15:29.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d20930 0x563934e23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 10 client.0 _ll_register_callbacks cb 0x563934d1ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d20930 0x563934e23e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45352/0 (socket says 172.21.15.89:45352) 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9d400640 1 -- 172.21.15.89:0/2060809147 learned_addr learned my addr 172.21.15.89:0/2060809147 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9de00640 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d11890 0x563934e23910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9e800640 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 0x563934e24390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9d400640 1 -- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 msgr2=0x563934e24390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9d400640 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 0x563934e24390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9d400640 1 -- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d11890 msgr2=0x563934e23910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9d400640 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d11890 0x563934e23910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9d400640 1 -- 172.21.15.89:0/2060809147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563934c046a0 con 0x563934d20930 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9de00640 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d11890 0x563934e23910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9e800640 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 0x563934e24390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9d400640 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d20930 0x563934e23e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fed8c000c10 tx=0x7fed8c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b41b86d6261b28a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:29.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed7f400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed7f400640 1 -- 172.21.15.89:0/2060809147 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0b2070 con 0x563934d20930 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 -- 172.21.15.89:0/2060809147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563934bfe7e0 con 0x563934d20930 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed7f400640 1 -- 172.21.15.89:0/2060809147 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fed8c0a5b20 con 0x563934d20930 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed7f400640 1 -- 172.21.15.89:0/2060809147 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fed8c0a5d20 con 0x563934d20930 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 10 client.5301 fetch_fsmap learned FSMap version 9 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 -- 172.21.15.89:0/2060809147 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563934c231c0 con 0x563934d20930 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed7f400640 1 -- 172.21.15.89:0/2060809147 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563934bfe7e0 con 0x563934d20930 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed7f400640 1 -- 172.21.15.89:0/2060809147 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fed8c005020 con 0x563934d20930 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 10 client.5301 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 10 client.5301 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 20 client.5301 populate_metadata read hostname 'smithi089' 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563934cfafc0 0x563934e72100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 4 client.5301 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:15:29.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fedac52a000 1 -- 172.21.15.89:0/2060809147 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563934c775e0 con 0x563934cfafc0 2024-08-31T04:15:29.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.188+0000 7fed9de00640 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563934cfafc0 0x563934e72100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fed9de00640 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563934cfafc0 0x563934e72100 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1880bb08f520986 server_cookie=dcf5a688933db1be in_seq=0 out_seq=0 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fed7f400640 10 client.5301 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fed7f400640 1 -- 172.21.15.89:0/2060809147 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563934c775e0 con 0x563934cfafc0 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fed7f400640 10 client.5301 handle_command_reply: tid=0 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 client.5301 shutdown 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 -- 172.21.15.89:0/2060809147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d20930 msgr2=0x563934e23e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d20930 0x563934e23e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fed8c000c10 tx=0x7fed8c004530 comp rx=0 tx=0).stop 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 -- 172.21.15.89:0/2060809147 shutdown_connections 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563934cfafc0 0x563934e72100 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d20930 0x563934e23e50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 0x563934e24390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fed7f400640 0 client.5301 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:29.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 --2- 172.21.15.89:0/2060809147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d11890 0x563934e23910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 -- 172.21.15.89:0/2060809147 >> 172.21.15.89:0/2060809147 conn(0x563934d36540 msgr2=0x563934e5a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:29.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 -- 172.21.15.89:0/2060809147 shutdown_connections 2024-08-31T04:15:29.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 1 -- 172.21.15.89:0/2060809147 wait complete. 2024-08-31T04:15:29.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.192+0000 7fedac52a000 20 client.5301 trim_cache size 0 max 16384 2024-08-31T04:15:29.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.208+0000 7fedac52a000 1 Processor -- start 2024-08-31T04:15:29.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.208+0000 7fedac52a000 1 -- start start 2024-08-31T04:15:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d20930 0x563934e70630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 0x563934e70b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feda01ff8c0 con 0x563934d11890 2024-08-31T04:15:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feda01fe7a0 con 0x563934d20930 2024-08-31T04:15:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feda006fc70 con 0x563934d36950 2024-08-31T04:15:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45362/0 (socket says 172.21.15.89:45362) 2024-08-31T04:15:29.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9de00640 1 -- 172.21.15.89:0/4177614565 learned_addr learned my addr 172.21.15.89:0/4177614565 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9e800640 1 --2- 172.21.15.89:0/4177614565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 0x563934e70b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9d400640 1 --2- 172.21.15.89:0/4177614565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d20930 0x563934e70630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9de00640 1 -- 172.21.15.89:0/4177614565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 msgr2=0x563934e70b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9de00640 1 --2- 172.21.15.89:0/4177614565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 0x563934e70b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9de00640 1 -- 172.21.15.89:0/4177614565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d20930 msgr2=0x563934e70630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9de00640 1 --2- 172.21.15.89:0/4177614565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d20930 0x563934e70630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9de00640 1 -- 172.21.15.89:0/4177614565 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563934ce92f0 con 0x563934d11890 2024-08-31T04:15:29.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed9de00640 1 --2- 172.21.15.89:0/4177614565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e700f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x563934c1f4c0 tx=0x7fed90015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32233f468792565 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:29.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed8a000640 1 -- 172.21.15.89:0/4177614565 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90004220 con 0x563934d11890 2024-08-31T04:15:29.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed8a000640 1 -- 172.21.15.89:0/4177614565 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed90003600 con 0x563934d11890 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fed8a000640 1 -- 172.21.15.89:0/4177614565 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed900044b0 con 0x563934d11890 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 -- 172.21.15.89:0/4177614565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 msgr2=0x563934e700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 --2- 172.21.15.89:0/4177614565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e700f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x563934c1f4c0 tx=0x7fed90015000 comp rx=0 tx=0).stop 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 -- 172.21.15.89:0/4177614565 shutdown_connections 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 --2- 172.21.15.89:0/4177614565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d36950 0x563934e70b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 --2- 172.21.15.89:0/4177614565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d20930 0x563934e70630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 --2- 172.21.15.89:0/4177614565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e700f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 -- 172.21.15.89:0/4177614565 >> 172.21.15.89:0/4177614565 conn(0x563934d36540 msgr2=0x563934e75350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 -- 172.21.15.89:0/4177614565 shutdown_connections 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.212+0000 7fedac52a000 1 -- 172.21.15.89:0/4177614565 wait complete. 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 -- start start 2024-08-31T04:15:29.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 Processor -- start 2024-08-31T04:15:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e746a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 0x563934e74be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 0x563934e98650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feda01f3200 con 0x563934d11890 2024-08-31T04:15:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feda01fe0f0 con 0x563934d36950 2024-08-31T04:15:29.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feda01fda40 con 0x563934d20930 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 10 client.0 _ll_register_callbacks cb 0x7fed8c0b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e746a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45364/0 (socket says 172.21.15.89:45364) 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9de00640 1 -- 172.21.15.89:0/1750229398 learned_addr learned my addr 172.21.15.89:0/1750229398 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9d400640 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 0x563934e74be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9e800640 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 0x563934e98650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9de00640 1 -- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 msgr2=0x563934e74be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9de00640 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 0x563934e74be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9de00640 1 -- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 msgr2=0x563934e98650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9de00640 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 0x563934e98650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9de00640 1 -- 172.21.15.89:0/1750229398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563934beeb30 con 0x563934d11890 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed9de00640 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e746a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fed90014040 tx=0x7fed9000f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c961725093ad9bd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed7f400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:15:29.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed7f400640 1 -- 172.21.15.89:0/1750229398 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90041060 con 0x563934d11890 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed7f400640 1 -- 172.21.15.89:0/1750229398 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fed90029600 con 0x563934d11890 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 -- 172.21.15.89:0/1750229398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed90003600 con 0x563934d11890 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed7f400640 1 -- 172.21.15.89:0/1750229398 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fed90029800 con 0x563934d11890 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 10 client.5307 fetch_fsmap learned FSMap version 9 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 -- 172.21.15.89:0/1750229398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563934bfbc70 con 0x563934d11890 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed7f400640 1 -- 172.21.15.89:0/1750229398 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed90003600 con 0x563934d11890 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fed7f400640 1 -- 172.21.15.89:0/1750229398 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fed900299a0 con 0x563934d11890 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 10 client.5307 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 10 client.5307 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 20 client.5307 populate_metadata read hostname 'smithi089' 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5639348f6e80 0x563934ed7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 4 client.5307 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a7b8f9d7", "release": true, "await": true}] 2024-08-31T04:15:29.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.216+0000 7fedac52a000 1 -- 172.21.15.89:0/1750229398 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a7b8f9d7", "release": true, "await": true}) -- 0x563934c73080 con 0x5639348f6e80 2024-08-31T04:15:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.220+0000 7fed9d400640 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5639348f6e80 0x563934ed7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.220+0000 7fed7f400640 10 client.5307 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:29.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.220+0000 7fed9d400640 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5639348f6e80 0x563934ed7a40 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f8c27b8b6d83d06 server_cookie=8e98e4d9f55012d4 in_seq=0 out_seq=0 2024-08-31T04:15:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed7f400640 1 -- 172.21.15.89:0/1750229398 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563934c73080 con 0x5639348f6e80 2024-08-31T04:15:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed7f400640 10 client.5307 handle_command_reply: tid=0 2024-08-31T04:15:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 client.5307 shutdown 2024-08-31T04:15:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 -- 172.21.15.89:0/1750229398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 msgr2=0x563934e746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:29.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e746a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fed90014040 tx=0x7fed9000f8c0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 -- 172.21.15.89:0/1750229398 shutdown_connections 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5639348f6e80 0x563934ed7a40 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563934d36950 0x563934e98650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563934d20930 0x563934e74be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed7f400640 0 client.5307 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 --2- 172.21.15.89:0/1750229398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563934d11890 0x563934e746a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 -- 172.21.15.89:0/1750229398 >> 172.21.15.89:0/1750229398 conn(0x563934d36540 msgr2=0x563934e1e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 -- 172.21.15.89:0/1750229398 shutdown_connections 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 1 -- 172.21.15.89:0/1750229398 wait complete. 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fedac52a000 20 client.5307 trim_cache size 0 max 16384 2024-08-31T04:15:29.880 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 40, 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "a7b8f9d7": { 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 40, 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 145.2, 2024-08-31T04:15:29.881 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:15:29.882 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 -- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fed800720c0 msgr2=0x7fed800745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fed800720c0 0x7fed800745d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed90005fd0 tx=0x7fed90005e80 comp rx=0 tx=0).stop 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 -- 172.21.15.89:0/1259526304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda0159c80 msgr2=0x7feda014c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda0159c80 0x7feda014c950 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fed9800ea80 tx=0x7fed9800ef40 comp rx=0 tx=0).stop 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 -- 172.21.15.89:0/1259526304 shutdown_connections 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fed800720c0 0x7fed800745d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda0159c80 0x7feda014c950 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda00ca1a0 0x7feda01548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 --2- 172.21.15.89:0/1259526304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda00b1be0 0x7feda01564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:29.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 -- 172.21.15.89:0/1259526304 >> 172.21.15.89:0/1259526304 conn(0x7feda006ce00 msgr2=0x7feda00c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:29.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 -- 172.21.15.89:0/1259526304 shutdown_connections 2024-08-31T04:15:29.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:15:29.880+0000 7fed9f200640 1 -- 172.21.15.89:0/1259526304 wait complete. 2024-08-31T04:15:29.900 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a7b8f9d7', total seconds elapsed: 26.6 2024-08-31T04:15:32.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:15:32.414 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:16:02.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:16:02.478 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:16:32.930 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:16:32.934 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:17:03.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:17:03.007 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:17:03.686 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.7 2024-08-31T04:17:03.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:17:03.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.846+0000 7f32b2a00640 1 -- 172.21.15.89:0/3912431583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0b2900 msgr2=0x7f32ac1520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:03.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.846+0000 7f32b2a00640 1 --2- 172.21.15.89:0/3912431583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0b2900 0x7f32ac1520f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f329400a950 tx=0x7f329401dae0 comp rx=0 tx=0).stop 2024-08-31T04:17:03.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.846+0000 7f32b2a00640 1 -- 172.21.15.89:0/3912431583 shutdown_connections 2024-08-31T04:17:03.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.846+0000 7f32b2a00640 1 --2- 172.21.15.89:0/3912431583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0b2900 0x7f32ac1520f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.846+0000 7f32b2a00640 1 -- 172.21.15.89:0/3912431583 >> 172.21.15.89:0/3912431583 conn(0x7f32ac0ccf20 msgr2=0x7f32ac0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.846+0000 7f32b2a00640 1 -- 172.21.15.89:0/3912431583 shutdown_connections 2024-08-31T04:17:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.846+0000 7f32b2a00640 1 -- 172.21.15.89:0/3912431583 wait complete. 2024-08-31T04:17:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 Processor -- start 2024-08-31T04:17:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 -- start start 2024-08-31T04:17:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ac0b2900 0x7f32ac0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ac0b2fe0 0x7f32ac14d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0c8810 0x7f32ac14d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac158980 con 0x7f32ac0c8810 2024-08-31T04:17:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac158800 con 0x7f32ac0b2fe0 2024-08-31T04:17:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f32ac165e80 con 0x7f32ac0b2900 2024-08-31T04:17:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b0a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0c8810 0x7f32ac14d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:03.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b0a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0c8810 0x7f32ac14d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33272/0 (socket says 172.21.15.89:33272) 2024-08-31T04:17:03.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b0a00640 1 -- 172.21.15.89:0/1083747070 learned_addr learned my addr 172.21.15.89:0/1083747070 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:03.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32abe00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ac0b2900 0x7f32ac0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:03.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32a3400640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ac0b2fe0 0x7f32ac14d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b0a00640 1 -- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ac0b2900 msgr2=0x7f32ac0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b0a00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ac0b2900 0x7f32ac0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b0a00640 1 -- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ac0b2fe0 msgr2=0x7f32ac14d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b0a00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ac0b2fe0 0x7f32ac14d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b0a00640 1 -- 172.21.15.89:0/1083747070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac14fe60 con 0x7f32ac0c8810 2024-08-31T04:17:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b0a00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0c8810 0x7f32ac14d6a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c730 tx=0x7f32a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32a8c00640 1 -- 172.21.15.89:0/1083747070 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4003b80 con 0x7f32ac0c8810 2024-08-31T04:17:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32a8c00640 1 -- 172.21.15.89:0/1083747070 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32a4003d40 con 0x7f32ac0c8810 2024-08-31T04:17:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ac151740 con 0x7f32ac0c8810 2024-08-31T04:17:03.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32a8c00640 1 -- 172.21.15.89:0/1083747070 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a40052d0 con 0x7f32ac0c8810 2024-08-31T04:17:03.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.850+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ac154b80 con 0x7f32ac0c8810 2024-08-31T04:17:03.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.854+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ac154970 con 0x7f32ac0c8810 2024-08-31T04:17:03.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.854+0000 7f32a8c00640 1 -- 172.21.15.89:0/1083747070 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f32a4005680 con 0x7f32ac0c8810 2024-08-31T04:17:03.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.854+0000 7f32a8c00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f32880720c0 0x7f32880745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:03.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.854+0000 7f32a8c00640 1 -- 172.21.15.89:0/1083747070 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f32a40937f0 con 0x7f32ac0c8810 2024-08-31T04:17:03.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.854+0000 7f32abe00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f32880720c0 0x7f32880745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:03.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.858+0000 7f32abe00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f32880720c0 0x7f32880745d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f329c007fd0 tx=0x7f329c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:03.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:03.858+0000 7f32a8c00640 1 -- 172.21.15.89:0/1083747070 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f32a405e790 con 0x7f32ac0c8810 2024-08-31T04:17:04.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32ac1520f0 con 0x7f32ac0c8810 2024-08-31T04:17:04.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32a8c00640 1 -- 172.21.15.89:0/1083747070 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f32a4062f50 con 0x7f32ac0c8810 2024-08-31T04:17:04.066 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:17:04.066 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:17:04.066 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:17:04.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f32880720c0 msgr2=0x7f32880745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f32880720c0 0x7f32880745d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f329c007fd0 tx=0x7f329c009040 comp rx=0 tx=0).stop 2024-08-31T04:17:04.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0c8810 msgr2=0x7f32ac14d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0c8810 0x7f32ac14d6a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c730 tx=0x7f32a400cbf0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 shutdown_connections 2024-08-31T04:17:04.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f32880720c0 0x7f32880745d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32ac0c8810 0x7f32ac14d6a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ac0b2fe0 0x7f32ac14d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 --2- 172.21.15.89:0/1083747070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ac0b2900 0x7f32ac0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 >> 172.21.15.89:0/1083747070 conn(0x7f32ac0ccf20 msgr2=0x7f32ac0c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:04.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 shutdown_connections 2024-08-31T04:17:04.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.066+0000 7f32b2a00640 1 -- 172.21.15.89:0/1083747070 wait complete. 2024-08-31T04:17:04.087 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 134.7 --await-for 45.0' 2024-08-31T04:17:04.088 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 134.7 --await-for 45.0 2024-08-31T04:17:04.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.254+0000 7f175b000640 1 -- 172.21.15.89:0/2853550986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1738003a40 msgr2=0x7f1738003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.254+0000 7f175b000640 1 --2- 172.21.15.89:0/2853550986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1738003a40 0x7f1738003eb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f174400c660 tx=0x7f174401d2e0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.254+0000 7f1759000640 1 -- 172.21.15.89:0/2853550986 reap_dead start 2024-08-31T04:17:04.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.254+0000 7f175b000640 1 -- 172.21.15.89:0/2853550986 shutdown_connections 2024-08-31T04:17:04.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.254+0000 7f175b000640 1 -- 172.21.15.89:0/2853550986 >> 172.21.15.89:0/2853550986 conn(0x7f17540c99b0 msgr2=0x7f17540c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:04.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.254+0000 7f175b000640 1 -- 172.21.15.89:0/2853550986 shutdown_connections 2024-08-31T04:17:04.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.254+0000 7f175b000640 1 -- 172.21.15.89:0/2853550986 wait complete. 2024-08-31T04:17:04.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 Processor -- start 2024-08-31T04:17:04.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 -- start start 2024-08-31T04:17:04.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1738003a40 0x7f1754146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17540c3be0 0x7f17541623a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1754146060 0x7f17540c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f175406fc10 con 0x7f1754146060 2024-08-31T04:17:04.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1754073e70 con 0x7f17540c3be0 2024-08-31T04:17:04.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1754069fc0 con 0x7f1738003a40 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1759000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1754146060 0x7f17540c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1753e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1738003a40 0x7f1754146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1759000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1754146060 0x7f17540c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33296/0 (socket says 172.21.15.89:33296) 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1759000640 1 -- 172.21.15.89:0/2788119243 learned_addr learned my addr 172.21.15.89:0/2788119243 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f174b400640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17540c3be0 0x7f17541623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1759000640 1 -- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1738003a40 msgr2=0x7f1754146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1759000640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1738003a40 0x7f1754146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1759000640 1 -- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17540c3be0 msgr2=0x7f17541623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1759000640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17540c3be0 0x7f17541623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1759000640 1 -- 172.21.15.89:0/2788119243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17540c2660 con 0x7f1754146060 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1759000640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1754146060 0x7f17540c8e00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f175406eda0 tx=0x7f174c011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1750c00640 1 -- 172.21.15.89:0/2788119243 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c01f070 con 0x7f1754146060 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1750c00640 1 -- 172.21.15.89:0/2788119243 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f174c00fba0 con 0x7f1754146060 2024-08-31T04:17:04.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f1750c00640 1 -- 172.21.15.89:0/2788119243 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c012450 con 0x7f1754146060 2024-08-31T04:17:04.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 -- 172.21.15.89:0/2788119243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175414f6e0 con 0x7f1754146060 2024-08-31T04:17:04.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.258+0000 7f175b000640 1 -- 172.21.15.89:0/2788119243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1754153f90 con 0x7f1754146060 2024-08-31T04:17:04.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.262+0000 7f1750c00640 1 -- 172.21.15.89:0/2788119243 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f174c022070 con 0x7f1754146060 2024-08-31T04:17:04.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.262+0000 7f1750c00640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17300720c0 0x7f17300745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.262+0000 7f1750c00640 1 -- 172.21.15.89:0/2788119243 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f174c093660 con 0x7f1754146060 2024-08-31T04:17:04.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.262+0000 7f17626b1000 1 Processor -- start 2024-08-31T04:17:04.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.262+0000 7f1753e00640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17300720c0 0x7f17300745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.262+0000 7f17626b1000 1 -- start start 2024-08-31T04:17:04.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17300720c0 0x7f17300745d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f17440ac000 tx=0x7f174401a120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:04.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c22dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 0x55873c22e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55873c083820 con 0x55873c12b3f0 2024-08-31T04:17:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55873c072db0 con 0x55873c120e90 2024-08-31T04:17:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55873c076d60 con 0x55873c10a960 2024-08-31T04:17:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33300/0 (socket says 172.21.15.89:33300) 2024-08-31T04:17:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 -- 172.21.15.89:0/1055685839 learned_addr learned my addr 172.21.15.89:0/1055685839 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1759000640 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 0x55873c22e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f174b400640 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c22dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 -- 172.21.15.89:0/1055685839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 msgr2=0x55873c22e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:04.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 0x55873c22e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 -- 172.21.15.89:0/1055685839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 msgr2=0x55873c22dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c22dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 -- 172.21.15.89:0/1055685839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55873c00db70 con 0x55873c12b3f0 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f174b400640 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c22dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1753e00640 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264d20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1744001e20 tx=0x7f17440b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1335a53e045076 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1748c00640 1 -- 172.21.15.89:0/1055685839 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17440cb070 con 0x55873c12b3f0 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1748c00640 1 -- 172.21.15.89:0/1055685839 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17440c0070 con 0x55873c12b3f0 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f1748c00640 1 -- 172.21.15.89:0/1055685839 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744001a60 con 0x55873c12b3f0 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 -- 172.21.15.89:0/1055685839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 msgr2=0x55873c264d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264d20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1744001e20 tx=0x7f17440b8000 comp rx=0 tx=0).stop 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 -- 172.21.15.89:0/1055685839 shutdown_connections 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 0x55873c22e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c22dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 --2- 172.21.15.89:0/1055685839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264d20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 -- 172.21.15.89:0/1055685839 >> 172.21.15.89:0/1055685839 conn(0x55873bd32210 msgr2=0x55873c267990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:04.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 -- 172.21.15.89:0/1055685839 shutdown_connections 2024-08-31T04:17:04.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.266+0000 7f17626b1000 1 -- 172.21.15.89:0/1055685839 wait complete. 2024-08-31T04:17:04.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 -- start start 2024-08-31T04:17:04.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 Processor -- start 2024-08-31T04:17:04.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 0x55873c2638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c263e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55873bd39b10 con 0x55873c12b3f0 2024-08-31T04:17:04.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55873bff96f0 con 0x55873c120e90 2024-08-31T04:17:04.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55873c07b390 con 0x55873c10a960 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 10 client.0 _ll_register_callbacks cb 0x55873c01ab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1759000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1759000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33306/0 (socket says 172.21.15.89:33306) 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1759000640 1 -- 172.21.15.89:0/3192042925 learned_addr learned my addr 172.21.15.89:0/3192042925 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1753e00640 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 0x55873c2638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f174b400640 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c263e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1759000640 1 -- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 msgr2=0x55873c2638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1759000640 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 0x55873c2638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1759000640 1 -- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 msgr2=0x55873c263e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1759000640 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c263e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1759000640 1 -- 172.21.15.89:0/3192042925 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55873c031380 con 0x55873c12b3f0 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1759000640 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f174c05e280 tx=0x7f174c05eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12350c49e89fbfb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1741600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:17:04.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1741600640 1 -- 172.21.15.89:0/3192042925 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c065280 con 0x55873c12b3f0 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1741600640 1 -- 172.21.15.89:0/3192042925 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f174c05d7e0 con 0x55873c12b3f0 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 -- 172.21.15.89:0/3192042925 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55873c081d20 con 0x55873c12b3f0 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f1741600640 1 -- 172.21.15.89:0/3192042925 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f174c05e090 con 0x55873c12b3f0 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 10 client.5328 fetch_fsmap learned FSMap version 9 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.270+0000 7f17626b1000 1 -- 172.21.15.89:0/3192042925 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55873c0f7e40 con 0x55873c12b3f0 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f1741600640 1 -- 172.21.15.89:0/3192042925 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55873c081d20 con 0x55873c12b3f0 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f1741600640 1 -- 172.21.15.89:0/3192042925 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f174c08bb90 con 0x55873c12b3f0 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 10 client.5328 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 10 client.5328 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 20 client.5328 populate_metadata read hostname 'smithi089' 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55873bd16dc0 0x55873c27ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 4 client.5328 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 -- 172.21.15.89:0/3192042925 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55873c085770 con 0x55873bd16dc0 2024-08-31T04:17:04.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f1753e00640 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55873bd16dc0 0x55873c27ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f1753e00640 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55873bd16dc0 0x55873c27ef90 crc :-1 s=READY pgs=570 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0efb6d26fdba518 server_cookie=af749c8963d25d69 in_seq=0 out_seq=0 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f1741600640 10 client.5328 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f1741600640 1 -- 172.21.15.89:0/3192042925 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55873c085770 con 0x55873bd16dc0 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f1741600640 10 client.5328 handle_command_reply: tid=0 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 client.5328 shutdown 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 -- 172.21.15.89:0/3192042925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 msgr2=0x55873c264370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f174c05e280 tx=0x7f174c05eb20 comp rx=0 tx=0).stop 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 -- 172.21.15.89:0/3192042925 shutdown_connections 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55873bd16dc0 0x55873c27ef90 crc :-1 s=READY pgs=570 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c12b3f0 0x55873c264370 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c263e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 --2- 172.21.15.89:0/3192042925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c10a960 0x55873c2638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 -- 172.21.15.89:0/3192042925 >> 172.21.15.89:0/3192042925 conn(0x55873bd32210 msgr2=0x55873c266340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:04.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f1741600640 0 client.5328 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:04.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 -- 172.21.15.89:0/3192042925 shutdown_connections 2024-08-31T04:17:04.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.274+0000 7f17626b1000 1 -- 172.21.15.89:0/3192042925 wait complete. 2024-08-31T04:17:04.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.278+0000 7f17626b1000 20 client.5328 trim_cache size 0 max 16384 2024-08-31T04:17:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f17626b1000 1 Processor -- start 2024-08-31T04:17:04.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f17626b1000 1 -- start start 2024-08-31T04:17:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f17626b1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c10a960 0x55873c2dc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f17626b1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c120e90 0x55873c2dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f17626b1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 0x55873c2dd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f17626b1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1754201aa0 con 0x55873c120e90 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f17626b1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1754202d80 con 0x55873c10a960 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f17626b1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1754202020 con 0x55873c12b3f0 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f174b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c120e90 0x55873c2dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f174b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c120e90 0x55873c2dcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33322/0 (socket says 172.21.15.89:33322) 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f174b400640 1 -- 172.21.15.89:0/1107594829 learned_addr learned my addr 172.21.15.89:0/1107594829 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f1759000640 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 0x55873c2dd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f1753e00640 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c10a960 0x55873c2dc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f174b400640 1 -- 172.21.15.89:0/1107594829 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 msgr2=0x55873c2dd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f174b400640 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 0x55873c2dd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f174b400640 1 -- 172.21.15.89:0/1107594829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c10a960 msgr2=0x55873c2dc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f174b400640 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c10a960 0x55873c2dc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f174b400640 1 -- 172.21.15.89:0/1107594829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55873c0cf5b0 con 0x55873c120e90 2024-08-31T04:17:04.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.294+0000 7f1759000640 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 0x55873c2dd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:17:04.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f174b400640 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c120e90 0x55873c2dcd80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f173c004640 tx=0x7f173c004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946e4cb5d925b268 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f1743e00640 1 -- 172.21.15.89:0/1107594829 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c0137c0 con 0x55873c120e90 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f1743e00640 1 -- 172.21.15.89:0/1107594829 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f173c013960 con 0x55873c120e90 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f1743e00640 1 -- 172.21.15.89:0/1107594829 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c013d70 con 0x55873c120e90 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 -- 172.21.15.89:0/1107594829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c120e90 msgr2=0x55873c2dcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c120e90 0x55873c2dcd80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f173c004640 tx=0x7f173c004b00 comp rx=0 tx=0).stop 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 -- 172.21.15.89:0/1107594829 shutdown_connections 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c120e90 0x55873c2dcd80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 0x55873c2dd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 --2- 172.21.15.89:0/1107594829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c10a960 0x55873c2dc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 -- 172.21.15.89:0/1107594829 >> 172.21.15.89:0/1107594829 conn(0x55873bd32210 msgr2=0x55873c2274c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 -- 172.21.15.89:0/1107594829 shutdown_connections 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 -- 172.21.15.89:0/1107594829 wait complete. 2024-08-31T04:17:04.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 -- start start 2024-08-31T04:17:04.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 Processor -- start 2024-08-31T04:17:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c10a960 0x55873c284e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c281b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 0x55873c2820a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55873bff4eb0 con 0x55873c10a960 2024-08-31T04:17:04.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f17542026b0 con 0x55873c120e90 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55873c01af20 con 0x55873c12b3f0 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f17626b1000 10 client.0 _ll_register_callbacks cb 0x7f174c0670a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.298+0000 7f1753e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c10a960 0x55873c284e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1753e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c10a960 0x55873c284e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33336/0 (socket says 172.21.15.89:33336) 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1753e00640 1 -- 172.21.15.89:0/2254048714 learned_addr learned my addr 172.21.15.89:0/2254048714 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1759000640 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 0x55873c2820a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f174b400640 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c281b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1753e00640 1 -- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 msgr2=0x55873c2820a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1753e00640 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 0x55873c2820a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1753e00640 1 -- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 msgr2=0x55873c281b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1753e00640 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c281b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1753e00640 1 -- 172.21.15.89:0/2254048714 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55873c003fc0 con 0x55873c10a960 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f174b400640 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c281b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:17:04.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1753e00640 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c10a960 0x55873c284e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1744006040 tx=0x7f1744006b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5442b2f6fcdd7d6d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1741600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1741600640 1 -- 172.21.15.89:0/2254048714 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17440cb040 con 0x55873c10a960 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1741600640 1 -- 172.21.15.89:0/2254048714 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f1744006620 con 0x55873c10a960 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f17626b1000 1 -- 172.21.15.89:0/2254048714 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173c013960 con 0x55873c10a960 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1741600640 1 -- 172.21.15.89:0/2254048714 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f17440db050 con 0x55873c10a960 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f17626b1000 10 client.5334 fetch_fsmap learned FSMap version 9 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f17626b1000 1 -- 172.21.15.89:0/2254048714 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55873bffce00 con 0x55873c10a960 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1741600640 1 -- 172.21.15.89:0/2254048714 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f173c013960 con 0x55873c10a960 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1741600640 1 -- 172.21.15.89:0/2254048714 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f17440de020 con 0x55873c10a960 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f17626b1000 10 client.5334 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f17626b1000 10 client.5334 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f17626b1000 20 client.5334 populate_metadata read hostname 'smithi089' 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f17626b1000 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55873bd04e20 0x55873c2829d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f17626b1000 4 client.5334 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.7, "await_for": 45.0}] 2024-08-31T04:17:04.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f17626b1000 1 -- 172.21.15.89:0/2254048714 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.7, "await_for": 45.0}) -- 0x55873c081210 con 0x55873bd04e20 2024-08-31T04:17:04.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f174b400640 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55873bd04e20 0x55873c2829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f1741600640 10 client.5334 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:04.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:04.302+0000 7f174b400640 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55873bd04e20 0x55873c2829d0 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cde2ea88a1dee4 server_cookie=90c180fddcf3a373 in_seq=0 out_seq=0 2024-08-31T04:17:06.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f1741600640 1 -- 172.21.15.89:0/2254048714 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55873c081210 con 0x55873bd04e20 2024-08-31T04:17:06.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f1741600640 10 client.5334 handle_command_reply: tid=0 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 client.5334 shutdown 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 -- 172.21.15.89:0/2254048714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c10a960 msgr2=0x55873c284e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c10a960 0x55873c284e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1744006040 tx=0x7f1744006b30 comp rx=0 tx=0).stop 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 -- 172.21.15.89:0/2254048714 shutdown_connections 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55873bd04e20 0x55873c2829d0 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55873c12b3f0 0x55873c2820a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55873c120e90 0x55873c281b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 --2- 172.21.15.89:0/2254048714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55873c10a960 0x55873c284e50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f1741600640 0 client.5334 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 -- 172.21.15.89:0/2254048714 >> 172.21.15.89:0/2254048714 conn(0x55873bd32210 msgr2=0x55873c2262a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 -- 172.21.15.89:0/2254048714 shutdown_connections 2024-08-31T04:17:06.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 1 -- 172.21.15.89:0/2254048714 wait complete. 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.670+0000 7f17626b1000 20 client.5334 trim_cache size 0 max 16384 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 42, 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stdout: "dc4cf3aa": { 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 42, 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:17:06.674 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 134.7, 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:06.675 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:06.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:06.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:06.676 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:17:06.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 -- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17300720c0 msgr2=0x7f17300745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:06.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17300720c0 0x7f17300745d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f17440ac000 tx=0x7f174401a120 comp rx=0 tx=0).stop 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 -- 172.21.15.89:0/2788119243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1754146060 msgr2=0x7f17540c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1754146060 0x7f17540c8e00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f175406eda0 tx=0x7f174c011b10 comp rx=0 tx=0).stop 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 -- 172.21.15.89:0/2788119243 shutdown_connections 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17300720c0 0x7f17300745d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1754146060 0x7f17540c8e00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17540c3be0 0x7f17541623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 --2- 172.21.15.89:0/2788119243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1738003a40 0x7f1754146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 -- 172.21.15.89:0/2788119243 >> 172.21.15.89:0/2788119243 conn(0x7f17540c99b0 msgr2=0x7f17541588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 -- 172.21.15.89:0/2788119243 shutdown_connections 2024-08-31T04:17:06.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:06.674+0000 7f175b000640 1 -- 172.21.15.89:0/2788119243 wait complete. 2024-08-31T04:17:06.694 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'dc4cf3aa', quiesce took 3.0 seconds. Will release after: 11.7 2024-08-31T04:17:18.396 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:17:18.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 -- 172.21.15.89:0/2499269366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde880c1f40 msgr2=0x7fde880c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 --2- 172.21.15.89:0/2499269366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde880c1f40 0x7fde880c9330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde880c9020 tx=0x7fde7401f010 comp rx=0 tx=0).stop 2024-08-31T04:17:18.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 -- 172.21.15.89:0/2499269366 shutdown_connections 2024-08-31T04:17:18.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 --2- 172.21.15.89:0/2499269366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde880c1f40 0x7fde880c9330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 --2- 172.21.15.89:0/2499269366 >> v2:172.21.15.170:3300/0 conn(0x7fde8815bc70 0x7fde88152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 -- 172.21.15.89:0/2499269366 >> 172.21.15.89:0/2499269366 conn(0x7fde880ccf20 msgr2=0x7fde880cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:18.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 -- 172.21.15.89:0/2499269366 shutdown_connections 2024-08-31T04:17:18.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 -- 172.21.15.89:0/2499269366 wait complete. 2024-08-31T04:17:18.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 Processor -- start 2024-08-31T04:17:18.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.566+0000 7fde90400640 1 -- start start 2024-08-31T04:17:18.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde90400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde880c1f40 0x7fde880cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde90400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde880c7920 0x7fde88150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde90400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde8815bc70 0x7fde880c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde90400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fde88074fb0 con 0x7fde880c1f40 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde90400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fde88074e30 con 0x7fde880c7920 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde90400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fde880c7d30 con 0x7fde8815bc70 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde880c1f40 0x7fde880cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde880c1f40 0x7fde880cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32806/0 (socket says 172.21.15.89:32806) 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8da00640 1 -- 172.21.15.89:0/2131491780 learned_addr learned my addr 172.21.15.89:0/2131491780 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8d000640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde880c7920 0x7fde88150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8e400640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde8815bc70 0x7fde880c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8da00640 1 -- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde8815bc70 msgr2=0x7fde880c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8da00640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde8815bc70 0x7fde880c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8da00640 1 -- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde880c7920 msgr2=0x7fde88150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8da00640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde880c7920 0x7fde88150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8da00640 1 -- 172.21.15.89:0/2131491780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde880cb920 con 0x7fde880c1f40 2024-08-31T04:17:18.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde8da00640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde880c1f40 0x7fde880cb3e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00e9f0 tx=0x7fde7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:18.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde85600640 1 -- 172.21.15.89:0/2131491780 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00cd80 con 0x7fde880c1f40 2024-08-31T04:17:18.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde85600640 1 -- 172.21.15.89:0/2131491780 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde7c004020 con 0x7fde880c1f40 2024-08-31T04:17:18.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde88155cc0 con 0x7fde880c1f40 2024-08-31T04:17:18.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde85600640 1 -- 172.21.15.89:0/2131491780 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c004470 con 0x7fde880c1f40 2024-08-31T04:17:18.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde880cc590 con 0x7fde880c1f40 2024-08-31T04:17:18.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde880c9330 con 0x7fde880c1f40 2024-08-31T04:17:18.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.570+0000 7fde85600640 1 -- 172.21.15.89:0/2131491780 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fde7c003600 con 0x7fde880c1f40 2024-08-31T04:17:18.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.574+0000 7fde85600640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde680720c0 0x7fde680745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.574+0000 7fde85600640 1 -- 172.21.15.89:0/2131491780 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fde7c0939e0 con 0x7fde880c1f40 2024-08-31T04:17:18.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.574+0000 7fde8d000640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde680720c0 0x7fde680745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.574+0000 7fde8d000640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde680720c0 0x7fde680745d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fde740b2000 tx=0x7fde7401d850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:18.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.578+0000 7fde85600640 1 -- 172.21.15.89:0/2131491780 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fde7c05eed0 con 0x7fde880c1f40 2024-08-31T04:17:18.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.778+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde881560a0 con 0x7fde880c1f40 2024-08-31T04:17:18.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.778+0000 7fde85600640 1 -- 172.21.15.89:0/2131491780 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fde7c05e7d0 con 0x7fde880c1f40 2024-08-31T04:17:18.779 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:17:18.780 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:17:18.780 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:17:18.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde680720c0 msgr2=0x7fde680745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde680720c0 0x7fde680745d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fde740b2000 tx=0x7fde7401d850 comp rx=0 tx=0).stop 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde880c1f40 msgr2=0x7fde880cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde880c1f40 0x7fde880cb3e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00e9f0 tx=0x7fde7c00edf0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 shutdown_connections 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fde680720c0 0x7fde680745d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde8815bc70 0x7fde880c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde880c7920 0x7fde88150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 --2- 172.21.15.89:0/2131491780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde880c1f40 0x7fde880cb3e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 >> 172.21.15.89:0/2131491780 conn(0x7fde880ccf20 msgr2=0x7fde880c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 shutdown_connections 2024-08-31T04:17:18.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.782+0000 7fde90400640 1 -- 172.21.15.89:0/2131491780 wait complete. 2024-08-31T04:17:18.801 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id dc4cf3aa --release --await' 2024-08-31T04:17:18.802 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id dc4cf3aa --release --await 2024-08-31T04:17:18.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.962+0000 7ff587e00640 1 -- 172.21.15.89:0/4060948703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5800b4090 msgr2=0x7ff58015ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.962+0000 7ff587e00640 1 --2- 172.21.15.89:0/4060948703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5800b4090 0x7ff58015ceb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff574009840 tx=0x7ff57401c820 comp rx=0 tx=0).stop 2024-08-31T04:17:18.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.962+0000 7ff587e00640 1 -- 172.21.15.89:0/4060948703 shutdown_connections 2024-08-31T04:17:18.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.962+0000 7ff587e00640 1 --2- 172.21.15.89:0/4060948703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5800b4090 0x7ff58015ceb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.962+0000 7ff587e00640 1 -- 172.21.15.89:0/4060948703 >> 172.21.15.89:0/4060948703 conn(0x7ff580071a70 msgr2=0x7ff58006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:18.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.962+0000 7ff587e00640 1 -- 172.21.15.89:0/4060948703 shutdown_connections 2024-08-31T04:17:18.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.962+0000 7ff587e00640 1 -- 172.21.15.89:0/4060948703 wait complete. 2024-08-31T04:17:18.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.962+0000 7ff587e00640 1 Processor -- start 2024-08-31T04:17:18.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.962+0000 7ff587e00640 1 -- start start 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff587e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5800b4090 0x7ff58015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff587e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5800c3e40 0x7ff580141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff587e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff580153e80 0x7ff5800ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff587e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff58015d570 con 0x7ff580153e80 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff587e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff58015d3f0 con 0x7ff5800b4090 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff587e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff5800cd5b0 con 0x7ff5800c3e40 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff580153e80 0x7ff5800ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff580153e80 0x7ff5800ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32820/0 (socket says 172.21.15.89:32820) 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585e00640 1 -- 172.21.15.89:0/1318953030 learned_addr learned my addr 172.21.15.89:0/1318953030 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff584a00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5800c3e40 0x7ff580141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585400640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5800b4090 0x7ff58015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585e00640 1 -- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5800c3e40 msgr2=0x7ff580141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585e00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5800c3e40 0x7ff580141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585e00640 1 -- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5800b4090 msgr2=0x7ff58015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585e00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5800b4090 0x7ff58015aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585e00640 1 -- 172.21.15.89:0/1318953030 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58015b0e0 con 0x7ff580153e80 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff585e00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff580153e80 0x7ff5800ca800 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff57800c6b0 tx=0x7ff57800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff57d600640 1 -- 172.21.15.89:0/1318953030 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578003b80 con 0x7ff580153e80 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff57d600640 1 -- 172.21.15.89:0/1318953030 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff578003d20 con 0x7ff580153e80 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff587e00640 1 -- 172.21.15.89:0/1318953030 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff580142080 con 0x7ff580153e80 2024-08-31T04:17:18.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff57d600640 1 -- 172.21.15.89:0/1318953030 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578005330 con 0x7ff580153e80 2024-08-31T04:17:18.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.966+0000 7ff587e00640 1 -- 172.21.15.89:0/1318953030 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58014a1e0 con 0x7ff580153e80 2024-08-31T04:17:18.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff57d600640 1 -- 172.21.15.89:0/1318953030 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff5780054d0 con 0x7ff580153e80 2024-08-31T04:17:18.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff57d600640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff5600720c0 0x7ff5600745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff57d600640 1 -- 172.21.15.89:0/1318953030 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff578092a80 con 0x7ff580153e80 2024-08-31T04:17:18.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff58f52d000 1 Processor -- start 2024-08-31T04:17:18.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff585400640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff5600720c0 0x7ff5600745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff58f52d000 1 -- start start 2024-08-31T04:17:18.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff585400640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff5600720c0 0x7ff5600745d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff5740af000 tx=0x7ff57401b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 0x562d98a99ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98a9a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 0x562d98a9a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff58f52d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562d9893ff30 con 0x562d98960930 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff58f52d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562d988b5690 con 0x562d98951890 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff58f52d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562d988a4c20 con 0x562d98976950 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff584a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98a9a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff584a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98a9a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32822/0 (socket says 172.21.15.89:32822) 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff584a00640 1 -- 172.21.15.89:0/4103905296 learned_addr learned my addr 172.21.15.89:0/4103905296 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff585400640 1 --2- 172.21.15.89:0/4103905296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 0x562d98a99ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff585e00640 1 --2- 172.21.15.89:0/4103905296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 0x562d98a9a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.970+0000 7ff584a00640 1 -- 172.21.15.89:0/4103905296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 msgr2=0x562d98a99ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:18.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff584a00640 1 --2- 172.21.15.89:0/4103905296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 0x562d98a99ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff584a00640 1 -- 172.21.15.89:0/4103905296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 msgr2=0x562d98a9a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:18.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff584a00640 1 --2- 172.21.15.89:0/4103905296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 0x562d98a9a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff584a00640 1 -- 172.21.15.89:0/4103905296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d988598f0 con 0x562d98960930 2024-08-31T04:17:18.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff584a00640 1 --2- 172.21.15.89:0/4103905296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98a9a010 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff56c001770 tx=0x7ff56c001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e425603f14ee84 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:18.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff571c00640 1 -- 172.21.15.89:0/4103905296 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0052e0 con 0x562d98960930 2024-08-31T04:17:18.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff571c00640 1 -- 172.21.15.89:0/4103905296 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff56c018070 con 0x562d98960930 2024-08-31T04:17:18.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff571c00640 1 -- 172.21.15.89:0/4103905296 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00f9b0 con 0x562d98960930 2024-08-31T04:17:18.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 -- 172.21.15.89:0/4103905296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 msgr2=0x562d98a9a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 --2- 172.21.15.89:0/4103905296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98a9a010 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff56c001770 tx=0x7ff56c001c30 comp rx=0 tx=0).stop 2024-08-31T04:17:18.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 -- 172.21.15.89:0/4103905296 shutdown_connections 2024-08-31T04:17:18.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 --2- 172.21.15.89:0/4103905296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98a9a010 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 --2- 172.21.15.89:0/4103905296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 0x562d98a9a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 --2- 172.21.15.89:0/4103905296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 0x562d98a99ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 -- 172.21.15.89:0/4103905296 >> 172.21.15.89:0/4103905296 conn(0x562d98976540 msgr2=0x562d98a97890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:18.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 -- 172.21.15.89:0/4103905296 shutdown_connections 2024-08-31T04:17:18.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 -- 172.21.15.89:0/4103905296 wait complete. 2024-08-31T04:17:18.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 -- start start 2024-08-31T04:17:18.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.974+0000 7ff58f52d000 1 Processor -- start 2024-08-31T04:17:18.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98a5e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 0x562d98a5ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 0x562d98a64960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562d9882b500 con 0x562d98951890 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562d988a8bd0 con 0x562d98976950 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562d9884ca30 con 0x562d98960930 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 10 client.0 _ll_register_callbacks cb 0x562d9895ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98a5e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98a5e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32838/0 (socket says 172.21.15.89:32838) 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585400640 1 -- 172.21.15.89:0/231720731 learned_addr learned my addr 172.21.15.89:0/231720731 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585e00640 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 0x562d98a64960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff584a00640 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 0x562d98a5ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585400640 1 -- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 msgr2=0x562d98a5ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:18.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585400640 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 0x562d98a5ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585400640 1 -- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 msgr2=0x562d98a64960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585400640 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 0x562d98a64960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585400640 1 -- 172.21.15.89:0/231720731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d988446a0 con 0x562d98951890 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff585400640 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98a5e830 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff57401a450 tx=0x7ff5740091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bd5d13b95fe5d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff566000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff566000640 1 -- 172.21.15.89:0/231720731 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5740b2040 con 0x562d98951890 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff566000640 1 -- 172.21.15.89:0/231720731 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff5740053c0 con 0x562d98951890 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 -- 172.21.15.89:0/231720731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d9883e7e0 con 0x562d98951890 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff566000640 1 -- 172.21.15.89:0/231720731 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff5740d2050 con 0x562d98951890 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 10 client.5352 fetch_fsmap learned FSMap version 9 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 -- 172.21.15.89:0/231720731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562d988631c0 con 0x562d98951890 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff566000640 1 -- 172.21.15.89:0/231720731 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562d9883e7e0 con 0x562d98951890 2024-08-31T04:17:18.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff566000640 1 -- 172.21.15.89:0/231720731 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff5740d5020 con 0x562d98951890 2024-08-31T04:17:18.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 10 client.5352 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:17:18.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 10 client.5352 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:17:18.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 20 client.5352 populate_metadata read hostname 'smithi089' 2024-08-31T04:17:18.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562d9893afc0 0x562d98ab2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:18.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 4 client.5352 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:17:18.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff58f52d000 1 -- 172.21.15.89:0/231720731 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d988b75e0 con 0x562d9893afc0 2024-08-31T04:17:18.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff584a00640 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562d9893afc0 0x562d98ab2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:18.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff584a00640 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562d9893afc0 0x562d98ab2cf0 crc :-1 s=READY pgs=576 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d89da0b347af19 server_cookie=ac26b52211e37f9a in_seq=0 out_seq=0 2024-08-31T04:17:18.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.978+0000 7ff566000640 10 client.5352 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff566000640 1 -- 172.21.15.89:0/231720731 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d988b75e0 con 0x562d9893afc0 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff566000640 10 client.5352 handle_command_reply: tid=0 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 client.5352 shutdown 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 -- 172.21.15.89:0/231720731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 msgr2=0x562d98a5e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98a5e830 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff57401a450 tx=0x7ff5740091e0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 -- 172.21.15.89:0/231720731 shutdown_connections 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562d9893afc0 0x562d98ab2cf0 crc :-1 s=READY pgs=576 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 0x562d98a64960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 0x562d98a5ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff566000640 0 client.5352 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:18.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 --2- 172.21.15.89:0/231720731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98a5e830 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:18.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 -- 172.21.15.89:0/231720731 >> 172.21.15.89:0/231720731 conn(0x562d98976540 msgr2=0x562d98a96240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:18.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 -- 172.21.15.89:0/231720731 shutdown_connections 2024-08-31T04:17:18.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 1 -- 172.21.15.89:0/231720731 wait complete. 2024-08-31T04:17:18.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.982+0000 7ff58f52d000 20 client.5352 trim_cache size 0 max 16384 2024-08-31T04:17:19.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.998+0000 7ff58f52d000 1 Processor -- start 2024-08-31T04:17:19.001 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:18.998+0000 7ff58f52d000 1 -- start start 2024-08-31T04:17:19.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98ab70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:19.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 0x562d98ab4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 0x562d98ab4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff580200160 con 0x562d98951890 2024-08-31T04:17:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801ff040 con 0x562d98976950 2024-08-31T04:17:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff58006f930 con 0x562d98960930 2024-08-31T04:17:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98ab70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:19.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98ab70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32842/0 (socket says 172.21.15.89:32842) 2024-08-31T04:17:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585400640 1 -- 172.21.15.89:0/204683079 learned_addr learned my addr 172.21.15.89:0/204683079 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff584a00640 1 --2- 172.21.15.89:0/204683079 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 0x562d98ab4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585e00640 1 --2- 172.21.15.89:0/204683079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 0x562d98ab4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585400640 1 -- 172.21.15.89:0/204683079 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 msgr2=0x562d98ab4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:19.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585400640 1 --2- 172.21.15.89:0/204683079 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 0x562d98ab4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585400640 1 -- 172.21.15.89:0/204683079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 msgr2=0x562d98ab4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:19.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585400640 1 --2- 172.21.15.89:0/204683079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 0x562d98ab4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585400640 1 -- 172.21.15.89:0/204683079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d989292f0 con 0x562d98951890 2024-08-31T04:17:19.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff585400640 1 --2- 172.21.15.89:0/204683079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98ab70d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff574009790 tx=0x7ff574005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734f8ce98a1bf685 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:19.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff571200640 1 -- 172.21.15.89:0/204683079 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5740dd070 con 0x562d98951890 2024-08-31T04:17:19.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff571200640 1 -- 172.21.15.89:0/204683079 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5740ca070 con 0x562d98951890 2024-08-31T04:17:19.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff571200640 1 -- 172.21.15.89:0/204683079 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5740b2050 con 0x562d98951890 2024-08-31T04:17:19.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 -- 172.21.15.89:0/204683079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 msgr2=0x562d98ab70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 --2- 172.21.15.89:0/204683079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98ab70d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff574009790 tx=0x7ff574005f40 comp rx=0 tx=0).stop 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 -- 172.21.15.89:0/204683079 shutdown_connections 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 --2- 172.21.15.89:0/204683079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98976950 0x562d98ab4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 --2- 172.21.15.89:0/204683079 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98960930 0x562d98ab4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 --2- 172.21.15.89:0/204683079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98951890 0x562d98ab70d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 -- 172.21.15.89:0/204683079 >> 172.21.15.89:0/204683079 conn(0x562d98976540 msgr2=0x562d98ab2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 -- 172.21.15.89:0/204683079 shutdown_connections 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.002+0000 7ff58f52d000 1 -- 172.21.15.89:0/204683079 wait complete. 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 -- start start 2024-08-31T04:17:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 Processor -- start 2024-08-31T04:17:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 0x562d98ad8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98ad8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 0x562d98ad91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801f78c0 con 0x562d98960930 2024-08-31T04:17:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801fe9a0 con 0x562d98951890 2024-08-31T04:17:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff5801fe2f0 con 0x562d98976950 2024-08-31T04:17:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 10 client.0 _ll_register_callbacks cb 0x7ff5740096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:17:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff584a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98ad8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff584a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98ad8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32858/0 (socket says 172.21.15.89:32858) 2024-08-31T04:17:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff584a00640 1 -- 172.21.15.89:0/595265149 learned_addr learned my addr 172.21.15.89:0/595265149 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff585400640 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 0x562d98ad8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff585e00640 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 0x562d98ad91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff584a00640 1 -- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 msgr2=0x562d98ad91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff584a00640 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 0x562d98ad91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff584a00640 1 -- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 msgr2=0x562d98ad8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff584a00640 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 0x562d98ad8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff584a00640 1 -- 172.21.15.89:0/595265149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d9882eb30 con 0x562d98960930 2024-08-31T04:17:19.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff584a00640 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98ad8c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x562d98967810 tx=0x7ff56c0012c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5456cf10cd117b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:19.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff566000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:17:19.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff566000640 1 -- 172.21.15.89:0/595265149 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00fbc0 con 0x562d98960930 2024-08-31T04:17:19.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff566000640 1 -- 172.21.15.89:0/595265149 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff56c00fd60 con 0x562d98960930 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 -- 172.21.15.89:0/595265149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5740ca070 con 0x562d98960930 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff566000640 1 -- 172.21.15.89:0/595265149 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff56c035050 con 0x562d98960930 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 10 client.5358 fetch_fsmap learned FSMap version 9 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 -- 172.21.15.89:0/595265149 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562d9883bc70 con 0x562d98960930 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff566000640 1 -- 172.21.15.89:0/595265149 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5740ca070 con 0x562d98960930 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff566000640 1 -- 172.21.15.89:0/595265149 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff56c038020 con 0x562d98960930 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 10 client.5358 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 10 client.5358 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 20 client.5358 populate_metadata read hostname 'smithi089' 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562d98536e80 0x562d98b20600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 4 client.5358 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "dc4cf3aa", "release": true, "await": true}] 2024-08-31T04:17:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.006+0000 7ff58f52d000 1 -- 172.21.15.89:0/595265149 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "dc4cf3aa", "release": true, "await": true}) -- 0x562d988b3080 con 0x562d98536e80 2024-08-31T04:17:19.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.010+0000 7ff585400640 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562d98536e80 0x562d98b20600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:19.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.010+0000 7ff585400640 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562d98536e80 0x562d98b20600 crc :-1 s=READY pgs=577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4f225295706135b server_cookie=77239524a59cce26 in_seq=0 out_seq=0 2024-08-31T04:17:19.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.010+0000 7ff566000640 10 client.5358 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:19.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff566000640 1 -- 172.21.15.89:0/595265149 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x562d988b3080 con 0x562d98536e80 2024-08-31T04:17:19.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff566000640 10 client.5358 handle_command_reply: tid=0 2024-08-31T04:17:19.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 client.5358 shutdown 2024-08-31T04:17:19.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 -- 172.21.15.89:0/595265149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 msgr2=0x562d98ad8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:19.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98ad8c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x562d98967810 tx=0x7ff56c0012c0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 -- 172.21.15.89:0/595265149 shutdown_connections 2024-08-31T04:17:19.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562d98536e80 0x562d98b20600 crc :-1 s=READY pgs=577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d98960930 0x562d98ad8c80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562d98976950 0x562d98ad91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff566000640 0 client.5358 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:19.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 --2- 172.21.15.89:0/595265149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562d98951890 0x562d98ad8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 -- 172.21.15.89:0/595265149 >> 172.21.15.89:0/595265149 conn(0x562d98976540 msgr2=0x562d98ab2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:19.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 -- 172.21.15.89:0/595265149 shutdown_connections 2024-08-31T04:17:19.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 1 -- 172.21.15.89:0/595265149 wait complete. 2024-08-31T04:17:19.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff58f52d000 20 client.5358 trim_cache size 0 max 16384 2024-08-31T04:17:19.425 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 44, 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "dc4cf3aa": { 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 44, 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:17:19.426 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 134.7, 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:19.427 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:17:19.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 -- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff5600720c0 msgr2=0x7ff5600745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff5600720c0 0x7ff5600745d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff5740af000 tx=0x7ff57401b060 comp rx=0 tx=0).stop 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 -- 172.21.15.89:0/1318953030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff580153e80 msgr2=0x7ff5800ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff580153e80 0x7ff5800ca800 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff57800c6b0 tx=0x7ff57800cb70 comp rx=0 tx=0).stop 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 -- 172.21.15.89:0/1318953030 shutdown_connections 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff5600720c0 0x7ff5600745d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff580153e80 0x7ff5800ca800 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5800c3e40 0x7ff580141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 --2- 172.21.15.89:0/1318953030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5800b4090 0x7ff58015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 -- 172.21.15.89:0/1318953030 >> 172.21.15.89:0/1318953030 conn(0x7ff580071a70 msgr2=0x7ff580148690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:19.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 -- 172.21.15.89:0/1318953030 shutdown_connections 2024-08-31T04:17:19.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:19.422+0000 7ff587e00640 1 -- 172.21.15.89:0/1318953030 wait complete. 2024-08-31T04:17:19.445 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'dc4cf3aa', total seconds elapsed: 15.8 2024-08-31T04:17:33.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:17:33.121 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:17:46.747 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 35.0 2024-08-31T04:17:46.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:17:46.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 -- 172.21.15.89:0/1084070735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 msgr2=0x7f6be8152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:46.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 --2- 172.21.15.89:0/1084070735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 0x7f6be8152a10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009900 tx=0x7f6bd401f0d0 comp rx=0 tx=0).stop 2024-08-31T04:17:46.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 -- 172.21.15.89:0/1084070735 shutdown_connections 2024-08-31T04:17:46.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 --2- 172.21.15.89:0/1084070735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6be80c9330 0x7f6be8074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:46.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 --2- 172.21.15.89:0/1084070735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 0x7f6be8152a10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:46.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 -- 172.21.15.89:0/1084070735 >> 172.21.15.89:0/1084070735 conn(0x7f6be80ccf20 msgr2=0x7f6be80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:46.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 -- 172.21.15.89:0/1084070735 shutdown_connections 2024-08-31T04:17:46.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 -- 172.21.15.89:0/1084070735 wait complete. 2024-08-31T04:17:46.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 Processor -- start 2024-08-31T04:17:46.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.901+0000 7f6bf0400640 1 -- start start 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bf0400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 0x7f6be81f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bf0400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6be80c9330 0x7f6be81e1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bf0400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6be815bc70 0x7f6be80c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bf0400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6be80c8030 con 0x7f6be80c1f40 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bf0400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6be80c3150 con 0x7f6be815bc70 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bf0400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6be8074c60 con 0x7f6be80c9330 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6beda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 0x7f6be81f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6beda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 0x7f6be81f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36372/0 (socket says 172.21.15.89:36372) 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6beda00640 1 -- 172.21.15.89:0/400695683 learned_addr learned my addr 172.21.15.89:0/400695683 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bed000640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6be80c9330 0x7f6be81e1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bee400640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6be815bc70 0x7f6be80c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:46.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6beda00640 1 -- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6be80c9330 msgr2=0x7f6be81e1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6beda00640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6be80c9330 0x7f6be81e1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6beda00640 1 -- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6be815bc70 msgr2=0x7f6be80c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6beda00640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6be815bc70 0x7f6be80c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6beda00640 1 -- 172.21.15.89:0/400695683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be81f63e0 con 0x7f6be80c1f40 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bed000640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6be80c9330 0x7f6be81e1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6beda00640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 0x7f6be81f5ea0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00b440 tx=0x7f6bdc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6be5600640 1 -- 172.21.15.89:0/400695683 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc015020 con 0x7f6be80c1f40 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6be5600640 1 -- 172.21.15.89:0/400695683 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bdc011980 con 0x7f6be80c1f40 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6be5600640 1 -- 172.21.15.89:0/400695683 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc011dd0 con 0x7f6be80c1f40 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be81530f0 con 0x7f6be80c1f40 2024-08-31T04:17:46.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be81e4940 con 0x7f6be80c1f40 2024-08-31T04:17:46.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.905+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be8152a10 con 0x7f6be80c1f40 2024-08-31T04:17:46.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.909+0000 7f6be5600640 1 -- 172.21.15.89:0/400695683 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6bdc018020 con 0x7f6be80c1f40 2024-08-31T04:17:46.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.909+0000 7f6be5600640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6bc80720c0 0x7f6bc80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:46.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.909+0000 7f6be5600640 1 -- 172.21.15.89:0/400695683 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f6bdc092d60 con 0x7f6be80c1f40 2024-08-31T04:17:46.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.909+0000 7f6bed000640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6bc80720c0 0x7f6bc80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:46.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.909+0000 7f6bed000640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6bc80720c0 0x7f6bc80745d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40b2000 tx=0x7f6bd401d910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:46.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:46.913+0000 7f6be5600640 1 -- 172.21.15.89:0/400695683 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6bdc01f030 con 0x7f6be80c1f40 2024-08-31T04:17:47.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.109+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6be81560a0 con 0x7f6be80c1f40 2024-08-31T04:17:47.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.109+0000 7f6be5600640 1 -- 172.21.15.89:0/400695683 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f6bdc00d040 con 0x7f6be80c1f40 2024-08-31T04:17:47.113 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:17:47.113 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:17:47.113 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:17:47.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6bc80720c0 msgr2=0x7f6bc80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6bc80720c0 0x7f6bc80745d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40b2000 tx=0x7f6bd401d910 comp rx=0 tx=0).stop 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 msgr2=0x7f6be81f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 0x7f6be81f5ea0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00b440 tx=0x7f6bdc00b900 comp rx=0 tx=0).stop 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 shutdown_connections 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6bc80720c0 0x7f6bc80745d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6be815bc70 0x7f6be80c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6be80c9330 0x7f6be81e1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 --2- 172.21.15.89:0/400695683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be80c1f40 0x7f6be81f5ea0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 >> 172.21.15.89:0/400695683 conn(0x7f6be80ccf20 msgr2=0x7f6be80c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 shutdown_connections 2024-08-31T04:17:47.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.113+0000 7f6bf0400640 1 -- 172.21.15.89:0/400695683 wait complete. 2024-08-31T04:17:47.134 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 155.0 --await-for 45.0' 2024-08-31T04:17:47.135 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 155.0 --await-for 45.0 2024-08-31T04:17:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 -- 172.21.15.89:0/65801967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 msgr2=0x7fc0401535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 --2- 172.21.15.89:0/65801967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 0x7fc0401535a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc0400ca970 tx=0x7fc02801c800 comp rx=0 tx=0).stop 2024-08-31T04:17:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 -- 172.21.15.89:0/65801967 shutdown_connections 2024-08-31T04:17:47.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 --2- 172.21.15.89:0/65801967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 0x7fc0401535a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 --2- 172.21.15.89:0/65801967 >> v2:172.21.15.170:3300/0 conn(0x7fc040153ae0 0x7fc04006ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 -- 172.21.15.89:0/65801967 >> 172.21.15.89:0/65801967 conn(0x7fc04006dd40 msgr2=0x7fc04006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:47.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 -- 172.21.15.89:0/65801967 shutdown_connections 2024-08-31T04:17:47.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 -- 172.21.15.89:0/65801967 wait complete. 2024-08-31T04:17:47.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 Processor -- start 2024-08-31T04:17:47.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 -- start start 2024-08-31T04:17:47.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0400c60b0 0x7fc0401521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc040153ae0 0x7fc0401526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 0x7fc040148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc04006d750 con 0x7fc040159740 2024-08-31T04:17:47.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc0400b4190 con 0x7fc040153ae0 2024-08-31T04:17:47.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.305+0000 7fc046000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc04006fbb0 con 0x7fc0400c60b0 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc045600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 0x7fc040148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc045600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 0x7fc040148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36392/0 (socket says 172.21.15.89:36392) 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc045600640 1 -- 172.21.15.89:0/1975789599 learned_addr learned my addr 172.21.15.89:0/1975789599 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc044c00640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0400c60b0 0x7fc0401521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc037e00640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc040153ae0 0x7fc0401526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc045600640 1 -- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0400c60b0 msgr2=0x7fc0401521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc045600640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0400c60b0 0x7fc0401521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc045600640 1 -- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc040153ae0 msgr2=0x7fc0401526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc045600640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc040153ae0 0x7fc0401526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc045600640 1 -- 172.21.15.89:0/1975789599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0401f4fb0 con 0x7fc040159740 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc037e00640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc040153ae0 0x7fc0401526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:17:47.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc045600640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 0x7fc040148ac0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc03800e970 tx=0x7fc03800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:47.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc03d600640 1 -- 172.21.15.89:0/1975789599 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038004d30 con 0x7fc040159740 2024-08-31T04:17:47.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc03d600640 1 -- 172.21.15.89:0/1975789599 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc03800cb20 con 0x7fc040159740 2024-08-31T04:17:47.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc046000640 1 -- 172.21.15.89:0/1975789599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0400c3700 con 0x7fc040159740 2024-08-31T04:17:47.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc03d600640 1 -- 172.21.15.89:0/1975789599 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038005020 con 0x7fc040159740 2024-08-31T04:17:47.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc046000640 1 -- 172.21.15.89:0/1975789599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0401f5550 con 0x7fc040159740 2024-08-31T04:17:47.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.309+0000 7fc03d600640 1 -- 172.21.15.89:0/1975789599 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc0380051c0 con 0x7fc040159740 2024-08-31T04:17:47.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc03d600640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc01c0720c0 0x7fc01c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc03d600640 1 -- 172.21.15.89:0/1975789599 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fc0380937a0 con 0x7fc040159740 2024-08-31T04:17:47.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc01c0720c0 0x7fc01c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc04ee81000 1 Processor -- start 2024-08-31T04:17:47.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc04ee81000 1 -- start start 2024-08-31T04:17:47.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc01c0720c0 0x7fc01c0745d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc030007fd0 tx=0x7fc030009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:47.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece8980a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 0x563ece85dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece73a960 0x563ece85e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc04ee81000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563ece6b3820 con 0x563ece75b3f0 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc04ee81000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563ece6a2db0 con 0x563ece73a960 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc04ee81000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563ece6a6d60 con 0x563ece750e90 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece8980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece8980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36408/0 (socket says 172.21.15.89:36408) 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 -- 172.21.15.89:0/3202539214 learned_addr learned my addr 172.21.15.89:0/3202539214 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc037e00640 1 --2- 172.21.15.89:0/3202539214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 0x563ece85dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc045600640 1 --2- 172.21.15.89:0/3202539214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece73a960 0x563ece85e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 -- 172.21.15.89:0/3202539214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 msgr2=0x563ece85dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 --2- 172.21.15.89:0/3202539214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 0x563ece85dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 -- 172.21.15.89:0/3202539214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece73a960 msgr2=0x563ece85e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 --2- 172.21.15.89:0/3202539214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece73a960 0x563ece85e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 -- 172.21.15.89:0/3202539214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ece63db70 con 0x563ece75b3f0 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc044c00640 1 --2- 172.21.15.89:0/3202539214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece8980a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc03000fb40 tx=0x7fc030012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783539fc7c10bc09 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:47.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc035200640 1 -- 172.21.15.89:0/3202539214 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030025070 con 0x563ece75b3f0 2024-08-31T04:17:47.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc035200640 1 -- 172.21.15.89:0/3202539214 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc03001b050 con 0x563ece75b3f0 2024-08-31T04:17:47.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.313+0000 7fc035200640 1 -- 172.21.15.89:0/3202539214 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030014e40 con 0x563ece75b3f0 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 -- 172.21.15.89:0/3202539214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 msgr2=0x563ece8980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 --2- 172.21.15.89:0/3202539214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece8980a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc03000fb40 tx=0x7fc030012000 comp rx=0 tx=0).stop 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 -- 172.21.15.89:0/3202539214 shutdown_connections 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 --2- 172.21.15.89:0/3202539214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece73a960 0x563ece85e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 --2- 172.21.15.89:0/3202539214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 0x563ece85dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 --2- 172.21.15.89:0/3202539214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece8980a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 -- 172.21.15.89:0/3202539214 >> 172.21.15.89:0/3202539214 conn(0x563ece362210 msgr2=0x563ece897990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 -- 172.21.15.89:0/3202539214 shutdown_connections 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 -- 172.21.15.89:0/3202539214 wait complete. 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 -- start start 2024-08-31T04:17:47.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 Processor -- start 2024-08-31T04:17:47.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece73a960 0x563ece8944e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 0x563ece894a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece75b3f0 0x563ece894f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563ece369b10 con 0x563ece73a960 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563ece6296f0 con 0x563ece75b3f0 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563ece6ab390 con 0x563ece750e90 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc04ee81000 10 client.0 _ll_register_callbacks cb 0x563ece64ab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc044c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece73a960 0x563ece8944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc044c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece73a960 0x563ece8944e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36410/0 (socket says 172.21.15.89:36410) 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc044c00640 1 -- 172.21.15.89:0/1174702155 learned_addr learned my addr 172.21.15.89:0/1174702155 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc037e00640 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 0x563ece894a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc045600640 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece75b3f0 0x563ece894f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc044c00640 1 -- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 msgr2=0x563ece894a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc044c00640 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 0x563ece894a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc044c00640 1 -- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece75b3f0 msgr2=0x563ece894f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:47.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.317+0000 7fc044c00640 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece75b3f0 0x563ece894f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc044c00640 1 -- 172.21.15.89:0/1174702155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ece661380 con 0x563ece73a960 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc044c00640 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece73a960 0x563ece8944e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x563ece66bed0 tx=0x7fc0300206a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da1f1da6f9318b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc02d600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc02d600640 1 -- 172.21.15.89:0/1174702155 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030025040 con 0x563ece73a960 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc02d600640 1 -- 172.21.15.89:0/1174702155 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fc030020a90 con 0x563ece73a960 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc04ee81000 1 -- 172.21.15.89:0/1174702155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ece6b1d20 con 0x563ece73a960 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc02d600640 1 -- 172.21.15.89:0/1174702155 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc030020c90 con 0x563ece73a960 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc04ee81000 10 client.5379 fetch_fsmap learned FSMap version 9 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc04ee81000 1 -- 172.21.15.89:0/1174702155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563ece727e40 con 0x563ece73a960 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc02d600640 1 -- 172.21.15.89:0/1174702155 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563ece6b1d20 con 0x563ece73a960 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc02d600640 1 -- 172.21.15.89:0/1174702155 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fc030031300 con 0x563ece73a960 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc04ee81000 10 client.5379 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc04ee81000 10 client.5379 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc04ee81000 20 client.5379 populate_metadata read hostname 'smithi089' 2024-08-31T04:17:47.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ece346dc0 0x563ece8aed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc04ee81000 4 client.5379 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:17:47.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc04ee81000 1 -- 172.21.15.89:0/1174702155 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ece6b5770 con 0x563ece346dc0 2024-08-31T04:17:47.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc037e00640 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ece346dc0 0x563ece8aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc037e00640 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ece346dc0 0x563ece8aed80 crc :-1 s=READY pgs=610 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a9c711dff1cd2af server_cookie=eea21e137044730d in_seq=0 out_seq=0 2024-08-31T04:17:47.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.321+0000 7fc02d600640 10 client.5379 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:47.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc02d600640 1 -- 172.21.15.89:0/1174702155 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ece6b5770 con 0x563ece346dc0 2024-08-31T04:17:47.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc02d600640 10 client.5379 handle_command_reply: tid=0 2024-08-31T04:17:47.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 client.5379 shutdown 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 -- 172.21.15.89:0/1174702155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece73a960 msgr2=0x563ece8944e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece73a960 0x563ece8944e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x563ece66bed0 tx=0x7fc0300206a0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 -- 172.21.15.89:0/1174702155 shutdown_connections 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ece346dc0 0x563ece8aed80 crc :-1 s=READY pgs=610 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece75b3f0 0x563ece894f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece750e90 0x563ece894a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1174702155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece73a960 0x563ece8944e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc02d600640 0 client.5379 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 -- 172.21.15.89:0/1174702155 >> 172.21.15.89:0/1174702155 conn(0x563ece362210 msgr2=0x563ece896ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 -- 172.21.15.89:0/1174702155 shutdown_connections 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 1 -- 172.21.15.89:0/1174702155 wait complete. 2024-08-31T04:17:47.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.325+0000 7fc04ee81000 20 client.5379 trim_cache size 0 max 16384 2024-08-31T04:17:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 Processor -- start 2024-08-31T04:17:47.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 -- start start 2024-08-31T04:17:47.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 0x563ece8ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 0x563ece89b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece89b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc040201390 con 0x563ece75b3f0 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc040202660 con 0x563ece750e90 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc040201910 con 0x563ece73a960 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc045600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece89b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc045600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece89b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36420/0 (socket says 172.21.15.89:36420) 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc045600640 1 -- 172.21.15.89:0/2100013591 learned_addr learned my addr 172.21.15.89:0/2100013591 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc044c00640 1 --2- 172.21.15.89:0/2100013591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 0x563ece8ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc037e00640 1 --2- 172.21.15.89:0/2100013591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 0x563ece89b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc045600640 1 -- 172.21.15.89:0/2100013591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 msgr2=0x563ece8ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc045600640 1 --2- 172.21.15.89:0/2100013591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 0x563ece8ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc045600640 1 -- 172.21.15.89:0/2100013591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 msgr2=0x563ece89b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:47.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc045600640 1 --2- 172.21.15.89:0/2100013591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 0x563ece89b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc045600640 1 -- 172.21.15.89:0/2100013591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ece6ff5b0 con 0x563ece75b3f0 2024-08-31T04:17:47.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc045600640 1 --2- 172.21.15.89:0/2100013591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece89b810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc03805b8b0 tx=0x7fc038093040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba42d49a0a263cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:47.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc02fe00640 1 -- 172.21.15.89:0/2100013591 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03804b020 con 0x563ece75b3f0 2024-08-31T04:17:47.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc02fe00640 1 -- 172.21.15.89:0/2100013591 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc038067040 con 0x563ece75b3f0 2024-08-31T04:17:47.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc02fe00640 1 -- 172.21.15.89:0/2100013591 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03801f050 con 0x563ece75b3f0 2024-08-31T04:17:47.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 -- 172.21.15.89:0/2100013591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 msgr2=0x563ece89b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:47.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 --2- 172.21.15.89:0/2100013591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece89b810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc03805b8b0 tx=0x7fc038093040 comp rx=0 tx=0).stop 2024-08-31T04:17:47.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 -- 172.21.15.89:0/2100013591 shutdown_connections 2024-08-31T04:17:47.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 --2- 172.21.15.89:0/2100013591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece89b810 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 --2- 172.21.15.89:0/2100013591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 0x563ece89b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 --2- 172.21.15.89:0/2100013591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 0x563ece8ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 -- 172.21.15.89:0/2100013591 >> 172.21.15.89:0/2100013591 conn(0x563ece362210 msgr2=0x563ece896990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:47.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 -- 172.21.15.89:0/2100013591 shutdown_connections 2024-08-31T04:17:47.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.345+0000 7fc04ee81000 1 -- 172.21.15.89:0/2100013591 wait complete. 2024-08-31T04:17:47.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 -- start start 2024-08-31T04:17:47.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 Processor -- start 2024-08-31T04:17:47.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 0x563ece915150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 0x563ece915690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece915bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563ece624eb0 con 0x563ece75b3f0 2024-08-31T04:17:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc040201fc0 con 0x563ece750e90 2024-08-31T04:17:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563ece64af20 con 0x563ece73a960 2024-08-31T04:17:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 10 client.0 _ll_register_callbacks cb 0x7fc030023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:17:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc045600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece915bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc045600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece915bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36426/0 (socket says 172.21.15.89:36426) 2024-08-31T04:17:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc045600640 1 -- 172.21.15.89:0/1451072685 learned_addr learned my addr 172.21.15.89:0/1451072685 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:17:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc044c00640 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 0x563ece915150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc037e00640 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 0x563ece915690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc045600640 1 -- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 msgr2=0x563ece915150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc045600640 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 0x563ece915150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc045600640 1 -- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 msgr2=0x563ece915690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:17:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc045600640 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 0x563ece915690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:47.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc045600640 1 -- 172.21.15.89:0/1451072685 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ece633fc0 con 0x563ece75b3f0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc045600640 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece915bd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc038016000 tx=0x7fc038083500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66221362f5c6f4a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc02d600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc02d600640 1 -- 172.21.15.89:0/1451072685 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03804b040 con 0x563ece75b3f0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc02d600640 1 -- 172.21.15.89:0/1451072685 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fc038091300 con 0x563ece75b3f0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 -- 172.21.15.89:0/1451072685 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc038067040 con 0x563ece75b3f0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc02d600640 1 -- 172.21.15.89:0/1451072685 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc03805e640 con 0x563ece75b3f0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 10 client.5385 fetch_fsmap learned FSMap version 9 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc04ee81000 1 -- 172.21.15.89:0/1451072685 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563ece62ce00 con 0x563ece75b3f0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc02d600640 1 -- 172.21.15.89:0/1451072685 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc038067040 con 0x563ece75b3f0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.349+0000 7fc02d600640 1 -- 172.21.15.89:0/1451072685 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fc03800f040 con 0x563ece75b3f0 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.353+0000 7fc04ee81000 10 client.5385 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.353+0000 7fc04ee81000 10 client.5385 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:17:47.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.353+0000 7fc04ee81000 20 client.5385 populate_metadata read hostname 'smithi089' 2024-08-31T04:17:47.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.353+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ece334e20 0x563ece8d5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:47.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.353+0000 7fc04ee81000 4 client.5385 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 155.0, "await_for": 45.0}] 2024-08-31T04:17:47.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.353+0000 7fc04ee81000 1 -- 172.21.15.89:0/1451072685 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 155.0, "await_for": 45.0}) -- 0x563ece8b50a0 con 0x563ece334e20 2024-08-31T04:17:47.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.353+0000 7fc044c00640 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ece334e20 0x563ece8d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:47.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.353+0000 7fc02d600640 10 client.5385 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:47.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:47.353+0000 7fc044c00640 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ece334e20 0x563ece8d5600 crc :-1 s=READY pgs=611 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ef0dbc572165b73 server_cookie=b7c2f7d8633237c4 in_seq=0 out_seq=0 2024-08-31T04:17:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc02d600640 1 -- 172.21.15.89:0/1451072685 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563ece8b50a0 con 0x563ece334e20 2024-08-31T04:17:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc02d600640 10 client.5385 handle_command_reply: tid=0 2024-08-31T04:17:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 client.5385 shutdown 2024-08-31T04:17:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 -- 172.21.15.89:0/1451072685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 msgr2=0x563ece915bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece915bd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc038016000 tx=0x7fc038083500 comp rx=0 tx=0).stop 2024-08-31T04:17:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 -- 172.21.15.89:0/1451072685 shutdown_connections 2024-08-31T04:17:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ece334e20 0x563ece8d5600 crc :-1 s=READY pgs=611 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ece75b3f0 0x563ece915bd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ece750e90 0x563ece915690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 --2- 172.21.15.89:0/1451072685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ece73a960 0x563ece915150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc02d600640 0 client.5385 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 -- 172.21.15.89:0/1451072685 >> 172.21.15.89:0/1451072685 conn(0x563ece362210 msgr2=0x563ece8ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 -- 172.21.15.89:0/1451072685 shutdown_connections 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 1 -- 172.21.15.89:0/1451072685 wait complete. 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc04ee81000 20 client.5385 trim_cache size 0 max 16384 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:17:51.151 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 46, 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "4a297228": { 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 46, 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 155.0, 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:17:51.152 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:17:51.153 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:17:51.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:51.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:51.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:51.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:51.153 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:17:51.153 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:17:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 -- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc01c0720c0 msgr2=0x7fc01c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc01c0720c0 0x7fc01c0745d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc030007fd0 tx=0x7fc030009040 comp rx=0 tx=0).stop 2024-08-31T04:17:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 -- 172.21.15.89:0/1975789599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 msgr2=0x7fc040148ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 0x7fc040148ac0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc03800e970 tx=0x7fc03800ee30 comp rx=0 tx=0).stop 2024-08-31T04:17:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 -- 172.21.15.89:0/1975789599 shutdown_connections 2024-08-31T04:17:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc01c0720c0 0x7fc01c0745d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc040159740 0x7fc040148ac0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc040153ae0 0x7fc0401526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 --2- 172.21.15.89:0/1975789599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0400c60b0 0x7fc0401521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:51.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 -- 172.21.15.89:0/1975789599 >> 172.21.15.89:0/1975789599 conn(0x7fc04006dd40 msgr2=0x7fc040157820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:51.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 -- 172.21.15.89:0/1975789599 shutdown_connections 2024-08-31T04:17:51.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:17:51.145+0000 7fc046000640 1 -- 172.21.15.89:0/1975789599 wait complete. 2024-08-31T04:17:51.171 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4a297228', quiesce took 4.4 seconds. Will release after: 30.6 2024-08-31T04:18:03.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:18:03.198 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:18:21.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:18:21.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 -- 172.21.15.89:0/4196151034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72dc15bc70 msgr2=0x7f72dc152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:21.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 --2- 172.21.15.89:0/4196151034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72dc15bc70 0x7f72dc152a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0c9020 tx=0x7f72cc01f0d0 comp rx=0 tx=0).stop 2024-08-31T04:18:21.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 -- 172.21.15.89:0/4196151034 shutdown_connections 2024-08-31T04:18:21.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 --2- 172.21.15.89:0/4196151034 >> v2:172.21.15.170:3300/0 conn(0x7f72dc0c1f40 0x7f72dc0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:21.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 --2- 172.21.15.89:0/4196151034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72dc15bc70 0x7f72dc152a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:21.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 -- 172.21.15.89:0/4196151034 >> 172.21.15.89:0/4196151034 conn(0x7f72dc0ccf20 msgr2=0x7f72dc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:21.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 -- 172.21.15.89:0/4196151034 shutdown_connections 2024-08-31T04:18:21.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 -- 172.21.15.89:0/4196151034 wait complete. 2024-08-31T04:18:21.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 Processor -- start 2024-08-31T04:18:21.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.941+0000 7f72e1400640 1 -- start start 2024-08-31T04:18:21.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72e1400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72dc0c1f40 0x7f72dc1f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:21.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72e1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72dc0c7920 0x7f72dc14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:21.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72e1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72dc15bc70 0x7f72dc0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:21.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72e1400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc074fb0 con 0x7f72dc15bc70 2024-08-31T04:18:21.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72e1400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc074e30 con 0x7f72dc0c7920 2024-08-31T04:18:21.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72e1400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc0c7d30 con 0x7f72dc0c1f40 2024-08-31T04:18:21.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72db200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72dc15bc70 0x7f72dc0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:21.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72db200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72dc15bc70 0x7f72dc0b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48478/0 (socket says 172.21.15.89:48478) 2024-08-31T04:18:21.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72db200640 1 -- 172.21.15.89:0/2055846140 learned_addr learned my addr 172.21.15.89:0/2055846140 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:18:21.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72da800640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72dc0c1f40 0x7f72dc1f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:21.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72d9e00640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72dc0c7920 0x7f72dc14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:21.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72db200640 1 -- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72dc0c1f40 msgr2=0x7f72dc1f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:21.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72db200640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72dc0c1f40 0x7f72dc1f2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:21.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72db200640 1 -- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72dc0c7920 msgr2=0x7f72dc14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:21.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72db200640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72dc0c7920 0x7f72dc14b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:21.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72db200640 1 -- 172.21.15.89:0/2055846140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc1f31e0 con 0x7f72dc15bc70 2024-08-31T04:18:21.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72db200640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72dc15bc70 0x7f72dc0b1f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c6b0 tx=0x7f72d400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:21.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72d2a00640 1 -- 172.21.15.89:0/2055846140 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4003b80 con 0x7f72dc15bc70 2024-08-31T04:18:21.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72d2a00640 1 -- 172.21.15.89:0/2055846140 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72d4003d20 con 0x7f72dc15bc70 2024-08-31T04:18:21.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72d2a00640 1 -- 172.21.15.89:0/2055846140 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4005330 con 0x7f72dc15bc70 2024-08-31T04:18:21.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc0ccbd0 con 0x7f72dc15bc70 2024-08-31T04:18:21.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc0c6600 con 0x7f72dc15bc70 2024-08-31T04:18:21.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.945+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc0c9330 con 0x7f72dc15bc70 2024-08-31T04:18:21.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.949+0000 7f72d2a00640 1 -- 172.21.15.89:0/2055846140 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f72d40054d0 con 0x7f72dc15bc70 2024-08-31T04:18:21.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.949+0000 7f72d2a00640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f72bc0720c0 0x7f72bc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:21.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.949+0000 7f72d2a00640 1 -- 172.21.15.89:0/2055846140 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f72d4092bf0 con 0x7f72dc15bc70 2024-08-31T04:18:21.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.949+0000 7f72da800640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f72bc0720c0 0x7f72bc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:21.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.949+0000 7f72da800640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f72bc0720c0 0x7f72bc0745d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0b2000 tx=0x7f72cc01d910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:21.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:21.953+0000 7f72d2a00640 1 -- 172.21.15.89:0/2055846140 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f72d405db10 con 0x7f72dc15bc70 2024-08-31T04:18:22.147 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.149+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72dc1560a0 con 0x7f72dc15bc70 2024-08-31T04:18:22.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.149+0000 7f72d2a00640 1 -- 172.21.15.89:0/2055846140 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f72d40622d0 con 0x7f72dc15bc70 2024-08-31T04:18:22.148 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:18:22.148 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:18:22.148 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:18:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f72bc0720c0 msgr2=0x7f72bc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f72bc0720c0 0x7f72bc0745d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0b2000 tx=0x7f72cc01d910 comp rx=0 tx=0).stop 2024-08-31T04:18:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72dc15bc70 msgr2=0x7f72dc0b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72dc15bc70 0x7f72dc0b1f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c6b0 tx=0x7f72d400cb70 comp rx=0 tx=0).stop 2024-08-31T04:18:22.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 shutdown_connections 2024-08-31T04:18:22.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f72bc0720c0 0x7f72bc0745d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72dc15bc70 0x7f72dc0b1f20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72dc0c7920 0x7f72dc14b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 --2- 172.21.15.89:0/2055846140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72dc0c1f40 0x7f72dc1f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 >> 172.21.15.89:0/2055846140 conn(0x7f72dc0ccf20 msgr2=0x7f72dc070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:22.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 shutdown_connections 2024-08-31T04:18:22.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.153+0000 7f72e1400640 1 -- 172.21.15.89:0/2055846140 wait complete. 2024-08-31T04:18:22.169 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 4a297228 --release --await' 2024-08-31T04:18:22.170 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 4a297228 --release --await 2024-08-31T04:18:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.333+0000 7fdd2a800640 1 -- 172.21.15.89:0/1952504333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2d20 msgr2=0x7fdd240c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.333+0000 7fdd2a800640 1 --2- 172.21.15.89:0/1952504333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2d20 0x7fdd240c1ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009840 tx=0x7fdd0c01c790 comp rx=0 tx=0).stop 2024-08-31T04:18:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.333+0000 7fdd2a800640 1 -- 172.21.15.89:0/1952504333 shutdown_connections 2024-08-31T04:18:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.333+0000 7fdd2a800640 1 --2- 172.21.15.89:0/1952504333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2d20 0x7fdd240c1ed0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.333+0000 7fdd2a800640 1 -- 172.21.15.89:0/1952504333 >> 172.21.15.89:0/1952504333 conn(0x7fdd240c99b0 msgr2=0x7fdd240c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.333+0000 7fdd2a800640 1 -- 172.21.15.89:0/1952504333 shutdown_connections 2024-08-31T04:18:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.333+0000 7fdd2a800640 1 -- 172.21.15.89:0/1952504333 wait complete. 2024-08-31T04:18:22.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.333+0000 7fdd2a800640 1 Processor -- start 2024-08-31T04:18:22.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.333+0000 7fdd2a800640 1 -- start start 2024-08-31T04:18:22.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd2a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2860 0x7fdd2414c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd2a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd240b2d20 0x7fdd2414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd2a800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd240c90e0 0x7fdd24145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd2a800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdd240c2670 con 0x7fdd240b2860 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd2a800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdd240c8c50 con 0x7fdd240b2d20 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd2a800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdd24166780 con 0x7fdd240c90e0 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2860 0x7fdd2414c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2860 0x7fdd2414c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48504/0 (socket says 172.21.15.89:48504) 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23400640 1 -- 172.21.15.89:0/621876086 learned_addr learned my addr 172.21.15.89:0/621876086 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23e00640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd240c90e0 0x7fdd24145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd1aa00640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd240b2d20 0x7fdd2414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23400640 1 -- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd240c90e0 msgr2=0x7fdd24145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23400640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd240c90e0 0x7fdd24145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23400640 1 -- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd240b2d20 msgr2=0x7fdd2414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23400640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd240b2d20 0x7fdd2414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23400640 1 -- 172.21.15.89:0/621876086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2414dbc0 con 0x7fdd240b2860 2024-08-31T04:18:22.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd23400640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2860 0x7fdd2414c8c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400c460 tx=0x7fdd1400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:22.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd1be00640 1 -- 172.21.15.89:0/621876086 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14016020 con 0x7fdd240b2860 2024-08-31T04:18:22.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd1be00640 1 -- 172.21.15.89:0/621876086 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd14012940 con 0x7fdd240b2860 2024-08-31T04:18:22.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd1be00640 1 -- 172.21.15.89:0/621876086 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14012d90 con 0x7fdd240b2860 2024-08-31T04:18:22.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd2a800640 1 -- 172.21.15.89:0/621876086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd24151ba0 con 0x7fdd240b2860 2024-08-31T04:18:22.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.337+0000 7fdd2a800640 1 -- 172.21.15.89:0/621876086 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd241f37b0 con 0x7fdd240b2860 2024-08-31T04:18:22.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd1be00640 1 -- 172.21.15.89:0/621876086 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdd14019020 con 0x7fdd240b2860 2024-08-31T04:18:22.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd1be00640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdd000720c0 0x7fdd000745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd1be00640 1 -- 172.21.15.89:0/621876086 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdd14092f40 con 0x7fdd240b2860 2024-08-31T04:18:22.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd31fec000 1 Processor -- start 2024-08-31T04:18:22.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd1aa00640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdd000720c0 0x7fdd000745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd31fec000 1 -- start start 2024-08-31T04:18:22.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd1aa00640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdd000720c0 0x7fdd000745d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0af000 tx=0x7fdd0c01afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:22.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33d1950 0x5597a34efe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 0x5597a34f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd31fec000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5597a339af30 con 0x5597a33ac890 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd31fec000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5597a3310690 con 0x5597a33bb930 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.341+0000 7fdd31fec000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5597a32ffc20 con 0x5597a33d1950 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48506/0 (socket says 172.21.15.89:48506) 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23e00640 1 -- 172.21.15.89:0/2032211358 learned_addr learned my addr 172.21.15.89:0/2032211358 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd1aa00640 1 --2- 172.21.15.89:0/2032211358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 0x5597a34f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23400640 1 --2- 172.21.15.89:0/2032211358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33d1950 0x5597a34efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23e00640 1 -- 172.21.15.89:0/2032211358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33d1950 msgr2=0x5597a34efe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:18:22.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23e00640 1 --2- 172.21.15.89:0/2032211358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33d1950 0x5597a34efe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23e00640 1 -- 172.21.15.89:0/2032211358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 msgr2=0x5597a34f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:18:22.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23e00640 1 --2- 172.21.15.89:0/2032211358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 0x5597a34f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23e00640 1 -- 172.21.15.89:0/2032211358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a32b48f0 con 0x5597a33ac890 2024-08-31T04:18:22.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd23e00640 1 --2- 172.21.15.89:0/2032211358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f5010 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c001c10 tx=0x7fdd1c0020d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673ab99063f04767 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:22.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd13e00640 1 -- 172.21.15.89:0/2032211358 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c019070 con 0x5597a33ac890 2024-08-31T04:18:22.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd13e00640 1 -- 172.21.15.89:0/2032211358 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd1c003b90 con 0x5597a33ac890 2024-08-31T04:18:22.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd13e00640 1 -- 172.21.15.89:0/2032211358 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c00e800 con 0x5597a33ac890 2024-08-31T04:18:22.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 -- 172.21.15.89:0/2032211358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 msgr2=0x5597a34f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 --2- 172.21.15.89:0/2032211358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f5010 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c001c10 tx=0x7fdd1c0020d0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 -- 172.21.15.89:0/2032211358 shutdown_connections 2024-08-31T04:18:22.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 --2- 172.21.15.89:0/2032211358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f5010 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 --2- 172.21.15.89:0/2032211358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 0x5597a34f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 --2- 172.21.15.89:0/2032211358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33d1950 0x5597a34efe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 -- 172.21.15.89:0/2032211358 >> 172.21.15.89:0/2032211358 conn(0x5597a33d1540 msgr2=0x5597a34f2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:22.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 -- 172.21.15.89:0/2032211358 shutdown_connections 2024-08-31T04:18:22.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 -- 172.21.15.89:0/2032211358 wait complete. 2024-08-31T04:18:22.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 -- start start 2024-08-31T04:18:22.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.345+0000 7fdd31fec000 1 Processor -- start 2024-08-31T04:18:22.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 0x5597a34ef030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33bb930 0x5597a34ef570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 0x5597a34f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5597a3286500 con 0x5597a33bb930 2024-08-31T04:18:22.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5597a3303bd0 con 0x5597a33d1950 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5597a32a7a30 con 0x5597a33ac890 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 10 client.0 _ll_register_callbacks cb 0x5597a33b5b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd1aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33bb930 0x5597a34ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd1aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33bb930 0x5597a34ef570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48522/0 (socket says 172.21.15.89:48522) 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd1aa00640 1 -- 172.21.15.89:0/3475353262 learned_addr learned my addr 172.21.15.89:0/3475353262 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd23400640 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 0x5597a34ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd23e00640 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 0x5597a34f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd1aa00640 1 -- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 msgr2=0x5597a34ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd1aa00640 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 0x5597a34ef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd1aa00640 1 -- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 msgr2=0x5597a34f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd1aa00640 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 0x5597a34f9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd1aa00640 1 -- 172.21.15.89:0/3475353262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a329f6a0 con 0x5597a33bb930 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd1aa00640 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33bb930 0x5597a34ef570 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0193a0 tx=0x7fdd0c0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed05c54e77a806b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd10c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd10c00640 1 -- 172.21.15.89:0/3475353262 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0cd060 con 0x5597a33bb930 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd10c00640 1 -- 172.21.15.89:0/3475353262 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdd0c0a6dc0 con 0x5597a33bb930 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 -- 172.21.15.89:0/3475353262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597a32997e0 con 0x5597a33bb930 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd10c00640 1 -- 172.21.15.89:0/3475353262 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdd0c0d3050 con 0x5597a33bb930 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 10 client.5403 fetch_fsmap learned FSMap version 9 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 -- 172.21.15.89:0/3475353262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5597a32be1c0 con 0x5597a33bb930 2024-08-31T04:18:22.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd10c00640 1 -- 172.21.15.89:0/3475353262 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5597a32997e0 con 0x5597a33bb930 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd10c00640 1 -- 172.21.15.89:0/3475353262 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdd0c0d6020 con 0x5597a33bb930 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 10 client.5403 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 10 client.5403 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 20 client.5403 populate_metadata read hostname 'smithi089' 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597a3395fc0 0x5597a34fa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 4 client.5403 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd31fec000 1 -- 172.21.15.89:0/3475353262 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597a33125e0 con 0x5597a3395fc0 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd23400640 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597a3395fc0 0x5597a34fa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd23400640 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597a3395fc0 0x5597a34fa970 crc :-1 s=READY pgs=612 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50aa2ee26730ce50 server_cookie=554bf13a84660880 in_seq=0 out_seq=0 2024-08-31T04:18:22.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.349+0000 7fdd10c00640 10 client.5403 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:18:22.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd10c00640 1 -- 172.21.15.89:0/3475353262 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597a33125e0 con 0x5597a3395fc0 2024-08-31T04:18:22.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd10c00640 10 client.5403 handle_command_reply: tid=0 2024-08-31T04:18:22.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 client.5403 shutdown 2024-08-31T04:18:22.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 -- 172.21.15.89:0/3475353262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33bb930 msgr2=0x5597a34ef570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33bb930 0x5597a34ef570 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0193a0 tx=0x7fdd0c0091e0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 -- 172.21.15.89:0/3475353262 shutdown_connections 2024-08-31T04:18:22.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597a3395fc0 0x5597a34fa970 crc :-1 s=READY pgs=612 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33bb930 0x5597a34ef570 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 0x5597a34f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 --2- 172.21.15.89:0/3475353262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 0x5597a34ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 -- 172.21.15.89:0/3475353262 >> 172.21.15.89:0/3475353262 conn(0x5597a33d1540 msgr2=0x5597a34f0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:22.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd10c00640 0 client.5403 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:18:22.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 -- 172.21.15.89:0/3475353262 shutdown_connections 2024-08-31T04:18:22.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 1 -- 172.21.15.89:0/3475353262 wait complete. 2024-08-31T04:18:22.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.353+0000 7fdd31fec000 20 client.5403 trim_cache size 0 max 16384 2024-08-31T04:18:22.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd31fec000 1 Processor -- start 2024-08-31T04:18:22.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd31fec000 1 -- start start 2024-08-31T04:18:22.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33bb930 0x5597a34f9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 0x5597a350c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd31fec000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24201d40 con 0x5597a33ac890 2024-08-31T04:18:22.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd31fec000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24200c20 con 0x5597a33d1950 2024-08-31T04:18:22.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd31fec000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdd241ff1a0 con 0x5597a33bb930 2024-08-31T04:18:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48526/0 (socket says 172.21.15.89:48526) 2024-08-31T04:18:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23400640 1 -- 172.21.15.89:0/2117059120 learned_addr learned my addr 172.21.15.89:0/2117059120 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:18:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd1aa00640 1 --2- 172.21.15.89:0/2117059120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33bb930 0x5597a34f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23e00640 1 --2- 172.21.15.89:0/2117059120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 0x5597a350c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23400640 1 -- 172.21.15.89:0/2117059120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33bb930 msgr2=0x5597a34f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:18:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23400640 1 --2- 172.21.15.89:0/2117059120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33bb930 0x5597a34f9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23400640 1 -- 172.21.15.89:0/2117059120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 msgr2=0x5597a350c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23400640 1 --2- 172.21.15.89:0/2117059120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 0x5597a350c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23400640 1 -- 172.21.15.89:0/2117059120 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a34f9f40 con 0x5597a33ac890 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd23400640 1 --2- 172.21.15.89:0/2117059120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f8d10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdd14059ef0 tx=0x7fdd14080040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79334111c31ec9c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd13400640 1 -- 172.21.15.89:0/2117059120 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14086030 con 0x5597a33ac890 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd13400640 1 -- 172.21.15.89:0/2117059120 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd14091110 con 0x5597a33ac890 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.373+0000 7fdd13400640 1 -- 172.21.15.89:0/2117059120 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14066c70 con 0x5597a33ac890 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 -- 172.21.15.89:0/2117059120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 msgr2=0x5597a34f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 --2- 172.21.15.89:0/2117059120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f8d10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdd14059ef0 tx=0x7fdd14080040 comp rx=0 tx=0).stop 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 -- 172.21.15.89:0/2117059120 shutdown_connections 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 --2- 172.21.15.89:0/2117059120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33d1950 0x5597a350c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 --2- 172.21.15.89:0/2117059120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33bb930 0x5597a34f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 --2- 172.21.15.89:0/2117059120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33ac890 0x5597a34f8d10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 -- 172.21.15.89:0/2117059120 >> 172.21.15.89:0/2117059120 conn(0x5597a33d1540 msgr2=0x5597a34b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 -- 172.21.15.89:0/2117059120 shutdown_connections 2024-08-31T04:18:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 -- 172.21.15.89:0/2117059120 wait complete. 2024-08-31T04:18:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 -- start start 2024-08-31T04:18:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 Processor -- start 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 0x5597a350ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 0x5597a350f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33d1950 0x5597a3533400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241ff7f0 con 0x5597a33d1950 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24200550 con 0x5597a33bb930 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdd241ffe80 con 0x5597a33ac890 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd31fec000 10 client.0 _ll_register_callbacks cb 0x7fdd0c0096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd23e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33d1950 0x5597a3533400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd23e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33d1950 0x5597a3533400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48528/0 (socket says 172.21.15.89:48528) 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd23e00640 1 -- 172.21.15.89:0/4117757571 learned_addr learned my addr 172.21.15.89:0/4117757571 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd23400640 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 0x5597a350ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd1aa00640 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 0x5597a350f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd23e00640 1 -- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 msgr2=0x5597a350ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:18:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd23e00640 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 0x5597a350ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd23e00640 1 -- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 msgr2=0x5597a350f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:18:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd23e00640 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 0x5597a350f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.377+0000 7fdd23e00640 1 -- 172.21.15.89:0/4117757571 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a33842f0 con 0x5597a33d1950 2024-08-31T04:18:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd23e00640 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33d1950 0x5597a3533400 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0012f0 tx=0x7fdd1c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1922bd320d6dea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd10c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:18:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd10c00640 1 -- 172.21.15.89:0/4117757571 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c024030 con 0x5597a33d1950 2024-08-31T04:18:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd10c00640 1 -- 172.21.15.89:0/4117757571 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdd1c010040 con 0x5597a33d1950 2024-08-31T04:18:22.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd31fec000 1 -- 172.21.15.89:0/4117757571 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd14091110 con 0x5597a33d1950 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd10c00640 1 -- 172.21.15.89:0/4117757571 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdd1c030050 con 0x5597a33d1950 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd31fec000 10 client.5409 fetch_fsmap learned FSMap version 9 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd31fec000 1 -- 172.21.15.89:0/4117757571 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5597a3289b30 con 0x5597a33d1950 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd10c00640 1 -- 172.21.15.89:0/4117757571 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd14091110 con 0x5597a33d1950 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd10c00640 1 -- 172.21.15.89:0/4117757571 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdd1c033020 con 0x5597a33d1950 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd31fec000 10 client.5409 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd31fec000 10 client.5409 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd31fec000 20 client.5409 populate_metadata read hostname 'smithi089' 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd31fec000 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597a2f91e80 0x5597a35727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd31fec000 4 client.5409 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4a297228", "release": true, "await": true}] 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd31fec000 1 -- 172.21.15.89:0/4117757571 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4a297228", "release": true, "await": true}) -- 0x5597a330e080 con 0x5597a2f91e80 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd23400640 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597a2f91e80 0x5597a35727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:22.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd23400640 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597a2f91e80 0x5597a35727f0 crc :-1 s=READY pgs=613 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab59d965023a4326 server_cookie=fd14dd7ad561cc4a in_seq=0 out_seq=0 2024-08-31T04:18:22.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.381+0000 7fdd10c00640 10 client.5409 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:18:22.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.821+0000 7fdd10c00640 1 -- 172.21.15.89:0/4117757571 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5597a330e080 con 0x5597a2f91e80 2024-08-31T04:18:22.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.821+0000 7fdd10c00640 10 client.5409 handle_command_reply: tid=0 2024-08-31T04:18:22.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 client.5409 shutdown 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 -- 172.21.15.89:0/4117757571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33d1950 msgr2=0x5597a3533400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33d1950 0x5597a3533400 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0012f0 tx=0x7fdd1c007e80 comp rx=0 tx=0).stop 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 -- 172.21.15.89:0/4117757571 shutdown_connections 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597a2f91e80 0x5597a35727f0 crc :-1 s=READY pgs=613 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597a33d1950 0x5597a3533400 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597a33bb930 0x5597a350f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 --2- 172.21.15.89:0/4117757571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597a33ac890 0x5597a350ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 -- 172.21.15.89:0/4117757571 >> 172.21.15.89:0/4117757571 conn(0x5597a33d1540 msgr2=0x5597a350fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd10c00640 0 client.5409 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:18:22.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 -- 172.21.15.89:0/4117757571 shutdown_connections 2024-08-31T04:18:22.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 1 -- 172.21.15.89:0/4117757571 wait complete. 2024-08-31T04:18:22.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd31fec000 20 client.5409 trim_cache size 0 max 16384 2024-08-31T04:18:22.823 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:18:22.823 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:18:22.823 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:18:22.823 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 48, 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "4a297228": { 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 48, 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 155.0, 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:18:22.824 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:18:22.825 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:18:22.825 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:18:22.825 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:18:22.825 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:18:22.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:18:22.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:18:22.825 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:18:22.826 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:18:22.826 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:18:22.826 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:18:22.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 -- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdd000720c0 msgr2=0x7fdd000745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdd000720c0 0x7fdd000745d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0af000 tx=0x7fdd0c01afd0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 -- 172.21.15.89:0/621876086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2860 msgr2=0x7fdd2414c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:22.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2860 0x7fdd2414c8c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400c460 tx=0x7fdd1400c920 comp rx=0 tx=0).stop 2024-08-31T04:18:22.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 -- 172.21.15.89:0/621876086 shutdown_connections 2024-08-31T04:18:22.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdd000720c0 0x7fdd000745d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd240c90e0 0x7fdd24145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd240b2d20 0x7fdd2414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 --2- 172.21.15.89:0/621876086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd240b2860 0x7fdd2414c8c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:22.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 -- 172.21.15.89:0/621876086 >> 172.21.15.89:0/621876086 conn(0x7fdd240c99b0 msgr2=0x7fdd2414bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:22.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 -- 172.21.15.89:0/621876086 shutdown_connections 2024-08-31T04:18:22.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:18:22.825+0000 7fdd2a800640 1 -- 172.21.15.89:0/621876086 wait complete. 2024-08-31T04:18:22.844 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4a297228', total seconds elapsed: 36.1 2024-08-31T04:18:33.294 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:18:33.298 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:19:03.485 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:19:03.490 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:19:27.848 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:19:27.849 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.25 2024-08-31T04:19:27.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:19:28.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.019+0000 7f1506600640 1 -- 172.21.15.89:0/1803511106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e4003a10 msgr2=0x7f14e4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.019+0000 7f1506600640 1 --2- 172.21.15.89:0/1803511106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14e4003a10 0x7f14e4003e80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f14f000c290 tx=0x7f14f001f790 comp rx=0 tx=0).stop 2024-08-31T04:19:28.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.019+0000 7f14ffe00640 1 -- 172.21.15.89:0/1803511106 reap_dead start 2024-08-31T04:19:28.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.019+0000 7f1506600640 1 -- 172.21.15.89:0/1803511106 shutdown_connections 2024-08-31T04:19:28.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.019+0000 7f1506600640 1 -- 172.21.15.89:0/1803511106 >> 172.21.15.89:0/1803511106 conn(0x7f15000ccf20 msgr2=0x7f15000cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:28.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.019+0000 7f1506600640 1 -- 172.21.15.89:0/1803511106 shutdown_connections 2024-08-31T04:19:28.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.019+0000 7f1506600640 1 -- 172.21.15.89:0/1803511106 wait complete. 2024-08-31T04:19:28.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.019+0000 7f1506600640 1 Processor -- start 2024-08-31T04:19:28.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 -- start start 2024-08-31T04:19:28.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14e4003a10 0x7f1500153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15001552a0 0x7f15001e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15001e5040 0x7f150014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f15000c8030 con 0x7f15001552a0 2024-08-31T04:19:28.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f15000c3150 con 0x7f15001e5040 2024-08-31T04:19:28.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1500152a10 con 0x7f14e4003a10 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f6a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15001552a0 0x7f15001e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f6a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15001552a0 0x7f15001e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55716/0 (socket says 172.21.15.89:55716) 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f6a00640 1 -- 172.21.15.89:0/42503395 learned_addr learned my addr 172.21.15.89:0/42503395 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14ff400640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14e4003a10 0x7f1500153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14ffe00640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15001e5040 0x7f150014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f6a00640 1 -- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14e4003a10 msgr2=0x7f1500153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f6a00640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14e4003a10 0x7f1500153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f6a00640 1 -- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15001e5040 msgr2=0x7f150014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f6a00640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15001e5040 0x7f150014d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f6a00640 1 -- 172.21.15.89:0/42503395 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1500153dd0 con 0x7f15001552a0 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f6a00640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15001552a0 0x7f15001e4b00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f14e8011750 tx=0x7f14e8011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f7e00640 1 -- 172.21.15.89:0/42503395 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e801f070 con 0x7f15001552a0 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f7e00640 1 -- 172.21.15.89:0/42503395 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14e800fe40 con 0x7f15001552a0 2024-08-31T04:19:28.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15001f0490 con 0x7f15001552a0 2024-08-31T04:19:28.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f14f7e00640 1 -- 172.21.15.89:0/42503395 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e80126b0 con 0x7f15001552a0 2024-08-31T04:19:28.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15001e41b0 con 0x7f15001552a0 2024-08-31T04:19:28.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.023+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15000c7920 con 0x7f15001552a0 2024-08-31T04:19:28.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.027+0000 7f14f7e00640 1 -- 172.21.15.89:0/42503395 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f14e8022070 con 0x7f15001552a0 2024-08-31T04:19:28.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.027+0000 7f14f7e00640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f14dc0720f0 0x7f14dc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.027+0000 7f14f7e00640 1 -- 172.21.15.89:0/42503395 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f14e8093980 con 0x7f15001552a0 2024-08-31T04:19:28.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.027+0000 7f14ff400640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f14dc0720f0 0x7f14dc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.027+0000 7f14ff400640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f14dc0720f0 0x7f14dc074600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f14f00b0000 tx=0x7f14f001c5d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:28.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.031+0000 7f14f7e00640 1 -- 172.21.15.89:0/42503395 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f14e805e800 con 0x7f15001552a0 2024-08-31T04:19:28.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.231+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15001560a0 con 0x7f15001552a0 2024-08-31T04:19:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.231+0000 7f14f7e00640 1 -- 172.21.15.89:0/42503395 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f14e8062fc0 con 0x7f15001552a0 2024-08-31T04:19:28.231 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:19:28.231 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:19:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:19:28.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f14dc0720f0 msgr2=0x7f14dc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f14dc0720f0 0x7f14dc074600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f14f00b0000 tx=0x7f14f001c5d0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15001552a0 msgr2=0x7f15001e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15001552a0 0x7f15001e4b00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f14e8011750 tx=0x7f14e8011c10 comp rx=0 tx=0).stop 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 shutdown_connections 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f14dc0720f0 0x7f14dc074600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15001552a0 0x7f15001e4b00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15001e5040 0x7f150014d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 --2- 172.21.15.89:0/42503395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14e4003a10 0x7f1500153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 >> 172.21.15.89:0/42503395 conn(0x7f15000ccf20 msgr2=0x7f150014fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 shutdown_connections 2024-08-31T04:19:28.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.235+0000 7f1506600640 1 -- 172.21.15.89:0/42503395 wait complete. 2024-08-31T04:19:28.253 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 141.25 --await-for 45.0' 2024-08-31T04:19:28.253 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 141.25 --await-for 45.0 2024-08-31T04:19:28.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.423+0000 7f01f4a00640 1 -- 172.21.15.89:0/4078742853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01f00b2d20 msgr2=0x7f01f00c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.423+0000 7f01f4a00640 1 --2- 172.21.15.89:0/4078742853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01f00b2d20 0x7f01f00c1ed0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009900 tx=0x7f01d801c850 comp rx=0 tx=0).stop 2024-08-31T04:19:28.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.423+0000 7f01f4a00640 1 -- 172.21.15.89:0/4078742853 shutdown_connections 2024-08-31T04:19:28.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.423+0000 7f01f4a00640 1 --2- 172.21.15.89:0/4078742853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01f00c90e0 0x7f01f00747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.423+0000 7f01f4a00640 1 --2- 172.21.15.89:0/4078742853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01f00b2d20 0x7f01f00c1ed0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.423+0000 7f01f4a00640 1 -- 172.21.15.89:0/4078742853 >> 172.21.15.89:0/4078742853 conn(0x7f01f00c99b0 msgr2=0x7f01f00c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:28.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.423+0000 7f01f4a00640 1 -- 172.21.15.89:0/4078742853 shutdown_connections 2024-08-31T04:19:28.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.423+0000 7f01f4a00640 1 -- 172.21.15.89:0/4078742853 wait complete. 2024-08-31T04:19:28.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 Processor -- start 2024-08-31T04:19:28.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 -- start start 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01f00b2860 0x7f01f0149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01f00b2d20 0x7f01f014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01f00c90e0 0x7f01f00cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0165770 con 0x7f01f00c90e0 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01658f0 con 0x7f01f00b2860 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f01f0165a70 con 0x7f01f00b2d20 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ee800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01f00c90e0 0x7f01f00cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ee800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01f00c90e0 0x7f01f00cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55724/0 (socket says 172.21.15.89:55724) 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ee800640 1 -- 172.21.15.89:0/1222632795 learned_addr learned my addr 172.21.15.89:0/1222632795 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:28.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ede00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01f00b2860 0x7f01f0149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01e5400640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01f00b2d20 0x7f01f014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ee800640 1 -- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01f00b2d20 msgr2=0x7f01f014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ee800640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01f00b2d20 0x7f01f014aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ee800640 1 -- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01f00b2860 msgr2=0x7f01f0149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ee800640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01f00b2860 0x7f01f0149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ee800640 1 -- 172.21.15.89:0/1222632795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f0149530 con 0x7f01f00c90e0 2024-08-31T04:19:28.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01ee800640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01f00c90e0 0x7f01f00cbed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f01e800e970 tx=0x7f01e800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:28.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01e6a00640 1 -- 172.21.15.89:0/1222632795 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e800ccc0 con 0x7f01f00c90e0 2024-08-31T04:19:28.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01e6a00640 1 -- 172.21.15.89:0/1222632795 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01e800ce60 con 0x7f01f00c90e0 2024-08-31T04:19:28.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 -- 172.21.15.89:0/1222632795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f0149250 con 0x7f01f00c90e0 2024-08-31T04:19:28.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01e6a00640 1 -- 172.21.15.89:0/1222632795 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8004260 con 0x7f01f00c90e0 2024-08-31T04:19:28.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.427+0000 7f01f4a00640 1 -- 172.21.15.89:0/1222632795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f00c6290 con 0x7f01f00c90e0 2024-08-31T04:19:28.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.431+0000 7f01e6a00640 1 -- 172.21.15.89:0/1222632795 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f01e8003600 con 0x7f01f00c90e0 2024-08-31T04:19:28.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.431+0000 7f01e6a00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f01cc0720f0 0x7f01cc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.431+0000 7f01e6a00640 1 -- 172.21.15.89:0/1222632795 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f01e8093890 con 0x7f01f00c90e0 2024-08-31T04:19:28.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.431+0000 7f01ede00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f01cc0720f0 0x7f01cc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.431+0000 7f01fbf79000 1 Processor -- start 2024-08-31T04:19:28.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.431+0000 7f01fbf79000 1 -- start start 2024-08-31T04:19:28.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ede00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f01cc0720f0 0x7f01cc074600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f01e0001e40 tx=0x7f01e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa35dab0 0x55dcfa890820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa74c840 0x55dcfa8944b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa8949f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa6af8c0 con 0x55dcfa736800 2024-08-31T04:19:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa69ee50 con 0x55dcfa35dab0 2024-08-31T04:19:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55dcfa6a2e00 con 0x55dcfa74c840 2024-08-31T04:19:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ee800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa8949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ee800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa8949f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55732/0 (socket says 172.21.15.89:55732) 2024-08-31T04:19:28.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ee800640 1 -- 172.21.15.89:0/89460170 learned_addr learned my addr 172.21.15.89:0/89460170 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ede00640 1 --2- 172.21.15.89:0/89460170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa35dab0 0x55dcfa890820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01e5400640 1 --2- 172.21.15.89:0/89460170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa74c840 0x55dcfa8944b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ee800640 1 -- 172.21.15.89:0/89460170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa74c840 msgr2=0x55dcfa8944b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ee800640 1 --2- 172.21.15.89:0/89460170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa74c840 0x55dcfa8944b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ee800640 1 -- 172.21.15.89:0/89460170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa35dab0 msgr2=0x55dcfa890820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ee800640 1 --2- 172.21.15.89:0/89460170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa35dab0 0x55dcfa890820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ee800640 1 -- 172.21.15.89:0/89460170 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfa63e850 con 0x55dcfa736800 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01ee800640 1 --2- 172.21.15.89:0/89460170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa8949f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f01e805ac70 tx=0x7f01e8067250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b692dc47f0b6ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01de600640 1 -- 172.21.15.89:0/89460170 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e805e680 con 0x55dcfa736800 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01de600640 1 -- 172.21.15.89:0/89460170 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01e8067910 con 0x55dcfa736800 2024-08-31T04:19:28.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01de600640 1 -- 172.21.15.89:0/89460170 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8004400 con 0x55dcfa736800 2024-08-31T04:19:28.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 -- 172.21.15.89:0/89460170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 msgr2=0x55dcfa8949f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 --2- 172.21.15.89:0/89460170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa8949f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f01e805ac70 tx=0x7f01e8067250 comp rx=0 tx=0).stop 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 -- 172.21.15.89:0/89460170 shutdown_connections 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 --2- 172.21.15.89:0/89460170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa8949f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 --2- 172.21.15.89:0/89460170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa74c840 0x55dcfa8944b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 --2- 172.21.15.89:0/89460170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa35dab0 0x55dcfa890820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 -- 172.21.15.89:0/89460170 >> 172.21.15.89:0/89460170 conn(0x55dcfa823290 msgr2=0x55dcfa893280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 -- 172.21.15.89:0/89460170 shutdown_connections 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 -- 172.21.15.89:0/89460170 wait complete. 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.435+0000 7f01fbf79000 1 -- start start 2024-08-31T04:19:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 Processor -- start 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 0x55dcfa89f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa89f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 0x55dcfa855ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa6446f0 con 0x55dcfa736800 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa6ae690 con 0x55dcfa74c840 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55dcfa620df0 con 0x55dcfa35dab0 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 10 client.0 _ll_register_callbacks cb 0x55dcfa83fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01e5400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa89f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01e5400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa89f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55742/0 (socket says 172.21.15.89:55742) 2024-08-31T04:19:28.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01e5400640 1 -- 172.21.15.89:0/2143184259 learned_addr learned my addr 172.21.15.89:0/2143184259 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01ede00640 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 0x55dcfa89f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01ee800640 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 0x55dcfa855ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01e5400640 1 -- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 msgr2=0x55dcfa89f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01e5400640 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 0x55dcfa89f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01e5400640 1 -- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 msgr2=0x55dcfa855ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01e5400640 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 0x55dcfa855ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01e5400640 1 -- 172.21.15.89:0/2143184259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfa649340 con 0x55dcfa736800 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01e5400640 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa89f580 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f01d80b0040 tx=0x7f01d8004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bc1bfd62b42a37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01d2a00640 1 -- 172.21.15.89:0/2143184259 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d80b2070 con 0x55dcfa736800 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01d2a00640 1 -- 172.21.15.89:0/2143184259 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f01d8005020 con 0x55dcfa736800 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 -- 172.21.15.89:0/2143184259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dcfa638960 con 0x55dcfa736800 2024-08-31T04:19:28.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01d2a00640 1 -- 172.21.15.89:0/2143184259 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f01d8005220 con 0x55dcfa736800 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 10 client.5424 fetch_fsmap learned FSMap version 9 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 -- 172.21.15.89:0/2143184259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55dcfa639bd0 con 0x55dcfa736800 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01d2a00640 1 -- 172.21.15.89:0/2143184259 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55dcfa638960 con 0x55dcfa736800 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01d2a00640 1 -- 172.21.15.89:0/2143184259 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f01d80053c0 con 0x55dcfa736800 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 10 client.5424 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 10 client.5424 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 20 client.5424 populate_metadata read hostname 'smithi089' 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55dcfa342e20 0x55dcfa8564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 4 client.5424 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:19:28.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01fbf79000 1 -- 172.21.15.89:0/2143184259 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcfa6b1810 con 0x55dcfa342e20 2024-08-31T04:19:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.439+0000 7f01ede00640 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55dcfa342e20 0x55dcfa8564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.443+0000 7f01ede00640 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55dcfa342e20 0x55dcfa8564f0 crc :-1 s=READY pgs=687 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d82df3a200fe6bf server_cookie=519867a19316f37a in_seq=0 out_seq=0 2024-08-31T04:19:28.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.443+0000 7f01d2a00640 10 client.5424 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01d2a00640 1 -- 172.21.15.89:0/2143184259 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dcfa6b1810 con 0x55dcfa342e20 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01d2a00640 10 client.5424 handle_command_reply: tid=0 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 client.5424 shutdown 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 -- 172.21.15.89:0/2143184259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 msgr2=0x55dcfa89f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa89f580 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f01d80b0040 tx=0x7f01d8004550 comp rx=0 tx=0).stop 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 -- 172.21.15.89:0/2143184259 shutdown_connections 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55dcfa342e20 0x55dcfa8564f0 crc :-1 s=READY pgs=687 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa736800 0x55dcfa89f580 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 0x55dcfa855ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01d2a00640 0 client.5424 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:28.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 --2- 172.21.15.89:0/2143184259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 0x55dcfa89f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 -- 172.21.15.89:0/2143184259 >> 172.21.15.89:0/2143184259 conn(0x55dcfa823290 msgr2=0x55dcfa8923c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 -- 172.21.15.89:0/2143184259 shutdown_connections 2024-08-31T04:19:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 1 -- 172.21.15.89:0/2143184259 wait complete. 2024-08-31T04:19:28.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.447+0000 7f01fbf79000 20 client.5424 trim_cache size 0 max 16384 2024-08-31T04:19:28.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01fbf79000 1 Processor -- start 2024-08-31T04:19:28.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01fbf79000 1 -- start start 2024-08-31T04:19:28.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa35dab0 0x55dcfa88ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa736800 0x55dcfa88f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 0x55dcfa8af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01fbf79000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0202c00 con 0x55dcfa35dab0 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01fbf79000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0201e60 con 0x55dcfa74c840 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01fbf79000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f01f0202530 con 0x55dcfa736800 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ede00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa35dab0 0x55dcfa88ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ede00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa35dab0 0x55dcfa88ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55744/0 (socket says 172.21.15.89:55744) 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ede00640 1 -- 172.21.15.89:0/4223121153 learned_addr learned my addr 172.21.15.89:0/4223121153 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01e5400640 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa736800 0x55dcfa88f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ee800640 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 0x55dcfa8af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ede00640 1 -- 172.21.15.89:0/4223121153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa736800 msgr2=0x55dcfa88f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ede00640 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa736800 0x55dcfa88f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ede00640 1 -- 172.21.15.89:0/4223121153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 msgr2=0x55dcfa8af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ede00640 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 0x55dcfa8af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ede00640 1 -- 172.21.15.89:0/4223121153 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfa723b30 con 0x55dcfa35dab0 2024-08-31T04:19:28.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ee800640 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 0x55dcfa8af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:19:28.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ede00640 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa35dab0 0x55dcfa88ee50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f01e0001c60 tx=0x7f01e0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9afb4d216558cf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:28.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ddc00640 1 -- 172.21.15.89:0/4223121153 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e002f070 con 0x55dcfa35dab0 2024-08-31T04:19:28.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ddc00640 1 -- 172.21.15.89:0/4223121153 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01e001b040 con 0x55dcfa35dab0 2024-08-31T04:19:28.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.467+0000 7f01ddc00640 1 -- 172.21.15.89:0/4223121153 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0014b30 con 0x55dcfa35dab0 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 -- 172.21.15.89:0/4223121153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa35dab0 msgr2=0x55dcfa88ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa35dab0 0x55dcfa88ee50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f01e0001c60 tx=0x7f01e0012000 comp rx=0 tx=0).stop 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 -- 172.21.15.89:0/4223121153 shutdown_connections 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa74c840 0x55dcfa8af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa736800 0x55dcfa88f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 --2- 172.21.15.89:0/4223121153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa35dab0 0x55dcfa88ee50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 -- 172.21.15.89:0/4223121153 >> 172.21.15.89:0/4223121153 conn(0x55dcfa823290 msgr2=0x55dcfa88ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 -- 172.21.15.89:0/4223121153 shutdown_connections 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 -- 172.21.15.89:0/4223121153 wait complete. 2024-08-31T04:19:28.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 -- start start 2024-08-31T04:19:28.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 Processor -- start 2024-08-31T04:19:28.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 0x55dcfa8a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa736800 0x55dcfa8a3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa74c840 0x55dcfa8a3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa6a2110 con 0x55dcfa74c840 2024-08-31T04:19:28.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa646f60 con 0x55dcfa736800 2024-08-31T04:19:28.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55dcfa6a7430 con 0x55dcfa35dab0 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01fbf79000 10 client.0 _ll_register_callbacks cb 0x7f01d80b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ee800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa74c840 0x55dcfa8a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ee800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa74c840 0x55dcfa8a3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55748/0 (socket says 172.21.15.89:55748) 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ee800640 1 -- 172.21.15.89:0/937124584 learned_addr learned my addr 172.21.15.89:0/937124584 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01e5400640 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa736800 0x55dcfa8a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ede00640 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 0x55dcfa8a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ee800640 1 -- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 msgr2=0x55dcfa8a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ee800640 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 0x55dcfa8a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ee800640 1 -- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa736800 msgr2=0x55dcfa8a3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ee800640 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa736800 0x55dcfa8a3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ee800640 1 -- 172.21.15.89:0/937124584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfa628ea0 con 0x55dcfa74c840 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01ee800640 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa74c840 0x55dcfa8a3880 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f01e8012020 tx=0x7f01e8091960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b44904937cdc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:28.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:19:28.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.471+0000 7f01d2a00640 1 -- 172.21.15.89:0/937124584 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8062ef0 con 0x55dcfa74c840 2024-08-31T04:19:28.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01d2a00640 1 -- 172.21.15.89:0/937124584 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f01e8067480 con 0x55dcfa74c840 2024-08-31T04:19:28.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01fbf79000 1 -- 172.21.15.89:0/937124584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e001b040 con 0x55dcfa74c840 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01d2a00640 1 -- 172.21.15.89:0/937124584 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f01e8090050 con 0x55dcfa74c840 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01fbf79000 10 client.5430 fetch_fsmap learned FSMap version 9 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01fbf79000 1 -- 172.21.15.89:0/937124584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55dcfa644c10 con 0x55dcfa74c840 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01d2a00640 1 -- 172.21.15.89:0/937124584 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01e001b040 con 0x55dcfa74c840 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01d2a00640 1 -- 172.21.15.89:0/937124584 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f01e808ab80 con 0x55dcfa74c840 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01fbf79000 10 client.5430 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01fbf79000 10 client.5430 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01fbf79000 20 client.5430 populate_metadata read hostname 'smithi089' 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01fbf79000 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55dcfa330e80 0x55dcfa8a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01fbf79000 4 client.5430 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.25, "await_for": 45.0}] 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01fbf79000 1 -- 172.21.15.89:0/937124584 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.25, "await_for": 45.0}) -- 0x55dcfa6ad2b0 con 0x55dcfa330e80 2024-08-31T04:19:28.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01ede00640 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55dcfa330e80 0x55dcfa8a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:28.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01ede00640 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55dcfa330e80 0x55dcfa8a3dc0 crc :-1 s=READY pgs=688 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36fd99ebab12fded server_cookie=c11c52cc5091a98a in_seq=0 out_seq=0 2024-08-31T04:19:28.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:28.475+0000 7f01d2a00640 10 client.5430 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:31.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01d2a00640 1 -- 172.21.15.89:0/937124584 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55dcfa6ad2b0 con 0x55dcfa330e80 2024-08-31T04:19:31.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01d2a00640 10 client.5430 handle_command_reply: tid=0 2024-08-31T04:19:31.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 client.5430 shutdown 2024-08-31T04:19:31.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 -- 172.21.15.89:0/937124584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa74c840 msgr2=0x55dcfa8a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa74c840 0x55dcfa8a3880 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f01e8012020 tx=0x7f01e8091960 comp rx=0 tx=0).stop 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 -- 172.21.15.89:0/937124584 shutdown_connections 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55dcfa330e80 0x55dcfa8a3dc0 crc :-1 s=READY pgs=688 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcfa74c840 0x55dcfa8a3880 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcfa736800 0x55dcfa8a3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01d2a00640 0 client.5430 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 --2- 172.21.15.89:0/937124584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dcfa35dab0 0x55dcfa8a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 -- 172.21.15.89:0/937124584 >> 172.21.15.89:0/937124584 conn(0x55dcfa823290 msgr2=0x55dcfa858b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 -- 172.21.15.89:0/937124584 shutdown_connections 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 1 -- 172.21.15.89:0/937124584 wait complete. 2024-08-31T04:19:31.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01fbf79000 20 client.5430 trim_cache size 0 max 16384 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 50, 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "14ba8f7a": { 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 50, 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:19:31.168 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 141.2, 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:31.169 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:19:31.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 -- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f01cc0720f0 msgr2=0x7f01cc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:31.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f01cc0720f0 0x7f01cc074600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f01e0001e40 tx=0x7f01e0009040 comp rx=0 tx=0).stop 2024-08-31T04:19:31.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 -- 172.21.15.89:0/1222632795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01f00c90e0 msgr2=0x7f01f00cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:31.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01f00c90e0 0x7f01f00cbed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f01e800e970 tx=0x7f01e800ed70 comp rx=0 tx=0).stop 2024-08-31T04:19:31.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 -- 172.21.15.89:0/1222632795 shutdown_connections 2024-08-31T04:19:31.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f01cc0720f0 0x7f01cc074600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:31.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01f00c90e0 0x7f01f00cbed0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:31.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01f00b2d20 0x7f01f014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:31.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 --2- 172.21.15.89:0/1222632795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01f00b2860 0x7f01f0149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:31.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 -- 172.21.15.89:0/1222632795 >> 172.21.15.89:0/1222632795 conn(0x7f01f00c99b0 msgr2=0x7f01f00745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:31.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 -- 172.21.15.89:0/1222632795 shutdown_connections 2024-08-31T04:19:31.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:31.167+0000 7f01f4a00640 1 -- 172.21.15.89:0/1222632795 wait complete. 2024-08-31T04:19:31.187 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '14ba8f7a', quiesce took 3.3 seconds. Will release after: 17.95 2024-08-31T04:19:33.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:19:33.603 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:19:49.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:19:49.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.303+0000 7f5513a00640 1 -- 172.21.15.89:0/3139514663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c074e20 msgr2=0x7f550c156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.303+0000 7f5513a00640 1 --2- 172.21.15.89:0/3139514663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c074e20 0x7f550c156e10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5500009840 tx=0x7f550001f010 comp rx=0 tx=0).stop 2024-08-31T04:19:49.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.303+0000 7f5513a00640 1 -- 172.21.15.89:0/3139514663 shutdown_connections 2024-08-31T04:19:49.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.303+0000 7f5513a00640 1 --2- 172.21.15.89:0/3139514663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c074e20 0x7f550c156e10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.303+0000 7f5513a00640 1 -- 172.21.15.89:0/3139514663 >> 172.21.15.89:0/3139514663 conn(0x7f550c0ccf20 msgr2=0x7f550c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.303+0000 7f5513a00640 1 -- 172.21.15.89:0/3139514663 shutdown_connections 2024-08-31T04:19:49.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.303+0000 7f5513a00640 1 -- 172.21.15.89:0/3139514663 wait complete. 2024-08-31T04:19:49.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 Processor -- start 2024-08-31T04:19:49.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 -- start start 2024-08-31T04:19:49.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f550c074e20 0x7f550c150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c15ce10 0x7f550c14d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f550c15d220 0x7f550c14dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f550c159c90 con 0x7f550c15ce10 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f550c15a2e0 con 0x7f550c15d220 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f550c159f70 con 0x7f550c074e20 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f550be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c15ce10 0x7f550c14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f550be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c15ce10 0x7f550c14d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50410/0 (socket says 172.21.15.89:50410) 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f550be00640 1 -- 172.21.15.89:0/2063877458 learned_addr learned my addr 172.21.15.89:0/2063877458 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5511000640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f550c074e20 0x7f550c150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5511a00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f550c15d220 0x7f550c14dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f550be00640 1 -- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f550c074e20 msgr2=0x7f550c150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f550be00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f550c074e20 0x7f550c150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f550be00640 1 -- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f550c15d220 msgr2=0x7f550c14dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f550be00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f550c15d220 0x7f550c14dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f550be00640 1 -- 172.21.15.89:0/2063877458 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c155230 con 0x7f550c15ce10 2024-08-31T04:19:49.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f550be00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c15ce10 0x7f550c14d760 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f54f800c430 tx=0x7f54f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5508c00640 1 -- 172.21.15.89:0/2063877458 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011790 con 0x7f550c15ce10 2024-08-31T04:19:49.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5508c00640 1 -- 172.21.15.89:0/2063877458 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54f8017070 con 0x7f550c15ce10 2024-08-31T04:19:49.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c1555f0 con 0x7f550c15ce10 2024-08-31T04:19:49.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5508c00640 1 -- 172.21.15.89:0/2063877458 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011cc0 con 0x7f550c15ce10 2024-08-31T04:19:49.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.307+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c0b2fe0 con 0x7f550c15ce10 2024-08-31T04:19:49.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.311+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550c155830 con 0x7f550c15ce10 2024-08-31T04:19:49.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.311+0000 7f5508c00640 1 -- 172.21.15.89:0/2063877458 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f54f801c460 con 0x7f550c15ce10 2024-08-31T04:19:49.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.311+0000 7f5508c00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ec0720f0 0x7f54ec074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.311+0000 7f5508c00640 1 -- 172.21.15.89:0/2063877458 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f54f8092c70 con 0x7f550c15ce10 2024-08-31T04:19:49.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.311+0000 7f5511000640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ec0720f0 0x7f54ec074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.315+0000 7f5511000640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ec0720f0 0x7f54ec074600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f55000b2000 tx=0x7f550001d850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.315+0000 7f5508c00640 1 -- 172.21.15.89:0/2063877458 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f550c155830 con 0x7f550c15ce10 2024-08-31T04:19:49.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.515+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f550c15ca50 con 0x7f550c15ce10 2024-08-31T04:19:49.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.515+0000 7f5508c00640 1 -- 172.21.15.89:0/2063877458 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f550c15ca50 con 0x7f550c15ce10 2024-08-31T04:19:49.515 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:19:49.515 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:19:49.515 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:19:49.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ec0720f0 msgr2=0x7f54ec074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ec0720f0 0x7f54ec074600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f55000b2000 tx=0x7f550001d850 comp rx=0 tx=0).stop 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c15ce10 msgr2=0x7f550c14d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c15ce10 0x7f550c14d760 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f54f800c430 tx=0x7f54f800c8f0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 shutdown_connections 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f54ec0720f0 0x7f54ec074600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f550c15ce10 0x7f550c14d760 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f550c15d220 0x7f550c14dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 --2- 172.21.15.89:0/2063877458 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f550c074e20 0x7f550c150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 >> 172.21.15.89:0/2063877458 conn(0x7f550c0ccf20 msgr2=0x7f550c158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 shutdown_connections 2024-08-31T04:19:49.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.519+0000 7f5513a00640 1 -- 172.21.15.89:0/2063877458 wait complete. 2024-08-31T04:19:49.537 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 14ba8f7a --release --await' 2024-08-31T04:19:49.537 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 14ba8f7a --release --await 2024-08-31T04:19:49.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 -- 172.21.15.89:0/3742911445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7dc0c90e0 msgr2=0x7fb7dc0747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 --2- 172.21.15.89:0/3742911445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7dc0c90e0 0x7fb7dc0747b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009c80 tx=0x7fb7d401cd10 comp rx=0 tx=0).stop 2024-08-31T04:19:49.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 -- 172.21.15.89:0/3742911445 shutdown_connections 2024-08-31T04:19:49.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 --2- 172.21.15.89:0/3742911445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7dc0c90e0 0x7fb7dc0747b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 --2- 172.21.15.89:0/3742911445 >> v2:172.21.15.170:3300/0 conn(0x7fb7dc0b2d20 0x7fb7dc0c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 -- 172.21.15.89:0/3742911445 >> 172.21.15.89:0/3742911445 conn(0x7fb7dc0c99b0 msgr2=0x7fb7dc0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 -- 172.21.15.89:0/3742911445 shutdown_connections 2024-08-31T04:19:49.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 -- 172.21.15.89:0/3742911445 wait complete. 2024-08-31T04:19:49.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 Processor -- start 2024-08-31T04:19:49.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.699+0000 7fb7e4200640 1 -- start start 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e4200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7dc0b2860 0x7fb7dc1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e4200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7dc0b2d20 0x7fb7dc15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e4200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7dc0c90e0 0x7fb7dc149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e4200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc165770 con 0x7fb7dc0b2860 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e4200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc1658f0 con 0x7fb7dc0b2d20 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e4200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc165a70 con 0x7fb7dc0c90e0 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7dc0b2860 0x7fb7dc1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7dc0b2860 0x7fb7dc1f30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50418/0 (socket says 172.21.15.89:50418) 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e1800640 1 -- 172.21.15.89:0/2650933134 learned_addr learned my addr 172.21.15.89:0/2650933134 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:49.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e2200640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7dc0c90e0 0x7fb7dc149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7dc0b2d20 0x7fb7dc15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e1800640 1 -- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7dc0c90e0 msgr2=0x7fb7dc149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e1800640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7dc0c90e0 0x7fb7dc149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e1800640 1 -- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7dc0b2d20 msgr2=0x7fb7dc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e1800640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7dc0b2d20 0x7fb7dc15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e1800640 1 -- 172.21.15.89:0/2650933134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc15b620 con 0x7fb7dc0b2860 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7dc0b2d20 0x7fb7dc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e1800640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7dc0b2860 0x7fb7dc1f30d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000c3c0 tx=0x7fb7d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7d9600640 1 -- 172.21.15.89:0/2650933134 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0017070 con 0x7fb7dc0b2860 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7d9600640 1 -- 172.21.15.89:0/2650933134 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7d00053c0 con 0x7fb7dc0b2860 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e4200640 1 -- 172.21.15.89:0/2650933134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc1f3610 con 0x7fb7dc0b2860 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7d9600640 1 -- 172.21.15.89:0/2650933134 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0003860 con 0x7fb7dc0b2860 2024-08-31T04:19:49.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.703+0000 7fb7e4200640 1 -- 172.21.15.89:0/2650933134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7dc1f7080 con 0x7fb7dc0b2860 2024-08-31T04:19:49.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7d9600640 1 -- 172.21.15.89:0/2650933134 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb7d001a070 con 0x7fb7dc0b2860 2024-08-31T04:19:49.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7d9600640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb7bc0720c0 0x7fb7bc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7d9600640 1 -- 172.21.15.89:0/2650933134 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb7d0092220 con 0x7fb7dc0b2860 2024-08-31T04:19:49.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb7bc0720c0 0x7fb7bc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7eba4c000 1 Processor -- start 2024-08-31T04:19:49.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7eba4c000 1 -- start start 2024-08-31T04:19:49.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb7bc0720c0 0x7fb7bc0745d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc06a780 tx=0x7fb7c80091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 0x55ea16f62ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 0x55ea16f63010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ea16e08f30 con 0x55ea16e3f950 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ea16d7e690 con 0x55ea16e29930 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.707+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ea16d6dc20 con 0x55ea16e1a890 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50428/0 (socket says 172.21.15.89:50428) 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e1800640 1 -- 172.21.15.89:0/3654056057 learned_addr learned my addr 172.21.15.89:0/3654056057 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e2200640 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 0x55ea16f63010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 0x55ea16f62ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e1800640 1 -- 172.21.15.89:0/3654056057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 msgr2=0x55ea16f63010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e1800640 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 0x55ea16f63010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e1800640 1 -- 172.21.15.89:0/3654056057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 msgr2=0x55ea16f62ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e1800640 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 0x55ea16f62ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e1800640 1 -- 172.21.15.89:0/3654056057 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea16d228f0 con 0x55ea16e3f950 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e2200640 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 0x55ea16f63010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7e1800640 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5de30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0090310 tx=0x7fb7d005cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbd8a5e56991d72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7ce000640 1 -- 172.21.15.89:0/3654056057 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0061990 con 0x55ea16e3f950 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7ce000640 1 -- 172.21.15.89:0/3654056057 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7d00663b0 con 0x55ea16e3f950 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7ce000640 1 -- 172.21.15.89:0/3654056057 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d005c690 con 0x55ea16e3f950 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 -- 172.21.15.89:0/3654056057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 msgr2=0x55ea16f5de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5de30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0090310 tx=0x7fb7d005cce0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 -- 172.21.15.89:0/3654056057 shutdown_connections 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 0x55ea16f63010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 0x55ea16f62ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/3654056057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5de30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 -- 172.21.15.89:0/3654056057 >> 172.21.15.89:0/3654056057 conn(0x55ea16e3f540 msgr2=0x55ea16f60890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 -- 172.21.15.89:0/3654056057 shutdown_connections 2024-08-31T04:19:49.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 -- 172.21.15.89:0/3654056057 wait complete. 2024-08-31T04:19:49.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 -- start start 2024-08-31T04:19:49.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.711+0000 7fb7eba4c000 1 Processor -- start 2024-08-31T04:19:49.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 0x55ea16f5cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 0x55ea16f5d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ea16cf4500 con 0x55ea16e3f950 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ea16d71bd0 con 0x55ea16e29930 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ea16d15a30 con 0x55ea16e1a890 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 10 client.0 _ll_register_callbacks cb 0x55ea16e23b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e2200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e2200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50438/0 (socket says 172.21.15.89:50438) 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e2200640 1 -- 172.21.15.89:0/2054152195 learned_addr learned my addr 172.21.15.89:0/2054152195 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 0x55ea16f5d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e1800640 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 0x55ea16f5cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e2200640 1 -- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 msgr2=0x55ea16f5cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e2200640 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 0x55ea16f5cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e2200640 1 -- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 msgr2=0x55ea16f5d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e2200640 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 0x55ea16f5d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e2200640 1 -- 172.21.15.89:0/2054152195 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea16d0d6a0 con 0x55ea16e3f950 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e2200640 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5d690 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009c80 tx=0x7fb7d4003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d26865263f9b3e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7c2a00640 1 -- 172.21.15.89:0/2054152195 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40bf060 con 0x55ea16e3f950 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7c2a00640 1 -- 172.21.15.89:0/2054152195 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb7d40092c0 con 0x55ea16e3f950 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2054152195 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ea16d077e0 con 0x55ea16e3f950 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7c2a00640 1 -- 172.21.15.89:0/2054152195 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb7d40c5050 con 0x55ea16e3f950 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 10 client.5448 fetch_fsmap learned FSMap version 9 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2054152195 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ea16d2c1c0 con 0x55ea16e3f950 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7c2a00640 1 -- 172.21.15.89:0/2054152195 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ea16d077e0 con 0x55ea16e3f950 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7c2a00640 1 -- 172.21.15.89:0/2054152195 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fb7d40c8020 con 0x55ea16e3f950 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 10 client.5448 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 10 client.5448 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 20 client.5448 populate_metadata read hostname 'smithi089' 2024-08-31T04:19:49.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ea16e03fc0 0x55ea16f78010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 4 client.5448 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:19:49.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2054152195 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea16d805e0 con 0x55ea16e03fc0 2024-08-31T04:19:49.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.715+0000 7fb7e1800640 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ea16e03fc0 0x55ea16f78010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7e1800640 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ea16e03fc0 0x55ea16f78010 crc :-1 s=READY pgs=695 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5356b591f5fb8e49 server_cookie=9df7f8858ddcd651 in_seq=0 out_seq=0 2024-08-31T04:19:49.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7c2a00640 10 client.5448 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:49.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7c2a00640 1 -- 172.21.15.89:0/2054152195 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea16d805e0 con 0x55ea16e03fc0 2024-08-31T04:19:49.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7c2a00640 10 client.5448 handle_command_reply: tid=0 2024-08-31T04:19:49.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 client.5448 shutdown 2024-08-31T04:19:49.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2054152195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 msgr2=0x55ea16f5d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5d690 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009c80 tx=0x7fb7d4003e50 comp rx=0 tx=0).stop 2024-08-31T04:19:49.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2054152195 shutdown_connections 2024-08-31T04:19:49.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ea16e03fc0 0x55ea16f78010 crc :-1 s=READY pgs=695 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e3f950 0x55ea16f5d690 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7c2a00640 0 client.5448 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:49.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e29930 0x55ea16f5d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2054152195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e1a890 0x55ea16f5cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2054152195 >> 172.21.15.89:0/2054152195 conn(0x55ea16e3f540 msgr2=0x55ea16f5e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2054152195 shutdown_connections 2024-08-31T04:19:49.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2054152195 wait complete. 2024-08-31T04:19:49.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.719+0000 7fb7eba4c000 20 client.5448 trim_cache size 0 max 16384 2024-08-31T04:19:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7eba4c000 1 Processor -- start 2024-08-31T04:19:49.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7eba4c000 1 -- start start 2024-08-31T04:19:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16f21840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 0x55ea16f7a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 0x55ea16f7a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc202170 con 0x55ea16e1a890 2024-08-31T04:19:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc201050 con 0x55ea16e3f950 2024-08-31T04:19:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc151770 con 0x55ea16e29930 2024-08-31T04:19:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16f21840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16f21840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50444/0 (socket says 172.21.15.89:50444) 2024-08-31T04:19:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e1800640 1 -- 172.21.15.89:0/2338092256 learned_addr learned my addr 172.21.15.89:0/2338092256 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/2338092256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 0x55ea16f7a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e2200640 1 --2- 172.21.15.89:0/2338092256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 0x55ea16f7a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e1800640 1 -- 172.21.15.89:0/2338092256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 msgr2=0x55ea16f7a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e1800640 1 --2- 172.21.15.89:0/2338092256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 0x55ea16f7a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e1800640 1 -- 172.21.15.89:0/2338092256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 msgr2=0x55ea16f7a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e1800640 1 --2- 172.21.15.89:0/2338092256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 0x55ea16f7a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e1800640 1 -- 172.21.15.89:0/2338092256 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea16f1fda0 con 0x55ea16e1a890 2024-08-31T04:19:49.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7e1800640 1 --2- 172.21.15.89:0/2338092256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16f21840 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000cd80 tx=0x7fb7d0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361551d98b0cb025 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7cd600640 1 -- 172.21.15.89:0/2338092256 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d005c430 con 0x55ea16e1a890 2024-08-31T04:19:49.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7cd600640 1 -- 172.21.15.89:0/2338092256 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7d005c6c0 con 0x55ea16e1a890 2024-08-31T04:19:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.739+0000 7fb7cd600640 1 -- 172.21.15.89:0/2338092256 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0062d80 con 0x55ea16e1a890 2024-08-31T04:19:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2338092256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 msgr2=0x55ea16f21840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2338092256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16f21840 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000cd80 tx=0x7fb7d0000bd0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2338092256 shutdown_connections 2024-08-31T04:19:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2338092256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 0x55ea16f7a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2338092256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 0x55ea16f7a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/2338092256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16f21840 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2338092256 >> 172.21.15.89:0/2338092256 conn(0x55ea16e3f540 msgr2=0x55ea16f7b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2338092256 shutdown_connections 2024-08-31T04:19:49.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- 172.21.15.89:0/2338092256 wait complete. 2024-08-31T04:19:49.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- start start 2024-08-31T04:19:49.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 Processor -- start 2024-08-31T04:19:49.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16fe1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 0x55ea16fe19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 0x55ea16fe1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc1ffbe0 con 0x55ea16e1a890 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc200980 con 0x55ea16e3f950 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc2002b0 con 0x55ea16e29930 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 10 client.0 _ll_register_callbacks cb 0x7fb7c8005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16fe1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16fe1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50452/0 (socket says 172.21.15.89:50452) 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e1800640 1 -- 172.21.15.89:0/4091775551 learned_addr learned my addr 172.21.15.89:0/4091775551 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e2200640 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 0x55ea16fe1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 0x55ea16fe19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e1800640 1 -- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 msgr2=0x55ea16fe19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e1800640 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 0x55ea16fe19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e1800640 1 -- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 msgr2=0x55ea16fe1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e1800640 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 0x55ea16fe1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e1800640 1 -- 172.21.15.89:0/4091775551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea16df22f0 con 0x55ea16e1a890 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e2200640 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 0x55ea16fe1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7e1800640 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16fe1470 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb7d005d160 tx=0x7fb7d0090310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552930c4b1dec94 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7c2a00640 1 -- 172.21.15.89:0/4091775551 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d008e060 con 0x55ea16e1a890 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7c2a00640 1 -- 172.21.15.89:0/4091775551 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb7d0059460 con 0x55ea16e1a890 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.743+0000 7fb7eba4c000 1 -- 172.21.15.89:0/4091775551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7d005c6c0 con 0x55ea16e1a890 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7c2a00640 1 -- 172.21.15.89:0/4091775551 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb7d0062b20 con 0x55ea16e1a890 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7eba4c000 10 client.5454 fetch_fsmap learned FSMap version 9 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7eba4c000 1 -- 172.21.15.89:0/4091775551 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ea16cf7b30 con 0x55ea16e1a890 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7c2a00640 1 -- 172.21.15.89:0/4091775551 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7d005c6c0 con 0x55ea16e1a890 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7c2a00640 1 -- 172.21.15.89:0/4091775551 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fb7d0062cc0 con 0x55ea16e1a890 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7eba4c000 10 client.5454 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:19:49.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7eba4c000 10 client.5454 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:19:49.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7eba4c000 20 client.5454 populate_metadata read hostname 'smithi089' 2024-08-31T04:19:49.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ea169ffe80 0x55ea16fa1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7eba4c000 4 client.5454 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "14ba8f7a", "release": true, "await": true}] 2024-08-31T04:19:49.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7eba4c000 1 -- 172.21.15.89:0/4091775551 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "14ba8f7a", "release": true, "await": true}) -- 0x55ea16d7c080 con 0x55ea169ffe80 2024-08-31T04:19:49.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ea169ffe80 0x55ea16fa1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7c2a00640 10 client.5454 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:49.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.747+0000 7fb7e0e00640 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ea169ffe80 0x55ea16fa1a40 crc :-1 s=READY pgs=696 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f015adbb7e2ef31a server_cookie=73d536c896ac2e84 in_seq=0 out_seq=0 2024-08-31T04:19:49.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7c2a00640 1 -- 172.21.15.89:0/4091775551 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ea16d7c080 con 0x55ea169ffe80 2024-08-31T04:19:49.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7c2a00640 10 client.5454 handle_command_reply: tid=0 2024-08-31T04:19:49.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 client.5454 shutdown 2024-08-31T04:19:49.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 -- 172.21.15.89:0/4091775551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 msgr2=0x55ea16fe1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16fe1470 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb7d005d160 tx=0x7fb7d0090310 comp rx=0 tx=0).stop 2024-08-31T04:19:49.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 -- 172.21.15.89:0/4091775551 shutdown_connections 2024-08-31T04:19:49.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ea169ffe80 0x55ea16fa1a40 crc :-1 s=READY pgs=696 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ea16e3f950 0x55ea16fe1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ea16e29930 0x55ea16fe19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 --2- 172.21.15.89:0/4091775551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea16e1a890 0x55ea16fe1470 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7c2a00640 0 client.5454 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:49.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 -- 172.21.15.89:0/4091775551 >> 172.21.15.89:0/4091775551 conn(0x55ea16e3f540 msgr2=0x55ea16f1d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 -- 172.21.15.89:0/4091775551 shutdown_connections 2024-08-31T04:19:49.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 1 -- 172.21.15.89:0/4091775551 wait complete. 2024-08-31T04:19:49.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7eba4c000 20 client.5454 trim_cache size 0 max 16384 2024-08-31T04:19:49.924 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:19:49.924 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:19:49.924 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:19:49.924 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 52, 2024-08-31T04:19:49.924 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:19:49.924 INFO:teuthology.orchestra.run.smithi089.stdout: "14ba8f7a": { 2024-08-31T04:19:49.924 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 52, 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 141.2, 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:19:49.925 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:19:49.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:49.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:49.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:49.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:49.926 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:49.926 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:19:49.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 -- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb7bc0720c0 msgr2=0x7fb7bc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb7bc0720c0 0x7fb7bc0745d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc06a780 tx=0x7fb7c80091e0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 -- 172.21.15.89:0/2650933134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7dc0b2860 msgr2=0x7fb7dc1f30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7dc0b2860 0x7fb7dc1f30d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000c3c0 tx=0x7fb7d000c880 comp rx=0 tx=0).stop 2024-08-31T04:19:49.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 -- 172.21.15.89:0/2650933134 shutdown_connections 2024-08-31T04:19:49.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb7bc0720c0 0x7fb7bc0745d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7dc0c90e0 0x7fb7dc149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7dc0b2d20 0x7fb7dc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 --2- 172.21.15.89:0/2650933134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7dc0b2860 0x7fb7dc1f30d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 -- 172.21.15.89:0/2650933134 >> 172.21.15.89:0/2650933134 conn(0x7fb7dc0c99b0 msgr2=0x7fb7dc157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 -- 172.21.15.89:0/2650933134 shutdown_connections 2024-08-31T04:19:49.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:49.923+0000 7fb7e4200640 1 -- 172.21.15.89:0/2650933134 wait complete. 2024-08-31T04:19:49.942 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '14ba8f7a', total seconds elapsed: 22.1 2024-08-31T04:19:49.942 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.25 2024-08-31T04:19:49.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:19:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.099+0000 7f39fa400640 1 -- 172.21.15.89:0/3415852952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d8004810 msgr2=0x7f39d8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.099+0000 7f39fa400640 1 --2- 172.21.15.89:0/3415852952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d8004810 0x7f39d8004c20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001690 tx=0x7f39dc01c7a0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.099+0000 7f39f3e00640 1 -- 172.21.15.89:0/3415852952 reap_dead start 2024-08-31T04:19:50.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.099+0000 7f39fa400640 1 -- 172.21.15.89:0/3415852952 shutdown_connections 2024-08-31T04:19:50.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.099+0000 7f39fa400640 1 -- 172.21.15.89:0/3415852952 >> 172.21.15.89:0/3415852952 conn(0x7f39f40ccf20 msgr2=0x7f39f40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:50.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.099+0000 7f39fa400640 1 -- 172.21.15.89:0/3415852952 shutdown_connections 2024-08-31T04:19:50.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.099+0000 7f39fa400640 1 -- 172.21.15.89:0/3415852952 wait complete. 2024-08-31T04:19:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.099+0000 7f39fa400640 1 Processor -- start 2024-08-31T04:19:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.099+0000 7f39fa400640 1 -- start start 2024-08-31T04:19:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39fa400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d8004810 0x7f39f41f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39fa400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39f41f59d0 0x7f39f414eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39fa400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39f414c7c0 0x7f39f414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39fa400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39f4074e30 con 0x7f39d8004810 2024-08-31T04:19:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39fa400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39f40c8030 con 0x7f39f414c7c0 2024-08-31T04:19:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39fa400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39f4074fb0 con 0x7f39f41f59d0 2024-08-31T04:19:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d8004810 0x7f39f41f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d8004810 0x7f39f41f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50476/0 (socket says 172.21.15.89:50476) 2024-08-31T04:19:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3400640 1 -- 172.21.15.89:0/691431305 learned_addr learned my addr 172.21.15.89:0/691431305 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3e00640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39f414c7c0 0x7f39f414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39eaa00640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39f41f59d0 0x7f39f414eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3400640 1 -- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39f41f59d0 msgr2=0x7f39f414eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3400640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39f41f59d0 0x7f39f414eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3400640 1 -- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39f414c7c0 msgr2=0x7f39f414cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3400640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39f414c7c0 0x7f39f414cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3400640 1 -- 172.21.15.89:0/691431305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f40c61e0 con 0x7f39d8004810 2024-08-31T04:19:50.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39f3400640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d8004810 0x7f39f41f2770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f39e4001ec0 tx=0x7f39e400ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39ebe00640 1 -- 172.21.15.89:0/691431305 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4015070 con 0x7f39d8004810 2024-08-31T04:19:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39ebe00640 1 -- 172.21.15.89:0/691431305 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39e400ca80 con 0x7f39d8004810 2024-08-31T04:19:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39ebe00640 1 -- 172.21.15.89:0/691431305 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4011460 con 0x7f39d8004810 2024-08-31T04:19:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f40b1b10 con 0x7f39d8004810 2024-08-31T04:19:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f40c67a0 con 0x7f39d8004810 2024-08-31T04:19:50.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.103+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f40c9330 con 0x7f39d8004810 2024-08-31T04:19:50.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.107+0000 7f39ebe00640 1 -- 172.21.15.89:0/691431305 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f39e4018070 con 0x7f39d8004810 2024-08-31T04:19:50.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.107+0000 7f39ebe00640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39d00720c0 0x7f39d00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.107+0000 7f39ebe00640 1 -- 172.21.15.89:0/691431305 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f39e40934a0 con 0x7f39d8004810 2024-08-31T04:19:50.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.107+0000 7f39eaa00640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39d00720c0 0x7f39d00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.107+0000 7f39eaa00640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39d00720c0 0x7f39d00745d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001660 tx=0x7f39dc019540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:50.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.111+0000 7f39ebe00640 1 -- 172.21.15.89:0/691431305 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f39e405e2a0 con 0x7f39d8004810 2024-08-31T04:19:50.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.307+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39f41560a0 con 0x7f39d8004810 2024-08-31T04:19:50.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.307+0000 7f39ebe00640 1 -- 172.21.15.89:0/691431305 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f39e4062a60 con 0x7f39d8004810 2024-08-31T04:19:50.308 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:19:50.308 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:19:50.308 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:19:50.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39d00720c0 msgr2=0x7f39d00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39d00720c0 0x7f39d00745d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001660 tx=0x7f39dc019540 comp rx=0 tx=0).stop 2024-08-31T04:19:50.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d8004810 msgr2=0x7f39f41f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d8004810 0x7f39f41f2770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f39e4001ec0 tx=0x7f39e400ea90 comp rx=0 tx=0).stop 2024-08-31T04:19:50.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 shutdown_connections 2024-08-31T04:19:50.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39d00720c0 0x7f39d00745d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39f414c7c0 0x7f39f414cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39f41f59d0 0x7f39f414eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 --2- 172.21.15.89:0/691431305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d8004810 0x7f39f41f2770 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 >> 172.21.15.89:0/691431305 conn(0x7f39f40ccf20 msgr2=0x7f39f415c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:50.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 shutdown_connections 2024-08-31T04:19:50.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.311+0000 7f39fa400640 1 -- 172.21.15.89:0/691431305 wait complete. 2024-08-31T04:19:50.329 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 141.25 --await-for 45.0' 2024-08-31T04:19:50.330 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 141.25 --await-for 45.0 2024-08-31T04:19:50.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.495+0000 7ff241c00640 1 -- 172.21.15.89:0/3997050146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 msgr2=0x7ff220004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.495+0000 7ff241c00640 1 --2- 172.21.15.89:0/3997050146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 0x7ff220004c20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff2280016f0 tx=0x7ff22801c750 comp rx=0 tx=0).stop 2024-08-31T04:19:50.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.495+0000 7ff241c00640 1 -- 172.21.15.89:0/3997050146 shutdown_connections 2024-08-31T04:19:50.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.495+0000 7ff241c00640 1 --2- 172.21.15.89:0/3997050146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 0x7ff220004c20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.495+0000 7ff241c00640 1 -- 172.21.15.89:0/3997050146 >> 172.21.15.89:0/3997050146 conn(0x7ff23c0c99b0 msgr2=0x7ff23c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:50.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.495+0000 7ff241c00640 1 -- 172.21.15.89:0/3997050146 shutdown_connections 2024-08-31T04:19:50.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.495+0000 7ff241c00640 1 -- 172.21.15.89:0/3997050146 wait complete. 2024-08-31T04:19:50.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff241c00640 1 Processor -- start 2024-08-31T04:19:50.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff241c00640 1 -- start start 2024-08-31T04:19:50.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff241c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 0x7ff23c0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff241c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff23c140570 0x7ff23c1e50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff241c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff23c152c40 0x7ff23c13d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff241c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c073b90 con 0x7ff220004810 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff241c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c0738b0 con 0x7ff23c140570 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff241c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff23c073e70 con 0x7ff23c152c40 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 0x7ff23c0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 0x7ff23c0cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50490/0 (socket says 172.21.15.89:50490) 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23aa00640 1 -- 172.21.15.89:0/2857808403 learned_addr learned my addr 172.21.15.89:0/2857808403 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23b400640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff23c152c40 0x7ff23c13d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23a000640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff23c140570 0x7ff23c1e50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23aa00640 1 -- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff23c152c40 msgr2=0x7ff23c13d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23aa00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff23c152c40 0x7ff23c13d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23aa00640 1 -- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff23c140570 msgr2=0x7ff23c1e50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23aa00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff23c140570 0x7ff23c1e50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23aa00640 1 -- 172.21.15.89:0/2857808403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c0cb670 con 0x7ff220004810 2024-08-31T04:19:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff23aa00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 0x7ff23c0cc3c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff22c012640 tx=0x7ff22c012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:50.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff232a00640 1 -- 172.21.15.89:0/2857808403 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c013980 con 0x7ff220004810 2024-08-31T04:19:50.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.499+0000 7ff232a00640 1 -- 172.21.15.89:0/2857808403 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff22c017030 con 0x7ff220004810 2024-08-31T04:19:50.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.503+0000 7ff232a00640 1 -- 172.21.15.89:0/2857808403 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c013de0 con 0x7ff220004810 2024-08-31T04:19:50.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.503+0000 7ff241c00640 1 -- 172.21.15.89:0/2857808403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23c0cc900 con 0x7ff220004810 2024-08-31T04:19:50.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.503+0000 7ff241c00640 1 -- 172.21.15.89:0/2857808403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff23c1488c0 con 0x7ff220004810 2024-08-31T04:19:50.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.503+0000 7ff232a00640 1 -- 172.21.15.89:0/2857808403 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff22c010440 con 0x7ff220004810 2024-08-31T04:19:50.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.503+0000 7ff232a00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff21c0720c0 0x7ff21c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.503+0000 7ff232a00640 1 -- 172.21.15.89:0/2857808403 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff22c096ba0 con 0x7ff220004810 2024-08-31T04:19:50.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.503+0000 7ff249307000 1 Processor -- start 2024-08-31T04:19:50.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.503+0000 7ff23a000640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff21c0720c0 0x7ff21c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.503+0000 7ff249307000 1 -- start start 2024-08-31T04:19:50.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23a000640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff21c0720c0 0x7ff21c0745d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff2280016c0 tx=0x7ff2280a8040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:50.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab16a1ab0 0x562ab1bd4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1bd84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1bd89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562ab19f38c0 con 0x562ab1a7a800 2024-08-31T04:19:50.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562ab19e2e50 con 0x562ab16a1ab0 2024-08-31T04:19:50.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562ab19e6e00 con 0x562ab1a90840 2024-08-31T04:19:50.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1bd89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1bd89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50494/0 (socket says 172.21.15.89:50494) 2024-08-31T04:19:50.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23b400640 1 -- 172.21.15.89:0/1935104866 learned_addr learned my addr 172.21.15.89:0/1935104866 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23a000640 1 --2- 172.21.15.89:0/1935104866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1bd84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23aa00640 1 --2- 172.21.15.89:0/1935104866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab16a1ab0 0x562ab1bd4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23b400640 1 -- 172.21.15.89:0/1935104866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 msgr2=0x562ab1bd84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23b400640 1 --2- 172.21.15.89:0/1935104866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1bd84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23b400640 1 -- 172.21.15.89:0/1935104866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab16a1ab0 msgr2=0x562ab1bd4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23b400640 1 --2- 172.21.15.89:0/1935104866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab16a1ab0 0x562ab1bd4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23b400640 1 -- 172.21.15.89:0/1935104866 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab1982850 con 0x562ab1a7a800 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff23b400640 1 --2- 172.21.15.89:0/1935104866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1bd89f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff23c15a810 tx=0x7ff234012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4778bb4370bafbec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff227400640 1 -- 172.21.15.89:0/1935104866 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234012110 con 0x562ab1a7a800 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff227400640 1 -- 172.21.15.89:0/1935104866 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff234012b50 con 0x562ab1a7a800 2024-08-31T04:19:50.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff227400640 1 -- 172.21.15.89:0/1935104866 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2340122b0 con 0x562ab1a7a800 2024-08-31T04:19:50.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 -- 172.21.15.89:0/1935104866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 msgr2=0x562ab1bd89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 --2- 172.21.15.89:0/1935104866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1bd89f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff23c15a810 tx=0x7ff234012450 comp rx=0 tx=0).stop 2024-08-31T04:19:50.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 -- 172.21.15.89:0/1935104866 shutdown_connections 2024-08-31T04:19:50.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 --2- 172.21.15.89:0/1935104866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1bd89f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 --2- 172.21.15.89:0/1935104866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1bd84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 --2- 172.21.15.89:0/1935104866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab16a1ab0 0x562ab1bd4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 -- 172.21.15.89:0/1935104866 >> 172.21.15.89:0/1935104866 conn(0x562ab1b67290 msgr2=0x562ab1bd7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:50.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 -- 172.21.15.89:0/1935104866 shutdown_connections 2024-08-31T04:19:50.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.507+0000 7ff249307000 1 -- 172.21.15.89:0/1935104866 wait complete. 2024-08-31T04:19:50.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 -- start start 2024-08-31T04:19:50.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 Processor -- start 2024-08-31T04:19:50.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1be3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 0x562ab1be3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1b99ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562ab19886f0 con 0x562ab16a1ab0 2024-08-31T04:19:50.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562ab19f2690 con 0x562ab1a7a800 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562ab1964df0 con 0x562ab1a90840 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 10 client.0 _ll_register_callbacks cb 0x562ab1b83a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1be3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1be3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50498/0 (socket says 172.21.15.89:50498) 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23aa00640 1 -- 172.21.15.89:0/2574947527 learned_addr learned my addr 172.21.15.89:0/2574947527 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23b400640 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1b99ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23a000640 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 0x562ab1be3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23aa00640 1 -- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 msgr2=0x562ab1b99ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23aa00640 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1b99ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23aa00640 1 -- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 msgr2=0x562ab1be3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:50.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23aa00640 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 0x562ab1be3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23aa00640 1 -- 172.21.15.89:0/2574947527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab198d340 con 0x562ab16a1ab0 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff23aa00640 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1be3040 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff22c05e000 tx=0x7ff22c061460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d494703569379d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff21be00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff21be00640 1 -- 172.21.15.89:0/2574947527 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c022030 con 0x562ab16a1ab0 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff21be00640 1 -- 172.21.15.89:0/2574947527 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff22c060e70 con 0x562ab16a1ab0 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 -- 172.21.15.89:0/2574947527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562ab197c960 con 0x562ab16a1ab0 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff21be00640 1 -- 172.21.15.89:0/2574947527 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff22c066280 con 0x562ab16a1ab0 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 10 client.5472 fetch_fsmap learned FSMap version 9 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff249307000 1 -- 172.21.15.89:0/2574947527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562ab197dbd0 con 0x562ab16a1ab0 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.511+0000 7ff21be00640 1 -- 172.21.15.89:0/2574947527 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562ab197c960 con 0x562ab16a1ab0 2024-08-31T04:19:50.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff21be00640 1 -- 172.21.15.89:0/2574947527 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff22c086b60 con 0x562ab16a1ab0 2024-08-31T04:19:50.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 10 client.5472 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:19:50.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 10 client.5472 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:19:50.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 20 client.5472 populate_metadata read hostname 'smithi089' 2024-08-31T04:19:50.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562ab1686e20 0x562ab1b9a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 4 client.5472 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:19:50.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 -- 172.21.15.89:0/2574947527 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ab19f5810 con 0x562ab1686e20 2024-08-31T04:19:50.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff23a000640 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562ab1686e20 0x562ab1b9a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff21be00640 10 client.5472 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:50.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff23a000640 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562ab1686e20 0x562ab1b9a4f0 crc :-1 s=READY pgs=697 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32db3142dd923dd5 server_cookie=d32ef66493ac0fa9 in_seq=0 out_seq=0 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff21be00640 1 -- 172.21.15.89:0/2574947527 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ab19f5810 con 0x562ab1686e20 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff21be00640 10 client.5472 handle_command_reply: tid=0 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 client.5472 shutdown 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 -- 172.21.15.89:0/2574947527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 msgr2=0x562ab1be3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1be3040 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff22c05e000 tx=0x7ff22c061460 comp rx=0 tx=0).stop 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 -- 172.21.15.89:0/2574947527 shutdown_connections 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562ab1686e20 0x562ab1b9a4f0 crc :-1 s=READY pgs=697 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1b99ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 0x562ab1be3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff21be00640 0 client.5472 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:50.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 --2- 172.21.15.89:0/2574947527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1be3040 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.515+0000 7ff249307000 1 -- 172.21.15.89:0/2574947527 >> 172.21.15.89:0/2574947527 conn(0x562ab1b67290 msgr2=0x562ab1bd63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:50.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.519+0000 7ff249307000 1 -- 172.21.15.89:0/2574947527 shutdown_connections 2024-08-31T04:19:50.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.519+0000 7ff249307000 1 -- 172.21.15.89:0/2574947527 wait complete. 2024-08-31T04:19:50.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.519+0000 7ff249307000 20 client.5472 trim_cache size 0 max 16384 2024-08-31T04:19:50.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff249307000 1 Processor -- start 2024-08-31T04:19:50.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff249307000 1 -- start start 2024-08-31T04:19:50.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff249307000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1bd2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff249307000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 0x562ab1bd3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff249307000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1bf3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff249307000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c1ffa80 con 0x562ab16a1ab0 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff249307000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c1fece0 con 0x562ab1a7a800 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff249307000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff23c1ff3b0 con 0x562ab1a90840 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1bd2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1bd2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50508/0 (socket says 172.21.15.89:50508) 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23aa00640 1 -- 172.21.15.89:0/2531773955 learned_addr learned my addr 172.21.15.89:0/2531773955 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23b400640 1 --2- 172.21.15.89:0/2531773955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1bf3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23a000640 1 --2- 172.21.15.89:0/2531773955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 0x562ab1bd3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23aa00640 1 -- 172.21.15.89:0/2531773955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 msgr2=0x562ab1bf3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23aa00640 1 --2- 172.21.15.89:0/2531773955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1bf3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23aa00640 1 -- 172.21.15.89:0/2531773955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 msgr2=0x562ab1bd3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23aa00640 1 --2- 172.21.15.89:0/2531773955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 0x562ab1bd3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.535+0000 7ff23aa00640 1 -- 172.21.15.89:0/2531773955 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab1a67b30 con 0x562ab16a1ab0 2024-08-31T04:19:50.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff23aa00640 1 --2- 172.21.15.89:0/2531773955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1bd2e50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff22c061710 tx=0x7ff22c05e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d972b3de8d399ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:50.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff226a00640 1 -- 172.21.15.89:0/2531773955 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c022040 con 0x562ab16a1ab0 2024-08-31T04:19:50.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff226a00640 1 -- 172.21.15.89:0/2531773955 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff22c086030 con 0x562ab16a1ab0 2024-08-31T04:19:50.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff226a00640 1 -- 172.21.15.89:0/2531773955 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c06aca0 con 0x562ab16a1ab0 2024-08-31T04:19:50.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 -- 172.21.15.89:0/2531773955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 msgr2=0x562ab1bd2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:50.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 --2- 172.21.15.89:0/2531773955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1bd2e50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff22c061710 tx=0x7ff22c05e160 comp rx=0 tx=0).stop 2024-08-31T04:19:50.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 -- 172.21.15.89:0/2531773955 shutdown_connections 2024-08-31T04:19:50.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 --2- 172.21.15.89:0/2531773955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab1a90840 0x562ab1bf3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 --2- 172.21.15.89:0/2531773955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a7a800 0x562ab1bd3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 --2- 172.21.15.89:0/2531773955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab16a1ab0 0x562ab1bd2e50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 -- 172.21.15.89:0/2531773955 >> 172.21.15.89:0/2531773955 conn(0x562ab1b67290 msgr2=0x562ab1bd3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:50.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 -- 172.21.15.89:0/2531773955 shutdown_connections 2024-08-31T04:19:50.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 -- 172.21.15.89:0/2531773955 wait complete. 2024-08-31T04:19:50.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 -- start start 2024-08-31T04:19:50.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 Processor -- start 2024-08-31T04:19:50.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab16a1ab0 0x562ab1be9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1be7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a90840 0x562ab1be78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562ab19e6110 con 0x562ab1a7a800 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562ab198af60 con 0x562ab1a90840 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.539+0000 7ff249307000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562ab19eb430 con 0x562ab16a1ab0 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 10 client.0 _ll_register_callbacks cb 0x7ff22c061830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1be7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1be7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50512/0 (socket says 172.21.15.89:50512) 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23a000640 1 -- 172.21.15.89:0/937839039 learned_addr learned my addr 172.21.15.89:0/937839039 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23aa00640 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab16a1ab0 0x562ab1be9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23b400640 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a90840 0x562ab1be78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23a000640 1 -- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab16a1ab0 msgr2=0x562ab1be9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23a000640 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab16a1ab0 0x562ab1be9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23a000640 1 -- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a90840 msgr2=0x562ab1be78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23a000640 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a90840 0x562ab1be78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23a000640 1 -- 172.21.15.89:0/937839039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab196cea0 con 0x562ab1a7a800 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23aa00640 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab16a1ab0 0x562ab1be9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23a000640 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1be7370 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff2280016f0 tx=0x7ff228019540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76908aacbcc05edf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff21be00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff21be00640 1 -- 172.21.15.89:0/937839039 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2280d3060 con 0x562ab1a7a800 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff21be00640 1 -- 172.21.15.89:0/937839039 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff2280a66b0 con 0x562ab1a7a800 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 1 -- 172.21.15.89:0/937839039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff22c086030 con 0x562ab1a7a800 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff21be00640 1 -- 172.21.15.89:0/937839039 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff2280d9050 con 0x562ab1a7a800 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 10 client.5478 fetch_fsmap learned FSMap version 9 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 1 -- 172.21.15.89:0/937839039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562ab1988c10 con 0x562ab1a7a800 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff21be00640 1 -- 172.21.15.89:0/937839039 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff22c086030 con 0x562ab1a7a800 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff21be00640 1 -- 172.21.15.89:0/937839039 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff2280dc020 con 0x562ab1a7a800 2024-08-31T04:19:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 10 client.5478 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:19:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 10 client.5478 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:19:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 20 client.5478 populate_metadata read hostname 'smithi089' 2024-08-31T04:19:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562ab1674e80 0x562ab1be7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 4 client.5478 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.25, "await_for": 45.0}] 2024-08-31T04:19:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff249307000 1 -- 172.21.15.89:0/937839039 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.25, "await_for": 45.0}) -- 0x562ab19f12b0 con 0x562ab1674e80 2024-08-31T04:19:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23aa00640 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562ab1674e80 0x562ab1be7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff23aa00640 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562ab1674e80 0x562ab1be7df0 crc :-1 s=READY pgs=698 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d63afc781c41ceec server_cookie=a55a848a1dffa4b1 in_seq=0 out_seq=0 2024-08-31T04:19:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:50.543+0000 7ff21be00640 10 client.5478 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:51.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff21be00640 1 -- 172.21.15.89:0/937839039 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x562ab19f12b0 con 0x562ab1674e80 2024-08-31T04:19:51.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff21be00640 10 client.5478 handle_command_reply: tid=0 2024-08-31T04:19:51.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 client.5478 shutdown 2024-08-31T04:19:51.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 -- 172.21.15.89:0/937839039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 msgr2=0x562ab1be7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:51.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1be7370 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff2280016f0 tx=0x7ff228019540 comp rx=0 tx=0).stop 2024-08-31T04:19:51.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 -- 172.21.15.89:0/937839039 shutdown_connections 2024-08-31T04:19:51.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562ab1674e80 0x562ab1be7df0 crc :-1 s=READY pgs=698 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ab1a7a800 0x562ab1be7370 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562ab1a90840 0x562ab1be78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 --2- 172.21.15.89:0/937839039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562ab16a1ab0 0x562ab1be9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff21be00640 0 client.5478 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:19:51.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 -- 172.21.15.89:0/937839039 >> 172.21.15.89:0/937839039 conn(0x562ab1b67290 msgr2=0x562ab1b9cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:51.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 -- 172.21.15.89:0/937839039 shutdown_connections 2024-08-31T04:19:51.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 1 -- 172.21.15.89:0/937839039 wait complete. 2024-08-31T04:19:51.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff249307000 20 client.5478 trim_cache size 0 max 16384 2024-08-31T04:19:51.328 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:19:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 54, 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "b98aa567": { 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 54, 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 141.2, 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:19:51.329 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:19:51.330 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 -- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff21c0720c0 msgr2=0x7ff21c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff21c0720c0 0x7ff21c0745d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff2280016c0 tx=0x7ff2280a8040 comp rx=0 tx=0).stop 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 -- 172.21.15.89:0/2857808403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 msgr2=0x7ff23c0cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 0x7ff23c0cc3c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff22c012640 tx=0x7ff22c012b00 comp rx=0 tx=0).stop 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 -- 172.21.15.89:0/2857808403 shutdown_connections 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff21c0720c0 0x7ff21c0745d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff23c152c40 0x7ff23c13d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff23c140570 0x7ff23c1e50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 --2- 172.21.15.89:0/2857808403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff220004810 0x7ff23c0cc3c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.327+0000 7ff241c00640 1 -- 172.21.15.89:0/2857808403 >> 172.21.15.89:0/2857808403 conn(0x7ff23c0c99b0 msgr2=0x7ff23c1579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:51.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.331+0000 7ff241c00640 1 -- 172.21.15.89:0/2857808403 shutdown_connections 2024-08-31T04:19:51.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:19:51.331+0000 7ff241c00640 1 -- 172.21.15.89:0/2857808403 wait complete. 2024-08-31T04:19:51.353 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b98aa567', quiesce took 1.4 seconds. Will release after: 19.85 2024-08-31T04:20:03.659 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:20:03.664 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:20:11.204 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:20:11.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.371+0000 7fd138000640 1 -- 172.21.15.89:0/3293862551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c1f40 msgr2=0x7fd130152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.371+0000 7fd138000640 1 --2- 172.21.15.89:0/3293862551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c1f40 0x7fd130152a10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009840 tx=0x7fd11c01f010 comp rx=0 tx=0).stop 2024-08-31T04:20:11.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.371+0000 7fd138000640 1 -- 172.21.15.89:0/3293862551 shutdown_connections 2024-08-31T04:20:11.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.371+0000 7fd138000640 1 --2- 172.21.15.89:0/3293862551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1300c9330 0x7fd130074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.371+0000 7fd138000640 1 --2- 172.21.15.89:0/3293862551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c1f40 0x7fd130152a10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.371+0000 7fd138000640 1 -- 172.21.15.89:0/3293862551 >> 172.21.15.89:0/3293862551 conn(0x7fd1300ccf20 msgr2=0x7fd1300cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:11.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.371+0000 7fd138000640 1 -- 172.21.15.89:0/3293862551 shutdown_connections 2024-08-31T04:20:11.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.371+0000 7fd138000640 1 -- 172.21.15.89:0/3293862551 wait complete. 2024-08-31T04:20:11.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 Processor -- start 2024-08-31T04:20:11.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 -- start start 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1300c1f40 0x7fd1300c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c9330 0x7fd1301e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd13015bc70 0x7fd130070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd1300c8030 con 0x7fd1300c9330 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd1300c3150 con 0x7fd13015bc70 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd130074c60 con 0x7fd1300c1f40 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd134c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c9330 0x7fd1301e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd134c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c9330 0x7fd1301e6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37296/0 (socket says 172.21.15.89:37296) 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd134c00640 1 -- 172.21.15.89:0/3694019317 learned_addr learned my addr 172.21.15.89:0/3694019317 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd135600640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1300c1f40 0x7fd1300c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd136000640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd13015bc70 0x7fd130070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd134c00640 1 -- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1300c1f40 msgr2=0x7fd1300c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd134c00640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1300c1f40 0x7fd1300c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd134c00640 1 -- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd13015bc70 msgr2=0x7fd130070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd134c00640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd13015bc70 0x7fd130070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd134c00640 1 -- 172.21.15.89:0/3694019317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13015b8c0 con 0x7fd1300c9330 2024-08-31T04:20:11.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd135600640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1300c1f40 0x7fd1300c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:20:11.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd134c00640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c9330 0x7fd1301e6a00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009930 tx=0x7fd11c004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:11.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd12d600640 1 -- 172.21.15.89:0/3694019317 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0b5040 con 0x7fd1300c9330 2024-08-31T04:20:11.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd12d600640 1 -- 172.21.15.89:0/3694019317 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd11c0a8c20 con 0x7fd1300c9330 2024-08-31T04:20:11.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd12d600640 1 -- 172.21.15.89:0/3694019317 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c003800 con 0x7fd1300c9330 2024-08-31T04:20:11.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd130158190 con 0x7fd1300c9330 2024-08-31T04:20:11.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.375+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1301573e0 con 0x7fd1300c9330 2024-08-31T04:20:11.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.379+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd13015b370 con 0x7fd1300c9330 2024-08-31T04:20:11.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.379+0000 7fd12d600640 1 -- 172.21.15.89:0/3694019317 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd11c0c0030 con 0x7fd1300c9330 2024-08-31T04:20:11.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.379+0000 7fd12d600640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd1100720f0 0x7fd110074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.379+0000 7fd12d600640 1 -- 172.21.15.89:0/3694019317 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fd11c12fff0 con 0x7fd1300c9330 2024-08-31T04:20:11.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.379+0000 7fd135600640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd1100720f0 0x7fd110074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.379+0000 7fd135600640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd1100720f0 0x7fd110074600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd124007a60 tx=0x7fd124009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:11.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.383+0000 7fd12d600640 1 -- 172.21.15.89:0/3694019317 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd11c0c7060 con 0x7fd1300c9330 2024-08-31T04:20:11.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.583+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd130157f80 con 0x7fd1300c9330 2024-08-31T04:20:11.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.583+0000 7fd12d600640 1 -- 172.21.15.89:0/3694019317 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fd11c018b70 con 0x7fd1300c9330 2024-08-31T04:20:11.583 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:20:11.583 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:20:11.584 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:20:11.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd1100720f0 msgr2=0x7fd110074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd1100720f0 0x7fd110074600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd124007a60 tx=0x7fd124009040 comp rx=0 tx=0).stop 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c9330 msgr2=0x7fd1301e6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c9330 0x7fd1301e6a00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009930 tx=0x7fd11c004620 comp rx=0 tx=0).stop 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 shutdown_connections 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd1100720f0 0x7fd110074600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1300c9330 0x7fd1301e6a00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd13015bc70 0x7fd130070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 --2- 172.21.15.89:0/3694019317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1300c1f40 0x7fd1300c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 >> 172.21.15.89:0/3694019317 conn(0x7fd1300ccf20 msgr2=0x7fd1300b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 shutdown_connections 2024-08-31T04:20:11.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.587+0000 7fd138000640 1 -- 172.21.15.89:0/3694019317 wait complete. 2024-08-31T04:20:11.605 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id b98aa567 --release --await' 2024-08-31T04:20:11.606 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id b98aa567 --release --await 2024-08-31T04:20:11.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.767+0000 7f9624c00640 1 -- 172.21.15.89:0/4221609170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f962006f3f0 msgr2=0x7f962006f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.767+0000 7f9624c00640 1 --2- 172.21.15.89:0/4221609170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f962006f3f0 0x7f962006f800 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f96200725d0 tx=0x7f961801cb80 comp rx=0 tx=0).stop 2024-08-31T04:20:11.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.767+0000 7f9624c00640 1 -- 172.21.15.89:0/4221609170 shutdown_connections 2024-08-31T04:20:11.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.767+0000 7f9624c00640 1 --2- 172.21.15.89:0/4221609170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f962006f3f0 0x7f962006f800 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.767+0000 7f9624c00640 1 --2- 172.21.15.89:0/4221609170 >> v2:172.21.15.170:3300/0 conn(0x7f9620074d50 0x7f962015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.767+0000 7f9624c00640 1 -- 172.21.15.89:0/4221609170 >> 172.21.15.89:0/4221609170 conn(0x7f96200c99b0 msgr2=0x7f96200c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:11.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.767+0000 7f9624c00640 1 -- 172.21.15.89:0/4221609170 shutdown_connections 2024-08-31T04:20:11.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.767+0000 7f9624c00640 1 -- 172.21.15.89:0/4221609170 wait complete. 2024-08-31T04:20:11.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 Processor -- start 2024-08-31T04:20:11.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 -- start start 2024-08-31T04:20:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f962006f3f0 0x7f9620162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9620074d50 0x7f96200c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9620153800 0x7f9620158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9620073e70 con 0x7f9620074d50 2024-08-31T04:20:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9620073b90 con 0x7f9620153800 2024-08-31T04:20:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9620069fc0 con 0x7f962006f3f0 2024-08-31T04:20:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9615400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9620074d50 0x7f96200c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9615400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9620074d50 0x7f96200c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35720/0 (socket says 172.21.15.89:35720) 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9615400640 1 -- 172.21.15.89:0/74118739 learned_addr learned my addr 172.21.15.89:0/74118739 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f961e800640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9620153800 0x7f9620158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f961de00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f962006f3f0 0x7f9620162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9615400640 1 -- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f962006f3f0 msgr2=0x7f9620162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9615400640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f962006f3f0 0x7f9620162190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9615400640 1 -- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9620153800 msgr2=0x7f9620158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9615400640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9620153800 0x7f9620158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9615400640 1 -- 172.21.15.89:0/74118739 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96201635d0 con 0x7f9620074d50 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9615400640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9620074d50 0x7f96200c3330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f960800c460 tx=0x7f960800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9616a00640 1 -- 172.21.15.89:0/74118739 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608016020 con 0x7f9620074d50 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9616a00640 1 -- 172.21.15.89:0/74118739 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9608012940 con 0x7f9620074d50 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 -- 172.21.15.89:0/74118739 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96200c3870 con 0x7f9620074d50 2024-08-31T04:20:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9616a00640 1 -- 172.21.15.89:0/74118739 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608012d90 con 0x7f9620074d50 2024-08-31T04:20:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.771+0000 7f9624c00640 1 -- 172.21.15.89:0/74118739 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96201f4f10 con 0x7f9620074d50 2024-08-31T04:20:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.775+0000 7f9616a00640 1 -- 172.21.15.89:0/74118739 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f9608019020 con 0x7f9620074d50 2024-08-31T04:20:11.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.775+0000 7f9616a00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95fc0720c0 0x7f95fc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.775+0000 7f9616a00640 1 -- 172.21.15.89:0/74118739 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f9608092cc0 con 0x7f9620074d50 2024-08-31T04:20:11.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.775+0000 7f962c195000 1 Processor -- start 2024-08-31T04:20:11.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.775+0000 7f961de00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95fc0720c0 0x7f95fc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.775+0000 7f962c195000 1 -- start start 2024-08-31T04:20:11.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.775+0000 7f961de00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95fc0720c0 0x7f95fc0745d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9610005fd0 tx=0x7f9610005f20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:11.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a2c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56136a174f30 con 0x56136a186890 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56136a0ea690 con 0x56136a1ab950 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56136a0d9c20 con 0x56136a195930 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35726/0 (socket says 172.21.15.89:35726) 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961e800640 1 -- 172.21.15.89:0/8472014 learned_addr learned my addr 172.21.15.89:0/8472014 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961de00640 1 --2- 172.21.15.89:0/8472014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a2c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f9615400640 1 --2- 172.21.15.89:0/8472014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961e800640 1 -- 172.21.15.89:0/8472014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 msgr2=0x56136a2cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961e800640 1 --2- 172.21.15.89:0/8472014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961e800640 1 -- 172.21.15.89:0/8472014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 msgr2=0x56136a2c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:20:11.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961e800640 1 --2- 172.21.15.89:0/8472014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a2c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961e800640 1 -- 172.21.15.89:0/8472014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56136a08e8f0 con 0x56136a186890 2024-08-31T04:20:11.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f961e800640 1 --2- 172.21.15.89:0/8472014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2cf010 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9618009b10 tx=0x7f9618019920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea8b44f710ded2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:11.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f960e600640 1 -- 172.21.15.89:0/8472014 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96180b2040 con 0x56136a186890 2024-08-31T04:20:11.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f960e600640 1 -- 172.21.15.89:0/8472014 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96180bc070 con 0x56136a186890 2024-08-31T04:20:11.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f960e600640 1 -- 172.21.15.89:0/8472014 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9618004a50 con 0x56136a186890 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 -- 172.21.15.89:0/8472014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 msgr2=0x56136a2cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 --2- 172.21.15.89:0/8472014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2cf010 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9618009b10 tx=0x7f9618019920 comp rx=0 tx=0).stop 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 -- 172.21.15.89:0/8472014 shutdown_connections 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 --2- 172.21.15.89:0/8472014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2cf010 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 --2- 172.21.15.89:0/8472014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 --2- 172.21.15.89:0/8472014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a2c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 -- 172.21.15.89:0/8472014 >> 172.21.15.89:0/8472014 conn(0x56136a1ab540 msgr2=0x56136a2cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 -- 172.21.15.89:0/8472014 shutdown_connections 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 -- 172.21.15.89:0/8472014 wait complete. 2024-08-31T04:20:11.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 -- start start 2024-08-31T04:20:11.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.779+0000 7f962c195000 1 Processor -- start 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a186890 0x56136a2c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2c9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a1ab950 0x56136a2c9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56136a060500 con 0x56136a1ab950 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56136a0ddbd0 con 0x56136a186890 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56136a081a30 con 0x56136a195930 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 10 client.0 _ll_register_callbacks cb 0x56136a18fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a1ab950 0x56136a2c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a1ab950 0x56136a2c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35732/0 (socket says 172.21.15.89:35732) 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961e800640 1 -- 172.21.15.89:0/621989270 learned_addr learned my addr 172.21.15.89:0/621989270 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:20:11.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f9615400640 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961de00640 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a186890 0x56136a2c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961e800640 1 -- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 msgr2=0x56136a2c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961e800640 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961e800640 1 -- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a186890 msgr2=0x56136a2c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961e800640 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a186890 0x56136a2c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961e800640 1 -- 172.21.15.89:0/621989270 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56136a0796a0 con 0x56136a1ab950 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f9615400640 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961de00640 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a186890 0x56136a2c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961e800640 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a1ab950 0x56136a2c9690 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9618019790 tx=0x7f9618003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa12ef1a59d668ce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f9602a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f9602a00640 1 -- 172.21.15.89:0/621989270 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96180c7060 con 0x56136a1ab950 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f9602a00640 1 -- 172.21.15.89:0/621989270 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f9618009200 con 0x56136a1ab950 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 -- 172.21.15.89:0/621989270 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56136a0737e0 con 0x56136a1ab950 2024-08-31T04:20:11.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f9602a00640 1 -- 172.21.15.89:0/621989270 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9618004a50 con 0x56136a1ab950 2024-08-31T04:20:11.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 10 client.5502 fetch_fsmap learned FSMap version 9 2024-08-31T04:20:11.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 -- 172.21.15.89:0/621989270 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56136a0981c0 con 0x56136a1ab950 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f9602a00640 1 -- 172.21.15.89:0/621989270 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56136a0737e0 con 0x56136a1ab950 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f9602a00640 1 -- 172.21.15.89:0/621989270 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f9618004ce0 con 0x56136a1ab950 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 10 client.5502 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 10 client.5502 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 20 client.5502 populate_metadata read hostname 'smithi089' 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56136a16ffc0 0x56136a2e4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 4 client.5502 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f962c195000 1 -- 172.21.15.89:0/621989270 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56136a0ec5e0 con 0x56136a16ffc0 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.783+0000 7f961de00640 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56136a16ffc0 0x56136a2e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f961de00640 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56136a16ffc0 0x56136a2e4010 crc :-1 s=READY pgs=699 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e0f1edb6d2aa507 server_cookie=f93cee7539a6e042 in_seq=0 out_seq=0 2024-08-31T04:20:11.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f9602a00640 10 client.5502 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:20:11.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f9602a00640 1 -- 172.21.15.89:0/621989270 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56136a0ec5e0 con 0x56136a16ffc0 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f9602a00640 10 client.5502 handle_command_reply: tid=0 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 client.5502 shutdown 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 -- 172.21.15.89:0/621989270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a1ab950 msgr2=0x56136a2c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a1ab950 0x56136a2c9690 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9618019790 tx=0x7f9618003d80 comp rx=0 tx=0).stop 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 -- 172.21.15.89:0/621989270 shutdown_connections 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56136a16ffc0 0x56136a2e4010 crc :-1 s=READY pgs=699 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a1ab950 0x56136a2c9690 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f9602a00640 0 client.5502 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 --2- 172.21.15.89:0/621989270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a186890 0x56136a2c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 -- 172.21.15.89:0/621989270 >> 172.21.15.89:0/621989270 conn(0x56136a1ab540 msgr2=0x56136a2ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:11.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 -- 172.21.15.89:0/621989270 shutdown_connections 2024-08-31T04:20:11.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 1 -- 172.21.15.89:0/621989270 wait complete. 2024-08-31T04:20:11.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.787+0000 7f962c195000 20 client.5502 trim_cache size 0 max 16384 2024-08-31T04:20:11.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f962c195000 1 Processor -- start 2024-08-31T04:20:11.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f962c195000 1 -- start start 2024-08-31T04:20:11.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f962c195000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2e2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f962c195000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2e2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f962c195000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a2e2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f962c195000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9620203920 con 0x56136a186890 2024-08-31T04:20:11.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f962c195000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9620202800 con 0x56136a1ab950 2024-08-31T04:20:11.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f962c195000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9620200ee0 con 0x56136a195930 2024-08-31T04:20:11.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2e2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2e2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35738/0 (socket says 172.21.15.89:35738) 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961de00640 1 -- 172.21.15.89:0/486558775 learned_addr learned my addr 172.21.15.89:0/486558775 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961e800640 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a2e2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f9615400640 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2e2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961de00640 1 -- 172.21.15.89:0/486558775 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 msgr2=0x56136a2e2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961de00640 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2e2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961de00640 1 -- 172.21.15.89:0/486558775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 msgr2=0x56136a2e2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961de00640 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a2e2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961de00640 1 -- 172.21.15.89:0/486558775 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56136a15e2f0 con 0x56136a186890 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961e800640 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a2e2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:20:11.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f961de00640 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2e2000 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9610010010 tx=0x7f9610015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e214458fba14b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:11.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f960dc00640 1 -- 172.21.15.89:0/486558775 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610011700 con 0x56136a186890 2024-08-31T04:20:11.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f960dc00640 1 -- 172.21.15.89:0/486558775 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f961002c070 con 0x56136a186890 2024-08-31T04:20:11.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.807+0000 7f960dc00640 1 -- 172.21.15.89:0/486558775 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610011aa0 con 0x56136a186890 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 -- 172.21.15.89:0/486558775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 msgr2=0x56136a2e2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2e2000 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9610010010 tx=0x7f9610015000 comp rx=0 tx=0).stop 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 -- 172.21.15.89:0/486558775 shutdown_connections 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a2e2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a195930 0x56136a2e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 --2- 172.21.15.89:0/486558775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a186890 0x56136a2e2000 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 -- 172.21.15.89:0/486558775 >> 172.21.15.89:0/486558775 conn(0x56136a1ab540 msgr2=0x56136a28d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 -- 172.21.15.89:0/486558775 shutdown_connections 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 -- 172.21.15.89:0/486558775 wait complete. 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 -- start start 2024-08-31T04:20:11.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 Processor -- start 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a186890 0x56136a3428e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a195930 0x56136a342e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a343360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f96202013b0 con 0x56136a195930 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9620202130 con 0x56136a1ab950 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9620201a60 con 0x56136a186890 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f962c195000 10 client.0 _ll_register_callbacks cb 0x7f9610015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9615400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a195930 0x56136a342e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9615400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a195930 0x56136a342e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35752/0 (socket says 172.21.15.89:35752) 2024-08-31T04:20:11.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9615400640 1 -- 172.21.15.89:0/322654656 learned_addr learned my addr 172.21.15.89:0/322654656 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f961de00640 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a186890 0x56136a3428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f961e800640 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a343360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9615400640 1 -- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a186890 msgr2=0x56136a3428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9615400640 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a186890 0x56136a3428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9615400640 1 -- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 msgr2=0x56136a343360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9615400640 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a343360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9615400640 1 -- 172.21.15.89:0/322654656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56136a063b30 con 0x56136a195930 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9615400640 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a195930 0x56136a342e20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f960800ce20 tx=0x7f960805d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71402814910fcfd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.811+0000 7f9602a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f9602a00640 1 -- 172.21.15.89:0/322654656 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960808e060 con 0x56136a195930 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f9602a00640 1 -- 172.21.15.89:0/322654656 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f9608064dc0 con 0x56136a195930 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f962c195000 1 -- 172.21.15.89:0/322654656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f961002c070 con 0x56136a195930 2024-08-31T04:20:11.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f9602a00640 1 -- 172.21.15.89:0/322654656 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9608087050 con 0x56136a195930 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f962c195000 10 client.5508 fetch_fsmap learned FSMap version 9 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f962c195000 1 -- 172.21.15.89:0/322654656 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56136a070c70 con 0x56136a195930 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f9602a00640 1 -- 172.21.15.89:0/322654656 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f961002c070 con 0x56136a195930 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f9602a00640 1 -- 172.21.15.89:0/322654656 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f960805ce50 con 0x56136a195930 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f962c195000 10 client.5508 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f962c195000 10 client.5508 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f962c195000 20 client.5508 populate_metadata read hostname 'smithi089' 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f962c195000 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561369d6be80 0x56136a2e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f962c195000 4 client.5508 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b98aa567", "release": true, "await": true}] 2024-08-31T04:20:11.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f962c195000 1 -- 172.21.15.89:0/322654656 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b98aa567", "release": true, "await": true}) -- 0x56136a0e8080 con 0x561369d6be80 2024-08-31T04:20:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f961de00640 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561369d6be80 0x56136a2e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f961de00640 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561369d6be80 0x56136a2e60a0 crc :-1 s=READY pgs=700 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99c51aa04f9c3d2b server_cookie=8b2122c9ac638500 in_seq=0 out_seq=0 2024-08-31T04:20:11.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:11.815+0000 7f9602a00640 10 client.5508 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:20:12.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9602a00640 1 -- 172.21.15.89:0/322654656 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56136a0e8080 con 0x561369d6be80 2024-08-31T04:20:12.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9602a00640 10 client.5508 handle_command_reply: tid=0 2024-08-31T04:20:12.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 client.5508 shutdown 2024-08-31T04:20:12.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 -- 172.21.15.89:0/322654656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a195930 msgr2=0x56136a342e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:12.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a195930 0x56136a342e20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f960800ce20 tx=0x7f960805d770 comp rx=0 tx=0).stop 2024-08-31T04:20:12.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 -- 172.21.15.89:0/322654656 shutdown_connections 2024-08-31T04:20:12.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x561369d6be80 0x56136a2e60a0 crc :-1 s=READY pgs=700 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56136a195930 0x56136a342e20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56136a1ab950 0x56136a343360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 --2- 172.21.15.89:0/322654656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56136a186890 0x56136a3428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9602a00640 0 client.5508 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:20:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 -- 172.21.15.89:0/322654656 >> 172.21.15.89:0/322654656 conn(0x56136a1ab540 msgr2=0x56136a28a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 -- 172.21.15.89:0/322654656 shutdown_connections 2024-08-31T04:20:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 1 -- 172.21.15.89:0/322654656 wait complete. 2024-08-31T04:20:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f962c195000 20 client.5508 trim_cache size 0 max 16384 2024-08-31T04:20:12.012 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:20:12.012 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 56, 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "b98aa567": { 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 56, 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 141.2, 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:20:12.013 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:20:12.014 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:20:12.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 -- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95fc0720c0 msgr2=0x7f95fc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:12.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95fc0720c0 0x7f95fc0745d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9610005fd0 tx=0x7f9610005f20 comp rx=0 tx=0).stop 2024-08-31T04:20:12.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 -- 172.21.15.89:0/74118739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9620074d50 msgr2=0x7f96200c3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:12.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9620074d50 0x7f96200c3330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f960800c460 tx=0x7f960800c920 comp rx=0 tx=0).stop 2024-08-31T04:20:12.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 -- 172.21.15.89:0/74118739 shutdown_connections 2024-08-31T04:20:12.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95fc0720c0 0x7f95fc0745d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9620074d50 0x7f96200c3330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9620153800 0x7f9620158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 --2- 172.21.15.89:0/74118739 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f962006f3f0 0x7f9620162190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 -- 172.21.15.89:0/74118739 >> 172.21.15.89:0/74118739 conn(0x7f96200c99b0 msgr2=0x7f962014ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:12.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 -- 172.21.15.89:0/74118739 shutdown_connections 2024-08-31T04:20:12.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:20:12.011+0000 7f9624c00640 1 -- 172.21.15.89:0/74118739 wait complete. 2024-08-31T04:20:12.031 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b98aa567', total seconds elapsed: 22.1 2024-08-31T04:20:33.724 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:20:33.728 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:21:03.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:21:03.784 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:21:11.768 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 1% (139/13678) Updating files: 1% (192/13678) Updating files: 1% (238/13678) Updating files: 2% (274/13678) Updating files: 2% (283/13678) Updating files: 2% (284/13678) Updating files: 2% (285/13678) Updating files: 2% (304/13678) Updating files: 2% (365/13678) Updating files: 3% (411/13678) Updating files: 3% (463/13678) Updating files: 3% (470/13678) Updating files: 4% (548/13678) Updating files: 4% (555/13678) Updating files: 4% (635/13678) Updating files: 4% (644/13678) Updating files: 4% (663/13678) Updating files: 5% (684/13678) Updating files: 5% (728/13678) Updating files: 5% (736/13678) Updating files: 5% (797/13678) Updating files: 6% (821/13678) Updating files: 6% (927/13678) Updating files: 7% (958/13678) Updating files: 7% (976/13678) Updating files: 7% (1000/13678) Updating files: 7% (1093/13678) Updating files: 8% (1095/13678) Updating files: 8% (1107/13678) Updating files: 8% (1190/13678) Updating files: 9% (1232/13678) Updating files: 9% (1290/13678) Updating files: 9% (1299/13678) Updating files: 9% (1367/13678) Updating files: 10% (1368/13678) Updating files: 10% (1441/13678) Updating files: 10% (1458/13678) Updating files: 10% (1485/13678) Updating files: 11% (1505/13678) Updating files: 11% (1581/13678) Updating files: 11% (1625/13678) Updating files: 12% (1642/13678) Updating files: 12% (1673/13678) Updating files: 12% (1714/13678) Updating files: 12% (1776/13678) Updating files: 13% (1779/13678) Updating files: 13% (1819/13678) Updating files: 13% (1865/13678) Updating files: 13% (1891/13678) Updating files: 14% (1915/13678) Updating files: 14% (1939/13678) Updating files: 14% (2000/13678) Updating files: 14% (2016/13678) Updating files: 14% (2040/13678) Updating files: 15% (2052/13678) Updating files: 15% (2085/13678) Updating files: 15% (2143/13678) Updating files: 16% (2189/13678) Updating files: 16% (2191/13678) Updating files: 16% (2240/13678) Updating files: 16% (2275/13678) Updating files: 16% (2322/13678) Updating files: 17% (2326/13678) Updating files: 17% (2331/13678) Updating files: 17% (2368/13678) Updating files: 17% (2402/13678) Updating files: 17% (2430/13678) Updating files: 18% (2463/13678) Updating files: 18% (2477/13678) Updating files: 18% (2494/13678) Updating files: 18% (2564/13678) Updating files: 19% (2599/13678) Updating files: 19% (2600/13678) Updating files: 19% (2636/13678) Updating files: 19% (2678/13678) Updating files: 19% (2721/13678) Updating files: 20% (2736/13678) Updating files: 20% (2740/13678) Updating files: 20% (2842/13678) Updating files: 21% (2873/13678) Updating files: 21% (2884/13678) Updating files: 21% (2909/13678) Updating files: 21% (2985/13678) Updating files: 22% (3010/13678) Updating files: 22% (3020/13678) Updating files: 22% (3028/13678) Updating files: 22% (3071/13678) Updating files: 22% (3121/13678) Updating files: 23% (3146/13678) Updating files: 23% (3179/13678) Updating files: 23% (3209/13678) Updating files: 23% (3254/13678) Updating files: 24% (3283/13678) Updating files: 24% (3319/13678) Updating files: 24% (3412/13678) Updating files: 25% (3420/13678) Updating files: 25% (3435/13678) Updating files: 25% (3484/13678) Updating files: 25% (3509/13678) Updating files: 26% (3557/13678) Updating files: 26% (3595/13678) Updating files: 26% (3667/13678) Updating files: 26% (3689/13678) Updating files: 27% (3694/13678) Updating files: 27% (3757/13678) Updating files: 27% (3765/13678) Updating files: 28% (3830/13678) Updating files: 28% (3857/13678) Updating files: 28% (3885/13678) Updating files: 28% (3911/13678) Updating files: 28% (3952/13678) Updating files: 29% (3967/13678) Updating files: 29% (4052/13678) Updating files: 29% (4100/13678) Updating files: 30% (4104/13678) Updating files: 30% (4173/13678) Updating files: 30% (4199/13678) Updating files: 31% (4241/13678) Updating files: 31% (4275/13678) Updating files: 31% (4295/13678) Updating files: 31% (4336/13678) Updating files: 32% (4377/13678) Updating files: 32% (4440/13678) Updating files: 32% (4446/13678) Updating files: 32% (4495/13678) Updating files: 32% (4504/13678) Updating files: 33% (4514/13678) Updating files: 33% (4553/13678) Updating files: 33% (4599/13678) Updating files: 33% (4614/13678) Updating files: 34% (4651/13678) Updating files: 34% (4659/13678) Updating files: 34% (4756/13678) Updating files: 34% (4758/13678) Updating files: 34% (4759/13678) Updating files: 35% (4788/13678) Updating files: 35% (4834/13678) Updating files: 35% (4920/13678) Updating files: 36% (4925/13678) Updating files: 36% (4942/13678) Updating files: 36% (4954/13678) Updating files: 37% (5061/13678) Updating files: 37% (5063/13678) Updating files: 37% (5083/13678) Updating files: 37% (5175/13678) Updating files: 38% (5198/13678) Updating files: 38% (5219/13678) Updating files: 38% (5234/13678) Updating files: 39% (5335/13678) Updating files: 39% (5341/13678) Updating files: 39% (5397/13678) Updating files: 39% (5442/13678) Updating files: 40% (5472/13678) Updating files: 40% (5509/13678) Updating files: 40% (5553/13678) Updating files: 40% (5587/13678) Updating files: 41% (5608/13678) Updating files: 41% (5610/13678) Updating files: 41% (5666/13678) Updating files: 41% (5686/13678) Updating files: 42% (5745/13678) Updating files: 42% (5772/13678) Updating files: 42% (5808/13678) Updating files: 42% (5869/13678) Updating files: 43% (5882/13678) Updating files: 43% (5901/13678) Updating files: 43% (5991/13678) Updating files: 44% (6019/13678) Updating files: 44% (6120/13678) Updating files: 44% (6148/13678) Updating files: 45% (6156/13678) Updating files: 45% (6191/13678) Updating files: 45% (6244/13678) Updating files: 45% (6256/13678) Updating files: 45% (6285/13678) Updating files: 46% (6292/13678) Updating files: 46% (6302/13678) Updating files: 46% (6313/13678) Updating files: 46% (6343/13678) Updating files: 46% (6381/13678) Updating files: 47% (6429/13678) Updating files: 47% (6435/13678) Updating files: 47% (6531/13678) Updating files: 48% (6566/13678) Updating files: 48% (6625/13678) Updating files: 48% (6676/13678) Updating files: 49% (6703/13678) Updating files: 49% (6759/13678) Updating files: 50% (6839/13678) Updating files: 50% (6849/13678) Updating files: 50% (6927/13678) Updating files: 51% (6976/13678) Updating files: 51% (6984/13678) Updating files: 51% (7057/13678) Updating files: 51% (7091/13678) Updating files: 52% (7113/13678) Updating files: 52% (7126/13678) Updating files: 52% (7199/13678) Updating files: 53% (7250/13678) Updating files: 53% (7302/13678) Updating files: 53% (7353/13678) Updating files: 54% (7387/13678) Updating files: 54% (7422/13678) Updating files: 54% (7450/13678) Updating files: 54% (7502/13678) Updating files: 55% (7523/13678) Updating files: 55% (7578/13678) Updating files: 56% (7660/13678) Updating files: 56% (7678/13678) Updating files: 56% (7745/13678) Updating files: 57% (7797/13678) Updating files: 57% (7800/13678) Updating files: 57% (7809/13678) Updating files: 57% (7833/13678) Updating files: 57% (7910/13678) Updating files: 58% (7934/13678) Updating files: 58% (7947/13678) Updating files: 58% (8009/13678) Updating files: 59% (8071/13678) Updating files: 59% (8087/13678) Updating files: 59% (8089/13678) Updating files: 59% (8140/13678) Updating files: 59% (8163/13678) Updating files: 59% (8164/13678) Updating files: 60% (8207/13678) Updating files: 60% (8216/13678) Updating files: 60% (8332/13678) Updating files: 61% (8344/13678) Updating files: 61% (8383/13678) Updating files: 61% (8451/13678) Updating files: 62% (8481/13678) Updating files: 62% (8542/13678) Updating files: 62% (8608/13678) Updating files: 62% (8617/13678) Updating files: 63% (8618/13678) Updating files: 63% (8666/13678) Updating files: 63% (8708/13678) Updating files: 63% (8723/13678) Updating files: 64% (8754/13678) Updating files: 64% (8790/13678) Updating files: 64% (8860/13678) Updating files: 65% (8891/13678) Updating files: 65% (8918/13678) Updating files: 65% (8965/13678) Updating files: 65% (8970/13678) Updating files: 65% (9008/13678) Updating files: 66% (9028/13678) Updating files: 66% (9049/13678) Updating files: 66% (9082/13678) Updating files: 66% (9152/13678) Updating files: 67% (9165/13678) Updating files: 67% (9188/13678) Updating files: 67% (9211/13678) Updating files: 67% (9242/13678) Updating files: 67% (9250/13678) Updating files: 68% (9302/13678) Updating files: 68% (9348/13678) Updating files: 68% (9395/13678) Updating files: 69% (9438/13678) Updating files: 69% (9456/13678) Updating files: 69% (9484/13678) Updating files: 69% (9534/13678) Updating files: 70% (9575/13678) Updating files: 70% (9581/13678) Updating files: 70% (9629/13678) Updating files: 70% (9639/13678) Updating files: 70% (9684/13678) Updating files: 70% (9700/13678) Updating files: 71% (9712/13678) Updating files: 71% (9773/13678) Updating files: 71% (9774/13678) Updating files: 71% (9775/13678) Updating files: 71% (9778/13678) Updating files: 72% (9849/13678) Updating files: 72% (9868/13678) Updating files: 72% (9984/13678) Updating files: 73% (9985/13678) Updating files: 73% (10013/13678) Updating files: 73% (10015/13678) Updating files: 73% (10092/13678) Updating files: 74% (10122/13678) Updating files: 74% (10131/13678) Updating files: 74% (10179/13678) Updating files: 74% (10218/13678) Updating files: 74% (10253/13678) Updating files: 75% (10259/13678) Updating files: 75% (10346/13678) Updating files: 75% (10378/13678) Updating files: 76% (10396/13678) Updating files: 76% (10523/13678) Updating files: 77% (10533/13678) Updating files: 77% (10602/13678) Updating files: 77% (10656/13678) Updating files: 78% (10669/13678) Updating files: 79% (10806/13678) Updating files: 79% (10807/13678) Updating files: 79% (10823/13678) Updating files: 80% (10943/13678) Updating files: 80% (10951/13678) Updating files: 80% (10979/13678) Updating files: 80% (11017/13678) Updating files: 80% (11061/13678) Updating files: 81% (11080/13678) Updating files: 81% (11107/13678) Updating files: 81% (11124/13678) Updating files: 81% (11135/13678) Updating files: 82% (11216/13678) Updating files: 82% (11241/13678) Updating files: 82% (11287/13678) Updating files: 82% (11352/13678) Updating files: 83% (11353/13678) Updating files: 83% (11420/13678) Updating files: 83% (11445/13678) Updating files: 84% (11490/13678) Updating files: 84% (11510/13678) Updating files: 84% (11560/13678) Updating files: 84% (11585/13678) Updating files: 84% (11617/13678) Updating files: 85% (11627/13678) Updating files: 85% (11682/13678) Updating files: 86% (11764/13678) Updating files: 86% (11801/13678) Updating files: 86% (11862/13678) Updating files: 86% (11881/13678) Updating files: 87% (11900/13678) Updating files: 87% (11973/13678) Updating files: 88% (12037/13678) Updating files: 88% (12129/13678) Updating files: 89% (12174/13678) Updating files: 89% (12235/13678) Updating files: 89% (12256/13678) Updating files: 89% (12300/13678) Updating files: 90% (12311/13678) Updating files: 90% (12327/13678) Updating files: 90% (12393/13678) Updating files: 91% (12447/13678) Updating files: 91% (12463/13678) Updating files: 91% (12568/13678) Updating files: 92% (12584/13678) Updating files: 92% (12610/13678) Updating files: 92% (12693/13678) Updating files: 93% (12721/13678) Updating files: 94% (12858/13678) Updating files: 94% (12891/13678) Updating files: 94% (12910/13678) Updating files: 94% (12989/13678) Updating files: 95% (12995/13678) Updating files: 96% (13131/13678) Updating files: 96% (13156/13678) Updating files: 96% (13246/13678) Updating files: 97% (13268/13678) Updating files: 97% (13271/13678) Updating files: 97% (13365/13678) Updating files: 98% (13405/13678) Updating files: 98% (13450/13678) Updating files: 98% (13469/13678) Updating files: 98% (13479/13678) Updating files: 98% (13510/13678) Updating files: 99% (13542/13678) Updating files: 99% (13616/13678) Updating files: 100% (13678/13678) Updating files: 100% (13678/13678), done. 2024-08-31T04:21:12.239 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 204c175eea3 msg: blobhash on entity_name_t causes strange badness... should look into that, but avoid for now 2024-08-31T04:21:12.302 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.1 2024-08-31T04:21:12.333 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 2 -eq 48 ] 2024-08-31T04:21:12.333 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.2 2024-08-31T04:21:12.333 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.2 2024-08-31T04:21:12.333 INFO:tasks.workunit.client.0.smithi089.stdout:v0.2 2024-08-31T04:21:12.334 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.2 2024-08-31T04:21:21.634 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 6% (14/222) Updating files: 6% (15/222) Updating files: 7% (16/222) Updating files: 8% (18/222) Updating files: 9% (20/222) Updating files: 10% (23/222) Updating files: 11% (25/222) Updating files: 12% (27/222) Updating files: 13% (29/222) Updating files: 14% (32/222) Updating files: 15% (34/222) Updating files: 16% (36/222) Updating files: 17% (38/222) Updating files: 18% (40/222) Updating files: 19% (43/222) Updating files: 20% (45/222) Updating files: 21% (47/222) Updating files: 22% (49/222) Updating files: 23% (52/222) Updating files: 24% (54/222) Updating files: 25% (56/222) Updating files: 26% (58/222) Updating files: 27% (60/222) Updating files: 28% (63/222) Updating files: 29% (65/222) Updating files: 30% (67/222) Updating files: 31% (69/222) Updating files: 32% (72/222) Updating files: 33% (74/222) Updating files: 34% (76/222) Updating files: 35% (78/222) Updating files: 36% (80/222) Updating files: 37% (83/222) Updating files: 38% (85/222) Updating files: 39% (87/222) Updating files: 40% (89/222) Updating files: 41% (92/222) Updating files: 42% (94/222) Updating files: 43% (96/222) Updating files: 43% (97/222) Updating files: 44% (98/222) Updating files: 45% (100/222) Updating files: 46% (103/222) Updating files: 47% (105/222) Updating files: 48% (107/222) Updating files: 49% (109/222) Updating files: 49% (110/222) Updating files: 50% (111/222) Updating files: 51% (114/222) Updating files: 52% (116/222) Updating files: 53% (118/222) Updating files: 54% (120/222) Updating files: 55% (123/222) Updating files: 56% (125/222) Updating files: 57% (127/222) Updating files: 58% (129/222) Updating files: 59% (131/222) Updating files: 60% (134/222) Updating files: 61% (136/222) Updating files: 62% (138/222) Updating files: 63% (140/222) Updating files: 64% (143/222) Updating files: 65% (145/222) Updating files: 66% (147/222) Updating files: 67% (149/222) Updating files: 68% (151/222) Updating files: 69% (154/222) Updating files: 70% (156/222) Updating files: 71% (158/222) Updating files: 72% (160/222) Updating files: 73% (163/222) Updating files: 74% (165/222) Updating files: 75% (167/222) Updating files: 76% (169/222) Updating files: 77% (171/222) Updating files: 78% (174/222) Updating files: 79% (176/222) Updating files: 80% (178/222) Updating files: 81% (180/222) Updating files: 82% (183/222) Updating files: 83% (185/222) Updating files: 84% (187/222) Updating files: 85% (189/222) Updating files: 86% (191/222) Updating files: 87% (194/222) Updating files: 88% (196/222) Updating files: 89% (198/222) Updating files: 90% (200/222) Updating files: 91% (203/222) Updating files: 92% (205/222) Updating files: 93% (207/222) Updating files: 94% (209/222) Updating files: 94% (210/222) Updating files: 95% (211/222) Updating files: 96% (214/222) Updating files: 97% (216/222) Updating files: 98% (218/222) Updating files: 99% (220/222) Updating files: 100% (222/222) Updating files: 100% (222/222), done. 2024-08-31T04:21:22.543 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 2b5f76f48e9 readme 2024-08-31T04:21:22.548 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.2 2024-08-31T04:21:23.418 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 3 -eq 48 ] 2024-08-31T04:21:23.418 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.3 2024-08-31T04:21:23.418 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.3 2024-08-31T04:21:23.418 INFO:tasks.workunit.client.0.smithi089.stdout:v0.3 2024-08-31T04:21:23.419 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.3 2024-08-31T04:21:28.019 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 7% (21/295) Updating files: 8% (24/295) Updating files: 9% (27/295) Updating files: 10% (30/295) Updating files: 11% (33/295) Updating files: 12% (36/295) Updating files: 13% (39/295) Updating files: 14% (42/295) Updating files: 15% (45/295) Updating files: 16% (48/295) Updating files: 17% (51/295) Updating files: 18% (54/295) Updating files: 19% (57/295) Updating files: 20% (59/295) Updating files: 21% (62/295) Updating files: 22% (65/295) Updating files: 23% (68/295) Updating files: 24% (71/295) Updating files: 25% (74/295) Updating files: 26% (77/295) Updating files: 27% (80/295) Updating files: 28% (83/295) Updating files: 29% (86/295) Updating files: 30% (89/295) Updating files: 31% (92/295) Updating files: 32% (95/295) Updating files: 33% (98/295) Updating files: 34% (101/295) Updating files: 34% (102/295) Updating files: 35% (104/295) Updating files: 36% (107/295) Updating files: 37% (110/295) Updating files: 38% (113/295) Updating files: 39% (116/295) Updating files: 40% (118/295) Updating files: 41% (121/295) Updating files: 42% (124/295) Updating files: 43% (127/295) Updating files: 44% (130/295) Updating files: 45% (133/295) Updating files: 46% (136/295) Updating files: 47% (139/295) Updating files: 48% (142/295) Updating files: 49% (145/295) Updating files: 50% (148/295) Updating files: 51% (151/295) Updating files: 52% (154/295) Updating files: 53% (157/295) Updating files: 54% (160/295) Updating files: 55% (163/295) Updating files: 56% (166/295) Updating files: 57% (169/295) Updating files: 58% (172/295) Updating files: 59% (175/295) Updating files: 60% (177/295) Updating files: 61% (180/295) Updating files: 62% (183/295) Updating files: 63% (186/295) Updating files: 64% (189/295) Updating files: 65% (192/295) Updating files: 66% (195/295) Updating files: 67% (198/295) Updating files: 68% (201/295) Updating files: 69% (204/295) Updating files: 70% (207/295) Updating files: 71% (210/295) Updating files: 72% (213/295) Updating files: 73% (216/295) Updating files: 74% (219/295) Updating files: 75% (222/295) Updating files: 76% (225/295) Updating files: 77% (228/295) Updating files: 78% (231/295) Updating files: 79% (234/295) Updating files: 80% (236/295) Updating files: 81% (239/295) Updating files: 82% (242/295) Updating files: 83% (245/295) Updating files: 84% (248/295) Updating files: 85% (251/295) Updating files: 86% (254/295) Updating files: 87% (257/295) Updating files: 88% (260/295) Updating files: 89% (263/295) Updating files: 90% (266/295) Updating files: 91% (269/295) Updating files: 92% (272/295) Updating files: 93% (275/295) Updating files: 94% (278/295) Updating files: 95% (281/295) Updating files: 96% (284/295) Updating files: 97% (287/295) Updating files: 98% (290/295) Updating files: 99% (293/295) Updating files: 100% (295/295) Updating files: 100% (295/295), done. 2024-08-31T04:21:28.076 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 2e986fe9ddf include ceph.spec in configure.ac 2024-08-31T04:21:28.085 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.3 2024-08-31T04:21:28.612 INFO:tasks.workunit.client.0.smithi089.stdout:v0.4 2024-08-31T04:21:28.613 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 4 -eq 48 ] 2024-08-31T04:21:28.613 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.4 2024-08-31T04:21:28.613 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.4 2024-08-31T04:21:28.614 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.4 2024-08-31T04:21:30.961 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.7 2024-08-31T04:21:30.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:21:31.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.129+0000 7f4aed200640 1 -- 172.21.15.89:0/4135266963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 msgr2=0x7f4ae8152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.129+0000 7f4aed200640 1 --2- 172.21.15.89:0/4135266963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 0x7f4ae8152a10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8073280 tx=0x7f4ad801f580 comp rx=0 tx=0).stop 2024-08-31T04:21:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.129+0000 7f4aed200640 1 -- 172.21.15.89:0/4135266963 shutdown_connections 2024-08-31T04:21:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.129+0000 7f4aed200640 1 --2- 172.21.15.89:0/4135266963 >> v2:172.21.15.170:3300/0 conn(0x7f4ae80c9330 0x7f4ae8074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.129+0000 7f4aed200640 1 --2- 172.21.15.89:0/4135266963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 0x7f4ae8152a10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.129+0000 7f4aed200640 1 -- 172.21.15.89:0/4135266963 >> 172.21.15.89:0/4135266963 conn(0x7f4ae80ccf20 msgr2=0x7f4ae80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.129+0000 7f4aed200640 1 -- 172.21.15.89:0/4135266963 shutdown_connections 2024-08-31T04:21:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.129+0000 7f4aed200640 1 -- 172.21.15.89:0/4135266963 wait complete. 2024-08-31T04:21:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 Processor -- start 2024-08-31T04:21:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 -- start start 2024-08-31T04:21:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae80c1f40 0x7f4ae81544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ae80c9330 0x7f4ae815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 0x7f4ae8153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae80c8030 con 0x7f4ae815bc70 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae80c3150 con 0x7f4ae80c1f40 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae8074c60 con 0x7f4ae80c9330 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 0x7f4ae8153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 0x7f4ae8153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50206/0 (socket says 172.21.15.89:50206) 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae6800640 1 -- 172.21.15.89:0/3448883895 learned_addr learned my addr 172.21.15.89:0/3448883895 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae5e00640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae80c1f40 0x7f4ae81544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae5400640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ae80c9330 0x7f4ae815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae6800640 1 -- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ae80c9330 msgr2=0x7f4ae815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae6800640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ae80c9330 0x7f4ae815afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae6800640 1 -- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae80c1f40 msgr2=0x7f4ae81544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae6800640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae80c1f40 0x7f4ae81544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae6800640 1 -- 172.21.15.89:0/3448883895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae815b4f0 con 0x7f4ae815bc70 2024-08-31T04:21:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae5400640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ae80c9330 0x7f4ae815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:21:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ae6800640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 0x7f4ae8153140 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000d640 tx=0x7f4ae000db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ade000640 1 -- 172.21.15.89:0/3448883895 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0017070 con 0x7f4ae815bc70 2024-08-31T04:21:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ade000640 1 -- 172.21.15.89:0/3448883895 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ae0005310 con 0x7f4ae815bc70 2024-08-31T04:21:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4ade000640 1 -- 172.21.15.89:0/3448883895 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00047b0 con 0x7f4ae815bc70 2024-08-31T04:21:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae8159fa0 con 0x7f4ae815bc70 2024-08-31T04:21:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.133+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae8159cc0 con 0x7f4ae815bc70 2024-08-31T04:21:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.137+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae8074720 con 0x7f4ae815bc70 2024-08-31T04:21:31.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.137+0000 7f4ade000640 1 -- 172.21.15.89:0/3448883895 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4ae0004950 con 0x7f4ae815bc70 2024-08-31T04:21:31.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.137+0000 7f4ade000640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ac80720c0 0x7f4ac80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.137+0000 7f4ade000640 1 -- 172.21.15.89:0/3448883895 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f4ae0092fa0 con 0x7f4ae815bc70 2024-08-31T04:21:31.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.137+0000 7f4ae5e00640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ac80720c0 0x7f4ac80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.141+0000 7f4ae5e00640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ac80720c0 0x7f4ac80745d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80b3000 tx=0x7f4ad801ddc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.141+0000 7f4ade000640 1 -- 172.21.15.89:0/3448883895 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4ae005de30 con 0x7f4ae815bc70 2024-08-31T04:21:31.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.341+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ae81560a0 con 0x7f4ae815bc70 2024-08-31T04:21:31.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4ade000640 1 -- 172.21.15.89:0/3448883895 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f4ae00625f0 con 0x7f4ae815bc70 2024-08-31T04:21:31.344 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:21:31.344 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:21:31.345 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:21:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ac80720c0 msgr2=0x7f4ac80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ac80720c0 0x7f4ac80745d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80b3000 tx=0x7f4ad801ddc0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 msgr2=0x7f4ae8153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 0x7f4ae8153140 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000d640 tx=0x7f4ae000db00 comp rx=0 tx=0).stop 2024-08-31T04:21:31.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 shutdown_connections 2024-08-31T04:21:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ac80720c0 0x7f4ac80745d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ae815bc70 0x7f4ae8153140 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ae80c9330 0x7f4ae815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 --2- 172.21.15.89:0/3448883895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ae80c1f40 0x7f4ae81544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 >> 172.21.15.89:0/3448883895 conn(0x7f4ae80ccf20 msgr2=0x7f4ae80765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 shutdown_connections 2024-08-31T04:21:31.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.345+0000 7f4aed200640 1 -- 172.21.15.89:0/3448883895 wait complete. 2024-08-31T04:21:31.368 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 151.7 --await-for 45.0' 2024-08-31T04:21:31.368 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 151.7 --await-for 45.0 2024-08-31T04:21:31.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 -- 172.21.15.89:0/396381993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c06f3f0 msgr2=0x7ff65c06f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 --2- 172.21.15.89:0/396381993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c06f3f0 0x7ff65c06f800 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff654009bc0 tx=0x7ff65401cba0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 -- 172.21.15.89:0/396381993 shutdown_connections 2024-08-31T04:21:31.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 --2- 172.21.15.89:0/396381993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c06f3f0 0x7ff65c06f800 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 --2- 172.21.15.89:0/396381993 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff65c074d50 0x7ff65c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 -- 172.21.15.89:0/396381993 >> 172.21.15.89:0/396381993 conn(0x7ff65c0c99b0 msgr2=0x7ff65c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:31.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 -- 172.21.15.89:0/396381993 shutdown_connections 2024-08-31T04:21:31.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 -- 172.21.15.89:0/396381993 wait complete. 2024-08-31T04:21:31.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 Processor -- start 2024-08-31T04:21:31.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.533+0000 7ff662800640 1 -- start start 2024-08-31T04:21:31.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff662800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff65c06f3f0 0x7ff65c0cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff662800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff65c074d50 0x7ff65c1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff662800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c153800 0x7ff65c158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff662800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c073e70 con 0x7ff65c153800 2024-08-31T04:21:31.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff662800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c073900 con 0x7ff65c06f3f0 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff662800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c069fc0 con 0x7ff65c074d50 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c153800 0x7ff65c158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c153800 0x7ff65c158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50230/0 (socket says 172.21.15.89:50230) 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65be00640 1 -- 172.21.15.89:0/1669602157 learned_addr learned my addr 172.21.15.89:0/1669602157 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65aa00640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff65c074d50 0x7ff65c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65b400640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff65c06f3f0 0x7ff65c0cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65be00640 1 -- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff65c074d50 msgr2=0x7ff65c1441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65be00640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff65c074d50 0x7ff65c1441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65be00640 1 -- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff65c06f3f0 msgr2=0x7ff65c0cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65be00640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff65c06f3f0 0x7ff65c0cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65be00640 1 -- 172.21.15.89:0/1669602157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c144720 con 0x7ff65c153800 2024-08-31T04:21:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65b400640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff65c06f3f0 0x7ff65c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:21:31.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff65be00640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c153800 0x7ff65c158d90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff65401a7d0 tx=0x7ff654003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff653400640 1 -- 172.21.15.89:0/1669602157 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540bb070 con 0x7ff65c153800 2024-08-31T04:21:31.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff653400640 1 -- 172.21.15.89:0/1669602157 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff654004d40 con 0x7ff65c153800 2024-08-31T04:21:31.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff653400640 1 -- 172.21.15.89:0/1669602157 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540b2040 con 0x7ff65c153800 2024-08-31T04:21:31.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff662800640 1 -- 172.21.15.89:0/1669602157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65c1f7ed0 con 0x7ff65c153800 2024-08-31T04:21:31.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.537+0000 7ff662800640 1 -- 172.21.15.89:0/1669602157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff65c1f8490 con 0x7ff65c153800 2024-08-31T04:21:31.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff653400640 1 -- 172.21.15.89:0/1669602157 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff6540be070 con 0x7ff65c153800 2024-08-31T04:21:31.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff653400640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff63c0720c0 0x7ff63c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff653400640 1 -- 172.21.15.89:0/1669602157 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff65412ca00 con 0x7ff65c153800 2024-08-31T04:21:31.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff669d6e000 1 Processor -- start 2024-08-31T04:21:31.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff65b400640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff63c0720c0 0x7ff63c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff669d6e000 1 -- start start 2024-08-31T04:21:31.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff65b400640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff63c0720c0 0x7ff63c0745d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009b90 tx=0x7ff64c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 0x5635cc29ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc156e90 0x5635cc263ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc140960 0x5635cc264220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff669d6e000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5635cc0b9820 con 0x5635cc156e90 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff669d6e000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5635cc0a8db0 con 0x5635cc1613f0 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff669d6e000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5635cc0acd60 con 0x5635cc140960 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff65aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc156e90 0x5635cc263ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff65b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 0x5635cc29ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff65aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc156e90 0x5635cc263ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50238/0 (socket says 172.21.15.89:50238) 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff65aa00640 1 -- 172.21.15.89:0/1729393655 learned_addr learned my addr 172.21.15.89:0/1729393655 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.541+0000 7ff65be00640 1 --2- 172.21.15.89:0/1729393655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc140960 0x5635cc264220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff65aa00640 1 -- 172.21.15.89:0/1729393655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc140960 msgr2=0x5635cc264220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:21:31.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff65aa00640 1 --2- 172.21.15.89:0/1729393655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc140960 0x5635cc264220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff65aa00640 1 -- 172.21.15.89:0/1729393655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 msgr2=0x5635cc29ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:21:31.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff65aa00640 1 --2- 172.21.15.89:0/1729393655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 0x5635cc29ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff65aa00640 1 -- 172.21.15.89:0/1729393655 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635cc043b70 con 0x5635cc156e90 2024-08-31T04:21:31.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff65aa00640 1 --2- 172.21.15.89:0/1729393655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc156e90 0x5635cc263ce0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff648001590 tx=0x7ff648001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed96268c8324cff4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff647e00640 1 -- 172.21.15.89:0/1729393655 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648005020 con 0x5635cc156e90 2024-08-31T04:21:31.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff647e00640 1 -- 172.21.15.89:0/1729393655 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6480052b0 con 0x5635cc156e90 2024-08-31T04:21:31.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff647e00640 1 -- 172.21.15.89:0/1729393655 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648005500 con 0x5635cc156e90 2024-08-31T04:21:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 -- 172.21.15.89:0/1729393655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc156e90 msgr2=0x5635cc263ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 --2- 172.21.15.89:0/1729393655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc156e90 0x5635cc263ce0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff648001590 tx=0x7ff648001a50 comp rx=0 tx=0).stop 2024-08-31T04:21:31.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 -- 172.21.15.89:0/1729393655 shutdown_connections 2024-08-31T04:21:31.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 --2- 172.21.15.89:0/1729393655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc156e90 0x5635cc263ce0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 --2- 172.21.15.89:0/1729393655 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc140960 0x5635cc264220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 --2- 172.21.15.89:0/1729393655 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 0x5635cc29ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 -- 172.21.15.89:0/1729393655 >> 172.21.15.89:0/1729393655 conn(0x5635cbd68210 msgr2=0x5635cc29d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:31.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 -- 172.21.15.89:0/1729393655 shutdown_connections 2024-08-31T04:21:31.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 -- 172.21.15.89:0/1729393655 wait complete. 2024-08-31T04:21:31.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 -- start start 2024-08-31T04:21:31.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.545+0000 7ff669d6e000 1 Processor -- start 2024-08-31T04:21:31.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc140960 0x5635cc2998f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 0x5635cc299e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc1613f0 0x5635cc29a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5635cbd6fb10 con 0x5635cc1613f0 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5635cc02f6f0 con 0x5635cc140960 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5635cc0b1390 con 0x5635cc156e90 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 10 client.0 _ll_register_callbacks cb 0x5635cc050b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc1613f0 0x5635cc29a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc140960 0x5635cc2998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc1613f0 0x5635cc29a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50242/0 (socket says 172.21.15.89:50242) 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65be00640 1 -- 172.21.15.89:0/267614693 learned_addr learned my addr 172.21.15.89:0/267614693 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65aa00640 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 0x5635cc299e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65be00640 1 -- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 msgr2=0x5635cc299e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65be00640 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 0x5635cc299e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65be00640 1 -- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc140960 msgr2=0x5635cc2998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:21:31.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65be00640 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc140960 0x5635cc2998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65be00640 1 -- 172.21.15.89:0/267614693 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635cc067380 con 0x5635cc1613f0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65aa00640 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 0x5635cc299e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65be00640 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc1613f0 0x5635cc29a370 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff65401c610 tx=0x7ff6540f6f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfc5c5dae37e21e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff644c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff644c00640 1 -- 172.21.15.89:0/267614693 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540f6270 con 0x5635cc1613f0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff644c00640 1 -- 172.21.15.89:0/267614693 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff6541005e0 con 0x5635cc1613f0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 -- 172.21.15.89:0/267614693 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635cc0b7d20 con 0x5635cc1613f0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff644c00640 1 -- 172.21.15.89:0/267614693 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff6540f72f0 con 0x5635cc1613f0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 10 client.5529 fetch_fsmap learned FSMap version 9 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 -- 172.21.15.89:0/267614693 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5635cc12de40 con 0x5635cc1613f0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff644c00640 1 -- 172.21.15.89:0/267614693 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5635cc0b7d20 con 0x5635cc1613f0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff644c00640 1 -- 172.21.15.89:0/267614693 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff6540b5030 con 0x5635cc1613f0 2024-08-31T04:21:31.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 10 client.5529 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:21:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 10 client.5529 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:21:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 20 client.5529 populate_metadata read hostname 'smithi089' 2024-08-31T04:21:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635cbd4cdc0 0x5635cc2b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 4 client.5529 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:21:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff669d6e000 1 -- 172.21.15.89:0/267614693 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635cc0bb770 con 0x5635cbd4cdc0 2024-08-31T04:21:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65b400640 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635cbd4cdc0 0x5635cc2b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff65b400640 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635cbd4cdc0 0x5635cc2b4f90 crc :-1 s=READY pgs=807 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77cc74d7c0e61191 server_cookie=fe10dbb591517b5b in_seq=0 out_seq=0 2024-08-31T04:21:31.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.549+0000 7ff644c00640 10 client.5529 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:21:31.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff644c00640 1 -- 172.21.15.89:0/267614693 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5635cc0bb770 con 0x5635cbd4cdc0 2024-08-31T04:21:31.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff644c00640 10 client.5529 handle_command_reply: tid=0 2024-08-31T04:21:31.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 client.5529 shutdown 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 -- 172.21.15.89:0/267614693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc1613f0 msgr2=0x5635cc29a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc1613f0 0x5635cc29a370 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff65401c610 tx=0x7ff6540f6f50 comp rx=0 tx=0).stop 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 -- 172.21.15.89:0/267614693 shutdown_connections 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635cbd4cdc0 0x5635cc2b4f90 crc :-1 s=READY pgs=807 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc1613f0 0x5635cc29a370 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 0x5635cc299e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 --2- 172.21.15.89:0/267614693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc140960 0x5635cc2998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 -- 172.21.15.89:0/267614693 >> 172.21.15.89:0/267614693 conn(0x5635cbd68210 msgr2=0x5635cc29c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff644c00640 0 client.5529 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 -- 172.21.15.89:0/267614693 shutdown_connections 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 1 -- 172.21.15.89:0/267614693 wait complete. 2024-08-31T04:21:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.553+0000 7ff669d6e000 20 client.5529 trim_cache size 0 max 16384 2024-08-31T04:21:31.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 Processor -- start 2024-08-31T04:21:31.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 -- start start 2024-08-31T04:21:31.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc25c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc156e90 0x5635cc25c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc1613f0 0x5635cc25cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c200d80 con 0x5635cc140960 2024-08-31T04:21:31.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c202130 con 0x5635cc156e90 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c2013d0 con 0x5635cc1613f0 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc25c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc25c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50244/0 (socket says 172.21.15.89:50244) 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65b400640 1 -- 172.21.15.89:0/2366829736 learned_addr learned my addr 172.21.15.89:0/2366829736 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65aa00640 1 --2- 172.21.15.89:0/2366829736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc156e90 0x5635cc25c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65be00640 1 --2- 172.21.15.89:0/2366829736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc1613f0 0x5635cc25cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65b400640 1 -- 172.21.15.89:0/2366829736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc1613f0 msgr2=0x5635cc25cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65b400640 1 --2- 172.21.15.89:0/2366829736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc1613f0 0x5635cc25cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65b400640 1 -- 172.21.15.89:0/2366829736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc156e90 msgr2=0x5635cc25c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65b400640 1 --2- 172.21.15.89:0/2366829736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc156e90 0x5635cc25c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65b400640 1 -- 172.21.15.89:0/2366829736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635cc1055b0 con 0x5635cc140960 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff65b400640 1 --2- 172.21.15.89:0/2366829736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc25c2a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff64c011fd0 tx=0x7ff64c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0977f9792182a9f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff647400640 1 -- 172.21.15.89:0/2366829736 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0210d0 con 0x5635cc140960 2024-08-31T04:21:31.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff647400640 1 -- 172.21.15.89:0/2366829736 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff64c021270 con 0x5635cc140960 2024-08-31T04:21:31.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff647400640 1 -- 172.21.15.89:0/2366829736 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0217e0 con 0x5635cc140960 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 -- 172.21.15.89:0/2366829736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 msgr2=0x5635cc25c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 --2- 172.21.15.89:0/2366829736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc25c2a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff64c011fd0 tx=0x7ff64c014000 comp rx=0 tx=0).stop 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 -- 172.21.15.89:0/2366829736 shutdown_connections 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 --2- 172.21.15.89:0/2366829736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc1613f0 0x5635cc25cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 --2- 172.21.15.89:0/2366829736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc156e90 0x5635cc25c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 --2- 172.21.15.89:0/2366829736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc25c2a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 -- 172.21.15.89:0/2366829736 >> 172.21.15.89:0/2366829736 conn(0x5635cbd68210 msgr2=0x5635cc29a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 -- 172.21.15.89:0/2366829736 shutdown_connections 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.573+0000 7ff669d6e000 1 -- 172.21.15.89:0/2366829736 wait complete. 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 -- start start 2024-08-31T04:21:31.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 Processor -- start 2024-08-31T04:21:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc3097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 0x5635cc317c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 0x5635cc3181c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5635cc02aeb0 con 0x5635cc140960 2024-08-31T04:21:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c201a60 con 0x5635cc1613f0 2024-08-31T04:21:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5635cc050f20 con 0x5635cc156e90 2024-08-31T04:21:31.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 10 client.0 _ll_register_callbacks cb 0x7ff654009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:21:31.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc3097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc3097c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50250/0 (socket says 172.21.15.89:50250) 2024-08-31T04:21:31.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65b400640 1 -- 172.21.15.89:0/3079533798 learned_addr learned my addr 172.21.15.89:0/3079533798 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:21:31.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65be00640 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 0x5635cc3181c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65aa00640 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 0x5635cc317c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65b400640 1 -- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 msgr2=0x5635cc317c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:21:31.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65b400640 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 0x5635cc317c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65b400640 1 -- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 msgr2=0x5635cc3181c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:21:31.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65b400640 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 0x5635cc3181c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65b400640 1 -- 172.21.15.89:0/3079533798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635cc039fc0 con 0x5635cc140960 2024-08-31T04:21:31.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff65b400640 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc3097c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff64c011870 tx=0x7ff64c021150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f55b5536a918d06 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff644c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:21:31.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff644c00640 1 -- 172.21.15.89:0/3079533798 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c036070 con 0x5635cc140960 2024-08-31T04:21:31.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff644c00640 1 -- 172.21.15.89:0/3079533798 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff64c021af0 con 0x5635cc140960 2024-08-31T04:21:31.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 -- 172.21.15.89:0/3079533798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff64c021270 con 0x5635cc140960 2024-08-31T04:21:31.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff644c00640 1 -- 172.21.15.89:0/3079533798 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff64c032430 con 0x5635cc140960 2024-08-31T04:21:31.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 10 client.5535 fetch_fsmap learned FSMap version 9 2024-08-31T04:21:31.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.577+0000 7ff669d6e000 1 -- 172.21.15.89:0/3079533798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5635cc032e00 con 0x5635cc140960 2024-08-31T04:21:31.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff644c00640 1 -- 172.21.15.89:0/3079533798 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff64c021270 con 0x5635cc140960 2024-08-31T04:21:31.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff644c00640 1 -- 172.21.15.89:0/3079533798 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff64c0326e0 con 0x5635cc140960 2024-08-31T04:21:31.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff669d6e000 10 client.5535 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:21:31.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff669d6e000 10 client.5535 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:21:31.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff669d6e000 20 client.5535 populate_metadata read hostname 'smithi089' 2024-08-31T04:21:31.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff669d6e000 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635cbd3ae20 0x5635cc318700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff669d6e000 4 client.5535 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 151.7, "await_for": 45.0}] 2024-08-31T04:21:31.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff669d6e000 1 -- 172.21.15.89:0/3079533798 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 151.7, "await_for": 45.0}) -- 0x5635cc0b7210 con 0x5635cbd3ae20 2024-08-31T04:21:31.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff65aa00640 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635cbd3ae20 0x5635cc318700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff644c00640 10 client.5535 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:21:31.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:31.581+0000 7ff65aa00640 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635cbd3ae20 0x5635cc318700 crc :-1 s=READY pgs=808 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d98079cb9d9a585 server_cookie=12edf3ec3c9adcef in_seq=0 out_seq=0 2024-08-31T04:21:34.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:21:34.283 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:21:38.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff644c00640 1 -- 172.21.15.89:0/3079533798 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5635cc0b7210 con 0x5635cbd3ae20 2024-08-31T04:21:38.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff644c00640 10 client.5535 handle_command_reply: tid=0 2024-08-31T04:21:38.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 client.5535 shutdown 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 -- 172.21.15.89:0/3079533798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 msgr2=0x5635cc3097c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc3097c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff64c011870 tx=0x7ff64c021150 comp rx=0 tx=0).stop 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 -- 172.21.15.89:0/3079533798 shutdown_connections 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635cbd3ae20 0x5635cc318700 crc :-1 s=READY pgs=808 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5635cc1613f0 0x5635cc3181c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5635cc156e90 0x5635cc317c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 --2- 172.21.15.89:0/3079533798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5635cc140960 0x5635cc3097c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff644c00640 0 client.5535 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 -- 172.21.15.89:0/3079533798 >> 172.21.15.89:0/3079533798 conn(0x5635cbd68210 msgr2=0x5635cc25c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 -- 172.21.15.89:0/3079533798 shutdown_connections 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 1 -- 172.21.15.89:0/3079533798 wait complete. 2024-08-31T04:21:38.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff669d6e000 20 client.5535 trim_cache size 0 max 16384 2024-08-31T04:21:38.591 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:21:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:21:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:21:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 58, 2024-08-31T04:21:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:21:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "bdc7c21e": { 2024-08-31T04:21:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 58, 2024-08-31T04:21:38.591 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 151.7, 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:21:38.592 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:21:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:21:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:21:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:21:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:21:38.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:21:38.593 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:21:38.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 -- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff63c0720c0 msgr2=0x7ff63c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff63c0720c0 0x7ff63c0745d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009b90 tx=0x7ff64c0091e0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 -- 172.21.15.89:0/1669602157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c153800 msgr2=0x7ff65c158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c153800 0x7ff65c158d90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff65401a7d0 tx=0x7ff654003f60 comp rx=0 tx=0).stop 2024-08-31T04:21:38.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 -- 172.21.15.89:0/1669602157 shutdown_connections 2024-08-31T04:21:38.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff63c0720c0 0x7ff63c0745d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff65c153800 0x7ff65c158d90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff65c074d50 0x7ff65c1441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 --2- 172.21.15.89:0/1669602157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff65c06f3f0 0x7ff65c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 -- 172.21.15.89:0/1669602157 >> 172.21.15.89:0/1669602157 conn(0x7ff65c0c99b0 msgr2=0x7ff65c148c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:38.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 -- 172.21.15.89:0/1669602157 shutdown_connections 2024-08-31T04:21:38.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:21:38.589+0000 7ff662800640 1 -- 172.21.15.89:0/1669602157 wait complete. 2024-08-31T04:21:38.609 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bdc7c21e', quiesce took 7.6 seconds. Will release after: 24.1 2024-08-31T04:22:02.710 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:22:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.881+0000 7fefa5200640 1 -- 172.21.15.89:0/1209412635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c1f40 msgr2=0x7fefa00c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.881+0000 7fefa5200640 1 --2- 172.21.15.89:0/1209412635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c1f40 0x7fefa00c9330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fefa0072540 tx=0x7fef8801f0b0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.881+0000 7fefa5200640 1 -- 172.21.15.89:0/1209412635 shutdown_connections 2024-08-31T04:22:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.881+0000 7fefa5200640 1 --2- 172.21.15.89:0/1209412635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefa00c7920 0x7fefa00c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.881+0000 7fefa5200640 1 --2- 172.21.15.89:0/1209412635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c1f40 0x7fefa00c9330 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.881+0000 7fefa5200640 1 --2- 172.21.15.89:0/1209412635 >> v2:172.21.15.170:3300/0 conn(0x7fefa015bc70 0x7fefa0152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.881+0000 7fefa5200640 1 -- 172.21.15.89:0/1209412635 >> 172.21.15.89:0/1209412635 conn(0x7fefa00ccf20 msgr2=0x7fefa00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:02.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.881+0000 7fefa5200640 1 -- 172.21.15.89:0/1209412635 shutdown_connections 2024-08-31T04:22:02.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.881+0000 7fefa5200640 1 -- 172.21.15.89:0/1209412635 wait complete. 2024-08-31T04:22:02.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 Processor -- start 2024-08-31T04:22:02.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 -- start start 2024-08-31T04:22:02.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefa00c1f40 0x7fefa01efda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:02.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c7920 0x7fefa00c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefa015bc70 0x7fefa01e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fefa00748a0 con 0x7fefa00c7920 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fefa0074720 con 0x7fefa00c1f40 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fefa0074a20 con 0x7fefa015bc70 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef95400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c7920 0x7fefa00c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef95400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c7920 0x7fefa00c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40378/0 (socket says 172.21.15.89:40378) 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef95400640 1 -- 172.21.15.89:0/2533742734 learned_addr learned my addr 172.21.15.89:0/2533742734 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef9de00640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefa00c1f40 0x7fefa01efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef9e800640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefa015bc70 0x7fefa01e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef95400640 1 -- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefa015bc70 msgr2=0x7fefa01e3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef95400640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefa015bc70 0x7fefa01e3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef95400640 1 -- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefa00c1f40 msgr2=0x7fefa01efda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef95400640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefa00c1f40 0x7fefa01efda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef95400640 1 -- 172.21.15.89:0/2533742734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa0156810 con 0x7fefa00c7920 2024-08-31T04:22:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef95400640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c7920 0x7fefa00c6500 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fef8801d760 tx=0x7fef88005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef96a00640 1 -- 172.21.15.89:0/2533742734 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef880b5040 con 0x7fefa00c7920 2024-08-31T04:22:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef96a00640 1 -- 172.21.15.89:0/2533742734 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef88005320 con 0x7fefa00c7920 2024-08-31T04:22:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa00c5650 con 0x7fefa00c7920 2024-08-31T04:22:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fef96a00640 1 -- 172.21.15.89:0/2533742734 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef880046d0 con 0x7fefa00c7920 2024-08-31T04:22:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.885+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa01f03a0 con 0x7fefa00c7920 2024-08-31T04:22:02.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.889+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa01e4a20 con 0x7fefa00c7920 2024-08-31T04:22:02.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.889+0000 7fef96a00640 1 -- 172.21.15.89:0/2533742734 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fef880c1060 con 0x7fefa00c7920 2024-08-31T04:22:02.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.889+0000 7fef96a00640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fef7c0720f0 0x7fef7c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:02.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.889+0000 7fef96a00640 1 -- 172.21.15.89:0/2533742734 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fef8812fb60 con 0x7fefa00c7920 2024-08-31T04:22:02.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.889+0000 7fef9de00640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fef7c0720f0 0x7fef7c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:02.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.893+0000 7fef9de00640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fef7c0720f0 0x7fef7c074600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef9000bb50 tx=0x7fef9000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:02.893+0000 7fef96a00640 1 -- 172.21.15.89:0/2533742734 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fef88018c10 con 0x7fefa00c7920 2024-08-31T04:22:03.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.093+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefa0074ea0 con 0x7fefa00c7920 2024-08-31T04:22:03.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.093+0000 7fef96a00640 1 -- 172.21.15.89:0/2533742734 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fef880fafc0 con 0x7fefa00c7920 2024-08-31T04:22:03.091 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:22:03.091 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:22:03.092 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fef7c0720f0 msgr2=0x7fef7c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fef7c0720f0 0x7fef7c074600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef9000bb50 tx=0x7fef9000b2e0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c7920 msgr2=0x7fefa00c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c7920 0x7fefa00c6500 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fef8801d760 tx=0x7fef88005780 comp rx=0 tx=0).stop 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 shutdown_connections 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fef7c0720f0 0x7fef7c074600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefa00c7920 0x7fefa00c6500 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefa015bc70 0x7fefa01e3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 --2- 172.21.15.89:0/2533742734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefa00c1f40 0x7fefa01efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 >> 172.21.15.89:0/2533742734 conn(0x7fefa00ccf20 msgr2=0x7fefa01e5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:03.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 shutdown_connections 2024-08-31T04:22:03.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.097+0000 7fefa5200640 1 -- 172.21.15.89:0/2533742734 wait complete. 2024-08-31T04:22:03.113 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id bdc7c21e --release --await' 2024-08-31T04:22:03.113 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id bdc7c21e --release --await 2024-08-31T04:22:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.277+0000 7fb625400640 1 -- 172.21.15.89:0/1492554847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 msgr2=0x7fb604004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.277+0000 7fb625400640 1 --2- 172.21.15.89:0/1492554847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 0x7fb604004c20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb608009b40 tx=0x7fb60801d270 comp rx=0 tx=0).stop 2024-08-31T04:22:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 -- 172.21.15.89:0/1492554847 shutdown_connections 2024-08-31T04:22:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 --2- 172.21.15.89:0/1492554847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 0x7fb604004c20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 -- 172.21.15.89:0/1492554847 >> 172.21.15.89:0/1492554847 conn(0x7fb6200c99b0 msgr2=0x7fb6200c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 -- 172.21.15.89:0/1492554847 shutdown_connections 2024-08-31T04:22:03.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 -- 172.21.15.89:0/1492554847 wait complete. 2024-08-31T04:22:03.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 Processor -- start 2024-08-31T04:22:03.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 -- start start 2024-08-31T04:22:03.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 0x7fb6201e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6201e32f0 0x7fb6201496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6200c94b0 0x7fb620149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb620073e70 con 0x7fb604004810 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb620073b90 con 0x7fb6201e32f0 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.281+0000 7fb625400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb620069fc0 con 0x7fb6200c94b0 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 0x7fb6201e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 0x7fb6201e8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40386/0 (socket says 172.21.15.89:40386) 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61e800640 1 -- 172.21.15.89:0/3853396472 learned_addr learned my addr 172.21.15.89:0/3853396472 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb615e00640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6201e32f0 0x7fb6201496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61f200640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6200c94b0 0x7fb620149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61e800640 1 -- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6200c94b0 msgr2=0x7fb620149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61e800640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6200c94b0 0x7fb620149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61e800640 1 -- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6201e32f0 msgr2=0x7fb6201496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61e800640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6201e32f0 0x7fb6201496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61e800640 1 -- 172.21.15.89:0/3853396472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6201e2e40 con 0x7fb604004810 2024-08-31T04:22:03.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb615e00640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6201e32f0 0x7fb6201496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:03.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb61e800640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 0x7fb6201e8ba0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb610004eb0 tx=0x7fb610001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:03.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb617400640 1 -- 172.21.15.89:0/3853396472 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610015020 con 0x7fb604004810 2024-08-31T04:22:03.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb617400640 1 -- 172.21.15.89:0/3853396472 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb610011960 con 0x7fb604004810 2024-08-31T04:22:03.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb625400640 1 -- 172.21.15.89:0/3853396472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6200cb530 con 0x7fb604004810 2024-08-31T04:22:03.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb617400640 1 -- 172.21.15.89:0/3853396472 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610011db0 con 0x7fb604004810 2024-08-31T04:22:03.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb625400640 1 -- 172.21.15.89:0/3853396472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6201e78c0 con 0x7fb604004810 2024-08-31T04:22:03.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.285+0000 7fb617400640 1 -- 172.21.15.89:0/3853396472 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb610018020 con 0x7fb604004810 2024-08-31T04:22:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb617400640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5fc0720f0 0x7fb5fc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb617400640 1 -- 172.21.15.89:0/3853396472 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb610093ac0 con 0x7fb604004810 2024-08-31T04:22:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb62c989000 1 Processor -- start 2024-08-31T04:22:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb62c989000 1 -- start start 2024-08-31T04:22:03.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb615e00640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5fc0720f0 0x7fb5fc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb615e00640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5fc0720f0 0x7fb5fc074600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb6080ad000 tx=0x7fb60801a010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:03.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb62c989000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56353024c950 0x56353036ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb62c989000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563530236930 0x56353036fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb62c989000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530370010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb62c989000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563530215f30 con 0x563530227890 2024-08-31T04:22:03.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb62c989000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56353018b690 con 0x56353024c950 2024-08-31T04:22:03.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb62c989000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56353017ac20 con 0x563530236930 2024-08-31T04:22:03.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61f200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530370010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61f200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530370010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40402/0 (socket says 172.21.15.89:40402) 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61f200640 1 -- 172.21.15.89:0/1732131577 learned_addr learned my addr 172.21.15.89:0/1732131577 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61e800640 1 --2- 172.21.15.89:0/1732131577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56353024c950 0x56353036ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb615e00640 1 --2- 172.21.15.89:0/1732131577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563530236930 0x56353036fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61f200640 1 -- 172.21.15.89:0/1732131577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563530236930 msgr2=0x56353036fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61f200640 1 --2- 172.21.15.89:0/1732131577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563530236930 0x56353036fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61f200640 1 -- 172.21.15.89:0/1732131577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56353024c950 msgr2=0x56353036ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61f200640 1 --2- 172.21.15.89:0/1732131577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56353024c950 0x56353036ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61f200640 1 -- 172.21.15.89:0/1732131577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56353012f8f0 con 0x563530227890 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb61f200640 1 --2- 172.21.15.89:0/1732131577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530370010 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb6180020f0 tx=0x7fb618004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979ac8b00774c8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb60f000640 1 -- 172.21.15.89:0/1732131577 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618013b20 con 0x563530227890 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb60f000640 1 -- 172.21.15.89:0/1732131577 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb618013db0 con 0x563530227890 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.289+0000 7fb60f000640 1 -- 172.21.15.89:0/1732131577 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61800f630 con 0x563530227890 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 -- 172.21.15.89:0/1732131577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 msgr2=0x563530370010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 --2- 172.21.15.89:0/1732131577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530370010 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb6180020f0 tx=0x7fb618004780 comp rx=0 tx=0).stop 2024-08-31T04:22:03.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 -- 172.21.15.89:0/1732131577 shutdown_connections 2024-08-31T04:22:03.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 --2- 172.21.15.89:0/1732131577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530370010 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 --2- 172.21.15.89:0/1732131577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563530236930 0x56353036fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 --2- 172.21.15.89:0/1732131577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56353024c950 0x56353036ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 -- 172.21.15.89:0/1732131577 >> 172.21.15.89:0/1732131577 conn(0x56353024c540 msgr2=0x56353036d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:03.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 -- 172.21.15.89:0/1732131577 shutdown_connections 2024-08-31T04:22:03.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 -- 172.21.15.89:0/1732131577 wait complete. 2024-08-31T04:22:03.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 -- start start 2024-08-31T04:22:03.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 Processor -- start 2024-08-31T04:22:03.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530227890 0x56353036a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530236930 0x56353036a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x563530374bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563530101500 con 0x563530236930 2024-08-31T04:22:03.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56353017ebd0 con 0x563530227890 2024-08-31T04:22:03.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563530122a30 con 0x56353024c950 2024-08-31T04:22:03.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb62c989000 10 client.0 _ll_register_callbacks cb 0x563530230b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb615e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530236930 0x56353036a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb615e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530236930 0x56353036a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40418/0 (socket says 172.21.15.89:40418) 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb615e00640 1 -- 172.21.15.89:0/1647598383 learned_addr learned my addr 172.21.15.89:0/1647598383 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb61e800640 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530227890 0x56353036a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb61f200640 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x563530374bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb615e00640 1 -- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 msgr2=0x563530374bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb615e00640 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x563530374bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb615e00640 1 -- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530227890 msgr2=0x56353036a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb615e00640 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530227890 0x56353036a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.293+0000 7fb615e00640 1 -- 172.21.15.89:0/1647598383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56353011a6a0 con 0x563530236930 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb615e00640 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530236930 0x56353036a570 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb6080ae040 tx=0x7fb6080091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae161cb9a320632 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb603400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb603400640 1 -- 172.21.15.89:0/1647598383 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6080ace10 con 0x563530236930 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb603400640 1 -- 172.21.15.89:0/1647598383 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb6080c4420 con 0x563530236930 2024-08-31T04:22:03.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 1 -- 172.21.15.89:0/1647598383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635301147e0 con 0x563530236930 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb603400640 1 -- 172.21.15.89:0/1647598383 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb6080d4050 con 0x563530236930 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 10 client.5553 fetch_fsmap learned FSMap version 9 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 1 -- 172.21.15.89:0/1647598383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5635301391c0 con 0x563530236930 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb603400640 1 -- 172.21.15.89:0/1647598383 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5635301147e0 con 0x563530236930 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb603400640 1 -- 172.21.15.89:0/1647598383 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fb6080d7020 con 0x563530236930 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 10 client.5553 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 10 client.5553 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 20 client.5553 populate_metadata read hostname 'smithi089' 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563530210fc0 0x563530375970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 4 client.5553 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 1 -- 172.21.15.89:0/1647598383 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56353018d5e0 con 0x563530210fc0 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb61e800640 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563530210fc0 0x563530375970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb603400640 10 client.5553 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:22:03.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb61e800640 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563530210fc0 0x563530375970 crc :-1 s=READY pgs=820 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fe74fac16a4bcee server_cookie=48983fcfe4ab3330 in_seq=0 out_seq=0 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb603400640 1 -- 172.21.15.89:0/1647598383 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56353018d5e0 con 0x563530210fc0 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb603400640 10 client.5553 handle_command_reply: tid=0 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.297+0000 7fb62c989000 1 client.5553 shutdown 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 -- 172.21.15.89:0/1647598383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530236930 msgr2=0x56353036a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530236930 0x56353036a570 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb6080ae040 tx=0x7fb6080091e0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 -- 172.21.15.89:0/1647598383 shutdown_connections 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563530210fc0 0x563530375970 crc :-1 s=READY pgs=820 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530236930 0x56353036a570 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x563530374bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 --2- 172.21.15.89:0/1647598383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530227890 0x56353036a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb603400640 0 client.5553 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 -- 172.21.15.89:0/1647598383 >> 172.21.15.89:0/1647598383 conn(0x56353024c540 msgr2=0x56353036b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 -- 172.21.15.89:0/1647598383 shutdown_connections 2024-08-31T04:22:03.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 1 -- 172.21.15.89:0/1647598383 wait complete. 2024-08-31T04:22:03.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.301+0000 7fb62c989000 20 client.5553 trim_cache size 0 max 16384 2024-08-31T04:22:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb62c989000 1 Processor -- start 2024-08-31T04:22:03.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb62c989000 1 -- start start 2024-08-31T04:22:03.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb62c989000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530373d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb62c989000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 0x563530374250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb62c989000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x5635303e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb62c989000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb620201310 con 0x563530227890 2024-08-31T04:22:03.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb62c989000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb6202001f0 con 0x563530236930 2024-08-31T04:22:03.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb62c989000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb6201f2a90 con 0x56353024c950 2024-08-31T04:22:03.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb61e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530373d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb61e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530373d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40420/0 (socket says 172.21.15.89:40420) 2024-08-31T04:22:03.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.317+0000 7fb61e800640 1 -- 172.21.15.89:0/3271734531 learned_addr learned my addr 172.21.15.89:0/3271734531 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb615e00640 1 --2- 172.21.15.89:0/3271734531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 0x563530374250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb61f200640 1 --2- 172.21.15.89:0/3271734531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x5635303e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb61e800640 1 -- 172.21.15.89:0/3271734531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 msgr2=0x5635303e08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb61e800640 1 --2- 172.21.15.89:0/3271734531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x5635303e08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb61e800640 1 -- 172.21.15.89:0/3271734531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 msgr2=0x563530374250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb61e800640 1 --2- 172.21.15.89:0/3271734531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 0x563530374250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb61e800640 1 -- 172.21.15.89:0/3271734531 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635301ff2f0 con 0x563530227890 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb61e800640 1 --2- 172.21.15.89:0/3271734531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530373d10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb61005a930 tx=0x7fb610061040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b54b113fd41f21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb60e600640 1 -- 172.21.15.89:0/3271734531 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610063120 con 0x563530227890 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb60e600640 1 -- 172.21.15.89:0/3271734531 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb61007f040 con 0x563530227890 2024-08-31T04:22:03.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb60e600640 1 -- 172.21.15.89:0/3271734531 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610067ab0 con 0x563530227890 2024-08-31T04:22:03.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 -- 172.21.15.89:0/3271734531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 msgr2=0x563530373d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 --2- 172.21.15.89:0/3271734531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530373d10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb61005a930 tx=0x7fb610061040 comp rx=0 tx=0).stop 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 -- 172.21.15.89:0/3271734531 shutdown_connections 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 --2- 172.21.15.89:0/3271734531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x5635303e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 --2- 172.21.15.89:0/3271734531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 0x563530374250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 --2- 172.21.15.89:0/3271734531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x563530373d10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 -- 172.21.15.89:0/3271734531 >> 172.21.15.89:0/3271734531 conn(0x56353024c540 msgr2=0x56353038a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 -- 172.21.15.89:0/3271734531 shutdown_connections 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 -- 172.21.15.89:0/3271734531 wait complete. 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 -- start start 2024-08-31T04:22:03.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.321+0000 7fb62c989000 1 Processor -- start 2024-08-31T04:22:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x56353038ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 0x563530387f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x5635303884a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb6201fed80 con 0x563530227890 2024-08-31T04:22:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb6201ffb20 con 0x563530236930 2024-08-31T04:22:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb6201ff450 con 0x56353024c950 2024-08-31T04:22:03.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 10 client.0 _ll_register_callbacks cb 0x7fb6080bb070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x56353038ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x56353038ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40428/0 (socket says 172.21.15.89:40428) 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61e800640 1 -- 172.21.15.89:0/1931101045 learned_addr learned my addr 172.21.15.89:0/1931101045 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb615e00640 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 0x563530387f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61f200640 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x5635303884a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61e800640 1 -- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 msgr2=0x5635303884a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61e800640 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x5635303884a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61e800640 1 -- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 msgr2=0x563530387f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61e800640 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 0x563530387f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61e800640 1 -- 172.21.15.89:0/1931101045 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563530104b30 con 0x563530227890 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb61e800640 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x56353038ac20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb610001b40 tx=0x7fb610006850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac92df830aed70e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:03.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb603400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb603400640 1 -- 172.21.15.89:0/1931101045 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610063120 con 0x563530227890 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb603400640 1 -- 172.21.15.89:0/1931101045 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb610065400 con 0x563530227890 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 -- 172.21.15.89:0/1931101045 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb61007f040 con 0x563530227890 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb603400640 1 -- 172.21.15.89:0/1931101045 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb610067620 con 0x563530227890 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 10 client.5559 fetch_fsmap learned FSMap version 9 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 -- 172.21.15.89:0/1931101045 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563530111c70 con 0x563530227890 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb603400640 1 -- 172.21.15.89:0/1931101045 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb61007f040 con 0x563530227890 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb603400640 1 -- 172.21.15.89:0/1931101045 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fb61004a040 con 0x563530227890 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 10 client.5559 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 10 client.5559 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 20 client.5559 populate_metadata read hostname 'smithi089' 2024-08-31T04:22:03.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56352fe0ce80 0x5635303892d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 4 client.5559 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bdc7c21e", "release": true, "await": true}] 2024-08-31T04:22:03.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb62c989000 1 -- 172.21.15.89:0/1931101045 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bdc7c21e", "release": true, "await": true}) -- 0x563530189080 con 0x56352fe0ce80 2024-08-31T04:22:03.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb615e00640 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56352fe0ce80 0x5635303892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb603400640 10 client.5559 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:22:03.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.325+0000 7fb615e00640 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56352fe0ce80 0x5635303892d0 crc :-1 s=READY pgs=821 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4406830eff2ed6e server_cookie=69e78c8f99ddc4db in_seq=0 out_seq=0 2024-08-31T04:22:03.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb603400640 1 -- 172.21.15.89:0/1931101045 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563530189080 con 0x56352fe0ce80 2024-08-31T04:22:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb603400640 10 client.5559 handle_command_reply: tid=0 2024-08-31T04:22:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 client.5559 shutdown 2024-08-31T04:22:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 -- 172.21.15.89:0/1931101045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 msgr2=0x56353038ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x56353038ac20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb610001b40 tx=0x7fb610006850 comp rx=0 tx=0).stop 2024-08-31T04:22:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 -- 172.21.15.89:0/1931101045 shutdown_connections 2024-08-31T04:22:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56352fe0ce80 0x5635303892d0 crc :-1 s=READY pgs=821 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56353024c950 0x5635303884a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563530236930 0x563530387f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 --2- 172.21.15.89:0/1931101045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563530227890 0x56353038ac20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb603400640 0 client.5559 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:22:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 -- 172.21.15.89:0/1931101045 >> 172.21.15.89:0/1931101045 conn(0x56353024c540 msgr2=0x5635303736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 -- 172.21.15.89:0/1931101045 shutdown_connections 2024-08-31T04:22:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 1 -- 172.21.15.89:0/1931101045 wait complete. 2024-08-31T04:22:03.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb62c989000 20 client.5559 trim_cache size 0 max 16384 2024-08-31T04:22:03.420 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:22:03.420 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:22:03.420 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:22:03.420 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 60, 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "bdc7c21e": { 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 60, 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 151.7, 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:22:03.421 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:22:03.422 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:22:03.422 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:22:03.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:22:03.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:22:03.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:22:03.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:22:03.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:22:03.422 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:22:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb625400640 1 -- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5fc0720f0 msgr2=0x7fb5fc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb625400640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5fc0720f0 0x7fb5fc074600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb6080ad000 tx=0x7fb60801a010 comp rx=0 tx=0).stop 2024-08-31T04:22:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb625400640 1 -- 172.21.15.89:0/3853396472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 msgr2=0x7fb6201e8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.421+0000 7fb625400640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 0x7fb6201e8ba0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb610004eb0 tx=0x7fb610001640 comp rx=0 tx=0).stop 2024-08-31T04:22:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.425+0000 7fb625400640 1 -- 172.21.15.89:0/3853396472 shutdown_connections 2024-08-31T04:22:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.425+0000 7fb625400640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5fc0720f0 0x7fb5fc074600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.425+0000 7fb625400640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6200c94b0 0x7fb620149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.425+0000 7fb625400640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6201e32f0 0x7fb6201496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.425+0000 7fb625400640 1 --2- 172.21.15.89:0/3853396472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb604004810 0x7fb6201e8ba0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.425+0000 7fb625400640 1 -- 172.21.15.89:0/3853396472 >> 172.21.15.89:0/3853396472 conn(0x7fb6200c99b0 msgr2=0x7fb620150320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:03.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.425+0000 7fb625400640 1 -- 172.21.15.89:0/3853396472 shutdown_connections 2024-08-31T04:22:03.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:22:03.425+0000 7fb625400640 1 -- 172.21.15.89:0/3853396472 wait complete. 2024-08-31T04:22:03.439 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bdc7c21e', total seconds elapsed: 32.5 2024-08-31T04:22:04.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:22:04.413 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:22:05.147 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 60% (150/247) Updating files: 61% (151/247) Updating files: 61% (152/247) Updating files: 61% (153/247) Updating files: 62% (154/247) Updating files: 63% (156/247) Updating files: 64% (159/247) Updating files: 64% (160/247) Updating files: 65% (161/247) Updating files: 66% (164/247) Updating files: 67% (166/247) Updating files: 68% (168/247) Updating files: 69% (171/247) Updating files: 70% (173/247) Updating files: 71% (176/247) Updating files: 72% (178/247) Updating files: 73% (181/247) Updating files: 74% (183/247) Updating files: 75% (186/247) Updating files: 76% (188/247) Updating files: 77% (191/247) Updating files: 78% (193/247) Updating files: 79% (196/247) Updating files: 80% (198/247) Updating files: 81% (201/247) Updating files: 82% (203/247) Updating files: 83% (206/247) Updating files: 84% (208/247) Updating files: 85% (210/247) Updating files: 86% (213/247) Updating files: 87% (215/247) Updating files: 88% (218/247) Updating files: 89% (220/247) Updating files: 90% (223/247) Updating files: 91% (225/247) Updating files: 92% (228/247) Updating files: 93% (230/247) Updating files: 94% (233/247) Updating files: 95% (235/247) Updating files: 96% (238/247) Updating files: 97% (240/247) Updating files: 98% (243/247) Updating files: 99% (245/247) Updating files: 100% (247/247) Updating files: 100% (247/247), done. 2024-08-31T04:22:05.432 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 13b1bf7c492 kclient: initializing kaddr (merge fix) 2024-08-31T04:22:05.499 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.4 2024-08-31T04:22:05.518 INFO:tasks.workunit.client.0.smithi089.stdout:v0.5 2024-08-31T04:22:05.518 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 5 -eq 48 ] 2024-08-31T04:22:05.518 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.5 2024-08-31T04:22:05.518 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.5 2024-08-31T04:22:05.519 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.5 2024-08-31T04:22:14.287 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 12% (31/245) Updating files: 13% (32/245) Updating files: 14% (35/245) Updating files: 15% (37/245) Updating files: 16% (40/245) Updating files: 17% (42/245) Updating files: 18% (45/245) Updating files: 19% (47/245) Updating files: 20% (49/245) Updating files: 21% (52/245) Updating files: 22% (54/245) Updating files: 23% (57/245) Updating files: 24% (59/245) Updating files: 25% (62/245) Updating files: 26% (64/245) Updating files: 27% (67/245) Updating files: 28% (69/245) Updating files: 29% (72/245) Updating files: 30% (74/245) Updating files: 31% (76/245) Updating files: 32% (79/245) Updating files: 33% (81/245) Updating files: 34% (84/245) Updating files: 35% (86/245) Updating files: 36% (89/245) Updating files: 37% (91/245) Updating files: 38% (94/245) Updating files: 39% (96/245) Updating files: 40% (98/245) Updating files: 40% (100/245) Updating files: 41% (101/245) Updating files: 42% (103/245) Updating files: 43% (106/245) Updating files: 44% (108/245) Updating files: 45% (111/245) Updating files: 46% (113/245) Updating files: 47% (116/245) Updating files: 48% (118/245) Updating files: 49% (121/245) Updating files: 50% (123/245) Updating files: 51% (125/245) Updating files: 52% (128/245) Updating files: 53% (130/245) Updating files: 54% (133/245) Updating files: 55% (135/245) Updating files: 56% (138/245) Updating files: 57% (140/245) Updating files: 58% (143/245) Updating files: 59% (145/245) Updating files: 60% (147/245) Updating files: 61% (150/245) Updating files: 62% (152/245) Updating files: 63% (155/245) Updating files: 64% (157/245) Updating files: 65% (160/245) Updating files: 66% (162/245) Updating files: 67% (165/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 76% (187/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 88% (216/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 92% (227/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-08-31T04:22:14.325 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 1dd420957f9 journal: detect size of raw block devices properly 2024-08-31T04:22:14.331 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.5 2024-08-31T04:22:14.563 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 6 -eq 48 ] 2024-08-31T04:22:14.563 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.6 2024-08-31T04:22:14.563 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.6 2024-08-31T04:22:14.564 INFO:tasks.workunit.client.0.smithi089.stdout:v0.6 2024-08-31T04:22:14.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.6 2024-08-31T04:22:22.273 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 32% (74/227) Updating files: 33% (75/227) Updating files: 34% (78/227) Updating files: 35% (80/227) Updating files: 36% (82/227) Updating files: 37% (84/227) Updating files: 38% (87/227) Updating files: 39% (89/227) Updating files: 40% (91/227) Updating files: 41% (94/227) Updating files: 42% (96/227) Updating files: 43% (98/227) Updating files: 44% (100/227) Updating files: 45% (103/227) Updating files: 46% (105/227) Updating files: 46% (106/227) Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 60% (137/227) Updating files: 60% (138/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 89% (204/227) Updating files: 90% (205/227) Updating files: 90% (206/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2024-08-31T04:22:22.615 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at a4c752df713 v0.6 2024-08-31T04:22:22.621 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.6 2024-08-31T04:22:22.639 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 7 -eq 48 ] 2024-08-31T04:22:22.639 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.7 2024-08-31T04:22:22.639 INFO:tasks.workunit.client.0.smithi089.stdout:v0.7 2024-08-31T04:22:22.639 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.7 2024-08-31T04:22:22.640 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.7 2024-08-31T04:22:25.101 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 62% (125/201) Updating files: 63% (127/201) Updating files: 64% (129/201) Updating files: 65% (131/201) Updating files: 66% (133/201) Updating files: 67% (135/201) Updating files: 68% (137/201) Updating files: 69% (139/201) Updating files: 70% (141/201) Updating files: 71% (143/201) Updating files: 72% (145/201) Updating files: 73% (147/201) Updating files: 74% (149/201) Updating files: 75% (151/201) Updating files: 76% (153/201) Updating files: 77% (155/201) Updating files: 78% (157/201) Updating files: 79% (159/201) Updating files: 80% (161/201) Updating files: 81% (163/201) Updating files: 82% (165/201) Updating files: 83% (167/201) Updating files: 84% (169/201) Updating files: 85% (171/201) Updating files: 86% (173/201) Updating files: 86% (174/201) Updating files: 87% (175/201) Updating files: 88% (177/201) Updating files: 89% (179/201) Updating files: 90% (181/201) Updating files: 91% (183/201) Updating files: 92% (185/201) Updating files: 93% (187/201) Updating files: 94% (189/201) Updating files: 95% (191/201) Updating files: 96% (193/201) Updating files: 97% (195/201) Updating files: 98% (197/201) Updating files: 99% (199/201) Updating files: 100% (201/201) Updating files: 100% (201/201), done. 2024-08-31T04:22:25.160 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at c46e1b320c6 mkcephfs: btrfsctl -a between mkfs and mount 2024-08-31T04:22:25.165 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.7 2024-08-31T04:22:25.286 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 8 -eq 48 ] 2024-08-31T04:22:25.286 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.8 2024-08-31T04:22:25.286 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.8 2024-08-31T04:22:25.286 INFO:tasks.workunit.client.0.smithi089.stdout:v0.8 2024-08-31T04:22:25.287 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.8 2024-08-31T04:22:34.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:22:34.475 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:22:38.366 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 13% (30/225) Updating files: 14% (32/225) Updating files: 15% (34/225) Updating files: 16% (36/225) Updating files: 17% (39/225) Updating files: 18% (41/225) Updating files: 19% (43/225) Updating files: 20% (45/225) Updating files: 21% (48/225) Updating files: 22% (50/225) Updating files: 23% (52/225) Updating files: 24% (54/225) Updating files: 25% (57/225) Updating files: 26% (59/225) Updating files: 27% (61/225) Updating files: 28% (63/225) Updating files: 29% (66/225) Updating files: 30% (68/225) Updating files: 31% (70/225) Updating files: 32% (72/225) Updating files: 33% (75/225) Updating files: 34% (77/225) Updating files: 35% (79/225) Updating files: 36% (81/225) Updating files: 37% (84/225) Updating files: 38% (86/225) Updating files: 39% (88/225) Updating files: 40% (90/225) Updating files: 41% (93/225) Updating files: 42% (95/225) Updating files: 43% (97/225) Updating files: 44% (99/225) Updating files: 45% (102/225) Updating files: 46% (104/225) Updating files: 47% (106/225) Updating files: 48% (108/225) Updating files: 49% (111/225) Updating files: 50% (113/225) Updating files: 51% (115/225) Updating files: 52% (117/225) Updating files: 53% (120/225) Updating files: 54% (122/225) Updating files: 55% (124/225) Updating files: 56% (126/225) Updating files: 57% (129/225) Updating files: 58% (131/225) Updating files: 59% (133/225) Updating files: 60% (135/225) Updating files: 61% (138/225) Updating files: 62% (140/225) Updating files: 63% (142/225) Updating files: 64% (144/225) Updating files: 65% (147/225) Updating files: 66% (149/225) Updating files: 67% (151/225) Updating files: 68% (153/225) Updating files: 69% (156/225) Updating files: 70% (158/225) Updating files: 71% (160/225) Updating files: 72% (162/225) Updating files: 73% (165/225) Updating files: 74% (167/225) Updating files: 75% (169/225) Updating files: 76% (171/225) Updating files: 77% (174/225) Updating files: 78% (176/225) Updating files: 78% (177/225) Updating files: 79% (178/225) Updating files: 80% (180/225) Updating files: 81% (183/225) Updating files: 82% (185/225) Updating files: 83% (187/225) Updating files: 84% (189/225) Updating files: 85% (192/225) Updating files: 86% (194/225) Updating files: 87% (196/225) Updating files: 88% (198/225) Updating files: 89% (201/225) Updating files: 90% (203/225) Updating files: 91% (205/225) Updating files: 92% (207/225) Updating files: 93% (210/225) Updating files: 94% (212/225) Updating files: 95% (214/225) Updating files: 96% (216/225) Updating files: 97% (219/225) Updating files: 98% (221/225) Updating files: 99% (223/225) Updating files: 100% (225/225) Updating files: 100% (225/225), done. 2024-08-31T04:22:38.493 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 284161c00ab kclient: kill dput/d_drop debug cruft 2024-08-31T04:22:38.500 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.8 2024-08-31T04:22:38.515 INFO:tasks.workunit.client.0.smithi089.stdout:v0.9 2024-08-31T04:22:38.515 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 9 -eq 48 ] 2024-08-31T04:22:38.515 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.9 2024-08-31T04:22:38.516 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.9 2024-08-31T04:22:38.516 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.9 2024-08-31T04:22:42.931 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 14% (28/193) Updating files: 15% (29/193) Updating files: 16% (31/193) Updating files: 17% (33/193) Updating files: 18% (35/193) Updating files: 19% (37/193) Updating files: 20% (39/193) Updating files: 21% (41/193) Updating files: 22% (43/193) Updating files: 23% (45/193) Updating files: 24% (47/193) Updating files: 25% (49/193) Updating files: 26% (51/193) Updating files: 27% (53/193) Updating files: 28% (55/193) Updating files: 29% (56/193) Updating files: 30% (58/193) Updating files: 31% (60/193) Updating files: 32% (62/193) Updating files: 33% (64/193) Updating files: 34% (66/193) Updating files: 35% (68/193) Updating files: 36% (70/193) Updating files: 37% (72/193) Updating files: 38% (74/193) Updating files: 39% (76/193) Updating files: 40% (78/193) Updating files: 41% (80/193) Updating files: 42% (82/193) Updating files: 43% (83/193) Updating files: 44% (85/193) Updating files: 45% (87/193) Updating files: 46% (89/193) Updating files: 47% (91/193) Updating files: 48% (93/193) Updating files: 49% (95/193) Updating files: 50% (97/193) Updating files: 51% (99/193) Updating files: 52% (101/193) Updating files: 52% (102/193) Updating files: 53% (103/193) Updating files: 54% (105/193) Updating files: 55% (107/193) Updating files: 56% (109/193) Updating files: 57% (111/193) Updating files: 58% (112/193) Updating files: 59% (114/193) Updating files: 60% (116/193) Updating files: 61% (118/193) Updating files: 62% (120/193) Updating files: 63% (122/193) Updating files: 64% (124/193) Updating files: 65% (126/193) Updating files: 66% (128/193) Updating files: 67% (130/193) Updating files: 68% (132/193) Updating files: 69% (134/193) Updating files: 70% (136/193) Updating files: 71% (138/193) Updating files: 72% (139/193) Updating files: 73% (141/193) Updating files: 74% (143/193) Updating files: 75% (145/193) Updating files: 76% (147/193) Updating files: 77% (149/193) Updating files: 78% (151/193) Updating files: 79% (153/193) Updating files: 80% (155/193) Updating files: 81% (157/193) Updating files: 82% (159/193) Updating files: 83% (161/193) Updating files: 84% (163/193) Updating files: 85% (165/193) Updating files: 86% (166/193) Updating files: 87% (168/193) Updating files: 88% (170/193) Updating files: 89% (172/193) Updating files: 90% (174/193) Updating files: 91% (176/193) Updating files: 92% (178/193) Updating files: 93% (180/193) Updating files: 94% (182/193) Updating files: 95% (184/193) Updating files: 96% (186/193) Updating files: 97% (188/193) Updating files: 98% (190/193) Updating files: 99% (192/193) Updating files: 100% (193/193) Updating files: 100% (193/193), done. 2024-08-31T04:22:42.993 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 41481853924 kclient: strip out kernel version compatibility cruft 2024-08-31T04:22:42.999 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.9 2024-08-31T04:22:43.600 INFO:tasks.workunit.client.0.smithi089.stdout:v0.10 2024-08-31T04:22:43.601 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 10 -eq 48 ] 2024-08-31T04:22:43.601 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.10 2024-08-31T04:22:43.601 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.10 2024-08-31T04:22:43.601 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.10 2024-08-31T04:22:46.687 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 63% (104/164) Updating files: 64% (105/164) Updating files: 65% (107/164) Updating files: 66% (109/164) Updating files: 67% (110/164) Updating files: 68% (112/164) Updating files: 69% (114/164) Updating files: 70% (115/164) Updating files: 71% (117/164) Updating files: 72% (119/164) Updating files: 73% (120/164) Updating files: 74% (122/164) Updating files: 75% (123/164) Updating files: 76% (125/164) Updating files: 77% (127/164) Updating files: 78% (128/164) Updating files: 79% (130/164) Updating files: 80% (132/164) Updating files: 81% (133/164) Updating files: 81% (134/164) Updating files: 82% (135/164) Updating files: 83% (137/164) Updating files: 84% (138/164) Updating files: 85% (140/164) Updating files: 86% (142/164) Updating files: 87% (143/164) Updating files: 88% (145/164) Updating files: 89% (146/164) Updating files: 90% (148/164) Updating files: 91% (150/164) Updating files: 92% (151/164) Updating files: 93% (153/164) Updating files: 94% (155/164) Updating files: 95% (156/164) Updating files: 96% (158/164) Updating files: 97% (160/164) Updating files: 98% (161/164) Updating files: 99% (163/164) Updating files: 100% (164/164) Updating files: 100% (164/164), done. 2024-08-31T04:22:46.758 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 007313fe844 v0.10 2024-08-31T04:22:46.765 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.10 2024-08-31T04:22:46.870 INFO:tasks.workunit.client.0.smithi089.stdout:v0.11 2024-08-31T04:22:46.870 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 11 -eq 48 ] 2024-08-31T04:22:46.870 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.11 2024-08-31T04:22:46.870 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.11 2024-08-31T04:22:46.870 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.11 2024-08-31T04:22:48.771 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 9fa6f5e7d09 v0.11 2024-08-31T04:22:48.775 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.11 2024-08-31T04:22:48.994 INFO:tasks.workunit.client.0.smithi089.stdout:v0.12 2024-08-31T04:22:48.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 12 -eq 48 ] 2024-08-31T04:22:48.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.12 2024-08-31T04:22:48.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.12 2024-08-31T04:22:48.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.12 2024-08-31T04:22:50.931 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 46% (35/75) Updating files: 48% (36/75) Updating files: 49% (37/75) Updating files: 50% (38/75) Updating files: 52% (39/75) Updating files: 53% (40/75) Updating files: 54% (41/75) Updating files: 56% (42/75) Updating files: 57% (43/75) Updating files: 58% (44/75) Updating files: 60% (45/75) Updating files: 61% (46/75) Updating files: 62% (47/75) Updating files: 64% (48/75) Updating files: 65% (49/75) Updating files: 66% (50/75) Updating files: 68% (51/75) Updating files: 69% (52/75) Updating files: 70% (53/75) Updating files: 72% (54/75) Updating files: 73% (55/75) Updating files: 74% (56/75) Updating files: 76% (57/75) Updating files: 77% (58/75) Updating files: 78% (59/75) Updating files: 80% (60/75) Updating files: 81% (61/75) Updating files: 82% (62/75) Updating files: 84% (63/75) Updating files: 85% (64/75) Updating files: 86% (65/75) Updating files: 88% (66/75) Updating files: 89% (67/75) Updating files: 90% (68/75) Updating files: 92% (69/75) Updating files: 93% (70/75) Updating files: 94% (71/75) Updating files: 96% (72/75) Updating files: 97% (73/75) Updating files: 98% (74/75) Updating files: 100% (75/75) Updating files: 100% (75/75), done. 2024-08-31T04:22:50.988 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at f524150822a v0.12 2024-08-31T04:22:50.992 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.12 2024-08-31T04:22:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:v0.13 2024-08-31T04:22:51.440 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 13 -eq 48 ] 2024-08-31T04:22:51.440 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.13 2024-08-31T04:22:51.440 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.13 2024-08-31T04:22:51.440 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.13 2024-08-31T04:23:02.311 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.8 2024-08-31T04:23:02.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:23:02.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.480+0000 7f10d0a00640 1 -- 172.21.15.89:0/1456695349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 msgr2=0x7f10cc156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.480+0000 7f10d0a00640 1 --2- 172.21.15.89:0/1456695349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 0x7f10cc156e10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f10cc073410 tx=0x7f10bc01f370 comp rx=0 tx=0).stop 2024-08-31T04:23:02.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.480+0000 7f10d0a00640 1 -- 172.21.15.89:0/1456695349 shutdown_connections 2024-08-31T04:23:02.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.480+0000 7f10d0a00640 1 --2- 172.21.15.89:0/1456695349 >> v2:172.21.15.170:3300/0 conn(0x7f10cc15ce10 0x7f10cc0c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.480+0000 7f10d0a00640 1 --2- 172.21.15.89:0/1456695349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 0x7f10cc156e10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.480+0000 7f10d0a00640 1 -- 172.21.15.89:0/1456695349 >> 172.21.15.89:0/1456695349 conn(0x7f10cc0ccf20 msgr2=0x7f10cc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:02.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.480+0000 7f10d0a00640 1 -- 172.21.15.89:0/1456695349 shutdown_connections 2024-08-31T04:23:02.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.480+0000 7f10d0a00640 1 -- 172.21.15.89:0/1456695349 wait complete. 2024-08-31T04:23:02.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 Processor -- start 2024-08-31T04:23:02.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 -- start start 2024-08-31T04:23:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 0x7f10cc1f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc15ce10 0x7f10cc155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc15d220 0x7f10cc1498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc159c90 con 0x7f10cc074e20 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc1599b0 con 0x7f10cc15ce10 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f10cc159f70 con 0x7f10cc15d220 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 0x7f10cc1f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 0x7f10cc1f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44566/0 (socket says 172.21.15.89:44566) 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c9e00640 1 -- 172.21.15.89:0/2597366082 learned_addr learned my addr 172.21.15.89:0/2597366082 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c1400640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc15ce10 0x7f10cc155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10ca800640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc15d220 0x7f10cc1498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c9e00640 1 -- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc15d220 msgr2=0x7f10cc1498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c9e00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc15d220 0x7f10cc1498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c9e00640 1 -- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc15ce10 msgr2=0x7f10cc155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c9e00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc15ce10 0x7f10cc155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c9e00640 1 -- 172.21.15.89:0/2597366082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc0c3ac0 con 0x7f10cc074e20 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10ca800640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc15d220 0x7f10cc1498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c9e00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 0x7f10cc1f5fa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f10bc000f90 tx=0x7f10bc0af400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c2a00640 1 -- 172.21.15.89:0/2597366082 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc0b4040 con 0x7f10cc074e20 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c2a00640 1 -- 172.21.15.89:0/2597366082 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10bc0bf070 con 0x7f10cc074e20 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10cc1f1eb0 con 0x7f10cc074e20 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10c2a00640 1 -- 172.21.15.89:0/2597366082 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc0b0930 con 0x7f10cc074e20 2024-08-31T04:23:02.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.484+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10cc1564d0 con 0x7f10cc074e20 2024-08-31T04:23:02.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.488+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10cc071e40 con 0x7f10cc074e20 2024-08-31T04:23:02.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.488+0000 7f10c2a00640 1 -- 172.21.15.89:0/2597366082 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f10bc0b0ad0 con 0x7f10cc074e20 2024-08-31T04:23:02.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.488+0000 7f10c2a00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10a80720f0 0x7f10a8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.488+0000 7f10c2a00640 1 -- 172.21.15.89:0/2597366082 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f10bc1312d0 con 0x7f10cc074e20 2024-08-31T04:23:02.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.488+0000 7f10c1400640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10a80720f0 0x7f10a8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.488+0000 7f10c1400640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10a80720f0 0x7f10a8074600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f10b40058d0 tx=0x7f10b4005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:02.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.492+0000 7f10c2a00640 1 -- 172.21.15.89:0/2597366082 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f10bc018ed0 con 0x7f10cc074e20 2024-08-31T04:23:02.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.692+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10cc074c00 con 0x7f10cc074e20 2024-08-31T04:23:02.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.692+0000 7f10c2a00640 1 -- 172.21.15.89:0/2597366082 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f10bc0fc7b0 con 0x7f10cc074e20 2024-08-31T04:23:02.691 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:23:02.691 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:23:02.691 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10a80720f0 msgr2=0x7f10a8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10a80720f0 0x7f10a8074600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f10b40058d0 tx=0x7f10b4005860 comp rx=0 tx=0).stop 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 msgr2=0x7f10cc1f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 0x7f10cc1f5fa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f10bc000f90 tx=0x7f10bc0af400 comp rx=0 tx=0).stop 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 shutdown_connections 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10a80720f0 0x7f10a8074600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10cc15d220 0x7f10cc1498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10cc15ce10 0x7f10cc155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 --2- 172.21.15.89:0/2597366082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10cc074e20 0x7f10cc1f5fa0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 >> 172.21.15.89:0/2597366082 conn(0x7f10cc0ccf20 msgr2=0x7f10cc153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:02.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 shutdown_connections 2024-08-31T04:23:02.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.696+0000 7f10d0a00640 1 -- 172.21.15.89:0/2597366082 wait complete. 2024-08-31T04:23:02.712 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 152.8 --await-for 45.0' 2024-08-31T04:23:02.713 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 152.8 --await-for 45.0 2024-08-31T04:23:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.880+0000 7ff797e00640 1 -- 172.21.15.89:0/1902974188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 msgr2=0x7ff790152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.880+0000 7ff797e00640 1 --2- 172.21.15.89:0/1902974188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 0x7ff790152780 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff7900cdf70 tx=0x7ff77c01c740 comp rx=0 tx=0).stop 2024-08-31T04:23:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.880+0000 7ff797e00640 1 -- 172.21.15.89:0/1902974188 shutdown_connections 2024-08-31T04:23:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.880+0000 7ff797e00640 1 --2- 172.21.15.89:0/1902974188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 0x7ff790152780 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.880+0000 7ff797e00640 1 --2- 172.21.15.89:0/1902974188 >> v2:172.21.15.170:3300/0 conn(0x7ff7900b2860 0x7ff7900b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.880+0000 7ff797e00640 1 -- 172.21.15.89:0/1902974188 >> 172.21.15.89:0/1902974188 conn(0x7ff7900c99b0 msgr2=0x7ff7900c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.880+0000 7ff797e00640 1 -- 172.21.15.89:0/1902974188 shutdown_connections 2024-08-31T04:23:02.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.880+0000 7ff797e00640 1 -- 172.21.15.89:0/1902974188 wait complete. 2024-08-31T04:23:02.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 Processor -- start 2024-08-31T04:23:02.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 -- start start 2024-08-31T04:23:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7900b2860 0x7ff7901f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 0x7ff7900cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7900c90e0 0x7ff79015af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff7900c32e0 con 0x7ff7900c1ed0 2024-08-31T04:23:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff7900c3160 con 0x7ff7900c90e0 2024-08-31T04:23:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff790074ec0 con 0x7ff7900b2860 2024-08-31T04:23:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff794a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 0x7ff7900cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff794a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 0x7ff7900cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44582/0 (socket says 172.21.15.89:44582) 2024-08-31T04:23:02.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff794a00640 1 -- 172.21.15.89:0/254459420 learned_addr learned my addr 172.21.15.89:0/254459420 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff795e00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7900c90e0 0x7ff79015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff795400640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7900b2860 0x7ff7901f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff794a00640 1 -- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7900b2860 msgr2=0x7ff7901f8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff794a00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7900b2860 0x7ff7901f8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff794a00640 1 -- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7900c90e0 msgr2=0x7ff79015af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff794a00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7900c90e0 0x7ff79015af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff794a00640 1 -- 172.21.15.89:0/254459420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7900c6e90 con 0x7ff7900c1ed0 2024-08-31T04:23:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff794a00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 0x7ff7900cc000 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff77c01cc20 tx=0x7ff77c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff78d600640 1 -- 172.21.15.89:0/254459420 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0b2040 con 0x7ff7900c1ed0 2024-08-31T04:23:02.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff78d600640 1 -- 172.21.15.89:0/254459420 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77c004130 con 0x7ff7900c1ed0 2024-08-31T04:23:02.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff78d600640 1 -- 172.21.15.89:0/254459420 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c003600 con 0x7ff7900c1ed0 2024-08-31T04:23:02.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 -- 172.21.15.89:0/254459420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff790159f40 con 0x7ff7900c1ed0 2024-08-31T04:23:02.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.884+0000 7ff797e00640 1 -- 172.21.15.89:0/254459420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff79015a500 con 0x7ff7900c1ed0 2024-08-31T04:23:02.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.888+0000 7ff78d600640 1 -- 172.21.15.89:0/254459420 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff77c0bd030 con 0x7ff7900c1ed0 2024-08-31T04:23:02.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.888+0000 7ff78d600640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff7700720c0 0x7ff7700745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.888+0000 7ff78d600640 1 -- 172.21.15.89:0/254459420 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff77c12cba0 con 0x7ff7900c1ed0 2024-08-31T04:23:02.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.888+0000 7ff795400640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff7700720c0 0x7ff7700745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.888+0000 7ff79f673000 1 Processor -- start 2024-08-31T04:23:02.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.888+0000 7ff79f673000 1 -- start start 2024-08-31T04:23:02.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff795400640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff7700720c0 0x7ff7700745d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff7840058d0 tx=0x7ff784005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:02.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 0x560818856d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x56081881fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5608186fc960 0x560818820220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560818675820 con 0x560818712e90 2024-08-31T04:23:02.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560818664db0 con 0x56081871d3f0 2024-08-31T04:23:02.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560818668d60 con 0x5608186fc960 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff794a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x56081881fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff794a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x56081881fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44590/0 (socket says 172.21.15.89:44590) 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff794a00640 1 -- 172.21.15.89:0/260354185 learned_addr learned my addr 172.21.15.89:0/260354185 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff795e00640 1 --2- 172.21.15.89:0/260354185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5608186fc960 0x560818820220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff795400640 1 --2- 172.21.15.89:0/260354185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 0x560818856d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff794a00640 1 -- 172.21.15.89:0/260354185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5608186fc960 msgr2=0x560818820220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff794a00640 1 --2- 172.21.15.89:0/260354185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5608186fc960 0x560818820220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff794a00640 1 -- 172.21.15.89:0/260354185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 msgr2=0x560818856d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff794a00640 1 --2- 172.21.15.89:0/260354185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 0x560818856d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff794a00640 1 -- 172.21.15.89:0/260354185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608185ffb70 con 0x560818712e90 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff794a00640 1 --2- 172.21.15.89:0/260354185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x56081881fce0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0b0040 tx=0x7ff77c0f4190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918f86f90590cfd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff781c00640 1 -- 172.21.15.89:0/260354185 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c11c020 con 0x560818712e90 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff781c00640 1 -- 172.21.15.89:0/260354185 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77c0a58f0 con 0x560818712e90 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff781c00640 1 -- 172.21.15.89:0/260354185 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0f7180 con 0x560818712e90 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 -- 172.21.15.89:0/260354185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 msgr2=0x56081881fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 --2- 172.21.15.89:0/260354185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x56081881fce0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0b0040 tx=0x7ff77c0f4190 comp rx=0 tx=0).stop 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 -- 172.21.15.89:0/260354185 shutdown_connections 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 --2- 172.21.15.89:0/260354185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x56081881fce0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 --2- 172.21.15.89:0/260354185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5608186fc960 0x560818820220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 --2- 172.21.15.89:0/260354185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 0x560818856d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 -- 172.21.15.89:0/260354185 >> 172.21.15.89:0/260354185 conn(0x560818324210 msgr2=0x560818859990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:02.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 -- 172.21.15.89:0/260354185 shutdown_connections 2024-08-31T04:23:02.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 -- 172.21.15.89:0/260354185 wait complete. 2024-08-31T04:23:02.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.892+0000 7ff79f673000 1 -- start start 2024-08-31T04:23:02.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 Processor -- start 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608186fc960 0x5608188558f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 0x560818855e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56081871d3f0 0x560818856370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56081832bb10 con 0x5608186fc960 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5608185eb6f0 con 0x560818712e90 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56081866d390 con 0x56081871d3f0 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 10 client.0 _ll_register_callbacks cb 0x56081860cb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608186fc960 0x5608188558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608186fc960 0x5608188558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44596/0 (socket says 172.21.15.89:44596) 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795400640 1 -- 172.21.15.89:0/40546859 learned_addr learned my addr 172.21.15.89:0/40546859 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795e00640 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56081871d3f0 0x560818856370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff794a00640 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 0x560818855e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795400640 1 -- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56081871d3f0 msgr2=0x560818856370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795400640 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56081871d3f0 0x560818856370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795400640 1 -- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 msgr2=0x560818855e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795400640 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 0x560818855e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795400640 1 -- 172.21.15.89:0/40546859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560818623380 con 0x5608186fc960 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795e00640 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56081871d3f0 0x560818856370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff794a00640 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 0x560818855e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff795400640 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608186fc960 0x5608188558f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff784010010 tx=0x7ff7840046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7fa5764e94464c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff776000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff776000640 1 -- 172.21.15.89:0/40546859 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78401f840 con 0x5608186fc960 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 -- 172.21.15.89:0/40546859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560818673d20 con 0x5608186fc960 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff776000640 1 -- 172.21.15.89:0/40546859 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff78401f9e0 con 0x5608186fc960 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff776000640 1 -- 172.21.15.89:0/40546859 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff78402f050 con 0x5608186fc960 2024-08-31T04:23:02.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 10 client.5583 fetch_fsmap learned FSMap version 9 2024-08-31T04:23:02.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 -- 172.21.15.89:0/40546859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5608186e9e40 con 0x5608186fc960 2024-08-31T04:23:02.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff776000640 1 -- 172.21.15.89:0/40546859 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560818673d20 con 0x5608186fc960 2024-08-31T04:23:02.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff776000640 1 -- 172.21.15.89:0/40546859 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff78401fbe0 con 0x5608186fc960 2024-08-31T04:23:02.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 10 client.5583 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:23:02.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 10 client.5583 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:23:02.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 20 client.5583 populate_metadata read hostname 'smithi089' 2024-08-31T04:23:02.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560818308dc0 0x560818870f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 4 client.5583 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:02.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.896+0000 7ff79f673000 1 -- 172.21.15.89:0/40546859 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560818677770 con 0x560818308dc0 2024-08-31T04:23:02.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff794a00640 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560818308dc0 0x560818870f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff776000640 10 client.5583 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff794a00640 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560818308dc0 0x560818870f90 crc :-1 s=READY pgs=865 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a42550ec8b40265 server_cookie=641be13ab451b957 in_seq=0 out_seq=0 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff776000640 1 -- 172.21.15.89:0/40546859 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560818677770 con 0x560818308dc0 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff776000640 10 client.5583 handle_command_reply: tid=0 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 client.5583 shutdown 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 -- 172.21.15.89:0/40546859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608186fc960 msgr2=0x5608188558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608186fc960 0x5608188558f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff784010010 tx=0x7ff7840046d0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 -- 172.21.15.89:0/40546859 shutdown_connections 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x560818308dc0 0x560818870f90 crc :-1 s=READY pgs=865 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56081871d3f0 0x560818856370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 0x560818855e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 --2- 172.21.15.89:0/40546859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608186fc960 0x5608188558f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 -- 172.21.15.89:0/40546859 >> 172.21.15.89:0/40546859 conn(0x560818324210 msgr2=0x560818858340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff776000640 0 client.5583 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:23:02.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 -- 172.21.15.89:0/40546859 shutdown_connections 2024-08-31T04:23:02.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 1 -- 172.21.15.89:0/40546859 wait complete. 2024-08-31T04:23:02.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.900+0000 7ff79f673000 20 client.5583 trim_cache size 0 max 16384 2024-08-31T04:23:02.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff79f673000 1 Processor -- start 2024-08-31T04:23:02.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff79f673000 1 -- start start 2024-08-31T04:23:02.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff79f673000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 0x560818855de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff79f673000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56081871d3f0 0x560818856320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff79f673000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 0x560818870f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff79f673000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff7902011b0 con 0x56081871d3f0 2024-08-31T04:23:02.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff79f673000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff790202580 con 0x560818712e90 2024-08-31T04:23:02.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff79f673000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff790201800 con 0x560818322470 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff794a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56081871d3f0 0x560818856320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff794a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56081871d3f0 0x560818856320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44612/0 (socket says 172.21.15.89:44612) 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff794a00640 1 -- 172.21.15.89:0/2140947433 learned_addr learned my addr 172.21.15.89:0/2140947433 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff795e00640 1 --2- 172.21.15.89:0/2140947433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 0x560818870f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff795400640 1 --2- 172.21.15.89:0/2140947433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 0x560818855de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff794a00640 1 -- 172.21.15.89:0/2140947433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 msgr2=0x560818870f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff794a00640 1 --2- 172.21.15.89:0/2140947433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 0x560818870f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff794a00640 1 -- 172.21.15.89:0/2140947433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 msgr2=0x560818855de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff794a00640 1 --2- 172.21.15.89:0/2140947433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 0x560818855de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff794a00640 1 -- 172.21.15.89:0/2140947433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608186c15b0 con 0x56081871d3f0 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff794a00640 1 --2- 172.21.15.89:0/2140947433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56081871d3f0 0x560818856320 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0f4c80 tx=0x7ff77c12abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb63b5c550d9bb0f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff781200640 1 -- 172.21.15.89:0/2140947433 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c11c040 con 0x56081871d3f0 2024-08-31T04:23:02.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff781200640 1 -- 172.21.15.89:0/2140947433 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77c0a58f0 con 0x56081871d3f0 2024-08-31T04:23:02.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.920+0000 7ff781200640 1 -- 172.21.15.89:0/2140947433 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0f7520 con 0x56081871d3f0 2024-08-31T04:23:02.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 -- 172.21.15.89:0/2140947433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56081871d3f0 msgr2=0x560818856320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 --2- 172.21.15.89:0/2140947433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56081871d3f0 0x560818856320 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0f4c80 tx=0x7ff77c12abc0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 -- 172.21.15.89:0/2140947433 shutdown_connections 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 --2- 172.21.15.89:0/2140947433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56081871d3f0 0x560818856320 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 --2- 172.21.15.89:0/2140947433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 0x560818870f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 --2- 172.21.15.89:0/2140947433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560818712e90 0x560818855de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 -- 172.21.15.89:0/2140947433 >> 172.21.15.89:0/2140947433 conn(0x560818324210 msgr2=0x560818855140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 -- 172.21.15.89:0/2140947433 shutdown_connections 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 -- 172.21.15.89:0/2140947433 wait complete. 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 -- start start 2024-08-31T04:23:02.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 Processor -- start 2024-08-31T04:23:02.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 0x5608188d68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x5608188d6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 0x5608188d7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5608185e6eb0 con 0x560818712e90 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff790201eb0 con 0x56081871d3f0 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56081860cf20 con 0x560818322470 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff79f673000 10 client.0 _ll_register_callbacks cb 0x7ff784015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff794a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x5608188d6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff794a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x5608188d6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44622/0 (socket says 172.21.15.89:44622) 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff794a00640 1 -- 172.21.15.89:0/1391093409 learned_addr learned my addr 172.21.15.89:0/1391093409 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff795400640 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 0x5608188d68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff795e00640 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 0x5608188d7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff794a00640 1 -- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 msgr2=0x5608188d68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff794a00640 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 0x5608188d68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff794a00640 1 -- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 msgr2=0x5608188d7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff794a00640 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 0x5608188d7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff794a00640 1 -- 172.21.15.89:0/1391093409 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608185f5fc0 con 0x560818712e90 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff794a00640 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x5608188d6e00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0f7710 tx=0x7ff77c0f77e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f8bdde2312e824 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.924+0000 7ff776000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff776000640 1 -- 172.21.15.89:0/1391093409 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0f8110 con 0x560818712e90 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff79f673000 1 -- 172.21.15.89:0/1391093409 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff77c0a58f0 con 0x560818712e90 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff776000640 1 -- 172.21.15.89:0/1391093409 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff77c100810 con 0x560818712e90 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff776000640 1 -- 172.21.15.89:0/1391093409 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff77c0f7a10 con 0x560818712e90 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff79f673000 10 client.5589 fetch_fsmap learned FSMap version 9 2024-08-31T04:23:02.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff79f673000 1 -- 172.21.15.89:0/1391093409 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5608185eee00 con 0x560818712e90 2024-08-31T04:23:02.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff776000640 1 -- 172.21.15.89:0/1391093409 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77c0a58f0 con 0x560818712e90 2024-08-31T04:23:02.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff776000640 1 -- 172.21.15.89:0/1391093409 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff77c10f070 con 0x560818712e90 2024-08-31T04:23:02.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff79f673000 10 client.5589 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:23:02.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff79f673000 10 client.5589 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:23:02.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff79f673000 20 client.5589 populate_metadata read hostname 'smithi089' 2024-08-31T04:23:02.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff79f673000 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5608188743b0 0x5608188747c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:02.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff79f673000 4 client.5589 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.8, "await_for": 45.0}] 2024-08-31T04:23:02.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff79f673000 1 -- 172.21.15.89:0/1391093409 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.8, "await_for": 45.0}) -- 0x560818673210 con 0x5608188743b0 2024-08-31T04:23:02.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff795400640 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5608188743b0 0x5608188747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:02.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff776000640 10 client.5589 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:23:02.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:02.928+0000 7ff795400640 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5608188743b0 0x5608188747c0 crc :-1 s=READY pgs=866 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcc03d6e6f0522d6 server_cookie=208e132f9ce37eec in_seq=0 out_seq=0 2024-08-31T04:23:04.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff776000640 1 -- 172.21.15.89:0/1391093409 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560818673210 con 0x5608188743b0 2024-08-31T04:23:04.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff776000640 10 client.5589 handle_command_reply: tid=0 2024-08-31T04:23:04.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff79f673000 1 client.5589 shutdown 2024-08-31T04:23:04.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff79f673000 1 -- 172.21.15.89:0/1391093409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 msgr2=0x5608188d6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff79f673000 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x5608188d6e00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0f7710 tx=0x7ff77c0f77e0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff79f673000 1 -- 172.21.15.89:0/1391093409 shutdown_connections 2024-08-31T04:23:04.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff79f673000 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5608188743b0 0x5608188747c0 crc :-1 s=READY pgs=866 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff79f673000 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560818712e90 0x5608188d6e00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff79f673000 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56081871d3f0 0x5608188d7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff79f673000 1 --2- 172.21.15.89:0/1391093409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560818322470 0x5608188d68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff79f673000 1 -- 172.21.15.89:0/1391093409 >> 172.21.15.89:0/1391093409 conn(0x560818324210 msgr2=0x560818818e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:04.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.448+0000 7ff776000640 0 client.5589 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:23:04.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff79f673000 1 -- 172.21.15.89:0/1391093409 shutdown_connections 2024-08-31T04:23:04.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff79f673000 1 -- 172.21.15.89:0/1391093409 wait complete. 2024-08-31T04:23:04.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff79f673000 20 client.5589 trim_cache size 0 max 16384 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 62, 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "58ce07ae": { 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 62, 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:23:04.448 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 152.8, 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:04.449 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:04.450 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:23:04.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 -- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff7700720c0 msgr2=0x7ff7700745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff7700720c0 0x7ff7700745d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff7840058d0 tx=0x7ff784005860 comp rx=0 tx=0).stop 2024-08-31T04:23:04.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 -- 172.21.15.89:0/254459420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 msgr2=0x7ff7900cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 0x7ff7900cc000 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff77c01cc20 tx=0x7ff77c005db0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 -- 172.21.15.89:0/254459420 shutdown_connections 2024-08-31T04:23:04.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff7700720c0 0x7ff7700745d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7900c1ed0 0x7ff7900cc000 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7900c90e0 0x7ff79015af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 --2- 172.21.15.89:0/254459420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7900b2860 0x7ff7901f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 -- 172.21.15.89:0/254459420 >> 172.21.15.89:0/254459420 conn(0x7ff7900c99b0 msgr2=0x7ff790151950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:04.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 -- 172.21.15.89:0/254459420 shutdown_connections 2024-08-31T04:23:04.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:04.452+0000 7ff797e00640 1 -- 172.21.15.89:0/254459420 wait complete. 2024-08-31T04:23:04.473 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '58ce07ae', quiesce took 2.2 seconds. Will release after: 30.599999999999998 2024-08-31T04:23:04.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:23:04.600 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:23:04.645 INFO:tasks.ceph.mds.d.smithi170.stderr:2024-08-31T04:23:04.646+0000 7f6c3a512640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34046) UID: 0 2024-08-31T04:23:04.646 INFO:tasks.ceph.mds.b.smithi170.stderr:2024-08-31T04:23:04.646+0000 7f1b7db9c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34046) UID: 0 2024-08-31T04:23:04.646 INFO:tasks.ceph.mds.f.smithi170.stderr:2024-08-31T04:23:04.646+0000 7f76ae22c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34046) UID: 0 2024-08-31T04:23:35.075 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:23:35.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.243+0000 7f233da00640 1 -- 172.21.15.89:0/4037042553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f233806d060 msgr2=0x7f233806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.243+0000 7f233da00640 1 --2- 172.21.15.89:0/4037042553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f233806d060 0x7f233806d680 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f233815a900 tx=0x7f232801f0b0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.243+0000 7f233da00640 1 -- 172.21.15.89:0/4037042553 shutdown_connections 2024-08-31T04:23:35.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.243+0000 7f233da00640 1 --2- 172.21.15.89:0/4037042553 >> v2:172.21.15.170:3300/0 conn(0x7f23380caef0 0x7f2338159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.243+0000 7f233da00640 1 --2- 172.21.15.89:0/4037042553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f233806d060 0x7f233806d680 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.243+0000 7f233da00640 1 -- 172.21.15.89:0/4037042553 >> 172.21.15.89:0/4037042553 conn(0x7f2338070bc0 msgr2=0x7f2338074690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:35.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.243+0000 7f233da00640 1 -- 172.21.15.89:0/4037042553 shutdown_connections 2024-08-31T04:23:35.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.243+0000 7f233da00640 1 -- 172.21.15.89:0/4037042553 wait complete. 2024-08-31T04:23:35.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 Processor -- start 2024-08-31T04:23:35.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 -- start start 2024-08-31T04:23:35.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f233806d060 0x7f2338154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23381537a0 0x7f2338148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23380cdc40 0x7f23381e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f23380cb540 con 0x7f23380cdc40 2024-08-31T04:23:35.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f23380cb3c0 con 0x7f23381537a0 2024-08-31T04:23:35.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2338153bb0 con 0x7f233806d060 2024-08-31T04:23:35.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2337400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23380cdc40 0x7f23381e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2337400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23380cdc40 0x7f23381e59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57376/0 (socket says 172.21.15.89:57376) 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2337400640 1 -- 172.21.15.89:0/1375559207 learned_addr learned my addr 172.21.15.89:0/1375559207 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2336a00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f233806d060 0x7f2338154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2336000640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23381537a0 0x7f2338148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2337400640 1 -- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f233806d060 msgr2=0x7f2338154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2337400640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f233806d060 0x7f2338154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2337400640 1 -- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23381537a0 msgr2=0x7f2338148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2337400640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23381537a0 0x7f2338148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2337400640 1 -- 172.21.15.89:0/1375559207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2338158f10 con 0x7f23380cdc40 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2336a00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f233806d060 0x7f2338154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:35.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f2337400640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23380cdc40 0x7f23381e59d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f233000ea80 tx=0x7f233000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f232ea00640 1 -- 172.21.15.89:0/1375559207 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233000cea0 con 0x7f23380cdc40 2024-08-31T04:23:35.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f232ea00640 1 -- 172.21.15.89:0/1375559207 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2330004b30 con 0x7f23380cdc40 2024-08-31T04:23:35.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23381591f0 con 0x7f23380cdc40 2024-08-31T04:23:35.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f232ea00640 1 -- 172.21.15.89:0/1375559207 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330005020 con 0x7f23380cdc40 2024-08-31T04:23:35.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.247+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23380cc270 con 0x7f23380cdc40 2024-08-31T04:23:35.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.251+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f233806d680 con 0x7f23380cdc40 2024-08-31T04:23:35.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.251+0000 7f232ea00640 1 -- 172.21.15.89:0/1375559207 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f23300051c0 con 0x7f23380cdc40 2024-08-31T04:23:35.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.251+0000 7f232ea00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23180720c0 0x7f23180745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.251+0000 7f232ea00640 1 -- 172.21.15.89:0/1375559207 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2330093b50 con 0x7f23380cdc40 2024-08-31T04:23:35.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.251+0000 7f2336a00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23180720c0 0x7f23180745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.255+0000 7f2336a00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23180720c0 0x7f23180745d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23280b2000 tx=0x7f232801d8f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.255+0000 7f232ea00640 1 -- 172.21.15.89:0/1375559207 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f233005f0c0 con 0x7f23380cdc40 2024-08-31T04:23:35.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.455+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2338154bc0 con 0x7f23380cdc40 2024-08-31T04:23:35.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.455+0000 7f232ea00640 1 -- 172.21.15.89:0/1375559207 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f233005e9c0 con 0x7f23380cdc40 2024-08-31T04:23:35.455 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:23:35.455 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:23:35.455 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:23:35.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23180720c0 msgr2=0x7f23180745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23180720c0 0x7f23180745d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23280b2000 tx=0x7f232801d8f0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23380cdc40 msgr2=0x7f23381e59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23380cdc40 0x7f23381e59d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f233000ea80 tx=0x7f233000ef40 comp rx=0 tx=0).stop 2024-08-31T04:23:35.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 shutdown_connections 2024-08-31T04:23:35.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f23180720c0 0x7f23180745d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23380cdc40 0x7f23381e59d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23381537a0 0x7f2338148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 --2- 172.21.15.89:0/1375559207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f233806d060 0x7f2338154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 >> 172.21.15.89:0/1375559207 conn(0x7f2338070bc0 msgr2=0x7f233814e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:35.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 shutdown_connections 2024-08-31T04:23:35.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.459+0000 7f233da00640 1 -- 172.21.15.89:0/1375559207 wait complete. 2024-08-31T04:23:35.476 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 58ce07ae --release --await' 2024-08-31T04:23:35.476 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 58ce07ae --release --await 2024-08-31T04:23:35.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 -- 172.21.15.89:0/1073843697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac8015ced0 msgr2=0x7fac8015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 --2- 172.21.15.89:0/1073843697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac8015ced0 0x7fac8015d2e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fac78009bc0 tx=0x7fac7801cb70 comp rx=0 tx=0).stop 2024-08-31T04:23:35.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 -- 172.21.15.89:0/1073843697 shutdown_connections 2024-08-31T04:23:35.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 --2- 172.21.15.89:0/1073843697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac8015ced0 0x7fac8015d2e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 --2- 172.21.15.89:0/1073843697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac800c4ce0 0x7fac801538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 -- 172.21.15.89:0/1073843697 >> 172.21.15.89:0/1073843697 conn(0x7fac80073630 msgr2=0x7fac80073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:35.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 -- 172.21.15.89:0/1073843697 shutdown_connections 2024-08-31T04:23:35.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 -- 172.21.15.89:0/1073843697 wait complete. 2024-08-31T04:23:35.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 Processor -- start 2024-08-31T04:23:35.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 -- start start 2024-08-31T04:23:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac800c4790 0x7fac801483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac800c4ce0 0x7fac80151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8015ced0 0x7fac80142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac800c3fe0 con 0x7fac800c4ce0 2024-08-31T04:23:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac80153e20 con 0x7fac800c4790 2024-08-31T04:23:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.643+0000 7fac87800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fac80152580 con 0x7fac8015ced0 2024-08-31T04:23:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac800c4ce0 0x7fac80151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac800c4ce0 0x7fac80151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57384/0 (socket says 172.21.15.89:57384) 2024-08-31T04:23:35.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7fe00640 1 -- 172.21.15.89:0/1795127648 learned_addr learned my addr 172.21.15.89:0/1795127648 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:35.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac84e00640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac800c4790 0x7fac801483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac85800640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8015ced0 0x7fac80142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7fe00640 1 -- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8015ced0 msgr2=0x7fac80142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7fe00640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8015ced0 0x7fac80142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7fe00640 1 -- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac800c4790 msgr2=0x7fac801483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7fe00640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac800c4790 0x7fac801483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7fe00640 1 -- 172.21.15.89:0/1795127648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac800b3a10 con 0x7fac800c4ce0 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7fe00640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac800c4ce0 0x7fac80151b70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c3c0 tx=0x7fac6c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7cc00640 1 -- 172.21.15.89:0/1795127648 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c017070 con 0x7fac800c4ce0 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7cc00640 1 -- 172.21.15.89:0/1795127648 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac6c003600 con 0x7fac800c4ce0 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7cc00640 1 -- 172.21.15.89:0/1795127648 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c003a50 con 0x7fac800c4ce0 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac87800640 1 -- 172.21.15.89:0/1795127648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac801520b0 con 0x7fac800c4ce0 2024-08-31T04:23:35.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac87800640 1 -- 172.21.15.89:0/1795127648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac801527a0 con 0x7fac800c4ce0 2024-08-31T04:23:35.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.647+0000 7fac7cc00640 1 -- 172.21.15.89:0/1795127648 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fac6c01a070 con 0x7fac800c4ce0 2024-08-31T04:23:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac7cc00640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fac600720c0 0x7fac600745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac7cc00640 1 -- 172.21.15.89:0/1795127648 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fac6c091fb0 con 0x7fac800c4ce0 2024-08-31T04:23:35.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac84e00640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fac600720c0 0x7fac600745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac8ed68000 1 Processor -- start 2024-08-31T04:23:35.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac8ed68000 1 -- start start 2024-08-31T04:23:35.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac84e00640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fac600720c0 0x7fac600745d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac70009b40 tx=0x7fac700091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2f6950 0x55945e414e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 0x55945e419ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e41a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac8ed68000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55945e2bff30 con 0x55945e2d1890 2024-08-31T04:23:35.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac8ed68000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55945e235690 con 0x55945e2f6950 2024-08-31T04:23:35.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac8ed68000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55945e224c20 con 0x55945e2e0930 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac85800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e41a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac85800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e41a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57396/0 (socket says 172.21.15.89:57396) 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac85800640 1 -- 172.21.15.89:0/3525780712 learned_addr learned my addr 172.21.15.89:0/3525780712 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac7fe00640 1 --2- 172.21.15.89:0/3525780712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 0x55945e419ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac84e00640 1 --2- 172.21.15.89:0/3525780712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2f6950 0x55945e414e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac85800640 1 -- 172.21.15.89:0/3525780712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 msgr2=0x55945e419ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac85800640 1 --2- 172.21.15.89:0/3525780712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 0x55945e419ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac85800640 1 -- 172.21.15.89:0/3525780712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2f6950 msgr2=0x55945e414e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac85800640 1 --2- 172.21.15.89:0/3525780712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2f6950 0x55945e414e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac85800640 1 -- 172.21.15.89:0/3525780712 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945e1d98f0 con 0x55945e2d1890 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.651+0000 7fac85800640 1 --2- 172.21.15.89:0/3525780712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e41a010 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fac78009bc0 tx=0x7fac78019910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9035e9bf4669c2f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac75600640 1 -- 172.21.15.89:0/3525780712 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac780b2040 con 0x55945e2d1890 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac75600640 1 -- 172.21.15.89:0/3525780712 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac780bd070 con 0x55945e2d1890 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac75600640 1 -- 172.21.15.89:0/3525780712 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78004c90 con 0x55945e2d1890 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 -- 172.21.15.89:0/3525780712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 msgr2=0x55945e41a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3525780712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e41a010 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fac78009bc0 tx=0x7fac78019910 comp rx=0 tx=0).stop 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 -- 172.21.15.89:0/3525780712 shutdown_connections 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3525780712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e41a010 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3525780712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 0x55945e419ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3525780712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2f6950 0x55945e414e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 -- 172.21.15.89:0/3525780712 >> 172.21.15.89:0/3525780712 conn(0x55945e2f6540 msgr2=0x55945e417890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:35.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 -- 172.21.15.89:0/3525780712 shutdown_connections 2024-08-31T04:23:35.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 -- 172.21.15.89:0/3525780712 wait complete. 2024-08-31T04:23:35.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 -- start start 2024-08-31T04:23:35.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 Processor -- start 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2d1890 0x55945e413c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 0x55945e414150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e414690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55945e1ab500 con 0x55945e2f6950 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55945e228bd0 con 0x55945e2d1890 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.655+0000 7fac8ed68000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55945e1cca30 con 0x55945e2e0930 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 10 client.0 _ll_register_callbacks cb 0x55945e2dab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac85800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e414690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac85800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e414690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57410/0 (socket says 172.21.15.89:57410) 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac85800640 1 -- 172.21.15.89:0/3269075882 learned_addr learned my addr 172.21.15.89:0/3269075882 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac7fe00640 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 0x55945e414150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac84e00640 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2d1890 0x55945e413c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac85800640 1 -- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 msgr2=0x55945e414150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac85800640 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 0x55945e414150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac85800640 1 -- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2d1890 msgr2=0x55945e413c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac85800640 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2d1890 0x55945e413c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac85800640 1 -- 172.21.15.89:0/3269075882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55945e1c46a0 con 0x55945e2f6950 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac84e00640 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2d1890 0x55945e413c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac85800640 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e414690 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fac780ba040 tx=0x7fac78004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8163899359e6fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac6a000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac6a000640 1 -- 172.21.15.89:0/3269075882 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac780b2070 con 0x55945e2f6950 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac6a000640 1 -- 172.21.15.89:0/3269075882 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fac78009200 con 0x55945e2f6950 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 1 -- 172.21.15.89:0/3269075882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55945e1be7e0 con 0x55945e2f6950 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac6a000640 1 -- 172.21.15.89:0/3269075882 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fac78003980 con 0x55945e2f6950 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 10 client.5610 fetch_fsmap learned FSMap version 9 2024-08-31T04:23:35.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 1 -- 172.21.15.89:0/3269075882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55945e1e31c0 con 0x55945e2f6950 2024-08-31T04:23:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac6a000640 1 -- 172.21.15.89:0/3269075882 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55945e1be7e0 con 0x55945e2f6950 2024-08-31T04:23:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac6a000640 1 -- 172.21.15.89:0/3269075882 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fac780c7ce0 con 0x55945e2f6950 2024-08-31T04:23:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 10 client.5610 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:23:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 10 client.5610 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:23:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 20 client.5610 populate_metadata read hostname 'smithi089' 2024-08-31T04:23:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55945e2bafc0 0x55945e42f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 4 client.5610 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:35.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac8ed68000 1 -- 172.21.15.89:0/3269075882 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55945e2375e0 con 0x55945e2bafc0 2024-08-31T04:23:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac84e00640 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55945e2bafc0 0x55945e42f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac84e00640 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55945e2bafc0 0x55945e42f010 crc :-1 s=READY pgs=872 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c80a54081bffbffe server_cookie=cd979f90047e3300 in_seq=0 out_seq=0 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.659+0000 7fac6a000640 10 client.5610 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac6a000640 1 -- 172.21.15.89:0/3269075882 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55945e2375e0 con 0x55945e2bafc0 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac6a000640 10 client.5610 handle_command_reply: tid=0 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 client.5610 shutdown 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 -- 172.21.15.89:0/3269075882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 msgr2=0x55945e414690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e414690 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fac780ba040 tx=0x7fac78004e30 comp rx=0 tx=0).stop 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 -- 172.21.15.89:0/3269075882 shutdown_connections 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55945e2bafc0 0x55945e42f010 crc :-1 s=READY pgs=872 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e414690 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac6a000640 0 client.5610 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2e0930 0x55945e414150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 --2- 172.21.15.89:0/3269075882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2d1890 0x55945e413c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 -- 172.21.15.89:0/3269075882 >> 172.21.15.89:0/3269075882 conn(0x55945e2f6540 msgr2=0x55945e415040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:35.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 -- 172.21.15.89:0/3269075882 shutdown_connections 2024-08-31T04:23:35.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 1 -- 172.21.15.89:0/3269075882 wait complete. 2024-08-31T04:23:35.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.663+0000 7fac8ed68000 20 client.5610 trim_cache size 0 max 16384 2024-08-31T04:23:35.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.679+0000 7fac8ed68000 1 Processor -- start 2024-08-31T04:23:35.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.679+0000 7fac8ed68000 1 -- start start 2024-08-31T04:23:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2d1890 0x55945e432680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 0x55945e3d4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e3d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac802038b0 con 0x55945e2f6950 2024-08-31T04:23:35.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac80202790 con 0x55945e2e0930 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fac80200e00 con 0x55945e2d1890 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac85800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e3d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac85800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e3d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57418/0 (socket says 172.21.15.89:57418) 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac85800640 1 -- 172.21.15.89:0/2311124352 learned_addr learned my addr 172.21.15.89:0/2311124352 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac84e00640 1 --2- 172.21.15.89:0/2311124352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2d1890 0x55945e432680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac7fe00640 1 --2- 172.21.15.89:0/2311124352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 0x55945e3d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac85800640 1 -- 172.21.15.89:0/2311124352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2d1890 msgr2=0x55945e432680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac85800640 1 --2- 172.21.15.89:0/2311124352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2d1890 0x55945e432680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac85800640 1 -- 172.21.15.89:0/2311124352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 msgr2=0x55945e3d4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac85800640 1 --2- 172.21.15.89:0/2311124352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 0x55945e3d4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac85800640 1 -- 172.21.15.89:0/2311124352 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55945e3d6da0 con 0x55945e2f6950 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac85800640 1 --2- 172.21.15.89:0/2311124352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e3d4bc0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fac7801a7a0 tx=0x7fac78009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee59efb26bab67b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac74c00640 1 -- 172.21.15.89:0/2311124352 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac780b2030 con 0x55945e2f6950 2024-08-31T04:23:35.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac74c00640 1 -- 172.21.15.89:0/2311124352 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac780bd050 con 0x55945e2f6950 2024-08-31T04:23:35.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac74c00640 1 -- 172.21.15.89:0/2311124352 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7800b0c0 con 0x55945e2f6950 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 -- 172.21.15.89:0/2311124352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 msgr2=0x55945e3d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 --2- 172.21.15.89:0/2311124352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e3d4bc0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fac7801a7a0 tx=0x7fac78009390 comp rx=0 tx=0).stop 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 -- 172.21.15.89:0/2311124352 shutdown_connections 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 --2- 172.21.15.89:0/2311124352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2f6950 0x55945e3d4bc0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 --2- 172.21.15.89:0/2311124352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 0x55945e3d4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 --2- 172.21.15.89:0/2311124352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2d1890 0x55945e432680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 -- 172.21.15.89:0/2311124352 >> 172.21.15.89:0/2311124352 conn(0x55945e2f6540 msgr2=0x55945e3d5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 -- 172.21.15.89:0/2311124352 shutdown_connections 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 -- 172.21.15.89:0/2311124352 wait complete. 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 -- start start 2024-08-31T04:23:35.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.683+0000 7fac8ed68000 1 Processor -- start 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e431010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 0x55945e431550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2f6950 0x55945e455560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac80201320 con 0x55945e2d1890 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac802020c0 con 0x55945e2e0930 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fac802019f0 con 0x55945e2f6950 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 10 client.0 _ll_register_callbacks cb 0x7fac700094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac84e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e431010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac84e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e431010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57428/0 (socket says 172.21.15.89:57428) 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac84e00640 1 -- 172.21.15.89:0/626351300 learned_addr learned my addr 172.21.15.89:0/626351300 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac7fe00640 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 0x55945e431550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac85800640 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2f6950 0x55945e455560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac84e00640 1 -- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2f6950 msgr2=0x55945e455560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac84e00640 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2f6950 0x55945e455560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac84e00640 1 -- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 msgr2=0x55945e431550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac84e00640 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 0x55945e431550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac84e00640 1 -- 172.21.15.89:0/626351300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55945e2a92f0 con 0x55945e2d1890 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac84e00640 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e431010 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fac70011810 tx=0x7fac70004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bfb4ea6f01c563 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac6a000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac6a000640 1 -- 172.21.15.89:0/626351300 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70005020 con 0x55945e2d1890 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac6a000640 1 -- 172.21.15.89:0/626351300 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fac700051c0 con 0x55945e2d1890 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 -- 172.21.15.89:0/626351300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac780bd050 con 0x55945e2d1890 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac6a000640 1 -- 172.21.15.89:0/626351300 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fac7003a050 con 0x55945e2d1890 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 10 client.5616 fetch_fsmap learned FSMap version 9 2024-08-31T04:23:35.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 -- 172.21.15.89:0/626351300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55945e1aeb30 con 0x55945e2d1890 2024-08-31T04:23:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac6a000640 1 -- 172.21.15.89:0/626351300 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac780bd050 con 0x55945e2d1890 2024-08-31T04:23:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac6a000640 1 -- 172.21.15.89:0/626351300 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fac7003d020 con 0x55945e2d1890 2024-08-31T04:23:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 10 client.5616 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:23:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 10 client.5616 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:23:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 20 client.5616 populate_metadata read hostname 'smithi089' 2024-08-31T04:23:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55945deb6e80 0x55945e455aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 4 client.5616 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "58ce07ae", "release": true, "await": true}] 2024-08-31T04:23:35.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac8ed68000 1 -- 172.21.15.89:0/626351300 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "58ce07ae", "release": true, "await": true}) -- 0x55945e233080 con 0x55945deb6e80 2024-08-31T04:23:35.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.687+0000 7fac7fe00640 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55945deb6e80 0x55945e455aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:35.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.691+0000 7fac7fe00640 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55945deb6e80 0x55945e455aa0 crc :-1 s=READY pgs=873 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef25f6f30e5b82af server_cookie=171ff43c0937a6b7 in_seq=0 out_seq=0 2024-08-31T04:23:35.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.691+0000 7fac6a000640 10 client.5616 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:23:35.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac6a000640 1 -- 172.21.15.89:0/626351300 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55945e233080 con 0x55945deb6e80 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac6a000640 10 client.5616 handle_command_reply: tid=0 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 client.5616 shutdown 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 -- 172.21.15.89:0/626351300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 msgr2=0x55945e431010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e431010 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fac70011810 tx=0x7fac70004740 comp rx=0 tx=0).stop 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 -- 172.21.15.89:0/626351300 shutdown_connections 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55945deb6e80 0x55945e455aa0 crc :-1 s=READY pgs=873 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55945e2f6950 0x55945e455560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55945e2e0930 0x55945e431550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac6a000640 0 client.5616 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 --2- 172.21.15.89:0/626351300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55945e2d1890 0x55945e431010 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 -- 172.21.15.89:0/626351300 >> 172.21.15.89:0/626351300 conn(0x55945e2f6540 msgr2=0x55945e3d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 -- 172.21.15.89:0/626351300 shutdown_connections 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 1 -- 172.21.15.89:0/626351300 wait complete. 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac8ed68000 20 client.5616 trim_cache size 0 max 16384 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 64, 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stdout: "58ce07ae": { 2024-08-31T04:23:35.782 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 64, 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 152.8, 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:35.783 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:35.784 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:35.784 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:35.784 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:23:35.784 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:23:35.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 -- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fac600720c0 msgr2=0x7fac600745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fac600720c0 0x7fac600745d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac70009b40 tx=0x7fac700091e0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 -- 172.21.15.89:0/1795127648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac800c4ce0 msgr2=0x7fac80151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac800c4ce0 0x7fac80151b70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c3c0 tx=0x7fac6c00c880 comp rx=0 tx=0).stop 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 -- 172.21.15.89:0/1795127648 shutdown_connections 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fac600720c0 0x7fac600745d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac800c4ce0 0x7fac80151b70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8015ced0 0x7fac80142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 --2- 172.21.15.89:0/1795127648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac800c4790 0x7fac801483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 -- 172.21.15.89:0/1795127648 >> 172.21.15.89:0/1795127648 conn(0x7fac80073630 msgr2=0x7fac80150850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 -- 172.21.15.89:0/1795127648 shutdown_connections 2024-08-31T04:23:35.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:23:35.783+0000 7fac87800640 1 -- 172.21.15.89:0/1795127648 wait complete. 2024-08-31T04:23:35.802 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '58ce07ae', total seconds elapsed: 33.5 2024-08-31T04:23:37.604 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 12% (16/133) Updating files: 13% (18/133) Updating files: 14% (19/133) Updating files: 15% (20/133) Updating files: 16% (22/133) Updating files: 17% (23/133) Updating files: 18% (24/133) Updating files: 19% (26/133) Updating files: 20% (27/133) Updating files: 21% (28/133) Updating files: 22% (30/133) Updating files: 23% (31/133) Updating files: 24% (32/133) Updating files: 25% (34/133) Updating files: 26% (35/133) Updating files: 27% (36/133) Updating files: 28% (38/133) Updating files: 29% (39/133) Updating files: 30% (40/133) Updating files: 31% (42/133) Updating files: 32% (43/133) Updating files: 33% (44/133) Updating files: 34% (46/133) Updating files: 35% (47/133) Updating files: 36% (48/133) Updating files: 37% (50/133) Updating files: 38% (51/133) Updating files: 39% (52/133) Updating files: 40% (54/133) Updating files: 41% (55/133) Updating files: 42% (56/133) Updating files: 43% (58/133) Updating files: 44% (59/133) Updating files: 45% (60/133) Updating files: 46% (62/133) Updating files: 47% (63/133) Updating files: 48% (64/133) Updating files: 49% (66/133) Updating files: 50% (67/133) Updating files: 51% (68/133) Updating files: 52% (70/133) Updating files: 53% (71/133) Updating files: 54% (72/133) Updating files: 55% (74/133) Updating files: 56% (75/133) Updating files: 57% (76/133) Updating files: 58% (78/133) Updating files: 59% (79/133) Updating files: 60% (80/133) Updating files: 61% (82/133) Updating files: 62% (83/133) Updating files: 63% (84/133) Updating files: 64% (86/133) Updating files: 65% (87/133) Updating files: 66% (88/133) Updating files: 67% (90/133) Updating files: 68% (91/133) Updating files: 69% (92/133) Updating files: 70% (94/133) Updating files: 71% (95/133) Updating files: 72% (96/133) Updating files: 73% (98/133) Updating files: 74% (99/133) Updating files: 75% (100/133) Updating files: 76% (102/133) Updating files: 77% (103/133) Updating files: 78% (104/133) Updating files: 79% (106/133) Updating files: 80% (107/133) Updating files: 81% (108/133) Updating files: 82% (110/133) Updating files: 83% (111/133) Updating files: 84% (112/133) Updating files: 85% (114/133) Updating files: 86% (115/133) Updating files: 87% (116/133) Updating files: 88% (118/133) Updating files: 89% (119/133) Updating files: 90% (120/133) Updating files: 91% (122/133) Updating files: 92% (123/133) Updating files: 93% (124/133) Updating files: 94% (126/133) Updating files: 95% (127/133) Updating files: 96% (128/133) Updating files: 97% (130/133) Updating files: 98% (131/133) Updating files: 99% (132/133) Updating files: 100% (133/133) Updating files: 100% (133/133), done. 2024-08-31T04:23:38.724 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 2b32297267d v0.13 2024-08-31T04:23:38.787 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.13 2024-08-31T04:23:38.807 INFO:tasks.workunit.client.0.smithi089.stdout:v0.14 2024-08-31T04:23:38.807 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 14 -eq 48 ] 2024-08-31T04:23:38.807 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.14 2024-08-31T04:23:38.807 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.14 2024-08-31T04:23:38.807 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.14 2024-08-31T04:23:51.993 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 58% (88/151) Updating files: 59% (90/151) Updating files: 60% (91/151) Updating files: 61% (93/151) Updating files: 62% (94/151) Updating files: 63% (96/151) Updating files: 64% (97/151) Updating files: 65% (99/151) Updating files: 66% (100/151) Updating files: 67% (102/151) Updating files: 68% (103/151) Updating files: 69% (105/151) Updating files: 70% (106/151) Updating files: 71% (108/151) Updating files: 72% (109/151) Updating files: 73% (111/151) Updating files: 74% (112/151) Updating files: 75% (114/151) Updating files: 76% (115/151) Updating files: 77% (117/151) Updating files: 78% (118/151) Updating files: 79% (120/151) Updating files: 80% (121/151) Updating files: 81% (123/151) Updating files: 82% (124/151) Updating files: 83% (126/151) Updating files: 84% (127/151) Updating files: 85% (129/151) Updating files: 86% (130/151) Updating files: 87% (132/151) Updating files: 88% (133/151) Updating files: 89% (135/151) Updating files: 90% (136/151) Updating files: 91% (138/151) Updating files: 92% (139/151) Updating files: 93% (141/151) Updating files: 94% (142/151) Updating files: 95% (144/151) Updating files: 96% (145/151) Updating files: 97% (147/151) Updating files: 98% (148/151) Updating files: 99% (150/151) Updating files: 100% (151/151) Updating files: 100% (151/151), done. 2024-08-31T04:23:52.321 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 1ec1e8d6fb6 v0.14 2024-08-31T04:23:52.325 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.14 2024-08-31T04:23:52.347 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 15 -eq 48 ] 2024-08-31T04:23:52.347 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.15 2024-08-31T04:23:52.348 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.15 2024-08-31T04:23:52.348 INFO:tasks.workunit.client.0.smithi089.stdout:v0.15 2024-08-31T04:23:52.348 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.15 2024-08-31T04:23:53.430 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 96% (108/112) Updating files: 97% (109/112) Updating files: 98% (110/112) Updating files: 99% (111/112) Updating files: 100% (112/112) Updating files: 100% (112/112), done. 2024-08-31T04:23:53.485 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at ab3c421eb95 v0.15 2024-08-31T04:23:53.489 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.15 2024-08-31T04:23:54.556 INFO:tasks.workunit.client.0.smithi089.stdout:v0.16 2024-08-31T04:23:54.556 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 16 -eq 48 ] 2024-08-31T04:23:54.556 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.16 2024-08-31T04:23:54.556 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.16 2024-08-31T04:23:54.556 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.16 2024-08-31T04:23:58.015 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 42% (45/107) Updating files: 43% (47/107) Updating files: 44% (48/107) Updating files: 45% (49/107) Updating files: 46% (50/107) Updating files: 47% (51/107) Updating files: 48% (52/107) Updating files: 49% (53/107) Updating files: 50% (54/107) Updating files: 51% (55/107) Updating files: 52% (56/107) Updating files: 53% (57/107) Updating files: 54% (58/107) Updating files: 55% (59/107) Updating files: 56% (60/107) Updating files: 57% (61/107) Updating files: 58% (63/107) Updating files: 59% (64/107) Updating files: 60% (65/107) Updating files: 61% (66/107) Updating files: 62% (67/107) Updating files: 63% (68/107) Updating files: 64% (69/107) Updating files: 65% (70/107) Updating files: 66% (71/107) Updating files: 67% (72/107) Updating files: 68% (73/107) Updating files: 69% (74/107) Updating files: 70% (75/107) Updating files: 71% (76/107) Updating files: 72% (78/107) Updating files: 73% (79/107) Updating files: 74% (80/107) Updating files: 75% (81/107) Updating files: 76% (82/107) Updating files: 77% (83/107) Updating files: 78% (84/107) Updating files: 79% (85/107) Updating files: 80% (86/107) Updating files: 81% (87/107) Updating files: 82% (88/107) Updating files: 83% (89/107) Updating files: 84% (90/107) Updating files: 85% (91/107) Updating files: 86% (93/107) Updating files: 87% (94/107) Updating files: 88% (95/107) Updating files: 89% (96/107) Updating files: 90% (97/107) Updating files: 91% (98/107) Updating files: 92% (99/107) Updating files: 93% (100/107) Updating files: 94% (101/107) Updating files: 95% (102/107) Updating files: 96% (103/107) Updating files: 97% (104/107) Updating files: 98% (105/107) Updating files: 99% (106/107) Updating files: 100% (107/107) Updating files: 100% (107/107), done. 2024-08-31T04:23:58.068 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 38dbaa5175c v0.16 2024-08-31T04:23:58.073 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.16 2024-08-31T04:23:58.242 INFO:tasks.workunit.client.0.smithi089.stdout:v0.17 2024-08-31T04:23:58.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 17 -eq 48 ] 2024-08-31T04:23:58.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.17 2024-08-31T04:23:58.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.17 2024-08-31T04:23:58.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.17 2024-08-31T04:24:09.439 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 40% (88/217) Updating files: 41% (89/217) Updating files: 42% (92/217) Updating files: 43% (94/217) Updating files: 44% (96/217) Updating files: 45% (98/217) Updating files: 46% (100/217) Updating files: 47% (102/217) Updating files: 48% (105/217) Updating files: 49% (107/217) Updating files: 50% (109/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 85% (186/217) Updating files: 86% (187/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2024-08-31T04:24:09.891 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at dac3a8c35fb v0.17 2024-08-31T04:24:09.894 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.17 2024-08-31T04:24:09.909 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 18 -eq 48 ] 2024-08-31T04:24:09.909 INFO:tasks.workunit.client.0.smithi089.stdout:v0.18 2024-08-31T04:24:09.909 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.18 2024-08-31T04:24:09.909 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.18 2024-08-31T04:24:09.910 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.18 2024-08-31T04:24:18.449 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 15% (122/779) Updating files: 16% (125/779) Updating files: 17% (133/779) Updating files: 18% (141/779) Updating files: 18% (148/779) Updating files: 19% (149/779) Updating files: 20% (156/779) Updating files: 21% (164/779) Updating files: 21% (165/779) Updating files: 22% (172/779) Updating files: 23% (180/779) Updating files: 24% (187/779) Updating files: 25% (195/779) Updating files: 26% (203/779) Updating files: 27% (211/779) Updating files: 28% (219/779) Updating files: 29% (226/779) Updating files: 30% (234/779) Updating files: 31% (242/779) Updating files: 32% (250/779) Updating files: 33% (258/779) Updating files: 34% (265/779) Updating files: 35% (273/779) Updating files: 36% (281/779) Updating files: 37% (289/779) Updating files: 38% (297/779) Updating files: 39% (304/779) Updating files: 40% (312/779) Updating files: 41% (320/779) Updating files: 42% (328/779) Updating files: 42% (332/779) Updating files: 43% (335/779) Updating files: 44% (343/779) Updating files: 45% (351/779) Updating files: 46% (359/779) Updating files: 47% (367/779) Updating files: 48% (374/779) Updating files: 49% (382/779) Updating files: 50% (390/779) Updating files: 51% (398/779) Updating files: 52% (406/779) Updating files: 53% (413/779) Updating files: 54% (421/779) Updating files: 55% (429/779) Updating files: 56% (437/779) Updating files: 57% (445/779) Updating files: 57% (446/779) Updating files: 58% (452/779) Updating files: 59% (460/779) Updating files: 59% (464/779) Updating files: 60% (468/779) Updating files: 61% (476/779) Updating files: 62% (483/779) Updating files: 63% (491/779) Updating files: 64% (499/779) Updating files: 65% (507/779) Updating files: 66% (515/779) Updating files: 67% (522/779) Updating files: 68% (530/779) Updating files: 69% (538/779) Updating files: 70% (546/779) Updating files: 71% (554/779) Updating files: 71% (555/779) Updating files: 72% (561/779) Updating files: 73% (569/779) Updating files: 74% (577/779) Updating files: 75% (585/779) Updating files: 76% (593/779) Updating files: 77% (600/779) Updating files: 78% (608/779) Updating files: 79% (616/779) Updating files: 80% (624/779) Updating files: 81% (631/779) Updating files: 82% (639/779) Updating files: 83% (647/779) Updating files: 84% (655/779) Updating files: 85% (663/779) Updating files: 85% (668/779) Updating files: 86% (670/779) Updating files: 87% (678/779) Updating files: 88% (686/779) Updating files: 89% (694/779) Updating files: 90% (702/779) Updating files: 91% (709/779) Updating files: 92% (717/779) Updating files: 93% (725/779) Updating files: 94% (733/779) Updating files: 95% (741/779) Updating files: 96% (748/779) Updating files: 97% (756/779) Updating files: 98% (764/779) Updating files: 99% (772/779) Updating files: 100% (779/779) Updating files: 100% (779/779), done. 2024-08-31T04:24:18.691 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 2f10137986a v0.18 2024-08-31T04:24:18.696 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.18 2024-08-31T04:24:18.726 INFO:tasks.workunit.client.0.smithi089.stdout:v0.19 2024-08-31T04:24:18.726 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 19 -eq 48 ] 2024-08-31T04:24:18.726 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.19 2024-08-31T04:24:18.727 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.19 2024-08-31T04:24:18.727 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.19 2024-08-31T04:24:22.615 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 50% (110/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 76% (167/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 86% (187/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2024-08-31T04:24:22.694 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 98f5be53f85 v0.19 2024-08-31T04:24:22.698 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.19 2024-08-31T04:24:22.742 INFO:tasks.workunit.client.0.smithi089.stdout:v0.20 2024-08-31T04:24:22.742 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 20 -eq 48 ] 2024-08-31T04:24:22.742 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.20 2024-08-31T04:24:22.742 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.20 2024-08-31T04:24:22.743 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.20 2024-08-31T04:24:34.644 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 11% (28/245) Updating files: 12% (30/245) Updating files: 13% (32/245) Updating files: 14% (35/245) Updating files: 15% (37/245) Updating files: 16% (40/245) Updating files: 17% (42/245) Updating files: 18% (45/245) Updating files: 19% (47/245) Updating files: 20% (49/245) Updating files: 21% (52/245) Updating files: 22% (54/245) Updating files: 23% (57/245) Updating files: 24% (59/245) Updating files: 25% (62/245) Updating files: 26% (64/245) Updating files: 27% (67/245) Updating files: 28% (69/245) Updating files: 29% (72/245) Updating files: 30% (74/245) Updating files: 31% (76/245) Updating files: 32% (79/245) Updating files: 33% (81/245) Updating files: 34% (84/245) Updating files: 35% (86/245) Updating files: 36% (89/245) Updating files: 37% (91/245) Updating files: 38% (94/245) Updating files: 39% (96/245) Updating files: 40% (98/245) Updating files: 41% (101/245) Updating files: 42% (103/245) Updating files: 43% (106/245) Updating files: 44% (108/245) Updating files: 45% (111/245) Updating files: 46% (113/245) Updating files: 47% (116/245) Updating files: 48% (118/245) Updating files: 49% (121/245) Updating files: 50% (123/245) Updating files: 51% (125/245) Updating files: 52% (128/245) Updating files: 53% (130/245) Updating files: 54% (133/245) Updating files: 55% (135/245) Updating files: 56% (138/245) Updating files: 57% (140/245) Updating files: 58% (143/245) Updating files: 59% (145/245) Updating files: 60% (147/245) Updating files: 61% (150/245) Updating files: 62% (152/245) Updating files: 63% (155/245) Updating files: 64% (157/245) Updating files: 65% (160/245) Updating files: 66% (162/245) Updating files: 67% (165/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 76% (187/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 88% (216/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 92% (227/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-08-31T04:24:34.819 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 266d2076b6c debian: fix up debian scripts 2024-08-31T04:24:34.822 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.20 2024-08-31T04:24:34.841 INFO:tasks.workunit.client.0.smithi089.stdout:v0.21 2024-08-31T04:24:34.841 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 21 -eq 48 ] 2024-08-31T04:24:34.842 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.21 2024-08-31T04:24:34.842 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.21 2024-08-31T04:24:34.842 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.21 2024-08-31T04:24:36.716 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.1 2024-08-31T04:24:36.717 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:24:36.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.873+0000 7f9a73400640 1 -- 172.21.15.89:0/3351713789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a50003fe0 msgr2=0x7f9a50004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:36.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.873+0000 7f9a73400640 1 --2- 172.21.15.89:0/3351713789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a50003fe0 0x7f9a50004810 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c072b00 tx=0x7f9a5801d220 comp rx=0 tx=0).stop 2024-08-31T04:24:36.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.873+0000 7f9a71400640 1 -- 172.21.15.89:0/3351713789 reap_dead start 2024-08-31T04:24:36.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.873+0000 7f9a73400640 1 -- 172.21.15.89:0/3351713789 shutdown_connections 2024-08-31T04:24:36.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.873+0000 7f9a73400640 1 -- 172.21.15.89:0/3351713789 >> 172.21.15.89:0/3351713789 conn(0x7f9a6c0ccf20 msgr2=0x7f9a6c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:36.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.873+0000 7f9a73400640 1 -- 172.21.15.89:0/3351713789 shutdown_connections 2024-08-31T04:24:36.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.873+0000 7f9a73400640 1 -- 172.21.15.89:0/3351713789 wait complete. 2024-08-31T04:24:36.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a73400640 1 Processor -- start 2024-08-31T04:24:36.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a73400640 1 -- start start 2024-08-31T04:24:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a73400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a50003fe0 0x7f9a6c1f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a73400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a6c153610 0x7f9a6c0b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a73400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a6c0b1520 0x7f9a6c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a73400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c0c8030 con 0x7f9a50003fe0 2024-08-31T04:24:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a73400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c0c3150 con 0x7f9a6c153610 2024-08-31T04:24:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a73400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9a6c152a10 con 0x7f9a6c0b1520 2024-08-31T04:24:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a70a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a50003fe0 0x7f9a6c1f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a70a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a50003fe0 0x7f9a6c1f26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33218/0 (socket says 172.21.15.89:33218) 2024-08-31T04:24:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a70a00640 1 -- 172.21.15.89:0/2083694145 learned_addr learned my addr 172.21.15.89:0/2083694145 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a6be00640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a6c153610 0x7f9a6c0b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.877+0000 7f9a71400640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a6c0b1520 0x7f9a6c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a70a00640 1 -- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a6c0b1520 msgr2=0x7f9a6c1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a70a00640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a6c0b1520 0x7f9a6c1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a70a00640 1 -- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a6c153610 msgr2=0x7f9a6c0b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a70a00640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a6c153610 0x7f9a6c0b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a70a00640 1 -- 172.21.15.89:0/2083694145 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c1f2c30 con 0x7f9a50003fe0 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a6be00640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a6c153610 0x7f9a6c0b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a70a00640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a50003fe0 0x7f9a6c1f26f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00e590 tx=0x7f9a5c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a68c00640 1 -- 172.21.15.89:0/2083694145 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c015070 con 0x7f9a50003fe0 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a68c00640 1 -- 172.21.15.89:0/2083694145 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a5c0109a0 con 0x7f9a50003fe0 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a68c00640 1 -- 172.21.15.89:0/2083694145 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c010df0 con 0x7f9a50003fe0 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6c1f2210 con 0x7f9a50003fe0 2024-08-31T04:24:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6c0c69a0 con 0x7f9a50003fe0 2024-08-31T04:24:36.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6c0c7920 con 0x7f9a50003fe0 2024-08-31T04:24:36.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.881+0000 7f9a68c00640 1 -- 172.21.15.89:0/2083694145 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f9a5c018070 con 0x7f9a50003fe0 2024-08-31T04:24:36.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.885+0000 7f9a68c00640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9a4c0720c0 0x7f9a4c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:36.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.885+0000 7f9a68c00640 1 -- 172.21.15.89:0/2083694145 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f9a5c0933a0 con 0x7f9a50003fe0 2024-08-31T04:24:36.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.885+0000 7f9a6be00640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9a4c0720c0 0x7f9a4c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:36.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.885+0000 7f9a6be00640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9a4c0720c0 0x7f9a4c0745d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a580ad000 tx=0x7f9a58019fc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:36.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:36.889+0000 7f9a68c00640 1 -- 172.21.15.89:0/2083694145 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9a5c05e910 con 0x7f9a50003fe0 2024-08-31T04:24:37.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a6c1560a0 con 0x7f9a50003fe0 2024-08-31T04:24:37.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a68c00640 1 -- 172.21.15.89:0/2083694145 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f9a5c05e210 con 0x7f9a50003fe0 2024-08-31T04:24:37.100 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:24:37.100 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:24:37.101 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:24:37.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9a4c0720c0 msgr2=0x7f9a4c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9a4c0720c0 0x7f9a4c0745d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a580ad000 tx=0x7f9a58019fc0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a50003fe0 msgr2=0x7f9a6c1f26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a50003fe0 0x7f9a6c1f26f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00e590 tx=0x7f9a5c00ea50 comp rx=0 tx=0).stop 2024-08-31T04:24:37.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 shutdown_connections 2024-08-31T04:24:37.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f9a4c0720c0 0x7f9a4c0745d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a6c0b1520 0x7f9a6c1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a6c153610 0x7f9a6c0b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 --2- 172.21.15.89:0/2083694145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a50003fe0 0x7f9a6c1f26f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 >> 172.21.15.89:0/2083694145 conn(0x7f9a6c0ccf20 msgr2=0x7f9a6c150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:37.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 shutdown_connections 2024-08-31T04:24:37.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.101+0000 7f9a73400640 1 -- 172.21.15.89:0/2083694145 wait complete. 2024-08-31T04:24:37.122 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 134.1 --await-for 45.0' 2024-08-31T04:24:37.122 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 134.1 --await-for 45.0 2024-08-31T04:24:37.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.285+0000 7f268b200640 1 -- 172.21.15.89:0/1373992173 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26840c90e0 msgr2=0x7f26840747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.285+0000 7f268b200640 1 --2- 172.21.15.89:0/1373992173 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26840c90e0 0x7f26840747b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f267c009bc0 tx=0x7f267c01cae0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.285+0000 7f268b200640 1 -- 172.21.15.89:0/1373992173 shutdown_connections 2024-08-31T04:24:37.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.285+0000 7f268b200640 1 --2- 172.21.15.89:0/1373992173 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26840c90e0 0x7f26840747b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.285+0000 7f268b200640 1 --2- 172.21.15.89:0/1373992173 >> v2:172.21.15.170:3300/0 conn(0x7f26840b2860 0x7f26840b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.285+0000 7f268b200640 1 -- 172.21.15.89:0/1373992173 >> 172.21.15.89:0/1373992173 conn(0x7f26840c99b0 msgr2=0x7f26840c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:37.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.285+0000 7f268b200640 1 -- 172.21.15.89:0/1373992173 shutdown_connections 2024-08-31T04:24:37.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.285+0000 7f268b200640 1 -- 172.21.15.89:0/1373992173 wait complete. 2024-08-31T04:24:37.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f268b200640 1 Processor -- start 2024-08-31T04:24:37.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f268b200640 1 -- start start 2024-08-31T04:24:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f268b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840b2860 0x7f26840cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f268b200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26840c1ed0 0x7f2684162560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f268b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26840c90e0 0x7f2684140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f268b200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2684158750 con 0x7f26840c1ed0 2024-08-31T04:24:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f268b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f26841585d0 con 0x7f26840b2860 2024-08-31T04:24:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f268b200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f26840736a0 con 0x7f26840c90e0 2024-08-31T04:24:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f2683e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840b2860 0x7f26840cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f267be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26840c1ed0 0x7f2684162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f2683e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840b2860 0x7f26840cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:48144/0 (socket says 172.21.15.89:48144) 2024-08-31T04:24:37.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f2683e00640 1 -- 172.21.15.89:0/364253621 learned_addr learned my addr 172.21.15.89:0/364253621 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:37.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.289+0000 7f2689200640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26840c90e0 0x7f2684140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f267be00640 1 -- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26840c90e0 msgr2=0x7f2684140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f267be00640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26840c90e0 0x7f2684140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f267be00640 1 -- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840b2860 msgr2=0x7f26840cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f267be00640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840b2860 0x7f26840cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f267be00640 1 -- 172.21.15.89:0/364253621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26841578a0 con 0x7f26840c1ed0 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f2683e00640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840b2860 0x7f26840cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f267be00640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26840c1ed0 0x7f2684162560 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c390 tx=0x7f266c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f2680c00640 1 -- 172.21.15.89:0/364253621 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c011790 con 0x7f26840c1ed0 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f2680c00640 1 -- 172.21.15.89:0/364253621 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f266c017070 con 0x7f26840c1ed0 2024-08-31T04:24:37.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f2680c00640 1 -- 172.21.15.89:0/364253621 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c011ce0 con 0x7f26840c1ed0 2024-08-31T04:24:37.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f268b200640 1 -- 172.21.15.89:0/364253621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26840cbd90 con 0x7f26840c1ed0 2024-08-31T04:24:37.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.293+0000 7f268b200640 1 -- 172.21.15.89:0/364253621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2684149c90 con 0x7f26840c1ed0 2024-08-31T04:24:37.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2680c00640 1 -- 172.21.15.89:0/364253621 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f266c01c460 con 0x7f26840c1ed0 2024-08-31T04:24:37.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2680c00640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f26600720c0 0x7f26600745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2680c00640 1 -- 172.21.15.89:0/364253621 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f266c092b40 con 0x7f26840c1ed0 2024-08-31T04:24:37.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f26928af000 1 Processor -- start 2024-08-31T04:24:37.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f26928af000 1 -- start start 2024-08-31T04:24:37.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2683e00640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f26600720c0 0x7f26600745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2683e00640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f26600720c0 0x7f26600745d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2674009680 tx=0x7f26740091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:37.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f26928af000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8666a93f0 0x55b8667e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f26928af000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 0x55b8667abce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f26928af000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667ac220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f26928af000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b866601820 con 0x55b866688960 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f26928af000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b8665f0db0 con 0x55b8666a93f0 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f26928af000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b8665f4d60 con 0x55b86669ee90 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2689200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2689200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33232/0 (socket says 172.21.15.89:33232) 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2689200640 1 -- 172.21.15.89:0/431557206 learned_addr learned my addr 172.21.15.89:0/431557206 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2683e00640 1 --2- 172.21.15.89:0/431557206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8666a93f0 0x55b8667e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f267be00640 1 --2- 172.21.15.89:0/431557206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 0x55b8667abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2689200640 1 -- 172.21.15.89:0/431557206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 msgr2=0x55b8667abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2689200640 1 --2- 172.21.15.89:0/431557206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 0x55b8667abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2689200640 1 -- 172.21.15.89:0/431557206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8666a93f0 msgr2=0x55b8667e2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2689200640 1 --2- 172.21.15.89:0/431557206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8666a93f0 0x55b8667e2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.297+0000 7f2689200640 1 -- 172.21.15.89:0/431557206 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86658bb70 con 0x55b866688960 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f2689200640 1 --2- 172.21.15.89:0/431557206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667ac220 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f267c01a710 tx=0x7f267c019880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd440c3607edf8f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f2678c00640 1 -- 172.21.15.89:0/431557206 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0b2040 con 0x55b866688960 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f2678c00640 1 -- 172.21.15.89:0/431557206 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f267c0bc070 con 0x55b866688960 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f2678c00640 1 -- 172.21.15.89:0/431557206 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c004cb0 con 0x55b866688960 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 -- 172.21.15.89:0/431557206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 msgr2=0x55b8667ac220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 --2- 172.21.15.89:0/431557206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667ac220 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f267c01a710 tx=0x7f267c019880 comp rx=0 tx=0).stop 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 -- 172.21.15.89:0/431557206 shutdown_connections 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 --2- 172.21.15.89:0/431557206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667ac220 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 --2- 172.21.15.89:0/431557206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 0x55b8667abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 --2- 172.21.15.89:0/431557206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b8666a93f0 0x55b8667e2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 -- 172.21.15.89:0/431557206 >> 172.21.15.89:0/431557206 conn(0x55b8662b0210 msgr2=0x55b8667e5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:37.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 -- 172.21.15.89:0/431557206 shutdown_connections 2024-08-31T04:24:37.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 -- 172.21.15.89:0/431557206 wait complete. 2024-08-31T04:24:37.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 -- start start 2024-08-31T04:24:37.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 Processor -- start 2024-08-31T04:24:37.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.301+0000 7f26928af000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 0x55b8667e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86669ee90 0x55b8667e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 0x55b8667e2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b8662b7b10 con 0x55b86669ee90 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b8665776f0 con 0x55b866688960 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b8665f9390 con 0x55b8666a93f0 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 10 client.0 _ll_register_callbacks cb 0x55b866598b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f267be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86669ee90 0x55b8667e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2683e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 0x55b8667e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f267be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86669ee90 0x55b8667e1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33248/0 (socket says 172.21.15.89:33248) 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f267be00640 1 -- 172.21.15.89:0/2473012958 learned_addr learned my addr 172.21.15.89:0/2473012958 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2689200640 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 0x55b8667e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f267be00640 1 -- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 msgr2=0x55b8667e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f267be00640 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 0x55b8667e2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f267be00640 1 -- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 msgr2=0x55b8667e18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:37.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f267be00640 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 0x55b8667e18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f267be00640 1 -- 172.21.15.89:0/2473012958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8665af380 con 0x55b86669ee90 2024-08-31T04:24:37.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f267be00640 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86669ee90 0x55b8667e1e30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f266c001ec0 tx=0x7f266c05d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e4298d2d39ed6b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:37.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2671600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:24:37.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2671600640 1 -- 172.21.15.89:0/2473012958 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c066c40 con 0x55b86669ee90 2024-08-31T04:24:37.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2671600640 1 -- 172.21.15.89:0/2473012958 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f266c064430 con 0x55b86669ee90 2024-08-31T04:24:37.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 1 -- 172.21.15.89:0/2473012958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b8665ffd20 con 0x55b86669ee90 2024-08-31T04:24:37.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2671600640 1 -- 172.21.15.89:0/2473012958 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f266c064630 con 0x55b86669ee90 2024-08-31T04:24:37.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 10 client.5631 fetch_fsmap learned FSMap version 9 2024-08-31T04:24:37.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 1 -- 172.21.15.89:0/2473012958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b866675e40 con 0x55b86669ee90 2024-08-31T04:24:37.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2671600640 1 -- 172.21.15.89:0/2473012958 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b8665ffd20 con 0x55b86669ee90 2024-08-31T04:24:37.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2671600640 1 -- 172.21.15.89:0/2473012958 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f266c05ece0 con 0x55b86669ee90 2024-08-31T04:24:37.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 10 client.5631 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 10 client.5631 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 20 client.5631 populate_metadata read hostname 'smithi089' 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b866294dc0 0x55b8667fcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 4 client.5631 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f26928af000 1 -- 172.21.15.89:0/2473012958 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b866603770 con 0x55b866294dc0 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2683e00640 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b866294dc0 0x55b8667fcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2671600640 10 client.5631 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.305+0000 7f2683e00640 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b866294dc0 0x55b8667fcf90 crc :-1 s=READY pgs=926 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd3585dd94fc1b72 server_cookie=adb4a287a5651109 in_seq=0 out_seq=0 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f2671600640 1 -- 172.21.15.89:0/2473012958 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b866603770 con 0x55b866294dc0 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f2671600640 10 client.5631 handle_command_reply: tid=0 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 client.5631 shutdown 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 -- 172.21.15.89:0/2473012958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86669ee90 msgr2=0x55b8667e1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86669ee90 0x55b8667e1e30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f266c001ec0 tx=0x7f266c05d300 comp rx=0 tx=0).stop 2024-08-31T04:24:37.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 -- 172.21.15.89:0/2473012958 shutdown_connections 2024-08-31T04:24:37.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b866294dc0 0x55b8667fcf90 crc :-1 s=READY pgs=926 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86669ee90 0x55b8667e1e30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 0x55b8667e2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 --2- 172.21.15.89:0/2473012958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 0x55b8667e18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 -- 172.21.15.89:0/2473012958 >> 172.21.15.89:0/2473012958 conn(0x55b8662b0210 msgr2=0x55b8667e4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:37.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f2671600640 0 client.5631 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:24:37.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 -- 172.21.15.89:0/2473012958 shutdown_connections 2024-08-31T04:24:37.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 1 -- 172.21.15.89:0/2473012958 wait complete. 2024-08-31T04:24:37.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.309+0000 7f26928af000 20 client.5631 trim_cache size 0 max 16384 2024-08-31T04:24:37.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.325+0000 7f26928af000 1 Processor -- start 2024-08-31T04:24:37.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.325+0000 7f26928af000 1 -- start start 2024-08-31T04:24:37.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.325+0000 7f26928af000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667fdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.325+0000 7f26928af000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b86669ee90 0x55b8667fe4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.325+0000 7f26928af000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 0x55b8667fea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.325+0000 7f26928af000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f26841f9710 con 0x55b866688960 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.325+0000 7f26928af000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2684202950 con 0x55b86669ee90 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.325+0000 7f26928af000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2684201bb0 con 0x55b8666a93f0 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2683e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667fdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2683e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667fdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33260/0 (socket says 172.21.15.89:33260) 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2683e00640 1 -- 172.21.15.89:0/786041203 learned_addr learned my addr 172.21.15.89:0/786041203 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f267be00640 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b86669ee90 0x55b8667fe4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2689200640 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 0x55b8667fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2683e00640 1 -- 172.21.15.89:0/786041203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 msgr2=0x55b8667fea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2683e00640 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 0x55b8667fea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2683e00640 1 -- 172.21.15.89:0/786041203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b86669ee90 msgr2=0x55b8667fe4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2683e00640 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b86669ee90 0x55b8667fe4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2683e00640 1 -- 172.21.15.89:0/786041203 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86664d5b0 con 0x55b866688960 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f267be00640 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b86669ee90 0x55b8667fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:37.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2683e00640 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667fdfa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f267400f730 tx=0x7f2674018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8ce3bd65468969 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:37.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2673e00640 1 -- 172.21.15.89:0/786041203 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674029420 con 0x55b866688960 2024-08-31T04:24:37.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2673e00640 1 -- 172.21.15.89:0/786041203 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26740295c0 con 0x55b866688960 2024-08-31T04:24:37.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f2673e00640 1 -- 172.21.15.89:0/786041203 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26740299d0 con 0x55b866688960 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 -- 172.21.15.89:0/786041203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 msgr2=0x55b8667fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667fdfa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f267400f730 tx=0x7f2674018000 comp rx=0 tx=0).stop 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 -- 172.21.15.89:0/786041203 shutdown_connections 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b8666a93f0 0x55b8667fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b86669ee90 0x55b8667fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 --2- 172.21.15.89:0/786041203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b866688960 0x55b8667fdfa0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 -- 172.21.15.89:0/786041203 >> 172.21.15.89:0/786041203 conn(0x55b8662b0210 msgr2=0x55b8667a4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 -- 172.21.15.89:0/786041203 shutdown_connections 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 -- 172.21.15.89:0/786041203 wait complete. 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 -- start start 2024-08-31T04:24:37.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.329+0000 7f26928af000 1 Processor -- start 2024-08-31T04:24:37.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 0x55b866801b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 0x55b8668020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b8666a93f0 0x55b8668234e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b866572eb0 con 0x55b8666a93f0 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2684202280 con 0x55b866688960 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b866598f20 con 0x55b86669ee90 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 10 client.0 _ll_register_callbacks cb 0x7f266c059970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2689200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b8666a93f0 0x55b8668234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2689200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b8666a93f0 0x55b8668234e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33262/0 (socket says 172.21.15.89:33262) 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2689200640 1 -- 172.21.15.89:0/1874564264 learned_addr learned my addr 172.21.15.89:0/1874564264 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2683e00640 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 0x55b866801b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f267be00640 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 0x55b8668020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2689200640 1 -- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 msgr2=0x55b8668020b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2689200640 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 0x55b8668020b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2689200640 1 -- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 msgr2=0x55b866801b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2689200640 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 0x55b866801b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2689200640 1 -- 172.21.15.89:0/1874564264 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b866581fc0 con 0x55b8666a93f0 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2689200640 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b8666a93f0 0x55b8668234e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f267c0b9040 tx=0x7f267c004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ead267278bc22e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2671600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2671600640 1 -- 172.21.15.89:0/1874564264 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0b2070 con 0x55b8666a93f0 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2671600640 1 -- 172.21.15.89:0/1874564264 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f267c003980 con 0x55b8666a93f0 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 -- 172.21.15.89:0/1874564264 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26740295c0 con 0x55b8666a93f0 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2671600640 1 -- 172.21.15.89:0/1874564264 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f267c0cd050 con 0x55b8666a93f0 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 10 client.5637 fetch_fsmap learned FSMap version 9 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 -- 172.21.15.89:0/1874564264 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b86657ae00 con 0x55b8666a93f0 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2671600640 1 -- 172.21.15.89:0/1874564264 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26740295c0 con 0x55b8666a93f0 2024-08-31T04:24:37.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2671600640 1 -- 172.21.15.89:0/1874564264 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f267c0d0020 con 0x55b8666a93f0 2024-08-31T04:24:37.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 10 client.5637 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:24:37.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 10 client.5637 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:24:37.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 20 client.5637 populate_metadata read hostname 'smithi089' 2024-08-31T04:24:37.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b866282e20 0x55b866823d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:37.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 4 client.5637 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.1, "await_for": 45.0}] 2024-08-31T04:24:37.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f26928af000 1 -- 172.21.15.89:0/1874564264 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.1, "await_for": 45.0}) -- 0x55b8665ff210 con 0x55b866282e20 2024-08-31T04:24:37.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2683e00640 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b866282e20 0x55b866823d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:37.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2671600640 10 client.5637 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:24:37.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:37.333+0000 7f2683e00640 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b866282e20 0x55b866823d20 crc :-1 s=READY pgs=927 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dde5aa14aa6f5d2c server_cookie=a04cbef59be98515 in_seq=0 out_seq=0 2024-08-31T04:24:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f2671600640 1 -- 172.21.15.89:0/1874564264 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b8665ff210 con 0x55b866282e20 2024-08-31T04:24:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f2671600640 10 client.5637 handle_command_reply: tid=0 2024-08-31T04:24:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 client.5637 shutdown 2024-08-31T04:24:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 -- 172.21.15.89:0/1874564264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b8666a93f0 msgr2=0x55b8668234e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b8666a93f0 0x55b8668234e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f267c0b9040 tx=0x7f267c004dc0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 -- 172.21.15.89:0/1874564264 shutdown_connections 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b866282e20 0x55b866823d20 crc :-1 s=READY pgs=927 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b8666a93f0 0x55b8668234e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b86669ee90 0x55b8668020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 --2- 172.21.15.89:0/1874564264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b866688960 0x55b866801b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f2671600640 0 client.5637 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 -- 172.21.15.89:0/1874564264 >> 172.21.15.89:0/1874564264 conn(0x55b8662b0210 msgr2=0x55b866802c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 -- 172.21.15.89:0/1874564264 shutdown_connections 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 1 -- 172.21.15.89:0/1874564264 wait complete. 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f26928af000 20 client.5637 trim_cache size 0 max 16384 2024-08-31T04:24:39.599 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 66, 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "2595d7c4": { 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 66, 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:24:39.600 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 134.1, 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:39.601 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:24:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 -- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f26600720c0 msgr2=0x7f26600745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f26600720c0 0x7f26600745d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2674009680 tx=0x7f26740091e0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 -- 172.21.15.89:0/364253621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26840c1ed0 msgr2=0x7f2684162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26840c1ed0 0x7f2684162560 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c390 tx=0x7f266c00c850 comp rx=0 tx=0).stop 2024-08-31T04:24:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 -- 172.21.15.89:0/364253621 shutdown_connections 2024-08-31T04:24:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f26600720c0 0x7f26600745d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26840c1ed0 0x7f2684162560 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26840c90e0 0x7f2684140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 --2- 172.21.15.89:0/364253621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840b2860 0x7f26840cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 -- 172.21.15.89:0/364253621 >> 172.21.15.89:0/364253621 conn(0x7f26840c99b0 msgr2=0x7f2684156440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 -- 172.21.15.89:0/364253621 shutdown_connections 2024-08-31T04:24:39.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:39.597+0000 7f268b200640 1 -- 172.21.15.89:0/364253621 wait complete. 2024-08-31T04:24:39.618 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2595d7c4', quiesce took 2.9 seconds. Will release after: 11.2 2024-08-31T04:24:50.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:24:50.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 -- 172.21.15.89:0/3923018775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f112415bc70 msgr2=0x7f1124152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:50.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 --2- 172.21.15.89:0/3923018775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f112415bc70 0x7f1124152a10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1114009900 tx=0x7f111401f0d0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 -- 172.21.15.89:0/3923018775 shutdown_connections 2024-08-31T04:24:50.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 --2- 172.21.15.89:0/3923018775 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11240c9330 0x7f1124074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 --2- 172.21.15.89:0/3923018775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f112415bc70 0x7f1124152a10 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 -- 172.21.15.89:0/3923018775 >> 172.21.15.89:0/3923018775 conn(0x7f11240ccf20 msgr2=0x7f11240cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:50.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 -- 172.21.15.89:0/3923018775 shutdown_connections 2024-08-31T04:24:50.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 -- 172.21.15.89:0/3923018775 wait complete. 2024-08-31T04:24:50.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 Processor -- start 2024-08-31T04:24:50.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 -- start start 2024-08-31T04:24:50.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11240c1f40 0x7f11241558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11240c9330 0x7f11241f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f112415bc70 0x7f11241e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f11240c8030 con 0x7f11240c1f40 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f11240c3150 con 0x7f112415bc70 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.985+0000 7f112b200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1124074c60 con 0x7f11240c9330 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11240c1f40 0x7f11241558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11240c1f40 0x7f11241558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43848/0 (socket says 172.21.15.89:43848) 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123e00640 1 -- 172.21.15.89:0/837155285 learned_addr learned my addr 172.21.15.89:0/837155285 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123400640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11240c9330 0x7f11241f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1129200640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f112415bc70 0x7f11241e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:50.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123e00640 1 -- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11240c9330 msgr2=0x7f11241f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:50.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123e00640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11240c9330 0x7f11241f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123e00640 1 -- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f112415bc70 msgr2=0x7f11241e1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:50.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123e00640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f112415bc70 0x7f11241e1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:50.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123e00640 1 -- 172.21.15.89:0/837155285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1124155e20 con 0x7f11240c1f40 2024-08-31T04:24:50.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f1123e00640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11240c1f40 0x7f11241558e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f11140099f0 tx=0x7f11140056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:50.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f111be00640 1 -- 172.21.15.89:0/837155285 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11140b5040 con 0x7f11240c1f40 2024-08-31T04:24:50.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f111be00640 1 -- 172.21.15.89:0/837155285 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1114003600 con 0x7f11240c1f40 2024-08-31T04:24:50.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11240c60a0 con 0x7f11240c1f40 2024-08-31T04:24:50.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f111be00640 1 -- 172.21.15.89:0/837155285 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11140039b0 con 0x7f11240c1f40 2024-08-31T04:24:50.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11240c4c00 con 0x7f11240c1f40 2024-08-31T04:24:50.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1124074720 con 0x7f11240c1f40 2024-08-31T04:24:50.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.989+0000 7f111be00640 1 -- 172.21.15.89:0/837155285 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f11140c2020 con 0x7f11240c1f40 2024-08-31T04:24:50.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.993+0000 7f111be00640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11040720c0 0x7f11040745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:50.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.993+0000 7f111be00640 1 -- 172.21.15.89:0/837155285 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f1114130a40 con 0x7f11240c1f40 2024-08-31T04:24:50.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.993+0000 7f1123400640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11040720c0 0x7f11040745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:50.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.993+0000 7f1123400640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11040720c0 0x7f11040745d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1110000f70 tx=0x7f1110009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:50.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:50.997+0000 7f111be00640 1 -- 172.21.15.89:0/837155285 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1114018c30 con 0x7f11240c1f40 2024-08-31T04:24:51.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.197+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11240c51b0 con 0x7f11240c1f40 2024-08-31T04:24:51.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.197+0000 7f111be00640 1 -- 172.21.15.89:0/837155285 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f11140fbfb0 con 0x7f11240c1f40 2024-08-31T04:24:51.198 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:24:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:24:51.199 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11040720c0 msgr2=0x7f11040745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11040720c0 0x7f11040745d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1110000f70 tx=0x7f1110009040 comp rx=0 tx=0).stop 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11240c1f40 msgr2=0x7f11241558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11240c1f40 0x7f11241558e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f11140099f0 tx=0x7f11140056e0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 shutdown_connections 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11040720c0 0x7f11040745d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f112415bc70 0x7f11241e1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11240c9330 0x7f11241f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 --2- 172.21.15.89:0/837155285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11240c1f40 0x7f11241558e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 >> 172.21.15.89:0/837155285 conn(0x7f11240ccf20 msgr2=0x7f11240c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:51.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 shutdown_connections 2024-08-31T04:24:51.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.201+0000 7f112b200640 1 -- 172.21.15.89:0/837155285 wait complete. 2024-08-31T04:24:51.221 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 2595d7c4 --release --await' 2024-08-31T04:24:51.222 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 2595d7c4 --release --await 2024-08-31T04:24:51.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 -- 172.21.15.89:0/1952161947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbddc0ca660 msgr2=0x7fbddc074820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 --2- 172.21.15.89:0/1952161947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbddc0ca660 0x7fbddc074820 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009bc0 tx=0x7fbdd001cba0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 -- 172.21.15.89:0/1952161947 shutdown_connections 2024-08-31T04:24:51.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 --2- 172.21.15.89:0/1952161947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbddc0c8b90 0x7fbddc0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 --2- 172.21.15.89:0/1952161947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbddc0ca660 0x7fbddc074820 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 -- 172.21.15.89:0/1952161947 >> 172.21.15.89:0/1952161947 conn(0x7fbddc0c99b0 msgr2=0x7fbddc0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:51.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 -- 172.21.15.89:0/1952161947 shutdown_connections 2024-08-31T04:24:51.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 -- 172.21.15.89:0/1952161947 wait complete. 2024-08-31T04:24:51.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 Processor -- start 2024-08-31T04:24:51.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.385+0000 7fbde3000640 1 -- start start 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde3000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbddc0c1ed0 0x7fbddc1f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde3000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbddc0c8b90 0x7fbddc154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde3000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbddc0ca660 0x7fbddc14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde3000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc074ee0 con 0x7fbddc0ca660 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde3000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc074d60 con 0x7fbddc0c8b90 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde3000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbddc152a00 con 0x7fbddc0c1ed0 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde2600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbddc0ca660 0x7fbddc14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde2600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbddc0ca660 0x7fbddc14e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43864/0 (socket says 172.21.15.89:43864) 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde2600640 1 -- 172.21.15.89:0/2923463696 learned_addr learned my addr 172.21.15.89:0/2923463696 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:51.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde1c00640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbddc0c1ed0 0x7fbddc1f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde1200640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbddc0c8b90 0x7fbddc154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde2600640 1 -- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbddc0c1ed0 msgr2=0x7fbddc1f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde2600640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbddc0c1ed0 0x7fbddc1f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde2600640 1 -- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbddc0c8b90 msgr2=0x7fbddc154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde2600640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbddc0c8b90 0x7fbddc154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde2600640 1 -- 172.21.15.89:0/2923463696 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc1f6dc0 con 0x7fbddc0ca660 2024-08-31T04:24:51.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde2600640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbddc0ca660 0x7fbddc14e2e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400e740 tx=0x7fbdd400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:51.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbdd9600640 1 -- 172.21.15.89:0/2923463696 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd400cc60 con 0x7fbddc0ca660 2024-08-31T04:24:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbdd9600640 1 -- 172.21.15.89:0/2923463696 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdd400ee50 con 0x7fbddc0ca660 2024-08-31T04:24:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbdd9600640 1 -- 172.21.15.89:0/2923463696 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4010670 con 0x7fbddc0ca660 2024-08-31T04:24:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde3000640 1 -- 172.21.15.89:0/2923463696 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc149dd0 con 0x7fbddc0ca660 2024-08-31T04:24:51.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.389+0000 7fbde3000640 1 -- 172.21.15.89:0/2923463696 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbddc14a3f0 con 0x7fbddc0ca660 2024-08-31T04:24:51.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdd9600640 1 -- 172.21.15.89:0/2923463696 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbdd4010810 con 0x7fbddc0ca660 2024-08-31T04:24:51.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdd9600640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdbc0720f0 0x7fbdbc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdd9600640 1 -- 172.21.15.89:0/2923463696 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fbdd4093aa0 con 0x7fbddc0ca660 2024-08-31T04:24:51.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdebd0f000 1 Processor -- start 2024-08-31T04:24:51.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbde1c00640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdbc0720f0 0x7fbdbc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdebd0f000 1 -- start start 2024-08-31T04:24:51.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbde1c00640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdbc0720f0 0x7fbdbc074600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00af000 tx=0x7fbdd001b3e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a283521950 0x55a283644290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a283648f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2834fc890 0x55a283649470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a2834eaf30 con 0x55a283521950 2024-08-31T04:24:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a283460690 con 0x55a2834fc890 2024-08-31T04:24:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.393+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a28344fc20 con 0x55a28350b930 2024-08-31T04:24:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a283521950 0x55a283644290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a283521950 0x55a283644290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43874/0 (socket says 172.21.15.89:43874) 2024-08-31T04:24:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1c00640 1 -- 172.21.15.89:0/542360413 learned_addr learned my addr 172.21.15.89:0/542360413 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde2600640 1 --2- 172.21.15.89:0/542360413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2834fc890 0x55a283649470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1200640 1 --2- 172.21.15.89:0/542360413 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a283648f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1c00640 1 -- 172.21.15.89:0/542360413 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 msgr2=0x55a283648f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1c00640 1 --2- 172.21.15.89:0/542360413 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a283648f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1c00640 1 -- 172.21.15.89:0/542360413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2834fc890 msgr2=0x55a283649470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1c00640 1 --2- 172.21.15.89:0/542360413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2834fc890 0x55a283649470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1c00640 1 -- 172.21.15.89:0/542360413 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2834048f0 con 0x55a283521950 2024-08-31T04:24:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbde1c00640 1 --2- 172.21.15.89:0/542360413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a283521950 0x55a283644290 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0000f90 tx=0x7fbdd00b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0dc1f39c39f7df7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdce000640 1 -- 172.21.15.89:0/542360413 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00b2040 con 0x55a283521950 2024-08-31T04:24:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdce000640 1 -- 172.21.15.89:0/542360413 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdd00c7070 con 0x55a283521950 2024-08-31T04:24:51.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdce000640 1 -- 172.21.15.89:0/542360413 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0004040 con 0x55a283521950 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 -- 172.21.15.89:0/542360413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a283521950 msgr2=0x55a283644290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/542360413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a283521950 0x55a283644290 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0000f90 tx=0x7fbdd00b5000 comp rx=0 tx=0).stop 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 -- 172.21.15.89:0/542360413 shutdown_connections 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/542360413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a2834fc890 0x55a283649470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/542360413 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a283648f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/542360413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a283521950 0x55a283644290 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 -- 172.21.15.89:0/542360413 >> 172.21.15.89:0/542360413 conn(0x55a283521540 msgr2=0x55a283646cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 -- 172.21.15.89:0/542360413 shutdown_connections 2024-08-31T04:24:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 -- 172.21.15.89:0/542360413 wait complete. 2024-08-31T04:24:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 -- start start 2024-08-31T04:24:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.397+0000 7fbdebd0f000 1 Processor -- start 2024-08-31T04:24:51.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28360e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a28350b930 0x55a28360ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a283521950 0x55a28360f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a2833d6500 con 0x55a2834fc890 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a283453bd0 con 0x55a28350b930 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a2833f7a30 con 0x55a283521950 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 10 client.0 _ll_register_callbacks cb 0x55a283505b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28360e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28360e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43882/0 (socket says 172.21.15.89:43882) 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1c00640 1 -- 172.21.15.89:0/117345092 learned_addr learned my addr 172.21.15.89:0/117345092 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1200640 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a28350b930 0x55a28360ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde2600640 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a283521950 0x55a28360f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1c00640 1 -- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a283521950 msgr2=0x55a28360f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1c00640 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a283521950 0x55a28360f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1c00640 1 -- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a28350b930 msgr2=0x55a28360ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1c00640 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a28350b930 0x55a28360ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1c00640 1 -- 172.21.15.89:0/117345092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2833ef6a0 con 0x55a2834fc890 2024-08-31T04:24:51.403 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1c00640 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28360e910 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00c4040 tx=0x7fbdd0003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8972ec099513 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdc2a00640 1 -- 172.21.15.89:0/117345092 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00b2040 con 0x55a2834fc890 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdc2a00640 1 -- 172.21.15.89:0/117345092 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fbdd0004240 con 0x55a2834fc890 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 -- 172.21.15.89:0/117345092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a2833e97e0 con 0x55a2834fc890 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdc2a00640 1 -- 172.21.15.89:0/117345092 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbdd00dd050 con 0x55a2834fc890 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 10 client.5655 fetch_fsmap learned FSMap version 9 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 -- 172.21.15.89:0/117345092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a28340e1c0 con 0x55a2834fc890 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdc2a00640 1 -- 172.21.15.89:0/117345092 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a2833e97e0 con 0x55a2834fc890 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdc2a00640 1 -- 172.21.15.89:0/117345092 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fbdd00e0020 con 0x55a2834fc890 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 10 client.5655 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 10 client.5655 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 20 client.5655 populate_metadata read hostname 'smithi089' 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a2834e5fc0 0x55a28365d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 4 client.5655 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:51.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbdebd0f000 1 -- 172.21.15.89:0/117345092 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2834625e0 con 0x55a2834e5fc0 2024-08-31T04:24:51.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.401+0000 7fbde1200640 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a2834e5fc0 0x55a28365d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdc2a00640 10 client.5655 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbde1200640 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a2834e5fc0 0x55a28365d100 crc :-1 s=READY pgs=934 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aa23184d239ccd4 server_cookie=bed798e3fd91aeda in_seq=0 out_seq=0 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdc2a00640 1 -- 172.21.15.89:0/117345092 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2834625e0 con 0x55a2834e5fc0 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdc2a00640 10 client.5655 handle_command_reply: tid=0 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 client.5655 shutdown 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 -- 172.21.15.89:0/117345092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 msgr2=0x55a28360e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28360e910 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00c4040 tx=0x7fbdd0003f20 comp rx=0 tx=0).stop 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 -- 172.21.15.89:0/117345092 shutdown_connections 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a2834e5fc0 0x55a28365d100 crc :-1 s=READY pgs=934 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a283521950 0x55a28360f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a28350b930 0x55a28360ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdc2a00640 0 client.5655 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:24:51.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/117345092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28360e910 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 -- 172.21.15.89:0/117345092 >> 172.21.15.89:0/117345092 conn(0x55a283521540 msgr2=0x55a2836456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:51.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 -- 172.21.15.89:0/117345092 shutdown_connections 2024-08-31T04:24:51.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 1 -- 172.21.15.89:0/117345092 wait complete. 2024-08-31T04:24:51.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.405+0000 7fbdebd0f000 20 client.5655 trim_cache size 0 max 16384 2024-08-31T04:24:51.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 Processor -- start 2024-08-31T04:24:51.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 -- start start 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a28365c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 0x55a28365cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1ff6a0 con 0x55a2834fc890 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1fe580 con 0x55a283521950 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbddc0c6190 con 0x55a28350b930 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43896/0 (socket says 172.21.15.89:43896) 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1c00640 1 -- 172.21.15.89:0/1154176199 learned_addr learned my addr 172.21.15.89:0/1154176199 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:51.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde2600640 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 0x55a28365cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1200640 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a28365c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1c00640 1 -- 172.21.15.89:0/1154176199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 msgr2=0x55a28365c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1c00640 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a28365c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1c00640 1 -- 172.21.15.89:0/1154176199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 msgr2=0x55a28365cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1c00640 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 0x55a28365cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1c00640 1 -- 172.21.15.89:0/1154176199 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2834d42f0 con 0x55a2834fc890 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde2600640 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 0x55a28365cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbde1c00640 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365c100 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbdd001c9d0 tx=0x7fbdd0009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4688f2027ad10e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdcd600640 1 -- 172.21.15.89:0/1154176199 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0004240 con 0x55a2834fc890 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdcd600640 1 -- 172.21.15.89:0/1154176199 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdd00c7040 con 0x55a2834fc890 2024-08-31T04:24:51.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdcd600640 1 -- 172.21.15.89:0/1154176199 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00ae790 con 0x55a2834fc890 2024-08-31T04:24:51.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 -- 172.21.15.89:0/1154176199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 msgr2=0x55a28365c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365c100 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbdd001c9d0 tx=0x7fbdd0009a40 comp rx=0 tx=0).stop 2024-08-31T04:24:51.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 -- 172.21.15.89:0/1154176199 shutdown_connections 2024-08-31T04:24:51.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 0x55a28365cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a28365c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/1154176199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365c100 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 -- 172.21.15.89:0/1154176199 >> 172.21.15.89:0/1154176199 conn(0x55a283521540 msgr2=0x55a283608e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 -- 172.21.15.89:0/1154176199 shutdown_connections 2024-08-31T04:24:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.425+0000 7fbdebd0f000 1 -- 172.21.15.89:0/1154176199 wait complete. 2024-08-31T04:24:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 -- start start 2024-08-31T04:24:51.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 Processor -- start 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a283660130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 0x55a283683650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1fd250 con 0x55a2834fc890 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1fdeb0 con 0x55a283521950 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbddc1fd7e0 con 0x55a28350b930 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 10 client.0 _ll_register_callbacks cb 0x7fbdd400cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43904/0 (socket says 172.21.15.89:43904) 2024-08-31T04:24:51.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1c00640 1 -- 172.21.15.89:0/3062304235 learned_addr learned my addr 172.21.15.89:0/3062304235 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde2600640 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 0x55a283683650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1200640 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a283660130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1c00640 1 -- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 msgr2=0x55a283660130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1c00640 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a283660130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1c00640 1 -- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 msgr2=0x55a283683650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1c00640 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 0x55a283683650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1c00640 1 -- 172.21.15.89:0/3062304235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2833d9b30 con 0x55a2834fc890 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1200640 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a283660130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbde1c00640 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365fbf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00a8020 tx=0x7fbdd00043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e9de7d6c7847c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdc2a00640 1 -- 172.21.15.89:0/3062304235 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00e7060 con 0x55a2834fc890 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdc2a00640 1 -- 172.21.15.89:0/3062304235 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fbdd00ae6d0 con 0x55a2834fc890 2024-08-31T04:24:51.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 -- 172.21.15.89:0/3062304235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdd00c7040 con 0x55a2834fc890 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdc2a00640 1 -- 172.21.15.89:0/3062304235 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbdd0004830 con 0x55a2834fc890 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 10 client.5661 fetch_fsmap learned FSMap version 9 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdebd0f000 1 -- 172.21.15.89:0/3062304235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a2833e6c70 con 0x55a2834fc890 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdc2a00640 1 -- 172.21.15.89:0/3062304235 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdd00c7040 con 0x55a2834fc890 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.429+0000 7fbdc2a00640 1 -- 172.21.15.89:0/3062304235 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fbdd00e0030 con 0x55a2834fc890 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.433+0000 7fbdebd0f000 10 client.5661 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.433+0000 7fbdebd0f000 10 client.5661 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.433+0000 7fbdebd0f000 20 client.5661 populate_metadata read hostname 'smithi089' 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.433+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a2830e1e80 0x55a283683b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.433+0000 7fbdebd0f000 4 client.5661 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2595d7c4", "release": true, "await": true}] 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.433+0000 7fbdebd0f000 1 -- 172.21.15.89:0/3062304235 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2595d7c4", "release": true, "await": true}) -- 0x55a28345e080 con 0x55a2830e1e80 2024-08-31T04:24:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.433+0000 7fbde1200640 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a2830e1e80 0x55a283683b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:51.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.433+0000 7fbde1200640 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a2830e1e80 0x55a283683b90 crc :-1 s=READY pgs=935 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b366febd9023607d server_cookie=fd880941661307a1 in_seq=0 out_seq=0 2024-08-31T04:24:51.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.433+0000 7fbdc2a00640 10 client.5661 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:24:51.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdc2a00640 1 -- 172.21.15.89:0/3062304235 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a28345e080 con 0x55a2830e1e80 2024-08-31T04:24:51.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdc2a00640 10 client.5661 handle_command_reply: tid=0 2024-08-31T04:24:51.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 client.5661 shutdown 2024-08-31T04:24:51.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 -- 172.21.15.89:0/3062304235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 msgr2=0x55a28365fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365fbf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00a8020 tx=0x7fbdd00043d0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 -- 172.21.15.89:0/3062304235 shutdown_connections 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a2830e1e80 0x55a283683b90 crc :-1 s=READY pgs=935 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a283521950 0x55a283683650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a28350b930 0x55a283660130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdc2a00640 0 client.5661 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 --2- 172.21.15.89:0/3062304235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a2834fc890 0x55a28365fbf0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 -- 172.21.15.89:0/3062304235 >> 172.21.15.89:0/3062304235 conn(0x55a283521540 msgr2=0x55a283608e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 -- 172.21.15.89:0/3062304235 shutdown_connections 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 1 -- 172.21.15.89:0/3062304235 wait complete. 2024-08-31T04:24:51.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbdebd0f000 20 client.5661 trim_cache size 0 max 16384 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 68, 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout: "2595d7c4": { 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 68, 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:24:51.535 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 134.1, 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:24:51.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:51.537 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:51.537 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:51.537 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:51.537 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:24:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:24:51.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 -- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdbc0720f0 msgr2=0x7fbdbc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdbc0720f0 0x7fbdbc074600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00af000 tx=0x7fbdd001b3e0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 -- 172.21.15.89:0/2923463696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbddc0ca660 msgr2=0x7fbddc14e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbddc0ca660 0x7fbddc14e2e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400e740 tx=0x7fbdd400ec00 comp rx=0 tx=0).stop 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 -- 172.21.15.89:0/2923463696 shutdown_connections 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbdbc0720f0 0x7fbdbc074600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbddc0ca660 0x7fbddc14e2e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbddc0c8b90 0x7fbddc154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 --2- 172.21.15.89:0/2923463696 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbddc0c1ed0 0x7fbddc1f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 -- 172.21.15.89:0/2923463696 >> 172.21.15.89:0/2923463696 conn(0x7fbddc0c99b0 msgr2=0x7fbddc073540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 -- 172.21.15.89:0/2923463696 shutdown_connections 2024-08-31T04:24:51.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:24:51.533+0000 7fbde3000640 1 -- 172.21.15.89:0/2923463696 wait complete. 2024-08-31T04:24:51.553 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2595d7c4', total seconds elapsed: 14.8 2024-08-31T04:25:00.977 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 12% (67/537) Updating files: 13% (70/537) Updating files: 14% (76/537) Updating files: 15% (81/537) Updating files: 16% (86/537) Updating files: 17% (92/537) Updating files: 18% (97/537) Updating files: 19% (103/537) Updating files: 19% (106/537) Updating files: 20% (108/537) Updating files: 21% (113/537) Updating files: 22% (119/537) Updating files: 23% (124/537) Updating files: 24% (129/537) Updating files: 25% (135/537) Updating files: 26% (140/537) Updating files: 27% (145/537) Updating files: 28% (151/537) Updating files: 29% (156/537) Updating files: 30% (162/537) Updating files: 31% (167/537) Updating files: 32% (172/537) Updating files: 33% (178/537) Updating files: 34% (183/537) Updating files: 35% (188/537) Updating files: 36% (194/537) Updating files: 37% (199/537) Updating files: 38% (205/537) Updating files: 39% (210/537) Updating files: 40% (215/537) Updating files: 41% (221/537) Updating files: 42% (226/537) Updating files: 43% (231/537) Updating files: 43% (233/537) Updating files: 44% (237/537) Updating files: 45% (242/537) Updating files: 46% (248/537) Updating files: 46% (250/537) Updating files: 47% (253/537) Updating files: 48% (258/537) Updating files: 49% (264/537) Updating files: 49% (266/537) Updating files: 50% (269/537) Updating files: 51% (274/537) Updating files: 52% (280/537) Updating files: 53% (285/537) Updating files: 54% (290/537) Updating files: 55% (296/537) Updating files: 56% (301/537) Updating files: 57% (307/537) Updating files: 58% (312/537) Updating files: 59% (317/537) Updating files: 60% (323/537) Updating files: 61% (328/537) Updating files: 62% (333/537) Updating files: 63% (339/537) Updating files: 64% (344/537) Updating files: 65% (350/537) Updating files: 66% (355/537) Updating files: 67% (360/537) Updating files: 68% (366/537) Updating files: 68% (369/537) Updating files: 69% (371/537) Updating files: 70% (376/537) Updating files: 71% (382/537) Updating files: 72% (387/537) Updating files: 73% (393/537) Updating files: 74% (398/537) Updating files: 75% (403/537) Updating files: 76% (409/537) Updating files: 77% (414/537) Updating files: 78% (419/537) Updating files: 79% (425/537) Updating files: 80% (430/537) Updating files: 80% (434/537) Updating files: 81% (435/537) Updating files: 82% (441/537) Updating files: 83% (446/537) Updating files: 84% (452/537) Updating files: 85% (457/537) Updating files: 86% (462/537) Updating files: 87% (468/537) Updating files: 87% (470/537) Updating files: 88% (473/537) Updating files: 89% (478/537) Updating files: 90% (484/537) Updating files: 91% (489/537) Updating files: 92% (495/537) Updating files: 93% (500/537) Updating files: 94% (505/537) Updating files: 95% (511/537) Updating files: 96% (516/537) Updating files: 97% (521/537) Updating files: 98% (527/537) Updating files: 99% (532/537) Updating files: 100% (537/537) Updating files: 100% (537/537), done. 2024-08-31T04:25:01.088 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 090436f56ac v0.21 2024-08-31T04:25:01.163 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.21 2024-08-31T04:25:01.174 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 22 -eq 48 ] 2024-08-31T04:25:01.175 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.22 2024-08-31T04:25:01.175 INFO:tasks.workunit.client.0.smithi089.stdout:v0.22 2024-08-31T04:25:01.175 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.22 2024-08-31T04:25:01.175 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.22 2024-08-31T04:25:08.860 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 30% (63/204) Updating files: 31% (64/204) Updating files: 32% (66/204) Updating files: 33% (68/204) Updating files: 34% (70/204) Updating files: 35% (72/204) Updating files: 36% (74/204) Updating files: 37% (76/204) Updating files: 37% (77/204) Updating files: 38% (78/204) Updating files: 39% (80/204) Updating files: 40% (82/204) Updating files: 41% (84/204) Updating files: 42% (86/204) Updating files: 43% (88/204) Updating files: 44% (90/204) Updating files: 45% (92/204) Updating files: 46% (94/204) Updating files: 47% (96/204) Updating files: 48% (98/204) Updating files: 49% (100/204) Updating files: 50% (102/204) Updating files: 51% (105/204) Updating files: 52% (107/204) Updating files: 53% (109/204) Updating files: 54% (111/204) Updating files: 55% (113/204) Updating files: 56% (115/204) Updating files: 57% (117/204) Updating files: 58% (119/204) Updating files: 59% (121/204) Updating files: 60% (123/204) Updating files: 61% (125/204) Updating files: 62% (127/204) Updating files: 63% (129/204) Updating files: 64% (131/204) Updating files: 65% (133/204) Updating files: 66% (135/204) Updating files: 67% (137/204) Updating files: 68% (139/204) Updating files: 69% (141/204) Updating files: 70% (143/204) Updating files: 71% (145/204) Updating files: 72% (147/204) Updating files: 73% (149/204) Updating files: 74% (151/204) Updating files: 75% (153/204) Updating files: 76% (156/204) Updating files: 77% (158/204) Updating files: 78% (160/204) Updating files: 78% (161/204) Updating files: 79% (162/204) Updating files: 80% (164/204) Updating files: 81% (166/204) Updating files: 82% (168/204) Updating files: 83% (170/204) Updating files: 84% (172/204) Updating files: 85% (174/204) Updating files: 86% (176/204) Updating files: 87% (178/204) Updating files: 88% (180/204) Updating files: 89% (182/204) Updating files: 90% (184/204) Updating files: 91% (186/204) Updating files: 92% (188/204) Updating files: 93% (190/204) Updating files: 94% (192/204) Updating files: 95% (194/204) Updating files: 96% (196/204) Updating files: 97% (198/204) Updating files: 98% (200/204) Updating files: 99% (202/204) Updating files: 100% (204/204) Updating files: 100% (204/204), done. 2024-08-31T04:25:08.952 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 8a7c95f60ad v0.22 2024-08-31T04:25:08.957 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.22 2024-08-31T04:25:09.058 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 23 -eq 48 ] 2024-08-31T04:25:09.059 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.23 2024-08-31T04:25:09.059 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.23 2024-08-31T04:25:09.059 INFO:tasks.workunit.client.0.smithi089.stdout:v0.23 2024-08-31T04:25:09.059 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.23 2024-08-31T04:25:12.265 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 7% (13/163) Updating files: 8% (14/163) Updating files: 9% (15/163) Updating files: 10% (17/163) Updating files: 11% (18/163) Updating files: 12% (20/163) Updating files: 13% (22/163) Updating files: 14% (23/163) Updating files: 15% (25/163) Updating files: 16% (27/163) Updating files: 17% (28/163) Updating files: 18% (30/163) Updating files: 19% (31/163) Updating files: 20% (33/163) Updating files: 21% (35/163) Updating files: 22% (36/163) Updating files: 23% (38/163) Updating files: 24% (40/163) Updating files: 25% (41/163) Updating files: 26% (43/163) Updating files: 27% (45/163) Updating files: 28% (46/163) Updating files: 29% (48/163) Updating files: 30% (49/163) Updating files: 31% (51/163) Updating files: 32% (53/163) Updating files: 33% (54/163) Updating files: 34% (56/163) Updating files: 35% (58/163) Updating files: 36% (59/163) Updating files: 37% (61/163) Updating files: 38% (62/163) Updating files: 39% (64/163) Updating files: 40% (66/163) Updating files: 41% (67/163) Updating files: 42% (69/163) Updating files: 43% (71/163) Updating files: 44% (72/163) Updating files: 45% (74/163) Updating files: 46% (75/163) Updating files: 47% (77/163) Updating files: 48% (79/163) Updating files: 49% (80/163) Updating files: 50% (82/163) Updating files: 51% (84/163) Updating files: 52% (85/163) Updating files: 53% (87/163) Updating files: 54% (89/163) Updating files: 55% (90/163) Updating files: 56% (92/163) Updating files: 57% (93/163) Updating files: 58% (95/163) Updating files: 59% (97/163) Updating files: 60% (98/163) Updating files: 61% (100/163) Updating files: 62% (102/163) Updating files: 63% (103/163) Updating files: 64% (105/163) Updating files: 65% (106/163) Updating files: 66% (108/163) Updating files: 67% (110/163) Updating files: 68% (111/163) Updating files: 69% (113/163) Updating files: 70% (115/163) Updating files: 71% (116/163) Updating files: 72% (118/163) Updating files: 73% (119/163) Updating files: 74% (121/163) Updating files: 75% (123/163) Updating files: 76% (124/163) Updating files: 77% (126/163) Updating files: 77% (127/163) Updating files: 78% (128/163) Updating files: 79% (129/163) Updating files: 80% (131/163) Updating files: 81% (133/163) Updating files: 82% (134/163) Updating files: 83% (136/163) Updating files: 84% (137/163) Updating files: 85% (139/163) Updating files: 86% (141/163) Updating files: 87% (142/163) Updating files: 88% (144/163) Updating files: 89% (146/163) Updating files: 90% (147/163) Updating files: 91% (149/163) Updating files: 92% (150/163) Updating files: 93% (152/163) Updating files: 94% (154/163) Updating files: 95% (155/163) Updating files: 96% (157/163) Updating files: 97% (159/163) Updating files: 98% (160/163) Updating files: 99% (162/163) Updating files: 100% (163/163) Updating files: 100% (163/163), done. 2024-08-31T04:25:12.329 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 5d1d8d0c460 v0.23 2024-08-31T04:25:12.335 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.23 2024-08-31T04:25:12.709 INFO:tasks.workunit.client.0.smithi089.stdout:v0.24 2024-08-31T04:25:12.709 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 24 -eq 48 ] 2024-08-31T04:25:12.709 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.24 2024-08-31T04:25:12.709 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.24 2024-08-31T04:25:12.709 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.24 2024-08-31T04:25:15.383 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 57% (106/185) Updating files: 58% (108/185) Updating files: 59% (110/185) Updating files: 60% (111/185) Updating files: 61% (113/185) Updating files: 62% (115/185) Updating files: 63% (117/185) Updating files: 64% (119/185) Updating files: 65% (121/185) Updating files: 66% (123/185) Updating files: 67% (124/185) Updating files: 68% (126/185) Updating files: 69% (128/185) Updating files: 70% (130/185) Updating files: 71% (132/185) Updating files: 72% (134/185) Updating files: 73% (136/185) Updating files: 74% (137/185) Updating files: 75% (139/185) Updating files: 76% (141/185) Updating files: 77% (143/185) Updating files: 78% (145/185) Updating files: 79% (147/185) Updating files: 80% (148/185) Updating files: 81% (150/185) Updating files: 82% (152/185) Updating files: 83% (154/185) Updating files: 84% (156/185) Updating files: 85% (158/185) Updating files: 86% (160/185) Updating files: 87% (161/185) Updating files: 88% (163/185) Updating files: 89% (165/185) Updating files: 90% (167/185) Updating files: 91% (169/185) Updating files: 92% (171/185) Updating files: 93% (173/185) Updating files: 94% (174/185) Updating files: 95% (176/185) Updating files: 96% (178/185) Updating files: 97% (180/185) Updating files: 98% (182/185) Updating files: 99% (184/185) Updating files: 100% (185/185) Updating files: 100% (185/185), done. 2024-08-31T04:25:15.449 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 180a4176035 v0.24 2024-08-31T04:25:15.454 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.24 2024-08-31T04:25:15.497 INFO:tasks.workunit.client.0.smithi089.stdout:v0.25 2024-08-31T04:25:15.497 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 25 -eq 48 ] 2024-08-31T04:25:15.497 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.25 2024-08-31T04:25:15.497 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.25 2024-08-31T04:25:15.497 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.25 2024-08-31T04:25:17.740 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:25:17.740 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-31T04:25:17.741 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:25:17.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.908+0000 7f0dbda00640 1 -- 172.21.15.89:0/180327626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db815d9f0 msgr2=0x7f0db80cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.908+0000 7f0dbda00640 1 --2- 172.21.15.89:0/180327626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db815d9f0 0x7f0db80cee10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009bc0 tx=0x7f0db001f3b0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.908+0000 7f0dbda00640 1 -- 172.21.15.89:0/180327626 shutdown_connections 2024-08-31T04:25:17.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.908+0000 7f0dbda00640 1 --2- 172.21.15.89:0/180327626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db815d9f0 0x7f0db80cee10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.908+0000 7f0dbda00640 1 --2- 172.21.15.89:0/180327626 >> v2:172.21.15.170:3300/0 conn(0x7f0db80ca0e0 0x7f0db80c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.908+0000 7f0dbda00640 1 -- 172.21.15.89:0/180327626 >> 172.21.15.89:0/180327626 conn(0x7f0db806cc30 msgr2=0x7f0db806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:17.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 -- 172.21.15.89:0/180327626 shutdown_connections 2024-08-31T04:25:17.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 -- 172.21.15.89:0/180327626 wait complete. 2024-08-31T04:25:17.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 Processor -- start 2024-08-31T04:25:17.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 -- start start 2024-08-31T04:25:17.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80ca0e0 0x7f0db814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:17.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db80ca930 0x7f0db814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:17.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db815d9f0 0x7f0db81e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0db80b1c90 con 0x7f0db80ca0e0 2024-08-31T04:25:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0db815d4d0 con 0x7f0db815d9f0 2024-08-31T04:25:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0dbda00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0db814e7e0 con 0x7f0db80ca930 2024-08-31T04:25:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0db7e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80ca0e0 0x7f0db814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.912+0000 7f0db7e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80ca0e0 0x7f0db814ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44274/0 (socket says 172.21.15.89:44274) 2024-08-31T04:25:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0db7e00640 1 -- 172.21.15.89:0/3699719853 learned_addr learned my addr 172.21.15.89:0/3699719853 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0db7400640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db80ca930 0x7f0db814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0dbd000640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db815d9f0 0x7f0db81e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:17.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0db7e00640 1 -- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db80ca930 msgr2=0x7f0db814f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0db7e00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db80ca930 0x7f0db814f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0db7e00640 1 -- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db815d9f0 msgr2=0x7f0db81e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0db7e00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db815d9f0 0x7f0db81e6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0db7e00640 1 -- 172.21.15.89:0/3699719853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db814e310 con 0x7f0db80ca0e0 2024-08-31T04:25:17.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0db7e00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80ca0e0 0x7f0db814ddd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c430 tx=0x7f0da800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:17.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0dafe00640 1 -- 172.21.15.89:0/3699719853 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8011790 con 0x7f0db80ca0e0 2024-08-31T04:25:17.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0dafe00640 1 -- 172.21.15.89:0/3699719853 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0da8017070 con 0x7f0db80ca0e0 2024-08-31T04:25:17.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0dafe00640 1 -- 172.21.15.89:0/3699719853 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8011ce0 con 0x7f0db80ca0e0 2024-08-31T04:25:17.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db806e020 con 0x7f0db80ca0e0 2024-08-31T04:25:17.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db806e5e0 con 0x7f0db80ca0e0 2024-08-31T04:25:17.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db80ca540 con 0x7f0db80ca0e0 2024-08-31T04:25:17.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.916+0000 7f0dafe00640 1 -- 172.21.15.89:0/3699719853 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0da801c460 con 0x7f0db80ca0e0 2024-08-31T04:25:17.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.920+0000 7f0dafe00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0d980720c0 0x7f0d980745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:17.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.920+0000 7f0dafe00640 1 -- 172.21.15.89:0/3699719853 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f0da8092be0 con 0x7f0db80ca0e0 2024-08-31T04:25:17.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.920+0000 7f0db7400640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0d980720c0 0x7f0d980745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:17.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.920+0000 7f0db7400640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0d980720c0 0x7f0d980745d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0db814f270 tx=0x7f0da40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:17.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:17.924+0000 7f0dafe00640 1 -- 172.21.15.89:0/3699719853 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0da805db40 con 0x7f0db80ca0e0 2024-08-31T04:25:18.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.128+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0db814d9f0 con 0x7f0db80ca0e0 2024-08-31T04:25:18.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.128+0000 7f0dafe00640 1 -- 172.21.15.89:0/3699719853 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f0da8062300 con 0x7f0db80ca0e0 2024-08-31T04:25:18.125 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:25:18.126 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:25:18.126 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:25:18.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.128+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0d980720c0 msgr2=0x7f0d980745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.128+0000 7f0dbda00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0d980720c0 0x7f0d980745d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0db814f270 tx=0x7f0da40091e0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.128+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80ca0e0 msgr2=0x7f0db814ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.128+0000 7f0dbda00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80ca0e0 0x7f0db814ddd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c430 tx=0x7f0da800c8f0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.132+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 shutdown_connections 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.132+0000 7f0dbda00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f0d980720c0 0x7f0d980745d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.132+0000 7f0dbda00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0db815d9f0 0x7f0db81e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.132+0000 7f0dbda00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0db80ca930 0x7f0db814f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.132+0000 7f0dbda00640 1 --2- 172.21.15.89:0/3699719853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db80ca0e0 0x7f0db814ddd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.132+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 >> 172.21.15.89:0/3699719853 conn(0x7f0db806cc30 msgr2=0x7f0db8149940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.132+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 shutdown_connections 2024-08-31T04:25:18.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.132+0000 7f0dbda00640 1 -- 172.21.15.89:0/3699719853 wait complete. 2024-08-31T04:25:18.147 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-31T04:25:18.147 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-31T04:25:18.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.316+0000 7faee1a00640 1 -- 172.21.15.89:0/2892866225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec0004810 msgr2=0x7faec0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:18.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.316+0000 7faee1a00640 1 --2- 172.21.15.89:0/2892866225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec0004810 0x7faec0004c20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faec4006fd0 tx=0x7faec401cf00 comp rx=0 tx=0).stop 2024-08-31T04:25:18.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.316+0000 7faee1a00640 1 -- 172.21.15.89:0/2892866225 shutdown_connections 2024-08-31T04:25:18.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.316+0000 7faee1a00640 1 --2- 172.21.15.89:0/2892866225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec0004810 0x7faec0004c20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.316+0000 7faee1a00640 1 -- 172.21.15.89:0/2892866225 >> 172.21.15.89:0/2892866225 conn(0x7faedc0c99b0 msgr2=0x7faedc0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:18.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.316+0000 7faee1a00640 1 -- 172.21.15.89:0/2892866225 shutdown_connections 2024-08-31T04:25:18.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.316+0000 7faee1a00640 1 -- 172.21.15.89:0/2892866225 wait complete. 2024-08-31T04:25:18.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 Processor -- start 2024-08-31T04:25:18.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 -- start start 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec0004810 0x7faedc15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faedc0c5740 0x7faedc14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faedc1e4fa0 0x7faedc1e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7faedc0c32e0 con 0x7faedc1e4fa0 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faedc0c3160 con 0x7faedc0c5740 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faedc1585d0 con 0x7faec0004810 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faedc1e4fa0 0x7faedc1e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faedc1e4fa0 0x7faedc1e53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44294/0 (socket says 172.21.15.89:44294) 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedb400640 1 -- 172.21.15.89:0/2020761982 learned_addr learned my addr 172.21.15.89:0/2020761982 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedaa00640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec0004810 0x7faedc15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faed2000640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faedc0c5740 0x7faedc14f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedb400640 1 -- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec0004810 msgr2=0x7faedc15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:18.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedb400640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec0004810 0x7faedc15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedb400640 1 -- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faedc0c5740 msgr2=0x7faedc14f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:18.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedb400640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faedc0c5740 0x7faedc14f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedb400640 1 -- 172.21.15.89:0/2020761982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc1e7c70 con 0x7faedc1e4fa0 2024-08-31T04:25:18.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faedb400640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faedc1e4fa0 0x7faedc1e53b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faedc0c3c70 tx=0x7faed400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:18.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faed3400640 1 -- 172.21.15.89:0/2020761982 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4003d90 con 0x7faedc1e4fa0 2024-08-31T04:25:18.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faed3400640 1 -- 172.21.15.89:0/2020761982 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faed400fe50 con 0x7faedc1e4fa0 2024-08-31T04:25:18.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 -- 172.21.15.89:0/2020761982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faedc071cd0 con 0x7faedc1e4fa0 2024-08-31T04:25:18.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faed3400640 1 -- 172.21.15.89:0/2020761982 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4004d90 con 0x7faedc1e4fa0 2024-08-31T04:25:18.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.320+0000 7faee1a00640 1 -- 172.21.15.89:0/2020761982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faedc0c4c60 con 0x7faedc1e4fa0 2024-08-31T04:25:18.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.324+0000 7faed3400640 1 -- 172.21.15.89:0/2020761982 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7faed4004050 con 0x7faedc1e4fa0 2024-08-31T04:25:18.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.324+0000 7faed3400640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faeb80720f0 0x7faeb8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.324+0000 7faed3400640 1 -- 172.21.15.89:0/2020761982 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7faed40940f0 con 0x7faedc1e4fa0 2024-08-31T04:25:18.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.324+0000 7faee91e8000 1 Processor -- start 2024-08-31T04:25:18.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.324+0000 7faee91e8000 1 -- start start 2024-08-31T04:25:18.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.324+0000 7faedaa00640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faeb80720f0 0x7faeb8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedaa00640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faeb80720f0 0x7faeb8074600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faedc06b990 tx=0x7faecc006b30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:18.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 0x558a921b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a9206ee90 0x558a9217bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9217c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558a91fd1820 con 0x558a92058960 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a91fc0db0 con 0x558a920793f0 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a91fc4d60 con 0x558a9206ee90 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9217c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9217c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44298/0 (socket says 172.21.15.89:44298) 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedb400640 1 -- 172.21.15.89:0/3772949668 learned_addr learned my addr 172.21.15.89:0/3772949668 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faed2000640 1 --2- 172.21.15.89:0/3772949668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a9206ee90 0x558a9217bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedaa00640 1 --2- 172.21.15.89:0/3772949668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 0x558a921b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedb400640 1 -- 172.21.15.89:0/3772949668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a9206ee90 msgr2=0x558a9217bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedb400640 1 --2- 172.21.15.89:0/3772949668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a9206ee90 0x558a9217bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedb400640 1 -- 172.21.15.89:0/3772949668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 msgr2=0x558a921b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:18.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedb400640 1 --2- 172.21.15.89:0/3772949668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 0x558a921b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedb400640 1 -- 172.21.15.89:0/3772949668 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a91f5bb70 con 0x558a92058960 2024-08-31T04:25:18.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faedb400640 1 --2- 172.21.15.89:0/3772949668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9217c220 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faed405ec60 tx=0x7faed405ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a194e4e5e6420cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:18.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faecb400640 1 -- 172.21.15.89:0/3772949668 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40637d0 con 0x558a92058960 2024-08-31T04:25:18.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faecb400640 1 -- 172.21.15.89:0/3772949668 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faed40681f0 con 0x558a92058960 2024-08-31T04:25:18.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faecb400640 1 -- 172.21.15.89:0/3772949668 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed405f3c0 con 0x558a92058960 2024-08-31T04:25:18.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 -- 172.21.15.89:0/3772949668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 msgr2=0x558a9217c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:18.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 --2- 172.21.15.89:0/3772949668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9217c220 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faed405ec60 tx=0x7faed405ee60 comp rx=0 tx=0).stop 2024-08-31T04:25:18.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 -- 172.21.15.89:0/3772949668 shutdown_connections 2024-08-31T04:25:18.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 --2- 172.21.15.89:0/3772949668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9217c220 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 --2- 172.21.15.89:0/3772949668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a9206ee90 0x558a9217bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 --2- 172.21.15.89:0/3772949668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 0x558a921b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 -- 172.21.15.89:0/3772949668 >> 172.21.15.89:0/3772949668 conn(0x558a91c80210 msgr2=0x558a921b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:18.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 -- 172.21.15.89:0/3772949668 shutdown_connections 2024-08-31T04:25:18.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 -- 172.21.15.89:0/3772949668 wait complete. 2024-08-31T04:25:18.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 -- start start 2024-08-31T04:25:18.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.328+0000 7faee91e8000 1 Processor -- start 2024-08-31T04:25:18.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 0x558a921b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a9206ee90 0x558a921b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 0x558a921b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558a91c87b10 con 0x558a9206ee90 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a91f476f0 con 0x558a920793f0 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a91fc9390 con 0x558a92058960 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 10 client.0 _ll_register_callbacks cb 0x558a91f68b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faed2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a9206ee90 0x558a921b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faed2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a9206ee90 0x558a921b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44300/0 (socket says 172.21.15.89:44300) 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faed2000640 1 -- 172.21.15.89:0/2679990194 learned_addr learned my addr 172.21.15.89:0/2679990194 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faedaa00640 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 0x558a921b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faedb400640 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 0x558a921b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faed2000640 1 -- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 msgr2=0x558a921b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faed2000640 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 0x558a921b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faed2000640 1 -- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 msgr2=0x558a921b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faed2000640 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 0x558a921b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faed2000640 1 -- 172.21.15.89:0/2679990194 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a91f7f380 con 0x558a9206ee90 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faedaa00640 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 0x558a921b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faed2000640 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a9206ee90 0x558a921b1e30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faec4006040 tx=0x7faec0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d6368c6fd8c0cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faebfe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faebfe00640 1 -- 172.21.15.89:0/2679990194 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4001d10 con 0x558a9206ee90 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faebfe00640 1 -- 172.21.15.89:0/2679990194 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7faec40060d0 con 0x558a9206ee90 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 -- 172.21.15.89:0/2679990194 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a91fcfd20 con 0x558a9206ee90 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faebfe00640 1 -- 172.21.15.89:0/2679990194 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7faec40c4050 con 0x558a9206ee90 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 10 client.5676 fetch_fsmap learned FSMap version 9 2024-08-31T04:25:18.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 -- 172.21.15.89:0/2679990194 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558a92045e40 con 0x558a9206ee90 2024-08-31T04:25:18.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faebfe00640 1 -- 172.21.15.89:0/2679990194 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558a91fcfd20 con 0x558a9206ee90 2024-08-31T04:25:18.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faebfe00640 1 -- 172.21.15.89:0/2679990194 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7faec40c7020 con 0x558a9206ee90 2024-08-31T04:25:18.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 10 client.5676 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:25:18.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 10 client.5676 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:25:18.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 20 client.5676 populate_metadata read hostname 'smithi089' 2024-08-31T04:25:18.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a91c64dc0 0x558a921ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 4 client.5676 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:18.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faee91e8000 1 -- 172.21.15.89:0/2679990194 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a91fd3770 con 0x558a91c64dc0 2024-08-31T04:25:18.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.332+0000 7faedaa00640 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a91c64dc0 0x558a921ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faedaa00640 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a91c64dc0 0x558a921ccf90 crc :-1 s=READY pgs=956 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7193e41a827b3be8 server_cookie=4fde66fce4fe94a8 in_seq=0 out_seq=0 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faebfe00640 10 client.5676 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faebfe00640 1 -- 172.21.15.89:0/2679990194 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a91fd3770 con 0x558a91c64dc0 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faebfe00640 10 client.5676 handle_command_reply: tid=0 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 client.5676 shutdown 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 -- 172.21.15.89:0/2679990194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a9206ee90 msgr2=0x558a921b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a9206ee90 0x558a921b1e30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faec4006040 tx=0x7faec0005840 comp rx=0 tx=0).stop 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 -- 172.21.15.89:0/2679990194 shutdown_connections 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a91c64dc0 0x558a921ccf90 crc :-1 s=READY pgs=956 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a9206ee90 0x558a921b1e30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a920793f0 0x558a921b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faebfe00640 0 client.5676 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:18.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 --2- 172.21.15.89:0/2679990194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 0x558a921b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 -- 172.21.15.89:0/2679990194 >> 172.21.15.89:0/2679990194 conn(0x558a91c80210 msgr2=0x558a921b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:18.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 -- 172.21.15.89:0/2679990194 shutdown_connections 2024-08-31T04:25:18.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 1 -- 172.21.15.89:0/2679990194 wait complete. 2024-08-31T04:25:18.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.336+0000 7faee91e8000 20 client.5676 trim_cache size 0 max 16384 2024-08-31T04:25:18.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faee91e8000 1 Processor -- start 2024-08-31T04:25:18.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faee91e8000 1 -- start start 2024-08-31T04:25:18.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faee91e8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9222ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faee91e8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 0x558a9222bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faee91e8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a920793f0 0x558a9222c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faee91e8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7faedc1fd450 con 0x558a92058960 2024-08-31T04:25:18.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faee91e8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faedc1fe820 con 0x558a9206ee90 2024-08-31T04:25:18.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faee91e8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faedc1fdaa0 con 0x558a920793f0 2024-08-31T04:25:18.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedaa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9222ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedaa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9222ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44302/0 (socket says 172.21.15.89:44302) 2024-08-31T04:25:18.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedaa00640 1 -- 172.21.15.89:0/3661977299 learned_addr learned my addr 172.21.15.89:0/3661977299 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:18.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedb400640 1 --2- 172.21.15.89:0/3661977299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a920793f0 0x558a9222c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faed2000640 1 --2- 172.21.15.89:0/3661977299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 0x558a9222bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedaa00640 1 -- 172.21.15.89:0/3661977299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a920793f0 msgr2=0x558a9222c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:18.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedaa00640 1 --2- 172.21.15.89:0/3661977299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a920793f0 0x558a9222c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedaa00640 1 -- 172.21.15.89:0/3661977299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 msgr2=0x558a9222bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:18.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedaa00640 1 --2- 172.21.15.89:0/3661977299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 0x558a9222bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedaa00640 1 -- 172.21.15.89:0/3661977299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a9201d5b0 con 0x558a92058960 2024-08-31T04:25:18.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faedaa00640 1 --2- 172.21.15.89:0/3661977299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9222ba60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x558a91cb6880 tx=0x7faecc00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cccf27c73548f27 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:18.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faecaa00640 1 -- 172.21.15.89:0/3661977299 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc02c070 con 0x558a92058960 2024-08-31T04:25:18.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faecaa00640 1 -- 172.21.15.89:0/3661977299 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faecc012d50 con 0x558a92058960 2024-08-31T04:25:18.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.356+0000 7faecaa00640 1 -- 172.21.15.89:0/3661977299 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc016070 con 0x558a92058960 2024-08-31T04:25:18.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 -- 172.21.15.89:0/3661977299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 msgr2=0x558a9222ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 --2- 172.21.15.89:0/3661977299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9222ba60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x558a91cb6880 tx=0x7faecc00c000 comp rx=0 tx=0).stop 2024-08-31T04:25:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 -- 172.21.15.89:0/3661977299 shutdown_connections 2024-08-31T04:25:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 --2- 172.21.15.89:0/3661977299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a920793f0 0x558a9222c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 --2- 172.21.15.89:0/3661977299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 0x558a9222bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 --2- 172.21.15.89:0/3661977299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a92058960 0x558a9222ba60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 -- 172.21.15.89:0/3661977299 >> 172.21.15.89:0/3661977299 conn(0x558a91c80210 msgr2=0x558a921b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 -- 172.21.15.89:0/3661977299 shutdown_connections 2024-08-31T04:25:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 -- 172.21.15.89:0/3661977299 wait complete. 2024-08-31T04:25:18.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 -- start start 2024-08-31T04:25:18.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 Processor -- start 2024-08-31T04:25:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 0x558a9217b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 0x558a9217bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a920793f0 0x558a922312f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558a91f42eb0 con 0x558a920793f0 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faedc1fe150 con 0x558a9206ee90 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a91f68f20 con 0x558a92058960 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faee91e8000 10 client.0 _ll_register_callbacks cb 0x7faec0003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a920793f0 0x558a922312f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a920793f0 0x558a922312f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44306/0 (socket says 172.21.15.89:44306) 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedb400640 1 -- 172.21.15.89:0/1797336339 learned_addr learned my addr 172.21.15.89:0/1797336339 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedaa00640 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 0x558a9217b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faed2000640 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 0x558a9217bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedb400640 1 -- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 msgr2=0x558a9217b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedb400640 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 0x558a9217b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedb400640 1 -- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 msgr2=0x558a9217bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedb400640 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 0x558a9217bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedb400640 1 -- 172.21.15.89:0/1797336339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a91f51fc0 con 0x558a920793f0 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faedb400640 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a920793f0 0x558a922312f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faed4004b00 tx=0x7faed405f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9329d2fbf1105357 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.360+0000 7faebfe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faebfe00640 1 -- 172.21.15.89:0/1797336339 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40681f0 con 0x558a920793f0 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faebfe00640 1 -- 172.21.15.89:0/1797336339 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7faed4086bd0 con 0x558a920793f0 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faee91e8000 1 -- 172.21.15.89:0/1797336339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faecc012d50 con 0x558a920793f0 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faebfe00640 1 -- 172.21.15.89:0/1797336339 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7faed40637d0 con 0x558a920793f0 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faee91e8000 10 client.5682 fetch_fsmap learned FSMap version 9 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faee91e8000 1 -- 172.21.15.89:0/1797336339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558a91f4ae00 con 0x558a920793f0 2024-08-31T04:25:18.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faebfe00640 1 -- 172.21.15.89:0/1797336339 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faecc012d50 con 0x558a920793f0 2024-08-31T04:25:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faebfe00640 1 -- 172.21.15.89:0/1797336339 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7faed4018070 con 0x558a920793f0 2024-08-31T04:25:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faee91e8000 10 client.5682 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:25:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faee91e8000 10 client.5682 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:25:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faee91e8000 20 client.5682 populate_metadata read hostname 'smithi089' 2024-08-31T04:25:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faee91e8000 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a91c52e20 0x558a92231c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:18.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faee91e8000 4 client.5682 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-31T04:25:18.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faee91e8000 1 -- 172.21.15.89:0/1797336339 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x558a91fcf210 con 0x558a91c52e20 2024-08-31T04:25:18.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faedaa00640 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a91c52e20 0x558a92231c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:18.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faedaa00640 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a91c52e20 0x558a92231c80 crc :-1 s=READY pgs=957 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cdd679d64064dc2 server_cookie=dd5b0b31130f045b in_seq=0 out_seq=0 2024-08-31T04:25:18.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:18.364+0000 7faebfe00640 10 client.5682 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:19.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faebfe00640 1 -- 172.21.15.89:0/1797336339 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x558a91fcf210 con 0x558a91c52e20 2024-08-31T04:25:19.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faebfe00640 10 client.5682 handle_command_reply: tid=0 2024-08-31T04:25:19.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 client.5682 shutdown 2024-08-31T04:25:19.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 -- 172.21.15.89:0/1797336339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a920793f0 msgr2=0x558a922312f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:19.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a920793f0 0x558a922312f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faed4004b00 tx=0x7faed405f470 comp rx=0 tx=0).stop 2024-08-31T04:25:19.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 -- 172.21.15.89:0/1797336339 shutdown_connections 2024-08-31T04:25:19.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a91c52e20 0x558a92231c80 crc :-1 s=READY pgs=957 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a920793f0 0x558a922312f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a9206ee90 0x558a9217bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 --2- 172.21.15.89:0/1797336339 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a92058960 0x558a9217b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faebfe00640 0 client.5682 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:19.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 -- 172.21.15.89:0/1797336339 >> 172.21.15.89:0/1797336339 conn(0x558a91c80210 msgr2=0x558a921b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:19.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 -- 172.21.15.89:0/1797336339 shutdown_connections 2024-08-31T04:25:19.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 1 -- 172.21.15.89:0/1797336339 wait complete. 2024-08-31T04:25:19.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee91e8000 20 client.5682 trim_cache size 0 max 16384 2024-08-31T04:25:19.855 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 70, 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "3b615858": { 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 70, 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:25:19.856 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 150.0, 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:25:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 -- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faeb80720f0 msgr2=0x7faeb8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faeb80720f0 0x7faeb8074600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faedc06b990 tx=0x7faecc006b30 comp rx=0 tx=0).stop 2024-08-31T04:25:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 -- 172.21.15.89:0/2020761982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faedc1e4fa0 msgr2=0x7faedc1e53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faedc1e4fa0 0x7faedc1e53b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faedc0c3c70 tx=0x7faed400f790 comp rx=0 tx=0).stop 2024-08-31T04:25:19.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 -- 172.21.15.89:0/2020761982 shutdown_connections 2024-08-31T04:25:19.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7faeb80720f0 0x7faeb8074600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faedc1e4fa0 0x7faedc1e53b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faedc0c5740 0x7faedc14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 --2- 172.21.15.89:0/2020761982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faec0004810 0x7faedc15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:19.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 -- 172.21.15.89:0/2020761982 >> 172.21.15.89:0/2020761982 conn(0x7faedc0c99b0 msgr2=0x7faedc157550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:19.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 -- 172.21.15.89:0/2020761982 shutdown_connections 2024-08-31T04:25:19.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:19.856+0000 7faee1a00640 1 -- 172.21.15.89:0/2020761982 wait complete. 2024-08-31T04:25:19.874 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3b615858', quiesce took 2.1 seconds. Will release after: 27.9 2024-08-31T04:25:22.845 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:25:22.848 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:25:47.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:25:47.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.944+0000 7fce81400640 1 -- 172.21.15.89:0/3837521809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce60004810 msgr2=0x7fce60004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:47.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.944+0000 7fce81400640 1 --2- 172.21.15.89:0/3837521809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce60004810 0x7fce60004c20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009b40 tx=0x7fce6c01d250 comp rx=0 tx=0).stop 2024-08-31T04:25:47.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.944+0000 7fce81400640 1 -- 172.21.15.89:0/3837521809 shutdown_connections 2024-08-31T04:25:47.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.944+0000 7fce81400640 1 --2- 172.21.15.89:0/3837521809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce60004810 0x7fce60004c20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:47.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.944+0000 7fce81400640 1 -- 172.21.15.89:0/3837521809 >> 172.21.15.89:0/3837521809 conn(0x7fce7c0ccf20 msgr2=0x7fce7c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:47.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.944+0000 7fce81400640 1 -- 172.21.15.89:0/3837521809 shutdown_connections 2024-08-31T04:25:47.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.944+0000 7fce81400640 1 -- 172.21.15.89:0/3837521809 wait complete. 2024-08-31T04:25:47.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 Processor -- start 2024-08-31T04:25:47.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 -- start start 2024-08-31T04:25:47.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60004810 0x7fce7c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:47.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce7c150ed0 0x7fce7c1f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:47.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce7c1f2c20 0x7fce7c1f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:47.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c152a10 con 0x7fce7c1f2c20 2024-08-31T04:25:47.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c0c3150 con 0x7fce60004810 2024-08-31T04:25:47.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c152b90 con 0x7fce7c150ed0 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7b200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce7c1f2c20 0x7fce7c1f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7b200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce7c1f2c20 0x7fce7c1f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56624/0 (socket says 172.21.15.89:56624) 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7b200640 1 -- 172.21.15.89:0/3978531068 learned_addr learned my addr 172.21.15.89:0/3978531068 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7a800640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60004810 0x7fce7c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce71e00640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce7c150ed0 0x7fce7c1f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7b200640 1 -- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce7c150ed0 msgr2=0x7fce7c1f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7b200640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce7c150ed0 0x7fce7c1f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7b200640 1 -- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60004810 msgr2=0x7fce7c15b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7b200640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60004810 0x7fce7c15b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7b200640 1 -- 172.21.15.89:0/3978531068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c15b710 con 0x7fce7c1f2c20 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce7b200640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce7c1f2c20 0x7fce7c1f5600 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0cadf0 tx=0x7fce740019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:47.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce73400640 1 -- 172.21.15.89:0/3978531068 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74011870 con 0x7fce7c1f2c20 2024-08-31T04:25:47.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce73400640 1 -- 172.21.15.89:0/3978531068 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce74017070 con 0x7fce7c1f2c20 2024-08-31T04:25:47.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce73400640 1 -- 172.21.15.89:0/3978531068 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74011d80 con 0x7fce7c1f2c20 2024-08-31T04:25:47.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7c1f2090 con 0x7fce7c1f2c20 2024-08-31T04:25:47.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.948+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7c15a330 con 0x7fce7c1f2c20 2024-08-31T04:25:47.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.952+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce7c0b1e20 con 0x7fce7c1f2c20 2024-08-31T04:25:47.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.952+0000 7fce73400640 1 -- 172.21.15.89:0/3978531068 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fce7401c460 con 0x7fce7c1f2c20 2024-08-31T04:25:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.952+0000 7fce73400640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fce580720c0 0x7fce580745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.952+0000 7fce73400640 1 -- 172.21.15.89:0/3978531068 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fce74093590 con 0x7fce7c1f2c20 2024-08-31T04:25:47.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.956+0000 7fce7a800640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fce580720c0 0x7fce580745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:47.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.956+0000 7fce7a800640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fce580720c0 0x7fce580745d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce64000fc0 tx=0x7fce64006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:47.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:47.960+0000 7fce73400640 1 -- 172.21.15.89:0/3978531068 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fce7405e4b0 con 0x7fce7c1f2c20 2024-08-31T04:25:48.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.152+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce7c15a120 con 0x7fce7c1f2c20 2024-08-31T04:25:48.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce73400640 1 -- 172.21.15.89:0/3978531068 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fce74062c70 con 0x7fce7c1f2c20 2024-08-31T04:25:48.151 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:25:48.152 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:25:48.152 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:25:48.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fce580720c0 msgr2=0x7fce580745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fce580720c0 0x7fce580745d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce64000fc0 tx=0x7fce64006040 comp rx=0 tx=0).stop 2024-08-31T04:25:48.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce7c1f2c20 msgr2=0x7fce7c1f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce7c1f2c20 0x7fce7c1f5600 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0cadf0 tx=0x7fce740019c0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 shutdown_connections 2024-08-31T04:25:48.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fce580720c0 0x7fce580745d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce7c1f2c20 0x7fce7c1f5600 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.154 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce7c150ed0 0x7fce7c1f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 --2- 172.21.15.89:0/3978531068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce60004810 0x7fce7c15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 >> 172.21.15.89:0/3978531068 conn(0x7fce7c0ccf20 msgr2=0x7fce7c1e2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:48.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 shutdown_connections 2024-08-31T04:25:48.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.156+0000 7fce81400640 1 -- 172.21.15.89:0/3978531068 wait complete. 2024-08-31T04:25:48.173 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 3b615858 --release --await' 2024-08-31T04:25:48.173 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 3b615858 --release --await 2024-08-31T04:25:48.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.336+0000 7ff147200640 1 -- 172.21.15.89:0/106709708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400b2860 msgr2=0x7ff1400b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.336+0000 7ff147200640 1 --2- 172.21.15.89:0/106709708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400b2860 0x7ff1400b2d20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff140073630 tx=0x7ff13001c800 comp rx=0 tx=0).stop 2024-08-31T04:25:48.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.336+0000 7ff147200640 1 -- 172.21.15.89:0/106709708 shutdown_connections 2024-08-31T04:25:48.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.336+0000 7ff147200640 1 --2- 172.21.15.89:0/106709708 >> v2:172.21.15.170:3300/0 conn(0x7ff1400c90e0 0x7ff1400747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.336+0000 7ff147200640 1 --2- 172.21.15.89:0/106709708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400b2860 0x7ff1400b2d20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.336+0000 7ff147200640 1 -- 172.21.15.89:0/106709708 >> 172.21.15.89:0/106709708 conn(0x7ff1400c99b0 msgr2=0x7ff1400c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:48.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.336+0000 7ff147200640 1 -- 172.21.15.89:0/106709708 shutdown_connections 2024-08-31T04:25:48.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.336+0000 7ff147200640 1 -- 172.21.15.89:0/106709708 wait complete. 2024-08-31T04:25:48.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff147200640 1 Processor -- start 2024-08-31T04:25:48.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff147200640 1 -- start start 2024-08-31T04:25:48.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff147200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1400b2860 0x7ff1401613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff147200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400c1ed0 0x7ff1400c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff147200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1400c90e0 0x7ff1400c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff147200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff140158750 con 0x7ff1400c1ed0 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff147200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff1401585d0 con 0x7ff1400c90e0 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff147200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff140165770 con 0x7ff1400b2860 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400c1ed0 0x7ff1400c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400c1ed0 0x7ff1400c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56640/0 (socket says 172.21.15.89:56640) 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13f400640 1 -- 172.21.15.89:0/2165837941 learned_addr learned my addr 172.21.15.89:0/2165837941 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13fe00640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1400b2860 0x7ff1401613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff145200640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1400c90e0 0x7ff1400c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13f400640 1 -- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1400b2860 msgr2=0x7ff1401613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13f400640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1400b2860 0x7ff1401613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13f400640 1 -- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1400c90e0 msgr2=0x7ff1400c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13f400640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1400c90e0 0x7ff1400c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13f400640 1 -- 172.21.15.89:0/2165837941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff140156920 con 0x7ff1400c1ed0 2024-08-31T04:25:48.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.340+0000 7ff13f400640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400c1ed0 0x7ff1400c5d50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c460 tx=0x7ff12c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:48.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.344+0000 7ff137e00640 1 -- 172.21.15.89:0/2165837941 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0052d0 con 0x7ff1400c1ed0 2024-08-31T04:25:48.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.344+0000 7ff137e00640 1 -- 172.21.15.89:0/2165837941 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff12c005470 con 0x7ff1400c1ed0 2024-08-31T04:25:48.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.344+0000 7ff137e00640 1 -- 172.21.15.89:0/2165837941 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c012870 con 0x7ff1400c1ed0 2024-08-31T04:25:48.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.344+0000 7ff147200640 1 -- 172.21.15.89:0/2165837941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1401618e0 con 0x7ff1400c1ed0 2024-08-31T04:25:48.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.344+0000 7ff147200640 1 -- 172.21.15.89:0/2165837941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1401f95c0 con 0x7ff1400c1ed0 2024-08-31T04:25:48.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.344+0000 7ff137e00640 1 -- 172.21.15.89:0/2165837941 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff12c012a10 con 0x7ff1400c1ed0 2024-08-31T04:25:48.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff137e00640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1200720c0 0x7ff1200745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff137e00640 1 -- 172.21.15.89:0/2165837941 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff12c0928a0 con 0x7ff1400c1ed0 2024-08-31T04:25:48.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1200720c0 0x7ff1200745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff14ea87000 1 Processor -- start 2024-08-31T04:25:48.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff14ea87000 1 -- start start 2024-08-31T04:25:48.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1200720c0 0x7ff1200745d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff1300af000 tx=0x7ff1300a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:48.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5749e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5615930 0x55b4c574ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5606890 0x55b4c574f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff14ea87000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b4c55f4f30 con 0x55b4c562b950 2024-08-31T04:25:48.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff14ea87000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b4c556a690 con 0x55b4c5615930 2024-08-31T04:25:48.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff14ea87000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b4c5559c20 con 0x55b4c5606890 2024-08-31T04:25:48.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5749e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5749e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56648/0 (socket says 172.21.15.89:56648) 2024-08-31T04:25:48.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 -- 172.21.15.89:0/4154692038 learned_addr learned my addr 172.21.15.89:0/4154692038 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:48.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff145200640 1 --2- 172.21.15.89:0/4154692038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5606890 0x55b4c574f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13f400640 1 --2- 172.21.15.89:0/4154692038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5615930 0x55b4c574ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 -- 172.21.15.89:0/4154692038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5606890 msgr2=0x55b4c574f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:48.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 --2- 172.21.15.89:0/4154692038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5606890 0x55b4c574f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 -- 172.21.15.89:0/4154692038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5615930 msgr2=0x55b4c574ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:48.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 --2- 172.21.15.89:0/4154692038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5615930 0x55b4c574ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.348+0000 7ff13fe00640 1 -- 172.21.15.89:0/4154692038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c550e8f0 con 0x55b4c562b950 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff13fe00640 1 --2- 172.21.15.89:0/4154692038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5749e30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff130009850 tx=0x7ff13001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2059447907d85a75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff134c00640 1 -- 172.21.15.89:0/4154692038 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1300c9070 con 0x55b4c562b950 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff134c00640 1 -- 172.21.15.89:0/4154692038 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1300b3040 con 0x55b4c562b950 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff134c00640 1 -- 172.21.15.89:0/4154692038 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1300a6ce0 con 0x55b4c562b950 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 -- 172.21.15.89:0/4154692038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 msgr2=0x55b4c5749e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4154692038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5749e30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff130009850 tx=0x7ff13001c800 comp rx=0 tx=0).stop 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 -- 172.21.15.89:0/4154692038 shutdown_connections 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4154692038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5606890 0x55b4c574f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4154692038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5615930 0x55b4c574ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4154692038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5749e30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 -- 172.21.15.89:0/4154692038 >> 172.21.15.89:0/4154692038 conn(0x55b4c562b540 msgr2=0x55b4c574c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 -- 172.21.15.89:0/4154692038 shutdown_connections 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 -- 172.21.15.89:0/4154692038 wait complete. 2024-08-31T04:25:48.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 -- start start 2024-08-31T04:25:48.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.352+0000 7ff14ea87000 1 Processor -- start 2024-08-31T04:25:48.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5606890 0x55b4c5749030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 0x55b4c5749570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c562b950 0x55b4c5753bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b4c54e0500 con 0x55b4c5606890 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b4c555dbd0 con 0x55b4c562b950 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b4c5501a30 con 0x55b4c5615930 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 10 client.0 _ll_register_callbacks cb 0x55b4c560fb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5606890 0x55b4c5749030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5606890 0x55b4c5749030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56652/0 (socket says 172.21.15.89:56652) 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13fe00640 1 -- 172.21.15.89:0/4274326418 learned_addr learned my addr 172.21.15.89:0/4274326418 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff145200640 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c562b950 0x55b4c5753bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13f400640 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 0x55b4c5749570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13fe00640 1 -- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 msgr2=0x55b4c5749570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13fe00640 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 0x55b4c5749570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13fe00640 1 -- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c562b950 msgr2=0x55b4c5753bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13fe00640 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c562b950 0x55b4c5753bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13fe00640 1 -- 172.21.15.89:0/4274326418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c54f96a0 con 0x55b4c5606890 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff145200640 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c562b950 0x55b4c5753bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13fe00640 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5606890 0x55b4c5749030 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff13001cce0 tx=0x7ff1300a6ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fea5c1f66f7c6c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff129600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff129600640 1 -- 172.21.15.89:0/4274326418 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1300c9070 con 0x55b4c5606890 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff129600640 1 -- 172.21.15.89:0/4274326418 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff1300036c0 con 0x55b4c5606890 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 -- 172.21.15.89:0/4274326418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4c54f37e0 con 0x55b4c5606890 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff129600640 1 -- 172.21.15.89:0/4274326418 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff1300d9050 con 0x55b4c5606890 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 10 client.5703 fetch_fsmap learned FSMap version 9 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 -- 172.21.15.89:0/4274326418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b4c55181c0 con 0x55b4c5606890 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff129600640 1 -- 172.21.15.89:0/4274326418 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b4c54f37e0 con 0x55b4c5606890 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff129600640 1 -- 172.21.15.89:0/4274326418 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff1300dc020 con 0x55b4c5606890 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 10 client.5703 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 10 client.5703 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:25:48.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 20 client.5703 populate_metadata read hostname 'smithi089' 2024-08-31T04:25:48.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4c55effc0 0x55b4c5754970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 4 client.5703 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:48.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff14ea87000 1 -- 172.21.15.89:0/4274326418 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4c556c5e0 con 0x55b4c55effc0 2024-08-31T04:25:48.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13f400640 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4c55effc0 0x55b4c5754970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff13f400640 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4c55effc0 0x55b4c5754970 crc :-1 s=READY pgs=968 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c018d800406eac server_cookie=7a818f3835bf15bd in_seq=0 out_seq=0 2024-08-31T04:25:48.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.356+0000 7ff129600640 10 client.5703 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:48.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff129600640 1 -- 172.21.15.89:0/4274326418 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4c556c5e0 con 0x55b4c55effc0 2024-08-31T04:25:48.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff129600640 10 client.5703 handle_command_reply: tid=0 2024-08-31T04:25:48.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 client.5703 shutdown 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 -- 172.21.15.89:0/4274326418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5606890 msgr2=0x55b4c5749030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5606890 0x55b4c5749030 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff13001cce0 tx=0x7ff1300a6ec0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 -- 172.21.15.89:0/4274326418 shutdown_connections 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4c55effc0 0x55b4c5754970 crc :-1 s=READY pgs=968 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c562b950 0x55b4c5753bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 0x55b4c5749570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff129600640 0 client.5703 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4274326418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5606890 0x55b4c5749030 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 -- 172.21.15.89:0/4274326418 >> 172.21.15.89:0/4274326418 conn(0x55b4c562b540 msgr2=0x55b4c574a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 -- 172.21.15.89:0/4274326418 shutdown_connections 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 1 -- 172.21.15.89:0/4274326418 wait complete. 2024-08-31T04:25:48.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.360+0000 7ff14ea87000 20 client.5703 trim_cache size 0 max 16384 2024-08-31T04:25:48.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.376+0000 7ff14ea87000 1 Processor -- start 2024-08-31T04:25:48.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.376+0000 7ff14ea87000 1 -- start start 2024-08-31T04:25:48.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 0x55b4c5752d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5615930 0x55b4c5753250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c562b950 0x55b4c57c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b4c570b590 con 0x55b4c5615930 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff140204360 con 0x55b4c5606890 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff140203240 con 0x55b4c562b950 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5615930 0x55b4c5753250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5615930 0x55b4c5753250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56660/0 (socket says 172.21.15.89:56660) 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13f400640 1 -- 172.21.15.89:0/4092142712 learned_addr learned my addr 172.21.15.89:0/4092142712 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff145200640 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c562b950 0x55b4c57c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13fe00640 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 0x55b4c5752d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13f400640 1 -- 172.21.15.89:0/4092142712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c562b950 msgr2=0x55b4c57c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13f400640 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c562b950 0x55b4c57c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13f400640 1 -- 172.21.15.89:0/4092142712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 msgr2=0x55b4c5752d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13f400640 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 0x55b4c5752d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13f400640 1 -- 172.21.15.89:0/4092142712 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c55de2f0 con 0x55b4c5615930 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13fe00640 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 0x55b4c5752d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff13f400640 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5615930 0x55b4c5753250 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff12c059860 tx=0x7ff12c0908c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e9b754445fa371 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff12be00640 1 -- 172.21.15.89:0/4092142712 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c066a10 con 0x55b4c5615930 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff12be00640 1 -- 172.21.15.89:0/4092142712 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff12c064040 con 0x55b4c5615930 2024-08-31T04:25:48.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff12be00640 1 -- 172.21.15.89:0/4092142712 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c05ca90 con 0x55b4c5615930 2024-08-31T04:25:48.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 -- 172.21.15.89:0/4092142712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5615930 msgr2=0x55b4c5753250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5615930 0x55b4c5753250 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff12c059860 tx=0x7ff12c0908c0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 -- 172.21.15.89:0/4092142712 shutdown_connections 2024-08-31T04:25:48.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c5615930 0x55b4c5753250 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c562b950 0x55b4c57c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 --2- 172.21.15.89:0/4092142712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 0x55b4c5752d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 -- 172.21.15.89:0/4092142712 >> 172.21.15.89:0/4092142712 conn(0x55b4c562b540 msgr2=0x55b4c5769810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:48.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 -- 172.21.15.89:0/4092142712 shutdown_connections 2024-08-31T04:25:48.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.380+0000 7ff14ea87000 1 -- 172.21.15.89:0/4092142712 wait complete. 2024-08-31T04:25:48.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 -- start start 2024-08-31T04:25:48.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 Processor -- start 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 0x55b4c57c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 0x55b4c5765920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5765e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff140202b70 con 0x55b4c562b950 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff1401f5c80 con 0x55b4c5606890 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff140201dd0 con 0x55b4c5615930 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 10 client.0 _ll_register_callbacks cb 0x7ff1300c7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff145200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5765e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff145200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5765e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56672/0 (socket says 172.21.15.89:56672) 2024-08-31T04:25:48.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff145200640 1 -- 172.21.15.89:0/647580566 learned_addr learned my addr 172.21.15.89:0/647580566 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff13fe00640 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 0x55b4c57c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff13f400640 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 0x55b4c5765920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff145200640 1 -- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 msgr2=0x55b4c5765920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff145200640 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 0x55b4c5765920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff145200640 1 -- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 msgr2=0x55b4c57c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff145200640 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 0x55b4c57c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff145200640 1 -- 172.21.15.89:0/647580566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c54e3b30 con 0x55b4c562b950 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff145200640 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5765e60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff138005c10 tx=0x7ff138012ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a030bff741a898 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff129600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff129600640 1 -- 172.21.15.89:0/647580566 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138022060 con 0x55b4c562b950 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 -- 172.21.15.89:0/647580566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4c575fed0 con 0x55b4c562b950 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff129600640 1 -- 172.21.15.89:0/647580566 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff138003d90 con 0x55b4c562b950 2024-08-31T04:25:48.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff129600640 1 -- 172.21.15.89:0/647580566 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff138028050 con 0x55b4c562b950 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 10 client.5709 fetch_fsmap learned FSMap version 9 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 -- 172.21.15.89:0/647580566 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b4c54f0c70 con 0x55b4c562b950 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff129600640 1 -- 172.21.15.89:0/647580566 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b4c575fed0 con 0x55b4c562b950 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff129600640 1 -- 172.21.15.89:0/647580566 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ff13802b020 con 0x55b4c562b950 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 10 client.5709 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 10 client.5709 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 20 client.5709 populate_metadata read hostname 'smithi089' 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4c51ebe80 0x55b4c57663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 4 client.5709 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3b615858", "release": true, "await": true}] 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.384+0000 7ff14ea87000 1 -- 172.21.15.89:0/647580566 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3b615858", "release": true, "await": true}) -- 0x55b4c574d2e0 con 0x55b4c51ebe80 2024-08-31T04:25:48.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.388+0000 7ff13fe00640 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4c51ebe80 0x55b4c57663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.388+0000 7ff13fe00640 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4c51ebe80 0x55b4c57663a0 crc :-1 s=READY pgs=969 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb4cca966fe166e9 server_cookie=c3cc0311fe8e7288 in_seq=0 out_seq=0 2024-08-31T04:25:48.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.388+0000 7ff129600640 10 client.5709 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:48.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff129600640 1 -- 172.21.15.89:0/647580566 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b4c574d2e0 con 0x55b4c51ebe80 2024-08-31T04:25:48.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff129600640 10 client.5709 handle_command_reply: tid=0 2024-08-31T04:25:48.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 client.5709 shutdown 2024-08-31T04:25:48.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 -- 172.21.15.89:0/647580566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 msgr2=0x55b4c5765e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5765e60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff138005c10 tx=0x7ff138012ca0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 -- 172.21.15.89:0/647580566 shutdown_connections 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4c51ebe80 0x55b4c57663a0 crc :-1 s=READY pgs=969 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4c562b950 0x55b4c5765e60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4c5615930 0x55b4c5765920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 --2- 172.21.15.89:0/647580566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4c5606890 0x55b4c57c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff129600640 0 client.5709 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 -- 172.21.15.89:0/647580566 >> 172.21.15.89:0/647580566 conn(0x55b4c562b540 msgr2=0x55b4c5751d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 -- 172.21.15.89:0/647580566 shutdown_connections 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 1 -- 172.21.15.89:0/647580566 wait complete. 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff14ea87000 20 client.5709 trim_cache size 0 max 16384 2024-08-31T04:25:48.494 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 72, 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "3b615858": { 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 72, 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:25:48.495 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 150.0, 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:48.496 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:25:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 -- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1200720c0 msgr2=0x7ff1200745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1200720c0 0x7ff1200745d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff1300af000 tx=0x7ff1300a7040 comp rx=0 tx=0).stop 2024-08-31T04:25:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 -- 172.21.15.89:0/2165837941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400c1ed0 msgr2=0x7ff1400c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400c1ed0 0x7ff1400c5d50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c460 tx=0x7ff12c00c920 comp rx=0 tx=0).stop 2024-08-31T04:25:48.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 -- 172.21.15.89:0/2165837941 shutdown_connections 2024-08-31T04:25:48.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1200720c0 0x7ff1200745d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1400c1ed0 0x7ff1400c5d50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1400c90e0 0x7ff1400c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 --2- 172.21.15.89:0/2165837941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1400b2860 0x7ff1401613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 -- 172.21.15.89:0/2165837941 >> 172.21.15.89:0/2165837941 conn(0x7ff1400c99b0 msgr2=0x7ff140156210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:48.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 -- 172.21.15.89:0/2165837941 shutdown_connections 2024-08-31T04:25:48.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.496+0000 7ff147200640 1 -- 172.21.15.89:0/2165837941 wait complete. 2024-08-31T04:25:48.513 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3b615858', total seconds elapsed: 30.8 2024-08-31T04:25:48.513 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-31T04:25:48.513 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:25:48.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 -- 172.21.15.89:0/3181552547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28640c4760 msgr2=0x7f28640c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 --2- 172.21.15.89:0/3181552547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28640c4760 0x7f28640c3f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2854009c80 tx=0x7f285401cda0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 -- 172.21.15.89:0/3181552547 shutdown_connections 2024-08-31T04:25:48.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 --2- 172.21.15.89:0/3181552547 >> v2:172.21.15.170:3300/0 conn(0x7f28640ca930 0x7f2864153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 --2- 172.21.15.89:0/3181552547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28640c4760 0x7f28640c3f70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 -- 172.21.15.89:0/3181552547 >> 172.21.15.89:0/3181552547 conn(0x7f28640717b0 msgr2=0x7f2864071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:48.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 -- 172.21.15.89:0/3181552547 shutdown_connections 2024-08-31T04:25:48.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 -- 172.21.15.89:0/3181552547 wait complete. 2024-08-31T04:25:48.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 Processor -- start 2024-08-31T04:25:48.670 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.672+0000 7f2869a00640 1 -- start start 2024-08-31T04:25:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2869a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28640c4760 0x7f28641f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2869a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28640ca930 0x7f28640b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2869a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2864153b90 0x7f2864139a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2869a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f28640b2c20 con 0x7f28640ca930 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2869a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f28640b2aa0 con 0x7f28640c4760 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2869a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f28640cad40 con 0x7f2864153b90 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28640ca930 0x7f28640b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28640ca930 0x7f28640b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56680/0 (socket says 172.21.15.89:56680) 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285a000640 1 -- 172.21.15.89:0/2864619304 learned_addr learned my addr 172.21.15.89:0/2864619304 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2862a00640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28640c4760 0x7f28641f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2863400640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2864153b90 0x7f2864139a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285a000640 1 -- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2864153b90 msgr2=0x7f2864139a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285a000640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2864153b90 0x7f2864139a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285a000640 1 -- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28640c4760 msgr2=0x7f28641f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285a000640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28640c4760 0x7f28641f8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285a000640 1 -- 172.21.15.89:0/2864619304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286414cdb0 con 0x7f28640ca930 2024-08-31T04:25:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2863400640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2864153b90 0x7f2864139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285a000640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28640ca930 0x7f28640b3db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f284c00e7c0 tx=0x7f284c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285b400640 1 -- 172.21.15.89:0/2864619304 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c00cc60 con 0x7f28640ca930 2024-08-31T04:25:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285b400640 1 -- 172.21.15.89:0/2864619304 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f284c00ce00 con 0x7f28640ca930 2024-08-31T04:25:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286414c580 con 0x7f28640ca930 2024-08-31T04:25:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f285b400640 1 -- 172.21.15.89:0/2864619304 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c005280 con 0x7f28640ca930 2024-08-31T04:25:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28640b4ca0 con 0x7f28640ca930 2024-08-31T04:25:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.676+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28640c3f70 con 0x7f28640ca930 2024-08-31T04:25:48.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.680+0000 7f285b400640 1 -- 172.21.15.89:0/2864619304 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f284c005420 con 0x7f28640ca930 2024-08-31T04:25:48.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.680+0000 7f285b400640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f28400720c0 0x7f28400745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:48.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.680+0000 7f285b400640 1 -- 172.21.15.89:0/2864619304 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f284c0938e0 con 0x7f28640ca930 2024-08-31T04:25:48.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.680+0000 7f2862a00640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f28400720c0 0x7f28400745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:48.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.680+0000 7f2862a00640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f28400720c0 0x7f28400745d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2854009c80 tx=0x7f285401b5e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:48.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.684+0000 7f285b400640 1 -- 172.21.15.89:0/2864619304 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f286414c580 con 0x7f28640ca930 2024-08-31T04:25:48.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f286414cf80 con 0x7f28640ca930 2024-08-31T04:25:48.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f285b400640 1 -- 172.21.15.89:0/2864619304 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f284c05edc0 con 0x7f28640ca930 2024-08-31T04:25:48.881 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:25:48.881 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:25:48.881 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:25:48.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f28400720c0 msgr2=0x7f28400745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f28400720c0 0x7f28400745d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2854009c80 tx=0x7f285401b5e0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28640ca930 msgr2=0x7f28640b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:48.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28640ca930 0x7f28640b3db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f284c00e7c0 tx=0x7f284c00ec80 comp rx=0 tx=0).stop 2024-08-31T04:25:48.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 shutdown_connections 2024-08-31T04:25:48.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f28400720c0 0x7f28400745d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28640ca930 0x7f28640b3db0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2864153b90 0x7f2864139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 --2- 172.21.15.89:0/2864619304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28640c4760 0x7f28641f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:48.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 >> 172.21.15.89:0/2864619304 conn(0x7f28640717b0 msgr2=0x7f286413d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:48.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 shutdown_connections 2024-08-31T04:25:48.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:48.884+0000 7f2869a00640 1 -- 172.21.15.89:0/2864619304 wait complete. 2024-08-31T04:25:48.903 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-31T04:25:48.903 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-31T04:25:49.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.072+0000 7f65fea00640 1 -- 172.21.15.89:0/3118052858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65dc005920 msgr2=0x7f65dc005d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:49.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.072+0000 7f65fea00640 1 --2- 172.21.15.89:0/3118052858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65dc005920 0x7f65dc005d30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f65f80b3430 tx=0x7f65e401f610 comp rx=0 tx=0).stop 2024-08-31T04:25:49.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.072+0000 7f65fca00640 1 -- 172.21.15.89:0/3118052858 reap_dead start 2024-08-31T04:25:49.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.072+0000 7f65fea00640 1 -- 172.21.15.89:0/3118052858 shutdown_connections 2024-08-31T04:25:49.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.072+0000 7f65fea00640 1 -- 172.21.15.89:0/3118052858 >> 172.21.15.89:0/3118052858 conn(0x7f65f80c99b0 msgr2=0x7f65f80c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:49.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 -- 172.21.15.89:0/3118052858 shutdown_connections 2024-08-31T04:25:49.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 -- 172.21.15.89:0/3118052858 wait complete. 2024-08-31T04:25:49.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 Processor -- start 2024-08-31T04:25:49.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 -- start start 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65dc005920 0x7f65f8153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f80c69c0 0x7f65f80c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f8146230 0x7f65f8146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81521d0 con 0x7f65f8146230 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65f80c2770 con 0x7f65f80c69c0 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.076+0000 7f65fea00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f65f8074de0 con 0x7f65dc005920 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fca00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f8146230 0x7f65f8146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fca00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f8146230 0x7f65f8146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56706/0 (socket says 172.21.15.89:56706) 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fca00640 1 -- 172.21.15.89:0/1865243987 learned_addr learned my addr 172.21.15.89:0/1865243987 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65f7400640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f80c69c0 0x7f65f80c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65f7e00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65dc005920 0x7f65f8153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fca00640 1 -- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65dc005920 msgr2=0x7f65f8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fca00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65dc005920 0x7f65f8153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fca00640 1 -- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f80c69c0 msgr2=0x7f65f80c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fca00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f80c69c0 0x7f65f80c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fca00640 1 -- 172.21.15.89:0/1865243987 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f8153b50 con 0x7f65f8146230 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65f7e00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65dc005920 0x7f65f8153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fca00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f8146230 0x7f65f8146640 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f65f806edc0 tx=0x7f65f000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65efe00640 1 -- 172.21.15.89:0/1865243987 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0004b30 con 0x7f65f8146230 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65efe00640 1 -- 172.21.15.89:0/1865243987 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65f0004cd0 con 0x7f65f8146230 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fea00640 1 -- 172.21.15.89:0/1865243987 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f8146b80 con 0x7f65f8146230 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65efe00640 1 -- 172.21.15.89:0/1865243987 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0003be0 con 0x7f65f8146230 2024-08-31T04:25:49.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65fea00640 1 -- 172.21.15.89:0/1865243987 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f8155010 con 0x7f65f8146230 2024-08-31T04:25:49.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.080+0000 7f65efe00640 1 -- 172.21.15.89:0/1865243987 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f65f0004030 con 0x7f65f8146230 2024-08-31T04:25:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65efe00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65d80720c0 0x7f65d80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65efe00640 1 -- 172.21.15.89:0/1865243987 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f65f0093950 con 0x7f65f8146230 2024-08-31T04:25:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f66060bd000 1 Processor -- start 2024-08-31T04:25:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65d80720c0 0x7f65d80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f66060bd000 1 -- start start 2024-08-31T04:25:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65d80720c0 0x7f65d80745d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65e8000c10 tx=0x7f65e8006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f66060bd000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf4b3f0 0x55a4de04e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f66060bd000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de084900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f66060bd000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf2a960 0x55a4de084e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f66060bd000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a4ddea3820 con 0x55a4ddf4b3f0 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f66060bd000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a4dde92db0 con 0x55a4ddf40e90 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f66060bd000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a4dde96d60 con 0x55a4ddf2a960 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf4b3f0 0x55a4de04e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf4b3f0 0x55a4de04e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56716/0 (socket says 172.21.15.89:56716) 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 -- 172.21.15.89:0/1215237783 learned_addr learned my addr 172.21.15.89:0/1215237783 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65fca00640 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf2a960 0x55a4de084e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7400640 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de084900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 -- 172.21.15.89:0/1215237783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf2a960 msgr2=0x55a4de084e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf2a960 0x55a4de084e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 -- 172.21.15.89:0/1215237783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 msgr2=0x55a4de084900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de084900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 -- 172.21.15.89:0/1215237783 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4dde2db70 con 0x55a4ddf4b3f0 2024-08-31T04:25:49.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7400640 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de084900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:49.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65f7e00640 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf4b3f0 0x55a4de04e4d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f65e8001880 tx=0x7f65e8004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104f90836df362e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65e3e00640 1 -- 172.21.15.89:0/1215237783 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8022070 con 0x55a4ddf4b3f0 2024-08-31T04:25:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65e3e00640 1 -- 172.21.15.89:0/1215237783 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65e8012cb0 con 0x55a4ddf4b3f0 2024-08-31T04:25:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.084+0000 7f65e3e00640 1 -- 172.21.15.89:0/1215237783 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8016070 con 0x55a4ddf4b3f0 2024-08-31T04:25:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 -- 172.21.15.89:0/1215237783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf4b3f0 msgr2=0x55a4de04e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf4b3f0 0x55a4de04e4d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f65e8001880 tx=0x7f65e8004f90 comp rx=0 tx=0).stop 2024-08-31T04:25:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 -- 172.21.15.89:0/1215237783 shutdown_connections 2024-08-31T04:25:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf2a960 0x55a4de084e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de084900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 --2- 172.21.15.89:0/1215237783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf4b3f0 0x55a4de04e4d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 -- 172.21.15.89:0/1215237783 >> 172.21.15.89:0/1215237783 conn(0x55a4ddb52210 msgr2=0x55a4de087990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:49.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 -- 172.21.15.89:0/1215237783 shutdown_connections 2024-08-31T04:25:49.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 -- 172.21.15.89:0/1215237783 wait complete. 2024-08-31T04:25:49.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 -- start start 2024-08-31T04:25:49.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 Processor -- start 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de084860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de084da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf4b3f0 0x55a4de0852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a4ddb59b10 con 0x55a4ddf2a960 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a4dde196f0 con 0x55a4ddf40e90 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a4dde9b390 con 0x55a4ddf4b3f0 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f66060bd000 10 client.0 _ll_register_callbacks cb 0x55a4dde3ab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de084860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de084860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56732/0 (socket says 172.21.15.89:56732) 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7e00640 1 -- 172.21.15.89:0/24136980 learned_addr learned my addr 172.21.15.89:0/24136980 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:49.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65fca00640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf4b3f0 0x55a4de0852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7400640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de084da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7e00640 1 -- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf4b3f0 msgr2=0x55a4de0852e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7e00640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf4b3f0 0x55a4de0852e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7e00640 1 -- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 msgr2=0x55a4de084da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7e00640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de084da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7e00640 1 -- 172.21.15.89:0/24136980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4dde51380 con 0x55a4ddf2a960 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.088+0000 7f65f7e00640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de084860 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f65e80011b0 tx=0x7f65e8013cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e39651c9b8d597 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65e0c00640 1 -- 172.21.15.89:0/24136980 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8016050 con 0x55a4ddf2a960 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f66060bd000 1 -- 172.21.15.89:0/24136980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4ddea1d20 con 0x55a4ddf2a960 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65e0c00640 1 -- 172.21.15.89:0/24136980 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f65e8027860 con 0x55a4ddf2a960 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65e0c00640 1 -- 172.21.15.89:0/24136980 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f65e8037050 con 0x55a4ddf2a960 2024-08-31T04:25:49.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f66060bd000 10 client.5724 fetch_fsmap learned FSMap version 9 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f66060bd000 1 -- 172.21.15.89:0/24136980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a4ddf17e40 con 0x55a4ddf2a960 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65e0c00640 1 -- 172.21.15.89:0/24136980 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a4ddea1d20 con 0x55a4ddf2a960 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65e0c00640 1 -- 172.21.15.89:0/24136980 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f65e803a020 con 0x55a4ddf2a960 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f66060bd000 10 client.5724 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f66060bd000 10 client.5724 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f66060bd000 20 client.5724 populate_metadata read hostname 'smithi089' 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f66060bd000 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 0x55a4de0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f66060bd000 4 client.5724 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f66060bd000 1 -- 172.21.15.89:0/24136980 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4ddea5770 con 0x55a4ddb36dc0 2024-08-31T04:25:49.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65f7400640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 0x55a4de0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65e0c00640 10 client.5724 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:49.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65f7400640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 0x55a4de0a3a20 crc :-1 s=READY pgs=971 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7e766167226d34 server_cookie=f3650adc8fc7c509 in_seq=0 out_seq=0 2024-08-31T04:25:49.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65e0c00640 1 -- 172.21.15.89:0/24136980 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a4ddea5770 con 0x55a4ddb36dc0 2024-08-31T04:25:49.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.092+0000 7f65e0c00640 10 client.5724 handle_command_reply: tid=0 2024-08-31T04:25:49.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f65f7400640 1 -- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 msgr2=0x55a4de0a3a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-08-31T04:25:49.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f65f7400640 1 -- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 msgr2=0x55a4de0a3a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-31T04:25:49.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f65f7400640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 0x55a4de0a3a20 crc :-1 s=READY pgs=971 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f65f7400640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 0x55a4de0a3a20 unknown :-1 s=READY pgs=971 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 client.5724 shutdown 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f65f7400640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 0x55a4de0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=971 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 -- 172.21.15.89:0/24136980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 msgr2=0x55a4de084860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de084860 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f65e80011b0 tx=0x7f65e8013cf0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f65f7400640 -1 monclient: get_auth_request but no auth handler is set up 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f65f7400640 0 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 0x55a4de0a3a20 unknown :-1 s=AUTH_CONNECTING pgs=971 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -13 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f65f7400640 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 0x55a4de0a3a20 unknown :-1 s=AUTH_CONNECTING pgs=971 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f65e0c00640 0 client.5724 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 -- 172.21.15.89:0/24136980 shutdown_connections 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb36dc0 0x55a4de0a3a20 unknown :-1 s=CLOSED pgs=971 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf4b3f0 0x55a4de0852e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de084da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 --2- 172.21.15.89:0/24136980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de084860 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 -- 172.21.15.89:0/24136980 >> 172.21.15.89:0/24136980 conn(0x55a4ddb52210 msgr2=0x55a4de086340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:49.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 -- 172.21.15.89:0/24136980 shutdown_connections 2024-08-31T04:25:49.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 1 -- 172.21.15.89:0/24136980 wait complete. 2024-08-31T04:25:49.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.096+0000 7f66060bd000 20 client.5724 trim_cache size 0 max 16384 2024-08-31T04:25:49.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.112+0000 7f66060bd000 1 Processor -- start 2024-08-31T04:25:49.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.112+0000 7f66060bd000 1 -- start start 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.112+0000 7f66060bd000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddb36dc0 0x55a4de096af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.112+0000 7f66060bd000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de04c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.112+0000 7f66060bd000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf40e90 0x55a4de04c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.112+0000 7f66060bd000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8151390 con 0x55a4ddf2a960 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.112+0000 7f66060bd000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81fb600 con 0x55a4ddb36dc0 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.112+0000 7f66060bd000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f65f81fa8b0 con 0x55a4ddf40e90 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de04c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de04c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56736/0 (socket says 172.21.15.89:56736) 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7400640 1 -- 172.21.15.89:0/4233206888 learned_addr learned my addr 172.21.15.89:0/4233206888 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:49.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65fca00640 1 --2- 172.21.15.89:0/4233206888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf40e90 0x55a4de04c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7e00640 1 --2- 172.21.15.89:0/4233206888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddb36dc0 0x55a4de096af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7400640 1 -- 172.21.15.89:0/4233206888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf40e90 msgr2=0x55a4de04c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7400640 1 --2- 172.21.15.89:0/4233206888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf40e90 0x55a4de04c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7400640 1 -- 172.21.15.89:0/4233206888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddb36dc0 msgr2=0x55a4de096af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7400640 1 --2- 172.21.15.89:0/4233206888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddb36dc0 0x55a4de096af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7400640 1 -- 172.21.15.89:0/4233206888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4de0535f0 con 0x55a4ddf2a960 2024-08-31T04:25:49.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65f7400640 1 --2- 172.21.15.89:0/4233206888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de04c080 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f65e4006c90 tx=0x7f65dc006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4837480b29d9c4da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65e3400640 1 -- 172.21.15.89:0/4233206888 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e40c9070 con 0x55a4ddf2a960 2024-08-31T04:25:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65e3400640 1 -- 172.21.15.89:0/4233206888 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65e40060a0 con 0x55a4ddf2a960 2024-08-31T04:25:49.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f65e3400640 1 -- 172.21.15.89:0/4233206888 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e40b5040 con 0x55a4ddf2a960 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 -- 172.21.15.89:0/4233206888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 msgr2=0x55a4de04c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 --2- 172.21.15.89:0/4233206888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de04c080 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f65e4006c90 tx=0x7f65dc006950 comp rx=0 tx=0).stop 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 -- 172.21.15.89:0/4233206888 shutdown_connections 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 --2- 172.21.15.89:0/4233206888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de04c080 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 --2- 172.21.15.89:0/4233206888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddf40e90 0x55a4de04c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 --2- 172.21.15.89:0/4233206888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddb36dc0 0x55a4de096af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 -- 172.21.15.89:0/4233206888 >> 172.21.15.89:0/4233206888 conn(0x55a4ddb52210 msgr2=0x55a4de092250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 -- 172.21.15.89:0/4233206888 shutdown_connections 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 -- 172.21.15.89:0/4233206888 wait complete. 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 -- start start 2024-08-31T04:25:49.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.116+0000 7f66060bd000 1 Processor -- start 2024-08-31T04:25:49.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddb36dc0 0x55a4de0a6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de0a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de0a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a4dde14eb0 con 0x55a4ddf2a960 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81faf60 con 0x55a4ddf40e90 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a4dde3af20 con 0x55a4ddb36dc0 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 10 client.0 _ll_register_callbacks cb 0x7f65e8001780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de0a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de0a6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56740/0 (socket says 172.21.15.89:56740) 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7400640 1 -- 172.21.15.89:0/3083332940 learned_addr learned my addr 172.21.15.89:0/3083332940 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65fca00640 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de0a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7e00640 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddb36dc0 0x55a4de0a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7400640 1 -- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddb36dc0 msgr2=0x55a4de0a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7400640 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddb36dc0 0x55a4de0a6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7400640 1 -- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 msgr2=0x55a4de0a6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7400640 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de0a6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7400640 1 -- 172.21.15.89:0/3083332940 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ddeef5b0 con 0x55a4ddf2a960 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7e00640 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddb36dc0 0x55a4de0a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7400640 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de0a6a50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f65e40262e0 tx=0x7f65e4006630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa951edf9e02e73 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65e0c00640 1 -- 172.21.15.89:0/3083332940 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e40c2020 con 0x55a4ddf2a960 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65e0c00640 1 -- 172.21.15.89:0/3083332940 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f65e4001620 con 0x55a4ddf2a960 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 -- 172.21.15.89:0/3083332940 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65e40060a0 con 0x55a4ddf2a960 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65e0c00640 1 -- 172.21.15.89:0/3083332940 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f65e40c9040 con 0x55a4ddf2a960 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 10 client.5730 fetch_fsmap learned FSMap version 9 2024-08-31T04:25:49.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 -- 172.21.15.89:0/3083332940 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a4dde23fc0 con 0x55a4ddf2a960 2024-08-31T04:25:49.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65e0c00640 1 -- 172.21.15.89:0/3083332940 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65e40060a0 con 0x55a4ddf2a960 2024-08-31T04:25:49.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65e0c00640 1 -- 172.21.15.89:0/3083332940 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f65e40bb050 con 0x55a4ddf2a960 2024-08-31T04:25:49.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 10 client.5730 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:25:49.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 10 client.5730 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:25:49.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 20 client.5730 populate_metadata read hostname 'smithi089' 2024-08-31T04:25:49.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb50470 0x55a4de0a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:49.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 4 client.5730 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-31T04:25:49.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f66060bd000 1 -- 172.21.15.89:0/3083332940 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55a4ddea1210 con 0x55a4ddb50470 2024-08-31T04:25:49.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7e00640 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb50470 0x55a4de0a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65e0c00640 10 client.5730 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:49.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:49.120+0000 7f65f7e00640 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb50470 0x55a4de0a74d0 crc :-1 s=READY pgs=972 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0bb80b18910ca48 server_cookie=b36d1cd93350689c in_seq=0 out_seq=0 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65e0c00640 1 -- 172.21.15.89:0/3083332940 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a4ddea1210 con 0x55a4ddb50470 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65e0c00640 10 client.5730 handle_command_reply: tid=0 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 client.5730 shutdown 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 -- 172.21.15.89:0/3083332940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 msgr2=0x55a4de0a6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de0a6a50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f65e40262e0 tx=0x7f65e4006630 comp rx=0 tx=0).stop 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 -- 172.21.15.89:0/3083332940 shutdown_connections 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a4ddb50470 0x55a4de0a74d0 crc :-1 s=READY pgs=972 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddf2a960 0x55a4de0a6a50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4ddf40e90 0x55a4de0a6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 --2- 172.21.15.89:0/3083332940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a4ddb36dc0 0x55a4de0a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:51.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65e0c00640 0 client.5730 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 -- 172.21.15.89:0/3083332940 >> 172.21.15.89:0/3083332940 conn(0x55a4ddb52210 msgr2=0x55a4de092250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 -- 172.21.15.89:0/3083332940 shutdown_connections 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 1 -- 172.21.15.89:0/3083332940 wait complete. 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f66060bd000 20 client.5730 trim_cache size 0 max 16384 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 74, 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:25:51.435 INFO:teuthology.orchestra.run.smithi089.stdout: "ad657bf5": { 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 74, 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 150.0, 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:25:51.436 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:51.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:51.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:51.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:51.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:25:51.437 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 -- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65d80720c0 msgr2=0x7f65d80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65d80720c0 0x7f65d80745d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65e8000c10 tx=0x7f65e8006b70 comp rx=0 tx=0).stop 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 -- 172.21.15.89:0/1865243987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f8146230 msgr2=0x7f65f8146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f8146230 0x7f65f8146640 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f65f806edc0 tx=0x7f65f000f3c0 comp rx=0 tx=0).stop 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 -- 172.21.15.89:0/1865243987 shutdown_connections 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f65d80720c0 0x7f65d80745d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f8146230 0x7f65f8146640 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65f80c69c0 0x7f65f80c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 --2- 172.21.15.89:0/1865243987 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65dc005920 0x7f65f8153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 -- 172.21.15.89:0/1865243987 >> 172.21.15.89:0/1865243987 conn(0x7f65f80c99b0 msgr2=0x7f65f80c88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 -- 172.21.15.89:0/1865243987 shutdown_connections 2024-08-31T04:25:51.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:25:51.436+0000 7f65fea00640 1 -- 172.21.15.89:0/1865243987 wait complete. 2024-08-31T04:25:51.455 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ad657bf5', quiesce took 2.9 seconds. Will release after: 27.1 2024-08-31T04:25:53.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:25:53.288 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:26:18.557 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:26:18.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 -- 172.21.15.89:0/3052419648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4ce0 msgr2=0x7f69f01538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:18.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 --2- 172.21.15.89:0/3052419648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4ce0 0x7f69f01538e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f69f0071070 tx=0x7f69e001cb80 comp rx=0 tx=0).stop 2024-08-31T04:26:18.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 -- 172.21.15.89:0/3052419648 shutdown_connections 2024-08-31T04:26:18.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 --2- 172.21.15.89:0/3052419648 >> v2:172.21.15.170:3300/0 conn(0x7f69f00c4790 0x7f69f00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:18.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 --2- 172.21.15.89:0/3052419648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4ce0 0x7f69f01538e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:18.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 -- 172.21.15.89:0/3052419648 >> 172.21.15.89:0/3052419648 conn(0x7f69f0073630 msgr2=0x7f69f0073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:18.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 -- 172.21.15.89:0/3052419648 shutdown_connections 2024-08-31T04:26:18.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 -- 172.21.15.89:0/3052419648 wait complete. 2024-08-31T04:26:18.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 Processor -- start 2024-08-31T04:26:18.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 -- start start 2024-08-31T04:26:18.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4790 0x7f69f01f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69f00c4ce0 0x7f69f015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69f00ca9a0 0x7f69f0149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0153fa0 con 0x7f69f00c4790 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0153e20 con 0x7f69f00c4ce0 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.727+0000 7f69f7400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f69f01669f0 con 0x7f69f00ca9a0 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f4a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4790 0x7f69f01f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f4a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4790 0x7f69f01f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56516/0 (socket says 172.21.15.89:56516) 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f4a00640 1 -- 172.21.15.89:0/2061398824 learned_addr learned my addr 172.21.15.89:0/2061398824 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69efe00640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69f00c4ce0 0x7f69f015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f5400640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69f00ca9a0 0x7f69f0149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f4a00640 1 -- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69f00ca9a0 msgr2=0x7f69f0149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:18.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f4a00640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69f00ca9a0 0x7f69f0149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:18.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f4a00640 1 -- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69f00c4ce0 msgr2=0x7f69f015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:18.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f4a00640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69f00c4ce0 0x7f69f015b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:18.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f4a00640 1 -- 172.21.15.89:0/2061398824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f01f5770 con 0x7f69f00c4790 2024-08-31T04:26:18.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f4a00640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4790 0x7f69f01f5230 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f69e0000f90 tx=0x7f69e0009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69ecc00640 1 -- 172.21.15.89:0/2061398824 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e00bb070 con 0x7f69f00c4790 2024-08-31T04:26:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69ecc00640 1 -- 172.21.15.89:0/2061398824 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e0004c00 con 0x7f69f00c4790 2024-08-31T04:26:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f00b3940 con 0x7f69f00c4790 2024-08-31T04:26:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69ecc00640 1 -- 172.21.15.89:0/2061398824 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e00b2040 con 0x7f69f00c4790 2024-08-31T04:26:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f015c040 con 0x7f69f00c4790 2024-08-31T04:26:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f00ca460 con 0x7f69f00c4790 2024-08-31T04:26:18.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.731+0000 7f69ecc00640 1 -- 172.21.15.89:0/2061398824 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f69e00be070 con 0x7f69f00c4790 2024-08-31T04:26:18.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.735+0000 7f69ecc00640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69d00720f0 0x7f69d0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:18.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.735+0000 7f69ecc00640 1 -- 172.21.15.89:0/2061398824 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f69e012cbf0 con 0x7f69f00c4790 2024-08-31T04:26:18.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.735+0000 7f69efe00640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69d00720f0 0x7f69d0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:18.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.735+0000 7f69efe00640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69d00720f0 0x7f69d0074600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f69dc005fd0 tx=0x7f69dc005e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:18.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.739+0000 7f69ecc00640 1 -- 172.21.15.89:0/2061398824 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f69e0016770 con 0x7f69f00c4790 2024-08-31T04:26:18.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.935+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69f0157270 con 0x7f69f00c4790 2024-08-31T04:26:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.935+0000 7f69ecc00640 1 -- 172.21.15.89:0/2061398824 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f69e00f80d0 con 0x7f69f00c4790 2024-08-31T04:26:18.934 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:26:18.934 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:26:18.934 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69d00720f0 msgr2=0x7f69d0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69d00720f0 0x7f69d0074600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f69dc005fd0 tx=0x7f69dc005e40 comp rx=0 tx=0).stop 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4790 msgr2=0x7f69f01f5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4790 0x7f69f01f5230 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f69e0000f90 tx=0x7f69e0009330 comp rx=0 tx=0).stop 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 shutdown_connections 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69d00720f0 0x7f69d0074600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69f00ca9a0 0x7f69f0149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69f00c4ce0 0x7f69f015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 --2- 172.21.15.89:0/2061398824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69f00c4790 0x7f69f01f5230 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:18.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 >> 172.21.15.89:0/2061398824 conn(0x7f69f0073630 msgr2=0x7f69f01636c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:18.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 shutdown_connections 2024-08-31T04:26:18.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:18.939+0000 7f69f7400640 1 -- 172.21.15.89:0/2061398824 wait complete. 2024-08-31T04:26:18.956 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id ad657bf5 --release --await' 2024-08-31T04:26:18.956 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id ad657bf5 --release --await 2024-08-31T04:26:19.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.119+0000 7f6a08c00640 1 -- 172.21.15.89:0/771838252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e8004810 msgr2=0x7f69e8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.119+0000 7f6a08c00640 1 --2- 172.21.15.89:0/771838252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69e8004810 0x7f69e8004c20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6a04159760 tx=0x7f69f001ce70 comp rx=0 tx=0).stop 2024-08-31T04:26:19.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.119+0000 7f6a02800640 1 -- 172.21.15.89:0/771838252 reap_dead start 2024-08-31T04:26:19.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.119+0000 7f6a08c00640 1 -- 172.21.15.89:0/771838252 shutdown_connections 2024-08-31T04:26:19.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.119+0000 7f6a08c00640 1 -- 172.21.15.89:0/771838252 >> 172.21.15.89:0/771838252 conn(0x7f6a040c99b0 msgr2=0x7f6a040c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:19.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.119+0000 7f6a08c00640 1 -- 172.21.15.89:0/771838252 shutdown_connections 2024-08-31T04:26:19.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.119+0000 7f6a08c00640 1 -- 172.21.15.89:0/771838252 wait complete. 2024-08-31T04:26:19.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.119+0000 7f6a08c00640 1 Processor -- start 2024-08-31T04:26:19.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.119+0000 7f6a08c00640 1 -- start start 2024-08-31T04:26:19.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a08c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69e8004810 0x7f6a041f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a08c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a04073870 0x7f6a0415af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a08c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a0415b4c0 0x7f6a04148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a08c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a04158750 con 0x7f6a04073870 2024-08-31T04:26:19.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a08c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041585d0 con 0x7f6a0415b4c0 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a08c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a04164770 con 0x7f69e8004810 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a04073870 0x7f6a0415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a04073870 0x7f6a0415af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56548/0 (socket says 172.21.15.89:56548) 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01400640 1 -- 172.21.15.89:0/2696314185 learned_addr learned my addr 172.21.15.89:0/2696314185 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01e00640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69e8004810 0x7f6a041f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a02800640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a0415b4c0 0x7f6a04148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01400640 1 -- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69e8004810 msgr2=0x7f6a041f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01400640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69e8004810 0x7f6a041f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01400640 1 -- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a0415b4c0 msgr2=0x7f6a04148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01400640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a0415b4c0 0x7f6a04148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01400640 1 -- 172.21.15.89:0/2696314185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0415c6d0 con 0x7f6a04073870 2024-08-31T04:26:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a02800640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a0415b4c0 0x7f6a04148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a01400640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a04073870 0x7f6a0415af80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f69f001c930 tx=0x7f69f0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f69fa000640 1 -- 172.21.15.89:0/2696314185 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f00a5bd0 con 0x7f6a04073870 2024-08-31T04:26:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f69fa000640 1 -- 172.21.15.89:0/2696314185 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69f00014e0 con 0x7f6a04073870 2024-08-31T04:26:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f69fa000640 1 -- 172.21.15.89:0/2696314185 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0006330 con 0x7f6a04073870 2024-08-31T04:26:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a08c00640 1 -- 172.21.15.89:0/2696314185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0414afa0 con 0x7f6a04073870 2024-08-31T04:26:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.123+0000 7f6a08c00640 1 -- 172.21.15.89:0/2696314185 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a04159830 con 0x7f6a04073870 2024-08-31T04:26:19.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.127+0000 7f69fa000640 1 -- 172.21.15.89:0/2696314185 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f69f00064d0 con 0x7f6a04073870 2024-08-31T04:26:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.127+0000 7f6a101a3000 1 Processor -- start 2024-08-31T04:26:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.127+0000 7f69fa000640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e40720c0 0x7f69e40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.127+0000 7f6a101a3000 1 -- start start 2024-08-31T04:26:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.127+0000 7f69fa000640 1 -- 172.21.15.89:0/2696314185 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f69f012c210 con 0x7f6a04073870 2024-08-31T04:26:19.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.127+0000 7f6a02800640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e40720c0 0x7f69e40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a02800640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e40720c0 0x7f69e40745d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6a040c3c70 tx=0x7f69fc006eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55886467c950 0x55886479ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x55886479fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558864657890 0x5588647a0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558864645f30 con 0x558864657890 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5588645bb690 con 0x55886467c950 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5588645aac20 con 0x558864666930 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a02800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558864657890 0x5588647a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a01e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55886467c950 0x55886479ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a01400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x55886479fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a01e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55886467c950 0x55886479ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:53248/0 (socket says 172.21.15.89:53248) 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a01e00640 1 -- 172.21.15.89:0/900989766 learned_addr learned my addr 172.21.15.89:0/900989766 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a02800640 1 -- 172.21.15.89:0/900989766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 msgr2=0x55886479fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a02800640 1 --2- 172.21.15.89:0/900989766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x55886479fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a02800640 1 -- 172.21.15.89:0/900989766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55886467c950 msgr2=0x55886479ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a02800640 1 --2- 172.21.15.89:0/900989766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55886467c950 0x55886479ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a02800640 1 -- 172.21.15.89:0/900989766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55886455f8f0 con 0x558864657890 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a02800640 1 --2- 172.21.15.89:0/900989766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558864657890 0x5588647a0010 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6a040709f0 tx=0x7f69fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a650e0317639d4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f69ee600640 1 -- 172.21.15.89:0/900989766 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc016070 con 0x558864657890 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f69ee600640 1 -- 172.21.15.89:0/900989766 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69fc023020 con 0x558864657890 2024-08-31T04:26:19.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f69ee600640 1 -- 172.21.15.89:0/900989766 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc012bf0 con 0x558864657890 2024-08-31T04:26:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 -- 172.21.15.89:0/900989766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558864657890 msgr2=0x5588647a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 --2- 172.21.15.89:0/900989766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558864657890 0x5588647a0010 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6a040709f0 tx=0x7f69fc013000 comp rx=0 tx=0).stop 2024-08-31T04:26:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 -- 172.21.15.89:0/900989766 shutdown_connections 2024-08-31T04:26:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 --2- 172.21.15.89:0/900989766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558864657890 0x5588647a0010 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 --2- 172.21.15.89:0/900989766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x55886479fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 --2- 172.21.15.89:0/900989766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55886467c950 0x55886479ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 -- 172.21.15.89:0/900989766 >> 172.21.15.89:0/900989766 conn(0x55886467c540 msgr2=0x55886479d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 -- 172.21.15.89:0/900989766 shutdown_connections 2024-08-31T04:26:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 -- 172.21.15.89:0/900989766 wait complete. 2024-08-31T04:26:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 -- start start 2024-08-31T04:26:19.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.131+0000 7f6a101a3000 1 Processor -- start 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864657890 0x558864799c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864666930 0x55886479a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x55886479a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558864531500 con 0x55886467c950 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5588645aebd0 con 0x558864666930 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558864552a30 con 0x558864657890 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 10 client.0 _ll_register_callbacks cb 0x558864660b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a02800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x55886479a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a01400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864666930 0x55886479a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a01e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864657890 0x558864799c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a02800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x55886479a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56570/0 (socket says 172.21.15.89:56570) 2024-08-31T04:26:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a01400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864666930 0x55886479a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:53262/0 (socket says 172.21.15.89:53262) 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a02800640 1 -- 172.21.15.89:0/2946032674 learned_addr learned my addr 172.21.15.89:0/2946032674 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a02800640 1 -- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864657890 msgr2=0x558864799c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a02800640 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864657890 0x558864799c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a02800640 1 -- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864666930 msgr2=0x55886479a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a02800640 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864666930 0x55886479a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a02800640 1 -- 172.21.15.89:0/2946032674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55886454a6a0 con 0x55886467c950 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a02800640 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x55886479a690 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6a040b3260 tx=0x7f69fc012c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d4b9aaf68385cb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f69e2a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f69e2a00640 1 -- 172.21.15.89:0/2946032674 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc016030 con 0x55886467c950 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f69e2a00640 1 -- 172.21.15.89:0/2946032674 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f69fc028840 con 0x55886467c950 2024-08-31T04:26:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 -- 172.21.15.89:0/2946032674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588645447e0 con 0x55886467c950 2024-08-31T04:26:19.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f69e2a00640 1 -- 172.21.15.89:0/2946032674 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f69fc039050 con 0x55886467c950 2024-08-31T04:26:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 10 client.5751 fetch_fsmap learned FSMap version 9 2024-08-31T04:26:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 -- 172.21.15.89:0/2946032674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5588645691c0 con 0x55886467c950 2024-08-31T04:26:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f69e2a00640 1 -- 172.21.15.89:0/2946032674 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5588645447e0 con 0x55886467c950 2024-08-31T04:26:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f69e2a00640 1 -- 172.21.15.89:0/2946032674 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f69fc03c020 con 0x55886467c950 2024-08-31T04:26:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 10 client.5751 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:26:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 10 client.5751 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:26:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 20 client.5751 populate_metadata read hostname 'smithi089' 2024-08-31T04:26:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558864640fc0 0x5588647b8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 4 client.5751 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:19.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.135+0000 7f6a101a3000 1 -- 172.21.15.89:0/2946032674 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588645bd5e0 con 0x558864640fc0 2024-08-31T04:26:19.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a01e00640 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558864640fc0 0x5588647b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f69e2a00640 10 client.5751 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:26:19.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a01e00640 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558864640fc0 0x5588647b8880 crc :-1 s=READY pgs=973 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e6536da5456fe8 server_cookie=e0cc17abeb1f52cb in_seq=0 out_seq=0 2024-08-31T04:26:19.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f69e2a00640 1 -- 172.21.15.89:0/2946032674 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588645bd5e0 con 0x558864640fc0 2024-08-31T04:26:19.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f69e2a00640 10 client.5751 handle_command_reply: tid=0 2024-08-31T04:26:19.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 client.5751 shutdown 2024-08-31T04:26:19.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 -- 172.21.15.89:0/2946032674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 msgr2=0x55886479a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x55886479a690 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6a040b3260 tx=0x7f69fc012c40 comp rx=0 tx=0).stop 2024-08-31T04:26:19.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 -- 172.21.15.89:0/2946032674 shutdown_connections 2024-08-31T04:26:19.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558864640fc0 0x5588647b8880 crc :-1 s=READY pgs=973 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x55886479a690 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f69e2a00640 0 client.5751 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:26:19.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864666930 0x55886479a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2946032674 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864657890 0x558864799c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 -- 172.21.15.89:0/2946032674 >> 172.21.15.89:0/2946032674 conn(0x55886467c540 msgr2=0x55886479b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:19.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 -- 172.21.15.89:0/2946032674 shutdown_connections 2024-08-31T04:26:19.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 1 -- 172.21.15.89:0/2946032674 wait complete. 2024-08-31T04:26:19.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.139+0000 7f6a101a3000 20 client.5751 trim_cache size 0 max 16384 2024-08-31T04:26:19.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 Processor -- start 2024-08-31T04:26:19.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 -- start start 2024-08-31T04:26:19.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 0x55886475ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x55886475b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x5588647bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a04200590 con 0x55886467c950 2024-08-31T04:26:19.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041ff470 con 0x558864657890 2024-08-31T04:26:19.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a040c6480 con 0x558864666930 2024-08-31T04:26:19.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a02800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x5588647bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a02800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x5588647bbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56584/0 (socket says 172.21.15.89:56584) 2024-08-31T04:26:19.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a02800640 1 -- 172.21.15.89:0/2842526717 learned_addr learned my addr 172.21.15.89:0/2842526717 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:26:19.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a01400640 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x55886475b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a01e00640 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 0x55886475ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a02800640 1 -- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 msgr2=0x55886475b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:19.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a02800640 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x55886475b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a02800640 1 -- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 msgr2=0x55886475ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:19.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a02800640 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 0x55886475ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a02800640 1 -- 172.21.15.89:0/2842526717 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55886462f2f0 con 0x55886467c950 2024-08-31T04:26:19.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a01400640 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x55886475b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:19.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a01e00640 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 0x55886475ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:19.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a02800640 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x5588647bbad0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f69fc012d30 tx=0x7f69fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8c340cfd2baf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:19.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f69edc00640 1 -- 172.21.15.89:0/2842526717 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc041020 con 0x55886467c950 2024-08-31T04:26:19.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f69edc00640 1 -- 172.21.15.89:0/2842526717 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69fc02c070 con 0x55886467c950 2024-08-31T04:26:19.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f69edc00640 1 -- 172.21.15.89:0/2842526717 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc016070 con 0x55886467c950 2024-08-31T04:26:19.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 -- 172.21.15.89:0/2842526717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 msgr2=0x5588647bbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.159+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x5588647bbad0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f69fc012d30 tx=0x7f69fc013000 comp rx=0 tx=0).stop 2024-08-31T04:26:19.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 -- 172.21.15.89:0/2842526717 shutdown_connections 2024-08-31T04:26:19.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x5588647bbad0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x55886475b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 --2- 172.21.15.89:0/2842526717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 0x55886475ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 -- 172.21.15.89:0/2842526717 >> 172.21.15.89:0/2842526717 conn(0x55886467c540 msgr2=0x55886475a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:19.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 -- 172.21.15.89:0/2842526717 shutdown_connections 2024-08-31T04:26:19.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 -- 172.21.15.89:0/2842526717 wait complete. 2024-08-31T04:26:19.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 -- start start 2024-08-31T04:26:19.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 Processor -- start 2024-08-31T04:26:19.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 0x55886481f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x558864821710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x558864823c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041fe020 con 0x55886467c950 2024-08-31T04:26:19.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041feda0 con 0x558864657890 2024-08-31T04:26:19.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a041fe6d0 con 0x558864666930 2024-08-31T04:26:19.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a101a3000 10 client.0 _ll_register_callbacks cb 0x7f69f40096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a02800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x558864823c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a02800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x558864823c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56586/0 (socket says 172.21.15.89:56586) 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a02800640 1 -- 172.21.15.89:0/1636591186 learned_addr learned my addr 172.21.15.89:0/1636591186 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a01e00640 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 0x55886481f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a01400640 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x558864821710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a02800640 1 -- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 msgr2=0x558864821710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a02800640 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x558864821710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a02800640 1 -- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 msgr2=0x55886481f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a02800640 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 0x55886481f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a02800640 1 -- 172.21.15.89:0/1636591186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558864534b30 con 0x55886467c950 2024-08-31T04:26:19.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f6a02800640 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x558864823c60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f69fc012f90 tx=0x7f69fc0326b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf07f302e9aa2cb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:19.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f69e2a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:26:19.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f69e2a00640 1 -- 172.21.15.89:0/1636591186 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc041070 con 0x55886467c950 2024-08-31T04:26:19.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.163+0000 7f69e2a00640 1 -- 172.21.15.89:0/1636591186 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f69fc032c30 con 0x55886467c950 2024-08-31T04:26:19.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a101a3000 1 -- 172.21.15.89:0/1636591186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69fc02c070 con 0x55886467c950 2024-08-31T04:26:19.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f69e2a00640 1 -- 172.21.15.89:0/1636591186 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f69fc052050 con 0x55886467c950 2024-08-31T04:26:19.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a101a3000 10 client.5757 fetch_fsmap learned FSMap version 9 2024-08-31T04:26:19.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a101a3000 1 -- 172.21.15.89:0/1636591186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558864541c70 con 0x55886467c950 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f69e2a00640 1 -- 172.21.15.89:0/1636591186 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69fc02c070 con 0x55886467c950 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f69e2a00640 1 -- 172.21.15.89:0/1636591186 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f69fc055020 con 0x55886467c950 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a101a3000 10 client.5757 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a101a3000 10 client.5757 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a101a3000 20 client.5757 populate_metadata read hostname 'smithi089' 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a101a3000 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55886423ce80 0x5588648261b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a101a3000 4 client.5757 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ad657bf5", "release": true, "await": true}] 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a101a3000 1 -- 172.21.15.89:0/1636591186 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ad657bf5", "release": true, "await": true}) -- 0x5588645b9080 con 0x55886423ce80 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a01e00640 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55886423ce80 0x5588648261b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f69e2a00640 10 client.5757 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:26:19.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.167+0000 7f6a01e00640 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55886423ce80 0x5588648261b0 crc :-1 s=READY pgs=974 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a3887dc61df7490 server_cookie=664da6254e78a6e0 in_seq=0 out_seq=0 2024-08-31T04:26:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.255+0000 7f69e2a00640 1 -- 172.21.15.89:0/1636591186 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5588645b9080 con 0x55886423ce80 2024-08-31T04:26:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.255+0000 7f69e2a00640 10 client.5757 handle_command_reply: tid=0 2024-08-31T04:26:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.255+0000 7f6a101a3000 1 client.5757 shutdown 2024-08-31T04:26:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 -- 172.21.15.89:0/1636591186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 msgr2=0x558864823c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x558864823c60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f69fc012f90 tx=0x7f69fc0326b0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 -- 172.21.15.89:0/1636591186 shutdown_connections 2024-08-31T04:26:19.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55886423ce80 0x5588648261b0 crc :-1 s=READY pgs=974 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55886467c950 0x558864823c60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558864666930 0x558864821710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 --2- 172.21.15.89:0/1636591186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558864657890 0x55886481f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f69e2a00640 0 client.5757 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:26:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 -- 172.21.15.89:0/1636591186 >> 172.21.15.89:0/1636591186 conn(0x55886467c540 msgr2=0x55886479a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 -- 172.21.15.89:0/1636591186 shutdown_connections 2024-08-31T04:26:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 1 -- 172.21.15.89:0/1636591186 wait complete. 2024-08-31T04:26:19.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a101a3000 20 client.5757 trim_cache size 0 max 16384 2024-08-31T04:26:19.258 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 76, 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "ad657bf5": { 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 76, 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 150.0, 2024-08-31T04:26:19.259 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:26:19.260 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:26:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 -- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e40720c0 msgr2=0x7f69e40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e40720c0 0x7f69e40745d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6a040c3c70 tx=0x7f69fc006eb0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 -- 172.21.15.89:0/2696314185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a04073870 msgr2=0x7f6a0415af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a04073870 0x7f6a0415af80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f69f001c930 tx=0x7f69f0001120 comp rx=0 tx=0).stop 2024-08-31T04:26:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 -- 172.21.15.89:0/2696314185 shutdown_connections 2024-08-31T04:26:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e40720c0 0x7f69e40745d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a04073870 0x7f6a0415af80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a0415b4c0 0x7f6a04148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 --2- 172.21.15.89:0/2696314185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69e8004810 0x7f6a041f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 -- 172.21.15.89:0/2696314185 >> 172.21.15.89:0/2696314185 conn(0x7f6a040c99b0 msgr2=0x7f6a04074350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:19.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 -- 172.21.15.89:0/2696314185 shutdown_connections 2024-08-31T04:26:19.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:26:19.259+0000 7f6a08c00640 1 -- 172.21.15.89:0/2696314185 wait complete. 2024-08-31T04:26:19.276 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ad657bf5', total seconds elapsed: 30.8 2024-08-31T04:26:23.342 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:26:23.346 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:26:25.543 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 15% (96/622) Updating files: 16% (100/622) Updating files: 17% (106/622) Updating files: 17% (110/622) Updating files: 18% (112/622) Updating files: 19% (119/622) Updating files: 20% (125/622) Updating files: 20% (127/622) Updating files: 21% (131/622) Updating files: 21% (133/622) Updating files: 22% (137/622) Updating files: 23% (144/622) Updating files: 24% (150/622) Updating files: 25% (156/622) Updating files: 26% (162/622) Updating files: 27% (168/622) Updating files: 28% (175/622) Updating files: 29% (181/622) Updating files: 30% (187/622) Updating files: 31% (193/622) Updating files: 32% (200/622) Updating files: 33% (206/622) Updating files: 34% (212/622) Updating files: 35% (218/622) Updating files: 36% (224/622) Updating files: 37% (231/622) Updating files: 38% (237/622) Updating files: 39% (243/622) Updating files: 40% (249/622) Updating files: 41% (256/622) Updating files: 42% (262/622) Updating files: 43% (268/622) Updating files: 44% (274/622) Updating files: 44% (275/622) Updating files: 45% (280/622) Updating files: 46% (287/622) Updating files: 47% (293/622) Updating files: 48% (299/622) Updating files: 49% (305/622) Updating files: 50% (311/622) Updating files: 51% (318/622) Updating files: 51% (319/622) Updating files: 52% (324/622) Updating files: 53% (330/622) Updating files: 54% (336/622) Updating files: 55% (343/622) Updating files: 56% (349/622) Updating files: 57% (355/622) Updating files: 58% (361/622) Updating files: 59% (367/622) Updating files: 60% (374/622) Updating files: 61% (380/622) Updating files: 62% (386/622) Updating files: 63% (392/622) Updating files: 64% (399/622) Updating files: 65% (405/622) Updating files: 66% (411/622) Updating files: 67% (417/622) Updating files: 68% (423/622) Updating files: 69% (430/622) Updating files: 70% (436/622) Updating files: 70% (441/622) Updating files: 71% (442/622) Updating files: 72% (448/622) Updating files: 73% (455/622) Updating files: 74% (461/622) Updating files: 75% (467/622) Updating files: 76% (473/622) Updating files: 77% (479/622) Updating files: 78% (486/622) Updating files: 79% (492/622) Updating files: 79% (497/622) Updating files: 80% (498/622) Updating files: 81% (504/622) Updating files: 82% (511/622) Updating files: 83% (517/622) Updating files: 84% (523/622) Updating files: 85% (529/622) Updating files: 86% (535/622) Updating files: 87% (542/622) Updating files: 88% (548/622) Updating files: 89% (554/622) Updating files: 90% (560/622) Updating files: 90% (562/622) Updating files: 91% (567/622) Updating files: 92% (573/622) Updating files: 93% (579/622) Updating files: 94% (585/622) Updating files: 95% (591/622) Updating files: 96% (598/622) Updating files: 97% (604/622) Updating files: 98% (610/622) Updating files: 99% (616/622) Updating files: 100% (622/622) Updating files: 100% (622/622), done. 2024-08-31T04:26:26.696 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 3fa121bf0a8 v0.25 2024-08-31T04:26:26.767 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.25 2024-08-31T04:26:26.791 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 26 -eq 48 ] 2024-08-31T04:26:26.791 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.26 2024-08-31T04:26:26.791 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.26 2024-08-31T04:26:26.791 INFO:tasks.workunit.client.0.smithi089.stdout:v0.26 2024-08-31T04:26:26.792 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.26 2024-08-31T04:26:33.719 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 5% (12/239) Updating files: 6% (15/239) Updating files: 7% (17/239) Updating files: 8% (20/239) Updating files: 9% (22/239) Updating files: 10% (24/239) Updating files: 11% (27/239) Updating files: 12% (29/239) Updating files: 13% (32/239) Updating files: 14% (34/239) Updating files: 15% (36/239) Updating files: 16% (39/239) Updating files: 17% (41/239) Updating files: 18% (44/239) Updating files: 19% (46/239) Updating files: 20% (48/239) Updating files: 21% (51/239) Updating files: 22% (53/239) Updating files: 23% (55/239) Updating files: 24% (58/239) Updating files: 25% (60/239) Updating files: 26% (63/239) Updating files: 27% (65/239) Updating files: 28% (67/239) Updating files: 29% (70/239) Updating files: 30% (72/239) Updating files: 31% (75/239) Updating files: 32% (77/239) Updating files: 33% (79/239) Updating files: 34% (82/239) Updating files: 35% (84/239) Updating files: 36% (87/239) Updating files: 37% (89/239) Updating files: 38% (91/239) Updating files: 39% (94/239) Updating files: 40% (96/239) Updating files: 41% (98/239) Updating files: 42% (101/239) Updating files: 43% (103/239) Updating files: 44% (106/239) Updating files: 45% (108/239) Updating files: 46% (110/239) Updating files: 47% (113/239) Updating files: 48% (115/239) Updating files: 49% (118/239) Updating files: 50% (120/239) Updating files: 51% (122/239) Updating files: 52% (125/239) Updating files: 53% (127/239) Updating files: 54% (130/239) Updating files: 55% (132/239) Updating files: 56% (134/239) Updating files: 57% (137/239) Updating files: 58% (139/239) Updating files: 59% (142/239) Updating files: 60% (144/239) Updating files: 61% (146/239) Updating files: 62% (149/239) Updating files: 63% (151/239) Updating files: 64% (153/239) Updating files: 65% (156/239) Updating files: 66% (158/239) Updating files: 67% (161/239) Updating files: 68% (163/239) Updating files: 69% (165/239) Updating files: 70% (168/239) Updating files: 71% (170/239) Updating files: 72% (173/239) Updating files: 73% (175/239) Updating files: 74% (177/239) Updating files: 75% (180/239) Updating files: 76% (182/239) Updating files: 77% (185/239) Updating files: 78% (187/239) Updating files: 79% (189/239) Updating files: 80% (192/239) Updating files: 81% (194/239) Updating files: 82% (196/239) Updating files: 83% (199/239) Updating files: 84% (201/239) Updating files: 85% (204/239) Updating files: 86% (206/239) Updating files: 87% (208/239) Updating files: 88% (211/239) Updating files: 89% (213/239) Updating files: 90% (216/239) Updating files: 91% (218/239) Updating files: 92% (220/239) Updating files: 93% (223/239) Updating files: 94% (225/239) Updating files: 95% (228/239) Updating files: 96% (230/239) Updating files: 97% (232/239) Updating files: 98% (235/239) Updating files: 99% (237/239) Updating files: 100% (239/239) Updating files: 100% (239/239), done. 2024-08-31T04:26:33.820 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 9981ff90968 v0.26 2024-08-31T04:26:33.828 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.26 2024-08-31T04:26:34.085 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 27 -eq 48 ] 2024-08-31T04:26:34.085 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.27 2024-08-31T04:26:34.085 INFO:tasks.workunit.client.0.smithi089.stdout:v0.27 2024-08-31T04:26:34.086 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.27 2024-08-31T04:26:34.086 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.27 2024-08-31T04:26:42.497 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 20% (52/253) Updating files: 21% (54/253) Updating files: 22% (56/253) Updating files: 23% (59/253) Updating files: 24% (61/253) Updating files: 25% (64/253) Updating files: 26% (66/253) Updating files: 27% (69/253) Updating files: 28% (71/253) Updating files: 29% (74/253) Updating files: 30% (76/253) Updating files: 31% (79/253) Updating files: 32% (81/253) Updating files: 33% (84/253) Updating files: 34% (87/253) Updating files: 35% (89/253) Updating files: 36% (92/253) Updating files: 37% (94/253) Updating files: 38% (97/253) Updating files: 39% (99/253) Updating files: 40% (102/253) Updating files: 41% (104/253) Updating files: 42% (107/253) Updating files: 43% (109/253) Updating files: 44% (112/253) Updating files: 45% (114/253) Updating files: 46% (117/253) Updating files: 47% (119/253) Updating files: 48% (122/253) Updating files: 49% (124/253) Updating files: 50% (127/253) Updating files: 51% (130/253) Updating files: 52% (132/253) Updating files: 53% (135/253) Updating files: 54% (137/253) Updating files: 55% (140/253) Updating files: 56% (142/253) Updating files: 57% (145/253) Updating files: 58% (147/253) Updating files: 59% (150/253) Updating files: 60% (152/253) Updating files: 61% (155/253) Updating files: 62% (157/253) Updating files: 63% (160/253) Updating files: 64% (162/253) Updating files: 65% (165/253) Updating files: 66% (167/253) Updating files: 67% (170/253) Updating files: 68% (173/253) Updating files: 69% (175/253) Updating files: 70% (178/253) Updating files: 71% (180/253) Updating files: 72% (183/253) Updating files: 73% (185/253) Updating files: 74% (188/253) Updating files: 75% (190/253) Updating files: 76% (193/253) Updating files: 77% (195/253) Updating files: 78% (198/253) Updating files: 79% (200/253) Updating files: 80% (203/253) Updating files: 81% (205/253) Updating files: 82% (208/253) Updating files: 83% (210/253) Updating files: 84% (213/253) Updating files: 84% (215/253) Updating files: 85% (216/253) Updating files: 86% (218/253) Updating files: 87% (221/253) Updating files: 88% (223/253) Updating files: 89% (226/253) Updating files: 90% (228/253) Updating files: 90% (230/253) Updating files: 91% (231/253) Updating files: 92% (233/253) Updating files: 93% (236/253) Updating files: 94% (238/253) Updating files: 95% (241/253) Updating files: 96% (243/253) Updating files: 97% (246/253) Updating files: 98% (248/253) Updating files: 99% (251/253) Updating files: 100% (253/253) Updating files: 100% (253/253), done. 2024-08-31T04:26:42.684 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 793034c62c8 v0.27 2024-08-31T04:26:42.691 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.27 2024-08-31T04:26:42.712 INFO:tasks.workunit.client.0.smithi089.stdout:v0.28 2024-08-31T04:26:42.712 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 28 -eq 48 ] 2024-08-31T04:26:42.712 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.28 2024-08-31T04:26:42.712 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.28 2024-08-31T04:26:42.712 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.28 2024-08-31T04:26:47.163 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 22% (51/227) Updating files: 23% (53/227) Updating files: 24% (55/227) Updating files: 25% (57/227) Updating files: 26% (60/227) Updating files: 27% (62/227) Updating files: 28% (64/227) Updating files: 29% (66/227) Updating files: 30% (69/227) Updating files: 31% (71/227) Updating files: 32% (73/227) Updating files: 33% (75/227) Updating files: 34% (78/227) Updating files: 35% (80/227) Updating files: 36% (82/227) Updating files: 37% (84/227) Updating files: 38% (87/227) Updating files: 39% (89/227) Updating files: 40% (91/227) Updating files: 41% (94/227) Updating files: 42% (96/227) Updating files: 43% (98/227) Updating files: 44% (100/227) Updating files: 45% (103/227) Updating files: 46% (105/227) Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 60% (137/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 68% (156/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 93% (213/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2024-08-31T04:26:47.229 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 071881d7e55 v0.28 2024-08-31T04:26:47.235 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.28 2024-08-31T04:26:47.313 INFO:tasks.workunit.client.0.smithi089.stdout:v0.29 2024-08-31T04:26:47.313 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 29 -eq 48 ] 2024-08-31T04:26:47.314 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.29 2024-08-31T04:26:47.314 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.29 2024-08-31T04:26:47.314 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.29 2024-08-31T04:26:50.784 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 21% (34/159) Updating files: 22% (35/159) Updating files: 23% (37/159) Updating files: 24% (39/159) Updating files: 25% (40/159) Updating files: 26% (42/159) Updating files: 27% (43/159) Updating files: 28% (45/159) Updating files: 29% (47/159) Updating files: 30% (48/159) Updating files: 31% (50/159) Updating files: 32% (51/159) Updating files: 33% (53/159) Updating files: 34% (55/159) Updating files: 35% (56/159) Updating files: 36% (58/159) Updating files: 37% (59/159) Updating files: 38% (61/159) Updating files: 39% (63/159) Updating files: 40% (64/159) Updating files: 41% (66/159) Updating files: 42% (67/159) Updating files: 43% (69/159) Updating files: 44% (70/159) Updating files: 45% (72/159) Updating files: 46% (74/159) Updating files: 47% (75/159) Updating files: 48% (77/159) Updating files: 49% (78/159) Updating files: 50% (80/159) Updating files: 51% (82/159) Updating files: 52% (83/159) Updating files: 53% (85/159) Updating files: 54% (86/159) Updating files: 55% (88/159) Updating files: 56% (90/159) Updating files: 57% (91/159) Updating files: 58% (93/159) Updating files: 59% (94/159) Updating files: 60% (96/159) Updating files: 61% (97/159) Updating files: 62% (99/159) Updating files: 63% (101/159) Updating files: 64% (102/159) Updating files: 65% (104/159) Updating files: 66% (105/159) Updating files: 67% (107/159) Updating files: 68% (109/159) Updating files: 69% (110/159) Updating files: 70% (112/159) Updating files: 71% (113/159) Updating files: 72% (115/159) Updating files: 73% (117/159) Updating files: 74% (118/159) Updating files: 75% (120/159) Updating files: 76% (121/159) Updating files: 77% (123/159) Updating files: 78% (125/159) Updating files: 79% (126/159) Updating files: 80% (128/159) Updating files: 81% (129/159) Updating files: 82% (131/159) Updating files: 83% (132/159) Updating files: 84% (134/159) Updating files: 85% (136/159) Updating files: 86% (137/159) Updating files: 87% (139/159) Updating files: 88% (140/159) Updating files: 89% (142/159) Updating files: 90% (144/159) Updating files: 91% (145/159) Updating files: 92% (147/159) Updating files: 93% (148/159) Updating files: 94% (150/159) Updating files: 95% (152/159) Updating files: 96% (153/159) Updating files: 97% (155/159) Updating files: 98% (156/159) Updating files: 99% (158/159) Updating files: 100% (159/159) Updating files: 100% (159/159), done. 2024-08-31T04:26:50.841 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 8e69c39f699 v0.29 2024-08-31T04:26:50.846 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.29 2024-08-31T04:26:50.984 INFO:tasks.workunit.client.0.smithi089.stdout:v0.30 2024-08-31T04:26:50.984 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 30 -eq 48 ] 2024-08-31T04:26:50.984 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.30 2024-08-31T04:26:50.984 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.30 2024-08-31T04:26:50.984 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.30 2024-08-31T04:26:53.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:26:53.449 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:27:04.121 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 41% (117/285) Updating files: 42% (120/285) Updating files: 43% (123/285) Updating files: 44% (126/285) Updating files: 45% (129/285) Updating files: 46% (132/285) Updating files: 47% (134/285) Updating files: 48% (137/285) Updating files: 49% (140/285) Updating files: 50% (143/285) Updating files: 51% (146/285) Updating files: 52% (149/285) Updating files: 53% (152/285) Updating files: 53% (153/285) Updating files: 54% (154/285) Updating files: 55% (157/285) Updating files: 56% (160/285) Updating files: 57% (163/285) Updating files: 58% (166/285) Updating files: 59% (169/285) Updating files: 60% (171/285) Updating files: 61% (174/285) Updating files: 62% (177/285) Updating files: 63% (180/285) Updating files: 64% (183/285) Updating files: 65% (186/285) Updating files: 66% (189/285) Updating files: 67% (191/285) Updating files: 68% (194/285) Updating files: 69% (197/285) Updating files: 70% (200/285) Updating files: 71% (203/285) Updating files: 72% (206/285) Updating files: 73% (209/285) Updating files: 74% (211/285) Updating files: 75% (214/285) Updating files: 76% (217/285) Updating files: 77% (220/285) Updating files: 78% (223/285) Updating files: 79% (226/285) Updating files: 80% (228/285) Updating files: 81% (231/285) Updating files: 82% (234/285) Updating files: 83% (237/285) Updating files: 84% (240/285) Updating files: 85% (243/285) Updating files: 86% (246/285) Updating files: 87% (248/285) Updating files: 88% (251/285) Updating files: 89% (254/285) Updating files: 90% (257/285) Updating files: 91% (260/285) Updating files: 92% (263/285) Updating files: 93% (266/285) Updating files: 94% (268/285) Updating files: 95% (271/285) Updating files: 96% (274/285) Updating files: 97% (277/285) Updating files: 98% (280/285) Updating files: 98% (282/285) Updating files: 99% (283/285) Updating files: 100% (285/285) Updating files: 100% (285/285), done. 2024-08-31T04:27:04.446 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 64b1b2c70f0 v0.30 2024-08-31T04:27:04.451 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.30 2024-08-31T04:27:05.131 INFO:tasks.workunit.client.0.smithi089.stdout:v0.31 2024-08-31T04:27:05.131 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 31 -eq 48 ] 2024-08-31T04:27:05.132 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.31 2024-08-31T04:27:05.132 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.31 2024-08-31T04:27:05.132 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.31 2024-08-31T04:27:13.362 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 17% (68/398) Updating files: 17% (71/398) Updating files: 18% (72/398) Updating files: 19% (76/398) Updating files: 20% (80/398) Updating files: 21% (84/398) Updating files: 22% (88/398) Updating files: 23% (92/398) Updating files: 24% (96/398) Updating files: 25% (100/398) Updating files: 26% (104/398) Updating files: 27% (108/398) Updating files: 28% (112/398) Updating files: 29% (116/398) Updating files: 30% (120/398) Updating files: 31% (124/398) Updating files: 32% (128/398) Updating files: 33% (132/398) Updating files: 34% (136/398) Updating files: 35% (140/398) Updating files: 36% (144/398) Updating files: 37% (148/398) Updating files: 38% (152/398) Updating files: 39% (156/398) Updating files: 40% (160/398) Updating files: 41% (164/398) Updating files: 42% (168/398) Updating files: 43% (172/398) Updating files: 44% (176/398) Updating files: 45% (180/398) Updating files: 46% (184/398) Updating files: 47% (188/398) Updating files: 48% (192/398) Updating files: 49% (196/398) Updating files: 50% (199/398) Updating files: 51% (203/398) Updating files: 51% (205/398) Updating files: 52% (207/398) Updating files: 53% (211/398) Updating files: 54% (215/398) Updating files: 55% (219/398) Updating files: 56% (223/398) Updating files: 57% (227/398) Updating files: 58% (231/398) Updating files: 59% (235/398) Updating files: 60% (239/398) Updating files: 61% (243/398) Updating files: 62% (247/398) Updating files: 63% (251/398) Updating files: 64% (255/398) Updating files: 65% (259/398) Updating files: 66% (263/398) Updating files: 67% (267/398) Updating files: 68% (271/398) Updating files: 69% (275/398) Updating files: 70% (279/398) Updating files: 71% (283/398) Updating files: 72% (287/398) Updating files: 73% (291/398) Updating files: 74% (295/398) Updating files: 75% (299/398) Updating files: 76% (303/398) Updating files: 77% (307/398) Updating files: 78% (311/398) Updating files: 79% (315/398) Updating files: 80% (319/398) Updating files: 81% (323/398) Updating files: 82% (327/398) Updating files: 83% (331/398) Updating files: 84% (335/398) Updating files: 85% (339/398) Updating files: 86% (343/398) Updating files: 87% (347/398) Updating files: 87% (348/398) Updating files: 88% (351/398) Updating files: 89% (355/398) Updating files: 90% (359/398) Updating files: 91% (363/398) Updating files: 92% (367/398) Updating files: 93% (371/398) Updating files: 94% (375/398) Updating files: 95% (379/398) Updating files: 96% (383/398) Updating files: 97% (387/398) Updating files: 98% (391/398) Updating files: 99% (395/398) Updating files: 100% (398/398) Updating files: 100% (398/398), done. 2024-08-31T04:27:13.433 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 9019c6ce640 v0.31 2024-08-31T04:27:13.438 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.31 2024-08-31T04:27:13.627 INFO:tasks.workunit.client.0.smithi089.stdout:v0.32 2024-08-31T04:27:13.627 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 32 -eq 48 ] 2024-08-31T04:27:13.627 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.32 2024-08-31T04:27:13.627 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.32 2024-08-31T04:27:13.628 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.32 2024-08-31T04:27:21.881 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 28% (56/195) Updating files: 29% (57/195) Updating files: 30% (59/195) Updating files: 31% (61/195) Updating files: 32% (63/195) Updating files: 33% (65/195) Updating files: 34% (67/195) Updating files: 35% (69/195) Updating files: 36% (71/195) Updating files: 37% (73/195) Updating files: 38% (75/195) Updating files: 39% (77/195) Updating files: 40% (78/195) Updating files: 41% (80/195) Updating files: 42% (82/195) Updating files: 43% (84/195) Updating files: 44% (86/195) Updating files: 45% (88/195) Updating files: 46% (90/195) Updating files: 47% (92/195) Updating files: 47% (93/195) Updating files: 48% (94/195) Updating files: 49% (96/195) Updating files: 50% (98/195) Updating files: 51% (100/195) Updating files: 52% (102/195) Updating files: 53% (104/195) Updating files: 54% (106/195) Updating files: 55% (108/195) Updating files: 56% (110/195) Updating files: 57% (112/195) Updating files: 58% (114/195) Updating files: 59% (116/195) Updating files: 60% (117/195) Updating files: 61% (119/195) Updating files: 62% (121/195) Updating files: 63% (123/195) Updating files: 64% (125/195) Updating files: 65% (127/195) Updating files: 66% (129/195) Updating files: 67% (131/195) Updating files: 68% (133/195) Updating files: 69% (135/195) Updating files: 70% (137/195) Updating files: 71% (139/195) Updating files: 72% (141/195) Updating files: 73% (143/195) Updating files: 74% (145/195) Updating files: 75% (147/195) Updating files: 76% (149/195) Updating files: 77% (151/195) Updating files: 78% (153/195) Updating files: 78% (154/195) Updating files: 79% (155/195) Updating files: 80% (156/195) Updating files: 81% (158/195) Updating files: 82% (160/195) Updating files: 83% (162/195) Updating files: 84% (164/195) Updating files: 85% (166/195) Updating files: 86% (168/195) Updating files: 87% (170/195) Updating files: 88% (172/195) Updating files: 89% (174/195) Updating files: 90% (176/195) Updating files: 91% (178/195) Updating files: 92% (180/195) Updating files: 93% (182/195) Updating files: 94% (184/195) Updating files: 95% (186/195) Updating files: 96% (188/195) Updating files: 97% (190/195) Updating files: 98% (192/195) Updating files: 99% (194/195) Updating files: 100% (195/195) Updating files: 100% (195/195), done. 2024-08-31T04:27:22.763 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at c08d08baa6a v0.32 2024-08-31T04:27:22.767 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.32 2024-08-31T04:27:22.789 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 33 -eq 48 ] 2024-08-31T04:27:22.789 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.33 2024-08-31T04:27:22.789 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.33 2024-08-31T04:27:22.789 INFO:tasks.workunit.client.0.smithi089.stdout:v0.33 2024-08-31T04:27:22.790 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.33 2024-08-31T04:27:23.521 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:27:23.525 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:27:24.462 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 63% (101/160) Updating files: 64% (103/160) Updating files: 65% (104/160) Updating files: 66% (106/160) Updating files: 67% (108/160) Updating files: 68% (109/160) Updating files: 69% (111/160) Updating files: 70% (112/160) Updating files: 71% (114/160) Updating files: 72% (116/160) Updating files: 73% (117/160) Updating files: 74% (119/160) Updating files: 75% (120/160) Updating files: 76% (122/160) Updating files: 77% (124/160) Updating files: 78% (125/160) Updating files: 79% (127/160) Updating files: 80% (128/160) Updating files: 81% (130/160) Updating files: 82% (132/160) Updating files: 83% (133/160) Updating files: 84% (135/160) Updating files: 85% (136/160) Updating files: 86% (138/160) Updating files: 87% (140/160) Updating files: 88% (141/160) Updating files: 89% (143/160) Updating files: 90% (144/160) Updating files: 91% (146/160) Updating files: 92% (148/160) Updating files: 93% (149/160) Updating files: 94% (151/160) Updating files: 95% (152/160) Updating files: 96% (154/160) Updating files: 97% (156/160) Updating files: 98% (157/160) Updating files: 99% (159/160) Updating files: 100% (160/160) Updating files: 100% (160/160), done. 2024-08-31T04:27:24.521 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 340b4348bf6 v0.33 2024-08-31T04:27:24.522 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.33 2024-08-31T04:27:24.673 INFO:tasks.workunit.client.0.smithi089.stdout:v0.34 2024-08-31T04:27:24.673 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 34 -eq 48 ] 2024-08-31T04:27:24.674 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.34 2024-08-31T04:27:24.674 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.34 2024-08-31T04:27:24.674 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.34 2024-08-31T04:27:27.288 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 27% (35/129) Updating files: 28% (37/129) Updating files: 29% (38/129) Updating files: 30% (39/129) Updating files: 31% (40/129) Updating files: 32% (42/129) Updating files: 33% (43/129) Updating files: 34% (44/129) Updating files: 35% (46/129) Updating files: 36% (47/129) Updating files: 37% (48/129) Updating files: 38% (50/129) Updating files: 39% (51/129) Updating files: 40% (52/129) Updating files: 41% (53/129) Updating files: 42% (55/129) Updating files: 43% (56/129) Updating files: 44% (57/129) Updating files: 45% (59/129) Updating files: 46% (60/129) Updating files: 47% (61/129) Updating files: 48% (62/129) Updating files: 49% (64/129) Updating files: 50% (65/129) Updating files: 51% (66/129) Updating files: 52% (68/129) Updating files: 53% (69/129) Updating files: 54% (70/129) Updating files: 55% (71/129) Updating files: 56% (73/129) Updating files: 57% (74/129) Updating files: 58% (75/129) Updating files: 59% (77/129) Updating files: 60% (78/129) Updating files: 61% (79/129) Updating files: 62% (80/129) Updating files: 63% (82/129) Updating files: 64% (83/129) Updating files: 65% (84/129) Updating files: 66% (86/129) Updating files: 67% (87/129) Updating files: 68% (88/129) Updating files: 69% (90/129) Updating files: 70% (91/129) Updating files: 71% (92/129) Updating files: 72% (93/129) Updating files: 73% (95/129) Updating files: 74% (96/129) Updating files: 75% (97/129) Updating files: 76% (99/129) Updating files: 77% (100/129) Updating files: 78% (101/129) Updating files: 79% (102/129) Updating files: 80% (104/129) Updating files: 81% (105/129) Updating files: 82% (106/129) Updating files: 83% (108/129) Updating files: 84% (109/129) Updating files: 85% (110/129) Updating files: 86% (111/129) Updating files: 87% (113/129) Updating files: 88% (114/129) Updating files: 89% (115/129) Updating files: 90% (117/129) Updating files: 91% (118/129) Updating files: 92% (119/129) Updating files: 93% (120/129) Updating files: 94% (122/129) Updating files: 95% (123/129) Updating files: 96% (124/129) Updating files: 97% (126/129) Updating files: 98% (127/129) Updating files: 99% (128/129) Updating files: 100% (129/129) Updating files: 100% (129/129), done. 2024-08-31T04:27:27.348 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 2f039eeeb74 v0.34 2024-08-31T04:27:27.351 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.34 2024-08-31T04:27:27.526 INFO:tasks.workunit.client.0.smithi089.stdout:v0.35 2024-08-31T04:27:27.526 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 35 -eq 48 ] 2024-08-31T04:27:27.526 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.35 2024-08-31T04:27:27.526 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.35 2024-08-31T04:27:27.526 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.35 2024-08-31T04:27:42.939 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 26% (90/334) Updating files: 27% (91/334) Updating files: 28% (94/334) Updating files: 29% (97/334) Updating files: 30% (101/334) Updating files: 31% (104/334) Updating files: 32% (107/334) Updating files: 32% (110/334) Updating files: 33% (111/334) Updating files: 34% (114/334) Updating files: 35% (117/334) Updating files: 36% (121/334) Updating files: 37% (124/334) Updating files: 38% (127/334) Updating files: 39% (131/334) Updating files: 40% (134/334) Updating files: 41% (137/334) Updating files: 42% (141/334) Updating files: 43% (144/334) Updating files: 44% (147/334) Updating files: 45% (151/334) Updating files: 46% (154/334) Updating files: 46% (155/334) Updating files: 47% (157/334) Updating files: 48% (161/334) Updating files: 49% (164/334) Updating files: 50% (167/334) Updating files: 51% (171/334) Updating files: 52% (174/334) Updating files: 53% (178/334) Updating files: 54% (181/334) Updating files: 55% (184/334) Updating files: 56% (188/334) Updating files: 56% (189/334) Updating files: 57% (191/334) Updating files: 58% (194/334) Updating files: 59% (198/334) Updating files: 60% (201/334) Updating files: 61% (204/334) Updating files: 62% (208/334) Updating files: 63% (211/334) Updating files: 64% (214/334) Updating files: 65% (218/334) Updating files: 66% (221/334) Updating files: 67% (224/334) Updating files: 68% (228/334) Updating files: 69% (231/334) Updating files: 70% (234/334) Updating files: 71% (238/334) Updating files: 72% (241/334) Updating files: 73% (244/334) Updating files: 74% (248/334) Updating files: 75% (251/334) Updating files: 76% (254/334) Updating files: 77% (258/334) Updating files: 78% (261/334) Updating files: 79% (264/334) Updating files: 80% (268/334) Updating files: 81% (271/334) Updating files: 82% (274/334) Updating files: 82% (275/334) Updating files: 83% (278/334) Updating files: 84% (281/334) Updating files: 85% (284/334) Updating files: 86% (288/334) Updating files: 87% (291/334) Updating files: 88% (294/334) Updating files: 89% (298/334) Updating files: 90% (301/334) Updating files: 91% (304/334) Updating files: 92% (308/334) Updating files: 93% (311/334) Updating files: 94% (314/334) Updating files: 94% (315/334) Updating files: 95% (318/334) Updating files: 96% (321/334) Updating files: 97% (324/334) Updating files: 98% (328/334) Updating files: 99% (331/334) Updating files: 100% (334/334) Updating files: 100% (334/334), done. 2024-08-31T04:27:42.991 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 0afda378124 v0.35 2024-08-31T04:27:42.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.35 2024-08-31T04:27:43.265 INFO:tasks.workunit.client.0.smithi089.stdout:v0.36 2024-08-31T04:27:43.266 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 36 -eq 48 ] 2024-08-31T04:27:43.266 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.36 2024-08-31T04:27:43.266 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.36 2024-08-31T04:27:43.266 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.36 2024-08-31T04:27:49.714 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 21% (53/244) Updating files: 22% (54/244) Updating files: 23% (57/244) Updating files: 24% (59/244) Updating files: 25% (61/244) Updating files: 26% (64/244) Updating files: 27% (66/244) Updating files: 28% (69/244) Updating files: 29% (71/244) Updating files: 30% (74/244) Updating files: 31% (76/244) Updating files: 32% (79/244) Updating files: 33% (81/244) Updating files: 34% (83/244) Updating files: 35% (86/244) Updating files: 36% (88/244) Updating files: 37% (91/244) Updating files: 38% (93/244) Updating files: 39% (96/244) Updating files: 40% (98/244) Updating files: 41% (101/244) Updating files: 42% (103/244) Updating files: 43% (105/244) Updating files: 44% (108/244) Updating files: 45% (110/244) Updating files: 45% (111/244) Updating files: 46% (113/244) Updating files: 47% (115/244) Updating files: 48% (118/244) Updating files: 49% (120/244) Updating files: 50% (122/244) Updating files: 51% (125/244) Updating files: 52% (127/244) Updating files: 53% (130/244) Updating files: 54% (132/244) Updating files: 55% (135/244) Updating files: 56% (137/244) Updating files: 57% (140/244) Updating files: 58% (142/244) Updating files: 59% (144/244) Updating files: 60% (147/244) Updating files: 61% (149/244) Updating files: 62% (152/244) Updating files: 63% (154/244) Updating files: 64% (157/244) Updating files: 65% (159/244) Updating files: 66% (162/244) Updating files: 67% (164/244) Updating files: 68% (166/244) Updating files: 69% (169/244) Updating files: 70% (171/244) Updating files: 71% (174/244) Updating files: 72% (176/244) Updating files: 73% (179/244) Updating files: 74% (181/244) Updating files: 75% (183/244) Updating files: 76% (186/244) Updating files: 77% (188/244) Updating files: 78% (191/244) Updating files: 79% (193/244) Updating files: 80% (196/244) Updating files: 81% (198/244) Updating files: 82% (201/244) Updating files: 83% (203/244) Updating files: 84% (205/244) Updating files: 85% (208/244) Updating files: 86% (210/244) Updating files: 87% (213/244) Updating files: 88% (215/244) Updating files: 88% (216/244) Updating files: 89% (218/244) Updating files: 90% (220/244) Updating files: 91% (223/244) Updating files: 92% (225/244) Updating files: 93% (227/244) Updating files: 94% (230/244) Updating files: 95% (232/244) Updating files: 96% (235/244) Updating files: 97% (237/244) Updating files: 98% (240/244) Updating files: 99% (242/244) Updating files: 100% (244/244) Updating files: 100% (244/244), done. 2024-08-31T04:27:49.818 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 877cacbbdbb v0.36 2024-08-31T04:27:49.821 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.36 2024-08-31T04:27:49.941 INFO:tasks.workunit.client.0.smithi089.stdout:v0.37 2024-08-31T04:27:49.941 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 37 -eq 48 ] 2024-08-31T04:27:49.942 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.37 2024-08-31T04:27:49.942 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.37 2024-08-31T04:27:49.942 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.37 2024-08-31T04:27:53.586 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:27:53.589 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:27:53.916 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 11% (20/181) Updating files: 12% (22/181) Updating files: 13% (24/181) Updating files: 14% (26/181) Updating files: 15% (28/181) Updating files: 16% (29/181) Updating files: 17% (31/181) Updating files: 18% (33/181) Updating files: 19% (35/181) Updating files: 20% (37/181) Updating files: 21% (39/181) Updating files: 22% (40/181) Updating files: 23% (42/181) Updating files: 24% (44/181) Updating files: 25% (46/181) Updating files: 26% (48/181) Updating files: 27% (49/181) Updating files: 28% (51/181) Updating files: 29% (53/181) Updating files: 30% (55/181) Updating files: 31% (57/181) Updating files: 32% (58/181) Updating files: 33% (60/181) Updating files: 34% (62/181) Updating files: 35% (64/181) Updating files: 36% (66/181) Updating files: 37% (67/181) Updating files: 38% (69/181) Updating files: 39% (71/181) Updating files: 40% (73/181) Updating files: 41% (75/181) Updating files: 42% (77/181) Updating files: 43% (78/181) Updating files: 44% (80/181) Updating files: 45% (82/181) Updating files: 46% (84/181) Updating files: 47% (86/181) Updating files: 48% (87/181) Updating files: 49% (89/181) Updating files: 50% (91/181) Updating files: 51% (93/181) Updating files: 52% (95/181) Updating files: 53% (96/181) Updating files: 54% (98/181) Updating files: 55% (100/181) Updating files: 56% (102/181) Updating files: 57% (104/181) Updating files: 58% (105/181) Updating files: 59% (107/181) Updating files: 60% (109/181) Updating files: 61% (111/181) Updating files: 62% (113/181) Updating files: 63% (115/181) Updating files: 64% (116/181) Updating files: 65% (118/181) Updating files: 66% (120/181) Updating files: 67% (122/181) Updating files: 68% (124/181) Updating files: 69% (125/181) Updating files: 70% (127/181) Updating files: 71% (129/181) Updating files: 72% (131/181) Updating files: 73% (133/181) Updating files: 74% (134/181) Updating files: 75% (136/181) Updating files: 76% (138/181) Updating files: 77% (140/181) Updating files: 78% (142/181) Updating files: 79% (143/181) Updating files: 80% (145/181) Updating files: 81% (147/181) Updating files: 82% (149/181) Updating files: 83% (151/181) Updating files: 84% (153/181) Updating files: 85% (154/181) Updating files: 86% (156/181) Updating files: 87% (158/181) Updating files: 88% (160/181) Updating files: 89% (162/181) Updating files: 90% (163/181) Updating files: 91% (165/181) Updating files: 91% (166/181) Updating files: 92% (167/181) Updating files: 93% (169/181) Updating files: 94% (171/181) Updating files: 95% (172/181) Updating files: 96% (174/181) Updating files: 97% (176/181) Updating files: 98% (178/181) Updating files: 99% (180/181) Updating files: 100% (181/181) Updating files: 100% (181/181), done. 2024-08-31T04:27:54.013 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at a6f3bbb744a v0.37 2024-08-31T04:27:54.016 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.37 2024-08-31T04:27:54.660 INFO:tasks.workunit.client.0.smithi089.stdout:v0.38 2024-08-31T04:27:54.660 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 38 -eq 48 ] 2024-08-31T04:27:54.660 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.38 2024-08-31T04:27:54.660 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.38 2024-08-31T04:27:54.660 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.38 2024-08-31T04:28:07.540 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 47% (81/171) Updating files: 48% (83/171) Updating files: 49% (84/171) Updating files: 50% (86/171) Updating files: 51% (88/171) Updating files: 52% (89/171) Updating files: 53% (91/171) Updating files: 54% (93/171) Updating files: 55% (95/171) Updating files: 56% (96/171) Updating files: 57% (98/171) Updating files: 58% (100/171) Updating files: 59% (101/171) Updating files: 60% (103/171) Updating files: 61% (105/171) Updating files: 62% (107/171) Updating files: 63% (108/171) Updating files: 64% (110/171) Updating files: 64% (111/171) Updating files: 65% (112/171) Updating files: 66% (113/171) Updating files: 67% (115/171) Updating files: 68% (117/171) Updating files: 69% (118/171) Updating files: 70% (120/171) Updating files: 71% (122/171) Updating files: 72% (124/171) Updating files: 73% (125/171) Updating files: 74% (127/171) Updating files: 75% (129/171) Updating files: 76% (130/171) Updating files: 77% (132/171) Updating files: 78% (134/171) Updating files: 79% (136/171) Updating files: 80% (137/171) Updating files: 81% (139/171) Updating files: 82% (141/171) Updating files: 83% (142/171) Updating files: 84% (144/171) Updating files: 85% (146/171) Updating files: 86% (148/171) Updating files: 87% (149/171) Updating files: 88% (151/171) Updating files: 89% (153/171) Updating files: 90% (154/171) Updating files: 91% (156/171) Updating files: 92% (158/171) Updating files: 93% (160/171) Updating files: 94% (161/171) Updating files: 95% (163/171) Updating files: 96% (165/171) Updating files: 97% (166/171) Updating files: 98% (168/171) Updating files: 99% (170/171) Updating files: 100% (171/171) Updating files: 100% (171/171), done. 2024-08-31T04:28:07.572 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at b600ec2ac7c v0.38 2024-08-31T04:28:07.575 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.38 2024-08-31T04:28:07.753 INFO:tasks.workunit.client.0.smithi089.stdout:v0.39 2024-08-31T04:28:07.753 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 39 -eq 48 ] 2024-08-31T04:28:07.753 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.39 2024-08-31T04:28:07.754 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.39 2024-08-31T04:28:07.754 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.39 2024-08-31T04:28:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-08-31T04:28:10.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:28:10.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 -- 172.21.15.89:0/283296244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a815bc70 msgr2=0x7f42a8152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:10.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 --2- 172.21.15.89:0/283296244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a815bc70 0x7f42a8152a10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f42a8073250 tx=0x7f429801f0b0 comp rx=0 tx=0).stop 2024-08-31T04:28:10.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 -- 172.21.15.89:0/283296244 shutdown_connections 2024-08-31T04:28:10.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 --2- 172.21.15.89:0/283296244 >> v2:172.21.15.170:3300/0 conn(0x7f42a80c7920 0x7f42a80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:10.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 --2- 172.21.15.89:0/283296244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a80c1f40 0x7f42a80c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:10.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 --2- 172.21.15.89:0/283296244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a815bc70 0x7f42a8152a10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:10.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 -- 172.21.15.89:0/283296244 >> 172.21.15.89:0/283296244 conn(0x7f42a80ccf20 msgr2=0x7f42a80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:10.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 -- 172.21.15.89:0/283296244 shutdown_connections 2024-08-31T04:28:10.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 -- 172.21.15.89:0/283296244 wait complete. 2024-08-31T04:28:10.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.863+0000 7f42ad400640 1 Processor -- start 2024-08-31T04:28:10.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 -- start start 2024-08-31T04:28:10.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a80c1f40 0x7f42a8153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:10.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a80c7920 0x7f42a80afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a815bc70 0x7f42a81f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f42a80748a0 con 0x7f42a80c1f40 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42a8074720 con 0x7f42a80c7920 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42a8074a20 con 0x7f42a815bc70 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a80c1f40 0x7f42a8153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a80c1f40 0x7f42a8153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54368/0 (socket says 172.21.15.89:54368) 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a6800640 1 -- 172.21.15.89:0/934210140 learned_addr learned my addr 172.21.15.89:0/934210140 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f429de00640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a80c7920 0x7f42a80afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a7200640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a815bc70 0x7f42a81f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a6800640 1 -- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a815bc70 msgr2=0x7f42a81f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a6800640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a815bc70 0x7f42a81f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a6800640 1 -- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a80c7920 msgr2=0x7f42a80afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:10.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a6800640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a80c7920 0x7f42a80afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:10.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a6800640 1 -- 172.21.15.89:0/934210140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a8155b20 con 0x7f42a80c1f40 2024-08-31T04:28:10.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a7200640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a815bc70 0x7f42a81f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:28:10.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f429de00640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a80c7920 0x7f42a80afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:28:10.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42a6800640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a80c1f40 0x7f42a8153a90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f429801d760 tx=0x7f4298005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:10.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f429f400640 1 -- 172.21.15.89:0/934210140 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42980b5040 con 0x7f42a80c1f40 2024-08-31T04:28:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f429f400640 1 -- 172.21.15.89:0/934210140 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4298005320 con 0x7f42a80c1f40 2024-08-31T04:28:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a8155dc0 con 0x7f42a80c1f40 2024-08-31T04:28:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f429f400640 1 -- 172.21.15.89:0/934210140 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42980046d0 con 0x7f42a80c1f40 2024-08-31T04:28:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a81e54c0 con 0x7f42a80c1f40 2024-08-31T04:28:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.867+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a8074ea0 con 0x7f42a80c1f40 2024-08-31T04:28:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.871+0000 7f429f400640 1 -- 172.21.15.89:0/934210140 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4298004890 con 0x7f42a80c1f40 2024-08-31T04:28:10.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.871+0000 7f429f400640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42840720c0 0x7f42840745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:10.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.871+0000 7f429f400640 1 -- 172.21.15.89:0/934210140 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f4298130470 con 0x7f42a80c1f40 2024-08-31T04:28:10.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.871+0000 7f429de00640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42840720c0 0x7f42840745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:10.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.871+0000 7f429de00640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42840720c0 0x7f42840745d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4290005fd0 tx=0x7f4290005d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:10.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:10.875+0000 7f429f400640 1 -- 172.21.15.89:0/934210140 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f42980c1060 con 0x7f42a80c1f40 2024-08-31T04:28:11.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.075+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42a81560a0 con 0x7f42a80c1f40 2024-08-31T04:28:11.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f429f400640 1 -- 172.21.15.89:0/934210140 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f42a8155b20 con 0x7f42a80c1f40 2024-08-31T04:28:11.077 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:28:11.077 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:28:11.077 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:28:11.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42840720c0 msgr2=0x7f42840745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:11.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42840720c0 0x7f42840745d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4290005fd0 tx=0x7f4290005d60 comp rx=0 tx=0).stop 2024-08-31T04:28:11.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a80c1f40 msgr2=0x7f42a8153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:11.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a80c1f40 0x7f42a8153a90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f429801d760 tx=0x7f4298005d80 comp rx=0 tx=0).stop 2024-08-31T04:28:11.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 shutdown_connections 2024-08-31T04:28:11.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f42840720c0 0x7f42840745d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a815bc70 0x7f42a81f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a80c7920 0x7f42a80afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 --2- 172.21.15.89:0/934210140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a80c1f40 0x7f42a8153a90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 >> 172.21.15.89:0/934210140 conn(0x7f42a80ccf20 msgr2=0x7f42a80b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:11.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 shutdown_connections 2024-08-31T04:28:11.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.079+0000 7f42ad400640 1 -- 172.21.15.89:0/934210140 wait complete. 2024-08-31T04:28:11.099 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-08-31T04:28:11.099 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-08-31T04:28:11.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.303+0000 7f8191800640 1 -- 172.21.15.89:0/1497074108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8170004d50 msgr2=0x7f8170005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:11.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.303+0000 7f8191800640 1 --2- 172.21.15.89:0/1497074108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8170004d50 0x7f8170005160 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8184009ee0 tx=0x7f818401d630 comp rx=0 tx=0).stop 2024-08-31T04:28:11.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.303+0000 7f818b400640 1 -- 172.21.15.89:0/1497074108 reap_dead start 2024-08-31T04:28:11.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.303+0000 7f8191800640 1 -- 172.21.15.89:0/1497074108 shutdown_connections 2024-08-31T04:28:11.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.303+0000 7f8191800640 1 -- 172.21.15.89:0/1497074108 >> 172.21.15.89:0/1497074108 conn(0x7f818c0c99b0 msgr2=0x7f818c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:11.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.303+0000 7f8191800640 1 -- 172.21.15.89:0/1497074108 shutdown_connections 2024-08-31T04:28:11.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.303+0000 7f8191800640 1 -- 172.21.15.89:0/1497074108 wait complete. 2024-08-31T04:28:11.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f8191800640 1 Processor -- start 2024-08-31T04:28:11.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f8191800640 1 -- start start 2024-08-31T04:28:11.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f8191800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f818c0c89b0 0x7f818c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f8191800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f818c1523a0 0x7f818c146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f8191800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f818c0c7880 0x7f818c0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f8191800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f818c0738b0 con 0x7f818c0c7880 2024-08-31T04:28:11.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f8191800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f818c070840 con 0x7f818c0c89b0 2024-08-31T04:28:11.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f8191800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f818c073b90 con 0x7f818c1523a0 2024-08-31T04:28:11.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f818c0c7880 0x7f818c0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f818c0c7880 0x7f818c0c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54382/0 (socket says 172.21.15.89:54382) 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818b400640 1 -- 172.21.15.89:0/2510684872 learned_addr learned my addr 172.21.15.89:0/2510684872 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818aa00640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f818c0c89b0 0x7f818c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818a000640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f818c1523a0 0x7f818c146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818b400640 1 -- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f818c1523a0 msgr2=0x7f818c146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818b400640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f818c1523a0 0x7f818c146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818b400640 1 -- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f818c0c89b0 msgr2=0x7f818c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818b400640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f818c0c89b0 0x7f818c15aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.307+0000 7f818b400640 1 -- 172.21.15.89:0/2510684872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818c1f2ff0 con 0x7f818c0c7880 2024-08-31T04:28:11.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.311+0000 7f818b400640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f818c0c7880 0x7f818c0c7c90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8184099160 tx=0x7f8184004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:11.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.311+0000 7f8182a00640 1 -- 172.21.15.89:0/2510684872 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81840ad070 con 0x7f818c0c7880 2024-08-31T04:28:11.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.311+0000 7f8182a00640 1 -- 172.21.15.89:0/2510684872 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81840a7ad0 con 0x7f818c0c7880 2024-08-31T04:28:11.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.311+0000 7f8191800640 1 -- 172.21.15.89:0/2510684872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818c1f3e70 con 0x7f818c0c7880 2024-08-31T04:28:11.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.311+0000 7f8182a00640 1 -- 172.21.15.89:0/2510684872 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184009200 con 0x7f818c0c7880 2024-08-31T04:28:11.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.311+0000 7f8191800640 1 -- 172.21.15.89:0/2510684872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f818c1f3850 con 0x7f818c0c7880 2024-08-31T04:28:11.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.311+0000 7f8182a00640 1 -- 172.21.15.89:0/2510684872 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f81840b0070 con 0x7f818c0c7880 2024-08-31T04:28:11.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.311+0000 7f8182a00640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f816c0720c0 0x7f816c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.311+0000 7f8182a00640 1 -- 172.21.15.89:0/2510684872 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f818412d4d0 con 0x7f818c0c7880 2024-08-31T04:28:11.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 Processor -- start 2024-08-31T04:28:11.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818aa00640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f816c0720c0 0x7f816c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 -- start start 2024-08-31T04:28:11.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818aa00640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f816c0720c0 0x7f816c0745d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f817c009c60 tx=0x7f817c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:11.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fde9df2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 0x563fdea19d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563fde834820 con 0x563fde8bb960 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563fde823db0 con 0x563fde8d1e90 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563fde827d60 con 0x563fde8dc3f0 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54394/0 (socket says 172.21.15.89:54394) 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818aa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fde9df2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818b400640 1 -- 172.21.15.89:0/3359450088 learned_addr learned my addr 172.21.15.89:0/3359450088 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818a000640 1 --2- 172.21.15.89:0/3359450088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 0x563fdea19d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818b400640 1 -- 172.21.15.89:0/3359450088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 msgr2=0x563fde9df2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818b400640 1 --2- 172.21.15.89:0/3359450088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fde9df2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818b400640 1 -- 172.21.15.89:0/3359450088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 msgr2=0x563fdea19d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818b400640 1 --2- 172.21.15.89:0/3359450088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 0x563fdea19d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818b400640 1 -- 172.21.15.89:0/3359450088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fde7beb70 con 0x563fde8bb960 2024-08-31T04:28:11.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f818b400640 1 --2- 172.21.15.89:0/3359450088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1a2a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f81840f4520 tx=0x7f81840f7f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766c535529f698ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:11.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8177400640 1 -- 172.21.15.89:0/3359450088 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81840f84a0 con 0x563fde8bb960 2024-08-31T04:28:11.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8177400640 1 -- 172.21.15.89:0/3359450088 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81840fcd10 con 0x563fde8bb960 2024-08-31T04:28:11.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8177400640 1 -- 172.21.15.89:0/3359450088 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184101730 con 0x563fde8bb960 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 -- 172.21.15.89:0/3359450088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 msgr2=0x563fdea1a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 --2- 172.21.15.89:0/3359450088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1a2a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f81840f4520 tx=0x7f81840f7f20 comp rx=0 tx=0).stop 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 -- 172.21.15.89:0/3359450088 shutdown_connections 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 --2- 172.21.15.89:0/3359450088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1a2a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 --2- 172.21.15.89:0/3359450088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 0x563fdea19d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 --2- 172.21.15.89:0/3359450088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fde9df2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 -- 172.21.15.89:0/3359450088 >> 172.21.15.89:0/3359450088 conn(0x563fde4e3210 msgr2=0x563fdea1cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 -- 172.21.15.89:0/3359450088 shutdown_connections 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.315+0000 7f8199074000 1 -- 172.21.15.89:0/3359450088 wait complete. 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 1 -- start start 2024-08-31T04:28:11.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 1 Processor -- start 2024-08-31T04:28:11.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 0x563fdea1bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fdea1c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563fde4eab10 con 0x563fde8bb960 2024-08-31T04:28:11.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563fde7aa6f0 con 0x563fde8d1e90 2024-08-31T04:28:11.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563fde82c390 con 0x563fde8dc3f0 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 10 client.0 _ll_register_callbacks cb 0x563fde7cbb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54400/0 (socket says 172.21.15.89:54400) 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818aa00640 1 -- 172.21.15.89:0/3500746433 learned_addr learned my addr 172.21.15.89:0/3500746433 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818b400640 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fdea1c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818a000640 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 0x563fdea1bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818aa00640 1 -- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 msgr2=0x563fdea1c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818aa00640 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fdea1c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818aa00640 1 -- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 msgr2=0x563fdea1bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818aa00640 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 0x563fdea1bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818aa00640 1 -- 172.21.15.89:0/3500746433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fde7e2380 con 0x563fde8bb960 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f818aa00640 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1b5f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f817c004620 tx=0x7f817c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819f5ec4859242ce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:11.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f816be00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f816be00640 1 -- 172.21.15.89:0/3500746433 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c02e060 con 0x563fde8bb960 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f8199074000 1 -- 172.21.15.89:0/3500746433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563fde832d20 con 0x563fde8bb960 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.319+0000 7f816be00640 1 -- 172.21.15.89:0/3500746433 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f817c01f700 con 0x563fde8bb960 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f816be00640 1 -- 172.21.15.89:0/3500746433 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f817c034050 con 0x563fde8bb960 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f8199074000 10 client.5775 fetch_fsmap learned FSMap version 9 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f8199074000 1 -- 172.21.15.89:0/3500746433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563fde8a8e40 con 0x563fde8bb960 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f816be00640 1 -- 172.21.15.89:0/3500746433 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563fde832d20 con 0x563fde8bb960 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f816be00640 1 -- 172.21.15.89:0/3500746433 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f817c037020 con 0x563fde8bb960 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f8199074000 10 client.5775 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f8199074000 10 client.5775 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f8199074000 20 client.5775 populate_metadata read hostname 'smithi089' 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f8199074000 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563fde4c7dc0 0x563fdea34810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f8199074000 4 client.5775 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:11.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f8199074000 1 -- 172.21.15.89:0/3500746433 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fde836770 con 0x563fde4c7dc0 2024-08-31T04:28:11.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f818a000640 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563fde4c7dc0 0x563fdea34810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f818a000640 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563fde4c7dc0 0x563fdea34810 crc :-1 s=READY pgs=1066 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4996e228fb59acef server_cookie=e8ec8aa8df5850e9 in_seq=0 out_seq=0 2024-08-31T04:28:11.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f816be00640 10 client.5775 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:11.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f816be00640 1 -- 172.21.15.89:0/3500746433 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fde836770 con 0x563fde4c7dc0 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.323+0000 7f816be00640 10 client.5775 handle_command_reply: tid=0 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 client.5775 shutdown 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 -- 172.21.15.89:0/3500746433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 msgr2=0x563fdea1b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1b5f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f817c004620 tx=0x7f817c0046d0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 -- 172.21.15.89:0/3500746433 shutdown_connections 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563fde4c7dc0 0x563fdea34810 crc :-1 s=READY pgs=1066 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fdea1c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8d1e90 0x563fdea1bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 --2- 172.21.15.89:0/3500746433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea1b5f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f816be00640 0 client.5775 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 -- 172.21.15.89:0/3500746433 >> 172.21.15.89:0/3500746433 conn(0x563fde4e3210 msgr2=0x563fdea1ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 -- 172.21.15.89:0/3500746433 shutdown_connections 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 1 -- 172.21.15.89:0/3500746433 wait complete. 2024-08-31T04:28:11.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.327+0000 7f8199074000 20 client.5775 trim_cache size 0 max 16384 2024-08-31T04:28:11.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.343+0000 7f8199074000 1 Processor -- start 2024-08-31T04:28:11.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.343+0000 7f8199074000 1 -- start start 2024-08-31T04:28:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8bb960 0x563fdea1aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8d1e90 0x563fdea1b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fdea1fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f818c0c3be0 con 0x563fde8d1e90 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f818c1fba10 con 0x563fde8bb960 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f818c1facb0 con 0x563fde8dc3f0 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8d1e90 0x563fdea1b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818a000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8d1e90 0x563fdea1b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54412/0 (socket says 172.21.15.89:54412) 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818a000640 1 -- 172.21.15.89:0/3147437406 learned_addr learned my addr 172.21.15.89:0/3147437406 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818aa00640 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8bb960 0x563fdea1aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818b400640 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fdea1fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818a000640 1 -- 172.21.15.89:0/3147437406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 msgr2=0x563fdea1fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818a000640 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fdea1fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818a000640 1 -- 172.21.15.89:0/3147437406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8bb960 msgr2=0x563fdea1aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:11.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818a000640 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8bb960 0x563fdea1aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818a000640 1 -- 172.21.15.89:0/3147437406 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fde9d5a60 con 0x563fde8d1e90 2024-08-31T04:28:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818aa00640 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8bb960 0x563fdea1aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:28:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f818a000640 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8d1e90 0x563fdea1b530 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8178001250 tx=0x7f81780014c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233f44fd10980f96 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8176a00640 1 -- 172.21.15.89:0/3147437406 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817801d3b0 con 0x563fde8d1e90 2024-08-31T04:28:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8176a00640 1 -- 172.21.15.89:0/3147437406 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f817801d550 con 0x563fde8d1e90 2024-08-31T04:28:11.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8176a00640 1 -- 172.21.15.89:0/3147437406 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817801d9a0 con 0x563fde8d1e90 2024-08-31T04:28:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 -- 172.21.15.89:0/3147437406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8d1e90 msgr2=0x563fdea1b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8d1e90 0x563fdea1b530 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8178001250 tx=0x7f81780014c0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 -- 172.21.15.89:0/3147437406 shutdown_connections 2024-08-31T04:28:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8d1e90 0x563fdea1b530 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8dc3f0 0x563fdea1fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 --2- 172.21.15.89:0/3147437406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8bb960 0x563fdea1aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 -- 172.21.15.89:0/3147437406 >> 172.21.15.89:0/3147437406 conn(0x563fde4e3210 msgr2=0x563fdea1c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:11.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 -- 172.21.15.89:0/3147437406 shutdown_connections 2024-08-31T04:28:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 -- 172.21.15.89:0/3147437406 wait complete. 2024-08-31T04:28:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 -- start start 2024-08-31T04:28:11.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.347+0000 7f8199074000 1 Processor -- start 2024-08-31T04:28:11.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea5ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8d1e90 0x563fdea5b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8dc3f0 0x563fdea5b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563fde7a5eb0 con 0x563fde8bb960 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f818c1fb340 con 0x563fde8dc3f0 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563fde7cbf20 con 0x563fde8d1e90 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 10 client.0 _ll_register_callbacks cb 0x7f817c009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea5ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea5ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54428/0 (socket says 172.21.15.89:54428) 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818aa00640 1 -- 172.21.15.89:0/2586616201 learned_addr learned my addr 172.21.15.89:0/2586616201 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818a000640 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8d1e90 0x563fdea5b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818b400640 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8dc3f0 0x563fdea5b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818aa00640 1 -- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8d1e90 msgr2=0x563fdea5b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818aa00640 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8d1e90 0x563fdea5b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818aa00640 1 -- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8dc3f0 msgr2=0x563fdea5b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:11.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818aa00640 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8dc3f0 0x563fdea5b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:11.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818aa00640 1 -- 172.21.15.89:0/2586616201 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fde8805b0 con 0x563fde8bb960 2024-08-31T04:28:11.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f818aa00640 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea5ad60 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f817c006010 tx=0x7f817c0044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304a2a00e8ef5c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:11.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f816be00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:28:11.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f816be00640 1 -- 172.21.15.89:0/2586616201 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c02f660 con 0x563fde8bb960 2024-08-31T04:28:11.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f816be00640 1 -- 172.21.15.89:0/2586616201 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f817c02ebf0 con 0x563fde8bb960 2024-08-31T04:28:11.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 1 -- 172.21.15.89:0/2586616201 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f817801d550 con 0x563fde8bb960 2024-08-31T04:28:11.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f816be00640 1 -- 172.21.15.89:0/2586616201 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f817c02edf0 con 0x563fde8bb960 2024-08-31T04:28:11.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 10 client.5781 fetch_fsmap learned FSMap version 9 2024-08-31T04:28:11.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.351+0000 7f8199074000 1 -- 172.21.15.89:0/2586616201 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563fde7b4fc0 con 0x563fde8bb960 2024-08-31T04:28:11.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f816be00640 1 -- 172.21.15.89:0/2586616201 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f817801d550 con 0x563fde8bb960 2024-08-31T04:28:11.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f816be00640 1 -- 172.21.15.89:0/2586616201 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f817c037040 con 0x563fde8bb960 2024-08-31T04:28:11.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f8199074000 10 client.5781 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:28:11.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f8199074000 10 client.5781 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:28:11.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f8199074000 20 client.5781 populate_metadata read hostname 'smithi089' 2024-08-31T04:28:11.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f8199074000 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563fde4b5e20 0x563fdea24240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:11.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f8199074000 4 client.5781 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-08-31T04:28:11.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f8199074000 1 -- 172.21.15.89:0/2586616201 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x563fdea3ab30 con 0x563fde4b5e20 2024-08-31T04:28:11.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f818a000640 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563fde4b5e20 0x563fdea24240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:11.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f818a000640 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563fde4b5e20 0x563fdea24240 crc :-1 s=READY pgs=1067 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f302b1789fad31e server_cookie=606bf0a29b58619f in_seq=0 out_seq=0 2024-08-31T04:28:11.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:11.355+0000 7f816be00640 10 client.5781 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:14.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f816be00640 1 -- 172.21.15.89:0/2586616201 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563fdea3ab30 con 0x563fde4b5e20 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f816be00640 10 client.5781 handle_command_reply: tid=0 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 client.5781 shutdown 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 -- 172.21.15.89:0/2586616201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 msgr2=0x563fdea5ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea5ad60 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f817c006010 tx=0x7f817c0044f0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 -- 172.21.15.89:0/2586616201 shutdown_connections 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563fde4b5e20 0x563fdea24240 crc :-1 s=READY pgs=1067 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fde8dc3f0 0x563fdea5b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563fde8d1e90 0x563fdea5b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 --2- 172.21.15.89:0/2586616201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fde8bb960 0x563fdea5ad60 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f816be00640 0 client.5781 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 -- 172.21.15.89:0/2586616201 >> 172.21.15.89:0/2586616201 conn(0x563fde4e3210 msgr2=0x563fdea1aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 -- 172.21.15.89:0/2586616201 shutdown_connections 2024-08-31T04:28:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 1 -- 172.21.15.89:0/2586616201 wait complete. 2024-08-31T04:28:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8199074000 20 client.5781 trim_cache size 0 max 16384 2024-08-31T04:28:14.225 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:28:14.225 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:28:14.225 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:28:14.225 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 78, 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "14acba80": { 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 78, 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.0, 2024-08-31T04:28:14.226 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:14.227 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:28:14.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 -- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f816c0720c0 msgr2=0x7f816c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:14.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f816c0720c0 0x7f816c0745d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f817c009c60 tx=0x7f817c0091e0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 -- 172.21.15.89:0/2510684872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f818c0c7880 msgr2=0x7f818c0c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f818c0c7880 0x7f818c0c7c90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8184099160 tx=0x7f8184004f80 comp rx=0 tx=0).stop 2024-08-31T04:28:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 -- 172.21.15.89:0/2510684872 shutdown_connections 2024-08-31T04:28:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f816c0720c0 0x7f816c0745d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f818c0c7880 0x7f818c0c7c90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f818c1523a0 0x7f818c146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 --2- 172.21.15.89:0/2510684872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f818c0c89b0 0x7f818c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 -- 172.21.15.89:0/2510684872 >> 172.21.15.89:0/2510684872 conn(0x7f818c0c99b0 msgr2=0x7f818c0c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 -- 172.21.15.89:0/2510684872 shutdown_connections 2024-08-31T04:28:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:14.223+0000 7f8191800640 1 -- 172.21.15.89:0/2510684872 wait complete. 2024-08-31T04:28:14.243 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '14acba80', quiesce took 3.5 seconds. Will release after: 6.5 2024-08-31T04:28:20.744 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:28:20.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 -- 172.21.15.89:0/2932580648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 msgr2=0x7f95fc0c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:20.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 --2- 172.21.15.89:0/2932580648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 0x7f95fc0c9330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f95fc072540 tx=0x7f95e401f0b0 comp rx=0 tx=0).stop 2024-08-31T04:28:20.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 -- 172.21.15.89:0/2932580648 shutdown_connections 2024-08-31T04:28:20.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 --2- 172.21.15.89:0/2932580648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95fc0c7920 0x7f95fc0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:20.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 --2- 172.21.15.89:0/2932580648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 0x7f95fc0c9330 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:20.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 --2- 172.21.15.89:0/2932580648 >> v2:172.21.15.170:3300/0 conn(0x7f95fc15bc70 0x7f95fc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:20.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 -- 172.21.15.89:0/2932580648 >> 172.21.15.89:0/2932580648 conn(0x7f95fc0ccf20 msgr2=0x7f95fc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:20.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 -- 172.21.15.89:0/2932580648 shutdown_connections 2024-08-31T04:28:20.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 -- 172.21.15.89:0/2932580648 wait complete. 2024-08-31T04:28:20.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 Processor -- start 2024-08-31T04:28:20.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.911+0000 7f9602800640 1 -- start start 2024-08-31T04:28:20.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f9602800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 0x7f95fc1e4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:20.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f9602800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95fc0c7920 0x7f95fc0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f9602800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95fc15bc70 0x7f95fc14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f9602800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0748a0 con 0x7f95fc0c1f40 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f9602800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc074720 con 0x7f95fc15bc70 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f9602800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95fc074a20 con 0x7f95fc0c7920 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 0x7f95fc1e4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 0x7f95fc1e4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50368/0 (socket says 172.21.15.89:50368) 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fb400640 1 -- 172.21.15.89:0/1557027320 learned_addr learned my addr 172.21.15.89:0/1557027320 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95f2a00640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95fc0c7920 0x7f95fc0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fbe00640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95fc15bc70 0x7f95fc14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fb400640 1 -- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95fc0c7920 msgr2=0x7f95fc0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fb400640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95fc0c7920 0x7f95fc0c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fb400640 1 -- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95fc15bc70 msgr2=0x7f95fc14d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:20.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fb400640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95fc15bc70 0x7f95fc14d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:20.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fb400640 1 -- 172.21.15.89:0/1557027320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc0c53d0 con 0x7f95fc0c1f40 2024-08-31T04:28:20.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95fb400640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 0x7f95fc1e4990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00e9f0 tx=0x7f95ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:20.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95f3e00640 1 -- 172.21.15.89:0/1557027320 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec00cd80 con 0x7f95fc0c1f40 2024-08-31T04:28:20.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95f3e00640 1 -- 172.21.15.89:0/1557027320 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95ec004c20 con 0x7f95fc0c1f40 2024-08-31T04:28:20.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95fc0b1e30 con 0x7f95fc0c1f40 2024-08-31T04:28:20.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f95f3e00640 1 -- 172.21.15.89:0/1557027320 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec005020 con 0x7f95fc0c1f40 2024-08-31T04:28:20.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95fc0c5640 con 0x7f95fc0c1f40 2024-08-31T04:28:20.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.915+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95fc074ea0 con 0x7f95fc0c1f40 2024-08-31T04:28:20.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.919+0000 7f95f3e00640 1 -- 172.21.15.89:0/1557027320 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f95ec0051c0 con 0x7f95fc0c1f40 2024-08-31T04:28:20.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.919+0000 7f95f3e00640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95d80720f0 0x7f95d8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:20.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.919+0000 7f95f3e00640 1 -- 172.21.15.89:0/1557027320 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f95ec093890 con 0x7f95fc0c1f40 2024-08-31T04:28:20.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.919+0000 7f95f2a00640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95d80720f0 0x7f95d8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:20.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.919+0000 7f95f2a00640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95d80720f0 0x7f95d8074600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f95e40b2000 tx=0x7f95e401d8f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:20.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:20.923+0000 7f95f3e00640 1 -- 172.21.15.89:0/1557027320 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f95ec016030 con 0x7f95fc0c1f40 2024-08-31T04:28:21.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.127+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95fc1560a0 con 0x7f95fc0c1f40 2024-08-31T04:28:21.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.127+0000 7f95f3e00640 1 -- 172.21.15.89:0/1557027320 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f95ec0672a0 con 0x7f95fc0c1f40 2024-08-31T04:28:21.126 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:28:21.127 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:28:21.127 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:28:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.127+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95d80720f0 msgr2=0x7f95d8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.127+0000 7f9602800640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95d80720f0 0x7f95d8074600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f95e40b2000 tx=0x7f95e401d8f0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 msgr2=0x7f95fc1e4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 0x7f95fc1e4990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00e9f0 tx=0x7f95ec00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 shutdown_connections 2024-08-31T04:28:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f95d80720f0 0x7f95d8074600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95fc15bc70 0x7f95fc14d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95fc0c7920 0x7f95fc0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 --2- 172.21.15.89:0/1557027320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc0c1f40 0x7f95fc1e4990 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 >> 172.21.15.89:0/1557027320 conn(0x7f95fc0ccf20 msgr2=0x7f95fc071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 shutdown_connections 2024-08-31T04:28:21.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.131+0000 7f9602800640 1 -- 172.21.15.89:0/1557027320 wait complete. 2024-08-31T04:28:21.148 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 14acba80 --release --await' 2024-08-31T04:28:21.149 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 14acba80 --release --await 2024-08-31T04:28:21.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.359+0000 7f6a0d400640 1 -- 172.21.15.89:0/1149889036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c80a0 msgr2=0x7f6a08152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.359+0000 7f6a0d400640 1 --2- 172.21.15.89:0/1149889036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c80a0 0x7f6a08152660 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6a080cb5b0 tx=0x7f69f801c690 comp rx=0 tx=0).stop 2024-08-31T04:28:21.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.359+0000 7f6a0d400640 1 -- 172.21.15.89:0/1149889036 shutdown_connections 2024-08-31T04:28:21.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.359+0000 7f6a0d400640 1 --2- 172.21.15.89:0/1149889036 >> v2:172.21.15.170:3300/0 conn(0x7f6a080c5040 0x7f6a0815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.359+0000 7f6a0d400640 1 --2- 172.21.15.89:0/1149889036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c80a0 0x7f6a08152660 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.359+0000 7f6a0d400640 1 -- 172.21.15.89:0/1149889036 >> 172.21.15.89:0/1149889036 conn(0x7f6a0806e340 msgr2=0x7f6a08072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.359+0000 7f6a0d400640 1 -- 172.21.15.89:0/1149889036 shutdown_connections 2024-08-31T04:28:21.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.363+0000 7f6a0d400640 1 -- 172.21.15.89:0/1149889036 wait complete. 2024-08-31T04:28:21.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.363+0000 7f6a0d400640 1 Processor -- start 2024-08-31T04:28:21.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.363+0000 7f6a0d400640 1 -- start start 2024-08-31T04:28:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a0d400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a080c4c30 0x7f6a081f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a0d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c5040 0x7f6a08158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a0d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a080c80a0 0x7f6a080ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a0d400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08071b70 con 0x7f6a080c5040 2024-08-31T04:28:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a0d400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a080c3660 con 0x7f6a080c80a0 2024-08-31T04:28:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a0d400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a08071cf0 con 0x7f6a080c4c30 2024-08-31T04:28:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a07400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c5040 0x7f6a08158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a07400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c5040 0x7f6a08158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50380/0 (socket says 172.21.15.89:50380) 2024-08-31T04:28:21.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a07400640 1 -- 172.21.15.89:0/2151100506 learned_addr learned my addr 172.21.15.89:0/2151100506 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:21.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a080c80a0 0x7f6a080ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a07400640 1 -- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a080c4c30 msgr2=0x7f6a081f6020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a07400640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a080c4c30 0x7f6a081f6020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a07400640 1 -- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a080c80a0 msgr2=0x7f6a080ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a07400640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a080c80a0 0x7f6a080ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a07400640 1 -- 172.21.15.89:0/2151100506 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a08159190 con 0x7f6a080c5040 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a07400640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c5040 0x7f6a08158680 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f69f400b470 tx=0x7f69f400b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f69ffe00640 1 -- 172.21.15.89:0/2151100506 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4015030 con 0x7f6a080c5040 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f69ffe00640 1 -- 172.21.15.89:0/2151100506 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69f4004020 con 0x7f6a080c5040 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a0d400640 1 -- 172.21.15.89:0/2151100506 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a080cc100 con 0x7f6a080c5040 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f69ffe00640 1 -- 172.21.15.89:0/2151100506 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4004470 con 0x7f6a080c5040 2024-08-31T04:28:21.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.367+0000 7f6a0d400640 1 -- 172.21.15.89:0/2151100506 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a080ccda0 con 0x7f6a080c5040 2024-08-31T04:28:21.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.371+0000 7f69ffe00640 1 -- 172.21.15.89:0/2151100506 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f69f4018070 con 0x7f6a080c5040 2024-08-31T04:28:21.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.371+0000 7f6a1625d000 1 Processor -- start 2024-08-31T04:28:21.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.371+0000 7f6a1625d000 1 -- start start 2024-08-31T04:28:21.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.371+0000 7f69ffe00640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e80720c0 0x7f69e80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.371+0000 7f69ffe00640 1 -- 172.21.15.89:0/2151100506 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f69f4092c90 con 0x7f6a080c5040 2024-08-31T04:28:21.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.371+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e80720c0 0x7f69e80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8f9950 0x56406ea17e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea1cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8d4890 0x56406ea1d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56406e8c2f30 con 0x56406e8e3930 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56406e838690 con 0x56406e8d4890 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56406e827c20 con 0x56406e8f9950 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a07400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea1cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a07400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea1cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50390/0 (socket says 172.21.15.89:50390) 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a07400640 1 -- 172.21.15.89:0/3298210939 learned_addr learned my addr 172.21.15.89:0/3298210939 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e80720c0 0x7f69e80745d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a00005fd0 tx=0x7f6a0000a4b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/3298210939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8d4890 0x56406ea1d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a07400640 1 -- 172.21.15.89:0/3298210939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8f9950 msgr2=0x56406ea17e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:28:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a07400640 1 --2- 172.21.15.89:0/3298210939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8f9950 0x56406ea17e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a07400640 1 -- 172.21.15.89:0/3298210939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8d4890 msgr2=0x56406ea1d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a07400640 1 --2- 172.21.15.89:0/3298210939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8d4890 0x56406ea1d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a07400640 1 -- 172.21.15.89:0/3298210939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56406e7dc8f0 con 0x56406e8e3930 2024-08-31T04:28:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/3298210939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8d4890 0x56406ea1d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:28:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a07400640 1 --2- 172.21.15.89:0/3298210939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea1cad0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f69f4059b80 tx=0x7f69f405e340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf777d961e0541b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f69f3e00640 1 -- 172.21.15.89:0/3298210939 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f405cd60 con 0x56406e8e3930 2024-08-31T04:28:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f69f3e00640 1 -- 172.21.15.89:0/3298210939 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69f405cf00 con 0x56406e8e3930 2024-08-31T04:28:21.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f69f3e00640 1 -- 172.21.15.89:0/3298210939 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f40596b0 con 0x56406e8e3930 2024-08-31T04:28:21.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 -- 172.21.15.89:0/3298210939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 msgr2=0x56406ea1cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3298210939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea1cad0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f69f4059b80 tx=0x7f69f405e340 comp rx=0 tx=0).stop 2024-08-31T04:28:21.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 -- 172.21.15.89:0/3298210939 shutdown_connections 2024-08-31T04:28:21.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3298210939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea1cad0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3298210939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8d4890 0x56406ea1d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3298210939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8f9950 0x56406ea17e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 -- 172.21.15.89:0/3298210939 >> 172.21.15.89:0/3298210939 conn(0x56406e8f9540 msgr2=0x56406ea1a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 -- 172.21.15.89:0/3298210939 shutdown_connections 2024-08-31T04:28:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 -- 172.21.15.89:0/3298210939 wait complete. 2024-08-31T04:28:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 -- start start 2024-08-31T04:28:21.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.375+0000 7f6a1625d000 1 Processor -- start 2024-08-31T04:28:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8d4890 0x56406ea17030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 0x56406ea17570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8f9950 0x56406ea21bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56406e7ae500 con 0x56406e8d4890 2024-08-31T04:28:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56406e82bbd0 con 0x56406e8e3930 2024-08-31T04:28:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56406e7cfa30 con 0x56406e8f9950 2024-08-31T04:28:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 10 client.0 _ll_register_callbacks cb 0x56406e8ddb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8d4890 0x56406ea17030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8d4890 0x56406ea17030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50400/0 (socket says 172.21.15.89:50400) 2024-08-31T04:28:21.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 0x56406ea17570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07e00640 1 -- 172.21.15.89:0/2020869796 learned_addr learned my addr 172.21.15.89:0/2020869796 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:21.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8f9950 0x56406ea21bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07e00640 1 -- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8f9950 msgr2=0x56406ea21bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07e00640 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8f9950 0x56406ea21bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07e00640 1 -- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 msgr2=0x56406ea17570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07e00640 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 0x56406ea17570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07e00640 1 -- 172.21.15.89:0/2020869796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56406e7c76a0 con 0x56406e8d4890 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a07e00640 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8d4890 0x56406ea17030 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f69f80b0040 tx=0x7f69f8004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274d7f18047447b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f69f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f69f0c00640 1 -- 172.21.15.89:0/2020869796 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f80b2040 con 0x56406e8d4890 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 -- 172.21.15.89:0/2020869796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56406e7c17e0 con 0x56406e8d4890 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f69f0c00640 1 -- 172.21.15.89:0/2020869796 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f69f8005d60 con 0x56406e8d4890 2024-08-31T04:28:21.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f69f0c00640 1 -- 172.21.15.89:0/2020869796 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f69f80c2050 con 0x56406e8d4890 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 10 client.5799 fetch_fsmap learned FSMap version 9 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 -- 172.21.15.89:0/2020869796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56406e7e61c0 con 0x56406e8d4890 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f69f0c00640 1 -- 172.21.15.89:0/2020869796 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56406e7c17e0 con 0x56406e8d4890 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f69f0c00640 1 -- 172.21.15.89:0/2020869796 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f69f80c5020 con 0x56406e8d4890 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 10 client.5799 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 10 client.5799 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 20 client.5799 populate_metadata read hostname 'smithi089' 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56406e8bdfc0 0x56406ea22970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 4 client.5799 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.379+0000 7f6a1625d000 1 -- 172.21.15.89:0/2020869796 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56406e83a5e0 con 0x56406e8bdfc0 2024-08-31T04:28:21.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a07400640 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56406e8bdfc0 0x56406ea22970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a07400640 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56406e8bdfc0 0x56406ea22970 crc :-1 s=READY pgs=1083 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54ed488778b5ab61 server_cookie=2ffc28de67ce6056 in_seq=0 out_seq=0 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f69f0c00640 10 client.5799 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f69f0c00640 1 -- 172.21.15.89:0/2020869796 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56406e83a5e0 con 0x56406e8bdfc0 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f69f0c00640 10 client.5799 handle_command_reply: tid=0 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 client.5799 shutdown 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 -- 172.21.15.89:0/2020869796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8d4890 msgr2=0x56406ea17030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8d4890 0x56406ea17030 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f69f80b0040 tx=0x7f69f8004560 comp rx=0 tx=0).stop 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 -- 172.21.15.89:0/2020869796 shutdown_connections 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56406e8bdfc0 0x56406ea22970 crc :-1 s=READY pgs=1083 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8f9950 0x56406ea21bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 0x56406ea17570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2020869796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8d4890 0x56406ea17030 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 -- 172.21.15.89:0/2020869796 >> 172.21.15.89:0/2020869796 conn(0x56406e8f9540 msgr2=0x56406ea18040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f69f0c00640 0 client.5799 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:21.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 -- 172.21.15.89:0/2020869796 shutdown_connections 2024-08-31T04:28:21.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 1 -- 172.21.15.89:0/2020869796 wait complete. 2024-08-31T04:28:21.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.383+0000 7f6a1625d000 20 client.5799 trim_cache size 0 max 16384 2024-08-31T04:28:21.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a1625d000 1 Processor -- start 2024-08-31T04:28:21.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a1625d000 1 -- start start 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea30380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 0x56406ea308c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8f9950 0x56406ea30e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a1625d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a082018c0 con 0x56406e8f9950 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a1625d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a082007a0 con 0x56406e8e3930 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a1625d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a081feeb0 con 0x56406e8d4890 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a0ca00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8f9950 0x56406ea30e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a0ca00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8f9950 0x56406ea30e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50404/0 (socket says 172.21.15.89:50404) 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a0ca00640 1 -- 172.21.15.89:0/2167095612 learned_addr learned my addr 172.21.15.89:0/2167095612 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:21.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a07400640 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 0x56406ea308c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a07e00640 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea30380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a0ca00640 1 -- 172.21.15.89:0/2167095612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 msgr2=0x56406ea30380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea30380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a0ca00640 1 -- 172.21.15.89:0/2167095612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 msgr2=0x56406ea308c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 0x56406ea308c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a0ca00640 1 -- 172.21.15.89:0/2167095612 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56406ea21f40 con 0x56406e8f9950 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.411+0000 7f6a07e00640 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea30380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8f9950 0x56406ea30e00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6a00010750 tx=0x7f6a00012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb912d6a226fa75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f69f3400640 1 -- 172.21.15.89:0/2167095612 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00016070 con 0x56406e8f9950 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f69f3400640 1 -- 172.21.15.89:0/2167095612 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a0001b410 con 0x56406e8f9950 2024-08-31T04:28:21.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f69f3400640 1 -- 172.21.15.89:0/2167095612 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0001b7e0 con 0x56406e8f9950 2024-08-31T04:28:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 -- 172.21.15.89:0/2167095612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8f9950 msgr2=0x56406ea30e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8f9950 0x56406ea30e00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6a00010750 tx=0x7f6a00012000 comp rx=0 tx=0).stop 2024-08-31T04:28:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 -- 172.21.15.89:0/2167095612 shutdown_connections 2024-08-31T04:28:21.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8f9950 0x56406ea30e00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8e3930 0x56406ea308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 --2- 172.21.15.89:0/2167095612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea30380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 -- 172.21.15.89:0/2167095612 >> 172.21.15.89:0/2167095612 conn(0x56406e8f9540 msgr2=0x56406ea1fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 -- 172.21.15.89:0/2167095612 shutdown_connections 2024-08-31T04:28:21.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 -- 172.21.15.89:0/2167095612 wait complete. 2024-08-31T04:28:21.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 -- start start 2024-08-31T04:28:21.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.415+0000 7f6a1625d000 1 Processor -- start 2024-08-31T04:28:21.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea96770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea96cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8f9950 0x56406ea971f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081ff330 con 0x56406e8e3930 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a082000d0 con 0x56406e8f9950 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a081ffa00 con 0x56406e8d4890 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 10 client.0 _ll_register_callbacks cb 0x7f69f80b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea96cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea96cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50410/0 (socket says 172.21.15.89:50410) 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07400640 1 -- 172.21.15.89:0/3862513230 learned_addr learned my addr 172.21.15.89:0/3862513230 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a0ca00640 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8f9950 0x56406ea971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07e00640 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea96770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07400640 1 -- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 msgr2=0x56406ea96770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07400640 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea96770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07400640 1 -- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8f9950 msgr2=0x56406ea971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:21.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07400640 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8f9950 0x56406ea971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07400640 1 -- 172.21.15.89:0/3862513230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56406e8ac2f0 con 0x56406e8e3930 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07e00640 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea96770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07400640 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea96cb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69f4059b80 tx=0x7f69f4059fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd789682ba20839 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f69f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f69f0c00640 1 -- 172.21.15.89:0/3862513230 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4059470 con 0x56406e8e3930 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f69f0c00640 1 -- 172.21.15.89:0/3862513230 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f69f4059610 con 0x56406e8e3930 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 -- 172.21.15.89:0/3862513230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a0001b410 con 0x56406e8e3930 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f69f0c00640 1 -- 172.21.15.89:0/3862513230 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f69f4089050 con 0x56406e8e3930 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 10 client.5805 fetch_fsmap learned FSMap version 9 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 -- 172.21.15.89:0/3862513230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56406e7b1b30 con 0x56406e8e3930 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f69f0c00640 1 -- 172.21.15.89:0/3862513230 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a0001b410 con 0x56406e8e3930 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f69f0c00640 1 -- 172.21.15.89:0/3862513230 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f69f4074040 con 0x56406e8e3930 2024-08-31T04:28:21.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 10 client.5805 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:28:21.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 10 client.5805 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:28:21.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 20 client.5805 populate_metadata read hostname 'smithi089' 2024-08-31T04:28:21.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56406e4b9e80 0x56406ea34490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:21.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 4 client.5805 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "14acba80", "release": true, "await": true}] 2024-08-31T04:28:21.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a1625d000 1 -- 172.21.15.89:0/3862513230 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "14acba80", "release": true, "await": true}) -- 0x56406e836080 con 0x56406e4b9e80 2024-08-31T04:28:21.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07e00640 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56406e4b9e80 0x56406ea34490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:21.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f69f0c00640 10 client.5805 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:21.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.419+0000 7f6a07e00640 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56406e4b9e80 0x56406ea34490 crc :-1 s=READY pgs=1084 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5facc6df11f303f server_cookie=699c9f05aca77caa in_seq=0 out_seq=0 2024-08-31T04:28:21.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f69f0c00640 1 -- 172.21.15.89:0/3862513230 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56406e836080 con 0x56406e4b9e80 2024-08-31T04:28:21.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f69f0c00640 10 client.5805 handle_command_reply: tid=0 2024-08-31T04:28:21.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 client.5805 shutdown 2024-08-31T04:28:21.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 -- 172.21.15.89:0/3862513230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 msgr2=0x56406ea96cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea96cb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69f4059b80 tx=0x7f69f4059fc0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 -- 172.21.15.89:0/3862513230 shutdown_connections 2024-08-31T04:28:21.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56406e4b9e80 0x56406ea34490 crc :-1 s=READY pgs=1084 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56406e8e3930 0x56406ea96cb0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56406e8f9950 0x56406ea971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 --2- 172.21.15.89:0/3862513230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56406e8d4890 0x56406ea96770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f69f0c00640 0 client.5805 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 -- 172.21.15.89:0/3862513230 >> 172.21.15.89:0/3862513230 conn(0x56406e8f9540 msgr2=0x56406e9d8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 -- 172.21.15.89:0/3862513230 shutdown_connections 2024-08-31T04:28:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 1 -- 172.21.15.89:0/3862513230 wait complete. 2024-08-31T04:28:21.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a1625d000 20 client.5805 trim_cache size 0 max 16384 2024-08-31T04:28:21.580 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 80, 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "14acba80": { 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 80, 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:28:21.581 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.0, 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:21.582 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:28:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 -- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e80720c0 msgr2=0x7f69e80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e80720c0 0x7f69e80745d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a00005fd0 tx=0x7f6a0000a4b0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 -- 172.21.15.89:0/2151100506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c5040 msgr2=0x7f6a08158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c5040 0x7f6a08158680 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f69f400b470 tx=0x7f69f400b930 comp rx=0 tx=0).stop 2024-08-31T04:28:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 -- 172.21.15.89:0/2151100506 shutdown_connections 2024-08-31T04:28:21.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69e80720c0 0x7f69e80745d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a080c5040 0x7f6a08158680 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a080c80a0 0x7f6a080ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 --2- 172.21.15.89:0/2151100506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a080c4c30 0x7f6a081f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 -- 172.21.15.89:0/2151100506 >> 172.21.15.89:0/2151100506 conn(0x7f6a0806e340 msgr2=0x7f6a080c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 -- 172.21.15.89:0/2151100506 shutdown_connections 2024-08-31T04:28:21.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:21.579+0000 7f6a0d400640 1 -- 172.21.15.89:0/2151100506 wait complete. 2024-08-31T04:28:21.603 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '14acba80', total seconds elapsed: 10.9 2024-08-31T04:28:23.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:28:23.708 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:28:32.068 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 18% (49/258) Updating files: 19% (50/258) Updating files: 20% (52/258) Updating files: 21% (55/258) Updating files: 22% (57/258) Updating files: 23% (60/258) Updating files: 24% (62/258) Updating files: 25% (65/258) Updating files: 26% (68/258) Updating files: 27% (70/258) Updating files: 28% (73/258) Updating files: 29% (75/258) Updating files: 30% (78/258) Updating files: 31% (80/258) Updating files: 32% (83/258) Updating files: 33% (86/258) Updating files: 34% (88/258) Updating files: 35% (91/258) Updating files: 36% (93/258) Updating files: 37% (96/258) Updating files: 38% (99/258) Updating files: 39% (101/258) Updating files: 40% (104/258) Updating files: 41% (106/258) Updating files: 42% (109/258) Updating files: 43% (111/258) Updating files: 44% (114/258) Updating files: 44% (115/258) Updating files: 45% (117/258) Updating files: 46% (119/258) Updating files: 47% (122/258) Updating files: 48% (124/258) Updating files: 49% (127/258) Updating files: 50% (129/258) Updating files: 51% (132/258) Updating files: 52% (135/258) Updating files: 53% (137/258) Updating files: 54% (140/258) Updating files: 55% (142/258) Updating files: 56% (145/258) Updating files: 57% (148/258) Updating files: 58% (150/258) Updating files: 59% (153/258) Updating files: 60% (155/258) Updating files: 61% (158/258) Updating files: 62% (160/258) Updating files: 63% (163/258) Updating files: 64% (166/258) Updating files: 65% (168/258) Updating files: 66% (171/258) Updating files: 67% (173/258) Updating files: 68% (176/258) Updating files: 69% (179/258) Updating files: 70% (181/258) Updating files: 71% (184/258) Updating files: 72% (186/258) Updating files: 73% (189/258) Updating files: 74% (191/258) Updating files: 75% (194/258) Updating files: 75% (196/258) Updating files: 76% (197/258) Updating files: 77% (199/258) Updating files: 78% (202/258) Updating files: 79% (204/258) Updating files: 80% (207/258) Updating files: 81% (209/258) Updating files: 81% (211/258) Updating files: 82% (212/258) Updating files: 83% (215/258) Updating files: 84% (217/258) Updating files: 85% (220/258) Updating files: 86% (222/258) Updating files: 87% (225/258) Updating files: 88% (228/258) Updating files: 89% (230/258) Updating files: 90% (233/258) Updating files: 91% (235/258) Updating files: 92% (238/258) Updating files: 93% (240/258) Updating files: 94% (243/258) Updating files: 95% (246/258) Updating files: 96% (248/258) Updating files: 97% (251/258) Updating files: 98% (253/258) Updating files: 99% (256/258) Updating files: 100% (258/258) Updating files: 100% (258/258), done. 2024-08-31T04:28:32.266 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 321ecdaba2c v0.39 2024-08-31T04:28:32.347 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.39 2024-08-31T04:28:32.672 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 40 -eq 48 ] 2024-08-31T04:28:32.672 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.40 2024-08-31T04:28:32.672 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.40 2024-08-31T04:28:32.672 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.40 2024-08-31T04:28:32.672 INFO:tasks.workunit.client.0.smithi089.stdout:v0.40 2024-08-31T04:28:40.176 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.3 2024-08-31T04:28:40.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:28:40.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.339+0000 7f1d77e00640 1 -- 172.21.15.89:0/797740641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d58003a10 msgr2=0x7f1d58003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.339+0000 7f1d77e00640 1 --2- 172.21.15.89:0/797740641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d58003a10 0x7f1d58003e80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c310 tx=0x7f1d6401cfc0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.339+0000 7f1d75e00640 1 -- 172.21.15.89:0/797740641 reap_dead start 2024-08-31T04:28:40.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.343+0000 7f1d77e00640 1 -- 172.21.15.89:0/797740641 shutdown_connections 2024-08-31T04:28:40.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.343+0000 7f1d77e00640 1 -- 172.21.15.89:0/797740641 >> 172.21.15.89:0/797740641 conn(0x7f1d70071be0 msgr2=0x7f1d7006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:40.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.343+0000 7f1d77e00640 1 -- 172.21.15.89:0/797740641 shutdown_connections 2024-08-31T04:28:40.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.343+0000 7f1d77e00640 1 -- 172.21.15.89:0/797740641 wait complete. 2024-08-31T04:28:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 Processor -- start 2024-08-31T04:28:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 -- start start 2024-08-31T04:28:40.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d58003a10 0x7f1d701f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d70152240 0x7f1d7014abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d700c86d0 0x7f1d700c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1d700cf610 con 0x7f1d700c86d0 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7008cff0 con 0x7f1d58003a10 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1d701596f0 con 0x7f1d70152240 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d700c86d0 0x7f1d700c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d74a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d70152240 0x7f1d7014abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d700c86d0 0x7f1d700c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48442/0 (socket says 172.21.15.89:48442) 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d58003a10 0x7f1d701f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75e00640 1 -- 172.21.15.89:0/3301209375 learned_addr learned my addr 172.21.15.89:0/3301209375 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75e00640 1 -- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d70152240 msgr2=0x7f1d7014abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75e00640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d70152240 0x7f1d7014abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75e00640 1 -- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d58003a10 msgr2=0x7f1d701f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75e00640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d58003a10 0x7f1d701f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75e00640 1 -- 172.21.15.89:0/3301209375 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d70154100 con 0x7f1d700c86d0 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d75e00640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d700c86d0 0x7f1d700c7aa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1d700b4470 tx=0x7f1d68010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d6d600640 1 -- 172.21.15.89:0/3301209375 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6800edf0 con 0x7f1d700c86d0 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d6d600640 1 -- 172.21.15.89:0/3301209375 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d68015070 con 0x7f1d700c86d0 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d701f3870 con 0x7f1d700c86d0 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d6d600640 1 -- 172.21.15.89:0/3301209375 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d68003d10 con 0x7f1d700c86d0 2024-08-31T04:28:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.347+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d700cd6a0 con 0x7f1d700c86d0 2024-08-31T04:28:40.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.351+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d700cd400 con 0x7f1d700c86d0 2024-08-31T04:28:40.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.351+0000 7f1d6d600640 1 -- 172.21.15.89:0/3301209375 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f1d68004030 con 0x7f1d700c86d0 2024-08-31T04:28:40.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.351+0000 7f1d6d600640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1d500720c0 0x7f1d500745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.351+0000 7f1d6d600640 1 -- 172.21.15.89:0/3301209375 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f1d680938b0 con 0x7f1d700c86d0 2024-08-31T04:28:40.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.351+0000 7f1d75400640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1d500720c0 0x7f1d500745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.355+0000 7f1d75400640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1d500720c0 0x7f1d500745d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c310 tx=0x7f1d64019e00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:40.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.359+0000 7f1d6d600640 1 -- 172.21.15.89:0/3301209375 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1d700cd400 con 0x7f1d700c86d0 2024-08-31T04:28:40.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.579+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d700c5d30 con 0x7f1d700c86d0 2024-08-31T04:28:40.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.579+0000 7f1d6d600640 1 -- 172.21.15.89:0/3301209375 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f1d6805e850 con 0x7f1d700c86d0 2024-08-31T04:28:40.580 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:28:40.581 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:28:40.581 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:28:40.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1d500720c0 msgr2=0x7f1d500745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1d500720c0 0x7f1d500745d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c310 tx=0x7f1d64019e00 comp rx=0 tx=0).stop 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d700c86d0 msgr2=0x7f1d700c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d700c86d0 0x7f1d700c7aa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1d700b4470 tx=0x7f1d68010e80 comp rx=0 tx=0).stop 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 shutdown_connections 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f1d500720c0 0x7f1d500745d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d700c86d0 0x7f1d700c7aa0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1d70152240 0x7f1d7014abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 --2- 172.21.15.89:0/3301209375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1d58003a10 0x7f1d701f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 >> 172.21.15.89:0/3301209375 conn(0x7f1d70071be0 msgr2=0x7f1d701539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 shutdown_connections 2024-08-31T04:28:40.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.583+0000 7f1d77e00640 1 -- 172.21.15.89:0/3301209375 wait complete. 2024-08-31T04:28:40.606 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 131.3 --await-for 45.0' 2024-08-31T04:28:40.606 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 131.3 --await-for 45.0 2024-08-31T04:28:40.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.799+0000 7f8c05c00640 1 -- 172.21.15.89:0/1024331663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be4004d50 msgr2=0x7f8be4005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.799+0000 7f8c05c00640 1 --2- 172.21.15.89:0/1024331663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be4004d50 0x7f8be4005160 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8c00152e90 tx=0x7f8bf801fa40 comp rx=0 tx=0).stop 2024-08-31T04:28:40.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.799+0000 7f8bff400640 1 -- 172.21.15.89:0/1024331663 reap_dead start 2024-08-31T04:28:40.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.799+0000 7f8c05c00640 1 -- 172.21.15.89:0/1024331663 shutdown_connections 2024-08-31T04:28:40.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.799+0000 7f8c05c00640 1 -- 172.21.15.89:0/1024331663 >> 172.21.15.89:0/1024331663 conn(0x7f8c000c99b0 msgr2=0x7f8c000c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:40.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.799+0000 7f8c05c00640 1 -- 172.21.15.89:0/1024331663 shutdown_connections 2024-08-31T04:28:40.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.799+0000 7f8c05c00640 1 -- 172.21.15.89:0/1024331663 wait complete. 2024-08-31T04:28:40.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.799+0000 7f8c05c00640 1 Processor -- start 2024-08-31T04:28:40.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.799+0000 7f8c05c00640 1 -- start start 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8c05c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be4004d50 0x7f8c0015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8c05c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c001f5640 0x7f8c00156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8c05c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c001ebdf0 0x7f8c001ec200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8c05c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8c000c22e0 con 0x7f8be4004d50 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8c05c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c000c2e80 con 0x7f8c001ebdf0 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8c05c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8c000c3160 con 0x7f8c001f5640 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bfea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be4004d50 0x7f8c0015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bfea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be4004d50 0x7f8c0015a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48460/0 (socket says 172.21.15.89:48460) 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bfea00640 1 -- 172.21.15.89:0/4222923389 learned_addr learned my addr 172.21.15.89:0/4222923389 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:40.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bff400640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c001ebdf0 0x7f8c001ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bf6000640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c001f5640 0x7f8c00156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bfea00640 1 -- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c001f5640 msgr2=0x7f8c00156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bfea00640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c001f5640 0x7f8c00156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bfea00640 1 -- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c001ebdf0 msgr2=0x7f8c001ec200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bfea00640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c001ebdf0 0x7f8c001ec200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bfea00640 1 -- 172.21.15.89:0/4222923389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0015a670 con 0x7f8be4004d50 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bff400640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c001ebdf0 0x7f8c001ec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bfea00640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be4004d50 0x7f8c0015a130 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0011b10 tx=0x7f8bf0009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bf7400640 1 -- 172.21.15.89:0/4222923389 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000fca0 con 0x7f8be4004d50 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bf7400640 1 -- 172.21.15.89:0/4222923389 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bf000fe40 con 0x7f8be4004d50 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8bf7400640 1 -- 172.21.15.89:0/4222923389 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0004280 con 0x7f8be4004d50 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8c05c00640 1 -- 172.21.15.89:0/4222923389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0014e180 con 0x7f8be4004d50 2024-08-31T04:28:40.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.803+0000 7f8c05c00640 1 -- 172.21.15.89:0/4222923389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0014db80 con 0x7f8be4004d50 2024-08-31T04:28:40.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8bf7400640 1 -- 172.21.15.89:0/4222923389 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8bf0003600 con 0x7f8be4004d50 2024-08-31T04:28:40.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8bf7400640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8bdc0720f0 0x7f8bdc074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8bf7400640 1 -- 172.21.15.89:0/4222923389 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8bf0093a00 con 0x7f8be4004d50 2024-08-31T04:28:40.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8bf6000640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8bdc0720f0 0x7f8bdc074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8c0d326000 1 Processor -- start 2024-08-31T04:28:40.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8c0d326000 1 -- start start 2024-08-31T04:28:40.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8bf6000640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8bdc0720f0 0x7f8bdc074600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c00157a20 tx=0x7f8be80091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0ccad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0c93ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 0x562af0c94220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8c0d326000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562af0ae9820 con 0x562af0b86e90 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8c0d326000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562af0ad8db0 con 0x562af0b70960 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.807+0000 7f8c0d326000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562af0adcd60 con 0x562af0b913f0 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bf6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0c93ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bf6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0c93ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48462/0 (socket says 172.21.15.89:48462) 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bf6000640 1 -- 172.21.15.89:0/3509798832 learned_addr learned my addr 172.21.15.89:0/3509798832 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bff400640 1 --2- 172.21.15.89:0/3509798832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 0x562af0c94220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bfea00640 1 --2- 172.21.15.89:0/3509798832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0ccad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bf6000640 1 -- 172.21.15.89:0/3509798832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 msgr2=0x562af0ccad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bf6000640 1 --2- 172.21.15.89:0/3509798832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0ccad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bf6000640 1 -- 172.21.15.89:0/3509798832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 msgr2=0x562af0c94220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bf6000640 1 --2- 172.21.15.89:0/3509798832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 0x562af0c94220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bf6000640 1 -- 172.21.15.89:0/3509798832 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562af0a73b70 con 0x562af0b86e90 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bf6000640 1 --2- 172.21.15.89:0/3509798832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0c93ce0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8be8013e70 tx=0x7f8be8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9dd01e611deae72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bef400640 1 -- 172.21.15.89:0/3509798832 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8005220 con 0x562af0b86e90 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bef400640 1 -- 172.21.15.89:0/3509798832 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8be80053c0 con 0x562af0b86e90 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8bef400640 1 -- 172.21.15.89:0/3509798832 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8011e80 con 0x562af0b86e90 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 -- 172.21.15.89:0/3509798832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 msgr2=0x562af0c93ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 --2- 172.21.15.89:0/3509798832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0c93ce0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8be8013e70 tx=0x7f8be8016000 comp rx=0 tx=0).stop 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 -- 172.21.15.89:0/3509798832 shutdown_connections 2024-08-31T04:28:40.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 --2- 172.21.15.89:0/3509798832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0c93ce0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 --2- 172.21.15.89:0/3509798832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 0x562af0c94220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 --2- 172.21.15.89:0/3509798832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0ccad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 -- 172.21.15.89:0/3509798832 >> 172.21.15.89:0/3509798832 conn(0x562af0798210 msgr2=0x562af0ccd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:40.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 -- 172.21.15.89:0/3509798832 shutdown_connections 2024-08-31T04:28:40.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 -- 172.21.15.89:0/3509798832 wait complete. 2024-08-31T04:28:40.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 -- start start 2024-08-31T04:28:40.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.811+0000 7f8c0d326000 1 Processor -- start 2024-08-31T04:28:40.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 0x562af0cc98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0cc9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0cca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562af079fb10 con 0x562af0b86e90 2024-08-31T04:28:40.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562af0a5f6f0 con 0x562af0b70960 2024-08-31T04:28:40.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562af0ae1390 con 0x562af0b913f0 2024-08-31T04:28:40.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 10 client.0 _ll_register_callbacks cb 0x562af0a80b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:40.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bf6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0cc9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bf6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0cc9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48464/0 (socket says 172.21.15.89:48464) 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bf6000640 1 -- 172.21.15.89:0/4060786500 learned_addr learned my addr 172.21.15.89:0/4060786500 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bff400640 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0cca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bfea00640 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 0x562af0cc98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bf6000640 1 -- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 msgr2=0x562af0cca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bf6000640 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0cca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bf6000640 1 -- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 msgr2=0x562af0cc98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bf6000640 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 0x562af0cc98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bf6000640 1 -- 172.21.15.89:0/4060786500 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562af0a97380 con 0x562af0b86e90 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bf6000640 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0cc9e30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8be8011c10 tx=0x7f8be801cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9781a0bc20bb114b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8be3e00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8be3e00640 1 -- 172.21.15.89:0/4060786500 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8011e80 con 0x562af0b86e90 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 -- 172.21.15.89:0/4060786500 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562af0ae7d20 con 0x562af0b86e90 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8be3e00640 1 -- 172.21.15.89:0/4060786500 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8be80047b0 con 0x562af0b86e90 2024-08-31T04:28:40.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8be3e00640 1 -- 172.21.15.89:0/4060786500 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8be80049b0 con 0x562af0b86e90 2024-08-31T04:28:40.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 10 client.5823 fetch_fsmap learned FSMap version 9 2024-08-31T04:28:40.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 -- 172.21.15.89:0/4060786500 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562af0b5de40 con 0x562af0b86e90 2024-08-31T04:28:40.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8be3e00640 1 -- 172.21.15.89:0/4060786500 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562af0ae7d20 con 0x562af0b86e90 2024-08-31T04:28:40.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8be3e00640 1 -- 172.21.15.89:0/4060786500 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8be803c080 con 0x562af0b86e90 2024-08-31T04:28:40.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 10 client.5823 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:28:40.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 10 client.5823 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:28:40.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 20 client.5823 populate_metadata read hostname 'smithi089' 2024-08-31T04:28:40.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562af077cdc0 0x562af0ce4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 4 client.5823 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:40.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8c0d326000 1 -- 172.21.15.89:0/4060786500 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562af0aeb770 con 0x562af077cdc0 2024-08-31T04:28:40.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.815+0000 7f8bfea00640 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562af077cdc0 0x562af0ce4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8bfea00640 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562af077cdc0 0x562af0ce4f90 crc :-1 s=READY pgs=1095 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caffdeab9ceb3f3 server_cookie=1aca492541e7b279 in_seq=0 out_seq=0 2024-08-31T04:28:40.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8be3e00640 10 client.5823 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:40.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8be3e00640 1 -- 172.21.15.89:0/4060786500 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562af0aeb770 con 0x562af077cdc0 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8be3e00640 10 client.5823 handle_command_reply: tid=0 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 client.5823 shutdown 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 -- 172.21.15.89:0/4060786500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 msgr2=0x562af0cc9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0cc9e30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8be8011c10 tx=0x7f8be801cb00 comp rx=0 tx=0).stop 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 -- 172.21.15.89:0/4060786500 shutdown_connections 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562af077cdc0 0x562af0ce4f90 crc :-1 s=READY pgs=1095 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0cc9e30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0cca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 --2- 172.21.15.89:0/4060786500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b70960 0x562af0cc98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8be3e00640 0 client.5823 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 -- 172.21.15.89:0/4060786500 >> 172.21.15.89:0/4060786500 conn(0x562af0798210 msgr2=0x562af0ccc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 -- 172.21.15.89:0/4060786500 shutdown_connections 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 1 -- 172.21.15.89:0/4060786500 wait complete. 2024-08-31T04:28:40.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.819+0000 7f8c0d326000 20 client.5823 trim_cache size 0 max 16384 2024-08-31T04:28:40.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 Processor -- start 2024-08-31T04:28:40.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 -- start start 2024-08-31T04:28:40.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b70960 0x562af0d3fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0d3ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b913f0 0x562af0d404a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001fe770 con 0x562af0b86e90 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001ffb10 con 0x562af0b913f0 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8c001fedc0 con 0x562af0b70960 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bf6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0d3ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bf6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0d3ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48472/0 (socket says 172.21.15.89:48472) 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bf6000640 1 -- 172.21.15.89:0/1353939981 learned_addr learned my addr 172.21.15.89:0/1353939981 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bfea00640 1 --2- 172.21.15.89:0/1353939981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b70960 0x562af0d3fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bff400640 1 --2- 172.21.15.89:0/1353939981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b913f0 0x562af0d404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bf6000640 1 -- 172.21.15.89:0/1353939981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b70960 msgr2=0x562af0d3fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bf6000640 1 --2- 172.21.15.89:0/1353939981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b70960 0x562af0d3fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bf6000640 1 -- 172.21.15.89:0/1353939981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b913f0 msgr2=0x562af0d404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:40.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bf6000640 1 --2- 172.21.15.89:0/1353939981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b913f0 0x562af0d404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bf6000640 1 -- 172.21.15.89:0/1353939981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562af0b355b0 con 0x562af0b86e90 2024-08-31T04:28:40.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8bf6000640 1 --2- 172.21.15.89:0/1353939981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0d3ff60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8be8013e50 tx=0x7f8be8011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d220cc6987814b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:40.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8beea00640 1 -- 172.21.15.89:0/1353939981 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8004b50 con 0x562af0b86e90 2024-08-31T04:28:40.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8beea00640 1 -- 172.21.15.89:0/1353939981 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8be801c770 con 0x562af0b86e90 2024-08-31T04:28:40.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8beea00640 1 -- 172.21.15.89:0/1353939981 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8004ef0 con 0x562af0b86e90 2024-08-31T04:28:40.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 -- 172.21.15.89:0/1353939981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 msgr2=0x562af0d3ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:40.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 --2- 172.21.15.89:0/1353939981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0d3ff60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8be8013e50 tx=0x7f8be8011e80 comp rx=0 tx=0).stop 2024-08-31T04:28:40.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 -- 172.21.15.89:0/1353939981 shutdown_connections 2024-08-31T04:28:40.842 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 --2- 172.21.15.89:0/1353939981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b86e90 0x562af0d3ff60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 --2- 172.21.15.89:0/1353939981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b913f0 0x562af0d404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 --2- 172.21.15.89:0/1353939981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b70960 0x562af0d3fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.839+0000 7f8c0d326000 1 -- 172.21.15.89:0/1353939981 >> 172.21.15.89:0/1353939981 conn(0x562af0798210 msgr2=0x562af0cca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 -- 172.21.15.89:0/1353939981 shutdown_connections 2024-08-31T04:28:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 -- 172.21.15.89:0/1353939981 wait complete. 2024-08-31T04:28:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 -- start start 2024-08-31T04:28:40.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 Processor -- start 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b70960 0x562af0cea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b86e90 0x562af0ceab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0d452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562af0a5aeb0 con 0x562af0b70960 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001ff440 con 0x562af0b86e90 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562af0a80f20 con 0x562af0b913f0 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 10 client.0 _ll_register_callbacks cb 0x7f8be4003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bfea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b70960 0x562af0cea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bfea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b70960 0x562af0cea5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48488/0 (socket says 172.21.15.89:48488) 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bfea00640 1 -- 172.21.15.89:0/2715672658 learned_addr learned my addr 172.21.15.89:0/2715672658 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bff400640 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0d452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bf6000640 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b86e90 0x562af0ceab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bfea00640 1 -- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 msgr2=0x562af0d452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bfea00640 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0d452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bfea00640 1 -- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b86e90 msgr2=0x562af0ceab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bfea00640 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b86e90 0x562af0ceab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bfea00640 1 -- 172.21.15.89:0/2715672658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562af0a69fc0 con 0x562af0b70960 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8bfea00640 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b70960 0x562af0cea5f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8bf005a900 tx=0x7f8bf001b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3201ab114f061e27 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8be3e00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8be3e00640 1 -- 172.21.15.89:0/2715672658 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0067b10 con 0x562af0b70960 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8be3e00640 1 -- 172.21.15.89:0/2715672658 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8bf005fbb0 con 0x562af0b70960 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 -- 172.21.15.89:0/2715672658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be801c770 con 0x562af0b70960 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8be3e00640 1 -- 172.21.15.89:0/2715672658 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8bf005fdb0 con 0x562af0b70960 2024-08-31T04:28:40.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 10 client.5829 fetch_fsmap learned FSMap version 9 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.843+0000 7f8c0d326000 1 -- 172.21.15.89:0/2715672658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562af0a62e00 con 0x562af0b70960 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8be3e00640 1 -- 172.21.15.89:0/2715672658 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8be801c770 con 0x562af0b70960 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8be3e00640 1 -- 172.21.15.89:0/2715672658 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8bf005dae0 con 0x562af0b70960 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8c0d326000 10 client.5829 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8c0d326000 10 client.5829 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8c0d326000 20 client.5829 populate_metadata read hostname 'smithi089' 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8c0d326000 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562af076ae20 0x562af0d457f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8c0d326000 4 client.5829 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.3, "await_for": 45.0}] 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8c0d326000 1 -- 172.21.15.89:0/2715672658 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.3, "await_for": 45.0}) -- 0x562af0ae7210 con 0x562af076ae20 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8bf6000640 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562af076ae20 0x562af0d457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8bf6000640 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562af076ae20 0x562af0d457f0 crc :-1 s=READY pgs=1096 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c521aaa1b60f51e1 server_cookie=7d05b1708d73e627 in_seq=0 out_seq=0 2024-08-31T04:28:40.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:40.847+0000 7f8be3e00640 10 client.5829 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8be3e00640 1 -- 172.21.15.89:0/2715672658 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x562af0ae7210 con 0x562af076ae20 2024-08-31T04:28:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8be3e00640 10 client.5829 handle_command_reply: tid=0 2024-08-31T04:28:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 client.5829 shutdown 2024-08-31T04:28:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 -- 172.21.15.89:0/2715672658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b70960 msgr2=0x562af0cea5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b70960 0x562af0cea5f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8bf005a900 tx=0x7f8bf001b040 comp rx=0 tx=0).stop 2024-08-31T04:28:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 -- 172.21.15.89:0/2715672658 shutdown_connections 2024-08-31T04:28:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562af076ae20 0x562af0d457f0 crc :-1 s=READY pgs=1096 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562af0b913f0 0x562af0d452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562af0b86e90 0x562af0ceab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 --2- 172.21.15.89:0/2715672658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562af0b70960 0x562af0cea5f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8be3e00640 0 client.5829 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 -- 172.21.15.89:0/2715672658 >> 172.21.15.89:0/2715672658 conn(0x562af0798210 msgr2=0x562af0cca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 -- 172.21.15.89:0/2715672658 shutdown_connections 2024-08-31T04:28:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 1 -- 172.21.15.89:0/2715672658 wait complete. 2024-08-31T04:28:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c0d326000 20 client.5829 trim_cache size 0 max 16384 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 82, 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "25c2c3c7": { 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 82, 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:28:44.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 131.3, 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:44.933 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:28:44.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 -- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8bdc0720f0 msgr2=0x7f8bdc074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:44.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8bdc0720f0 0x7f8bdc074600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c00157a20 tx=0x7f8be80091e0 comp rx=0 tx=0).stop 2024-08-31T04:28:44.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 -- 172.21.15.89:0/4222923389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be4004d50 msgr2=0x7f8c0015a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:44.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be4004d50 0x7f8c0015a130 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0011b10 tx=0x7f8bf0009e90 comp rx=0 tx=0).stop 2024-08-31T04:28:44.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 -- 172.21.15.89:0/4222923389 shutdown_connections 2024-08-31T04:28:44.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8bdc0720f0 0x7f8bdc074600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:44.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c001ebdf0 0x7f8c001ec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:44.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c001f5640 0x7f8c00156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:44.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 --2- 172.21.15.89:0/4222923389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8be4004d50 0x7f8c0015a130 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:44.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 -- 172.21.15.89:0/4222923389 >> 172.21.15.89:0/4222923389 conn(0x7f8c000c99b0 msgr2=0x7f8c000736a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:44.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 -- 172.21.15.89:0/4222923389 shutdown_connections 2024-08-31T04:28:44.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:44.930+0000 7f8c05c00640 1 -- 172.21.15.89:0/4222923389 wait complete. 2024-08-31T04:28:44.954 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '25c2c3c7', quiesce took 4.8 seconds. Will release after: 6.500000000000001 2024-08-31T04:28:51.455 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:28:51.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.618+0000 7f9722600640 1 -- 172.21.15.89:0/2497056935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 msgr2=0x7f971c0c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:51.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.618+0000 7f9722600640 1 --2- 172.21.15.89:0/2497056935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 0x7f971c0c4090 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9714009c80 tx=0x7f971401cda0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.622+0000 7f9722600640 1 -- 172.21.15.89:0/2497056935 shutdown_connections 2024-08-31T04:28:51.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.622+0000 7f9722600640 1 --2- 172.21.15.89:0/2497056935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 0x7f971c0c4090 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.622+0000 7f9722600640 1 --2- 172.21.15.89:0/2497056935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f971c0b30f0 0x7f971c0726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.622+0000 7f9722600640 1 -- 172.21.15.89:0/2497056935 >> 172.21.15.89:0/2497056935 conn(0x7f971c070c00 msgr2=0x7f971c074740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:51.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.622+0000 7f9722600640 1 -- 172.21.15.89:0/2497056935 shutdown_connections 2024-08-31T04:28:51.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.622+0000 7f9722600640 1 -- 172.21.15.89:0/2497056935 wait complete. 2024-08-31T04:28:51.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.622+0000 7f9722600640 1 Processor -- start 2024-08-31T04:28:51.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.622+0000 7f9722600640 1 -- start start 2024-08-31T04:28:51.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9722600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f971c0b30f0 0x7f971c14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:51.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9722600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 0x7f971c0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:51.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9722600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f971c0ca810 0x7f971c146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:51.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9722600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f971c072ff0 con 0x7f971c0c3c80 2024-08-31T04:28:51.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9722600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f971c072e70 con 0x7f971c0ca810 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9722600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f971c0c4e10 con 0x7f971c0b30f0 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9712a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 0x7f971c0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9712a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 0x7f971c0c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55782/0 (socket says 172.21.15.89:55782) 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9712a00640 1 -- 172.21.15.89:0/1555304689 learned_addr learned my addr 172.21.15.89:0/1555304689 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f971b400640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f971c0b30f0 0x7f971c14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f971be00640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f971c0ca810 0x7f971c146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9712a00640 1 -- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f971c0b30f0 msgr2=0x7f971c14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9712a00640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f971c0b30f0 0x7f971c14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9712a00640 1 -- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f971c0ca810 msgr2=0x7f971c146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9712a00640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f971c0ca810 0x7f971c146710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9712a00640 1 -- 172.21.15.89:0/1555304689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971c165f70 con 0x7f971c0c3c80 2024-08-31T04:28:51.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f971b400640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f971c0b30f0 0x7f971c14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:28:51.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f971be00640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f971c0ca810 0x7f971c146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:28:51.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9712a00640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 0x7f971c0c9350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f970400c3f0 tx=0x7f970400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:51.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9713e00640 1 -- 172.21.15.89:0/1555304689 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704017070 con 0x7f971c0c3c80 2024-08-31T04:28:51.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9713e00640 1 -- 172.21.15.89:0/1555304689 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97040053c0 con 0x7f971c0c3c80 2024-08-31T04:28:51.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9713e00640 1 -- 172.21.15.89:0/1555304689 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704003860 con 0x7f971c0c3c80 2024-08-31T04:28:51.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971c14dcb0 con 0x7f971c0c3c80 2024-08-31T04:28:51.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971c154f60 con 0x7f971c0c3c80 2024-08-31T04:28:51.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f971c0726f0 con 0x7f971c0c3c80 2024-08-31T04:28:51.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.626+0000 7f9713e00640 1 -- 172.21.15.89:0/1555304689 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f970401a070 con 0x7f971c0c3c80 2024-08-31T04:28:51.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.630+0000 7f9713e00640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f96f80720f0 0x7f96f8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:51.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.630+0000 7f9713e00640 1 -- 172.21.15.89:0/1555304689 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f9704092240 con 0x7f971c0c3c80 2024-08-31T04:28:51.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.630+0000 7f971b400640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f96f80720f0 0x7f96f8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:51.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.630+0000 7f971b400640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f96f80720f0 0x7f96f8074600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f970c00bbd0 tx=0x7f970c00b5b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:51.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.634+0000 7f9713e00640 1 -- 172.21.15.89:0/1555304689 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9704001090 con 0x7f971c0c3c80 2024-08-31T04:28:51.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f971c156050 con 0x7f971c0c3c80 2024-08-31T04:28:51.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9713e00640 1 -- 172.21.15.89:0/1555304689 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f970405d7b0 con 0x7f971c0c3c80 2024-08-31T04:28:51.830 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:28:51.830 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:28:51.831 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:28:51.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f96f80720f0 msgr2=0x7f96f8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:51.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f96f80720f0 0x7f96f8074600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f970c00bbd0 tx=0x7f970c00b5b0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 msgr2=0x7f971c0c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 0x7f971c0c9350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f970400c3f0 tx=0x7f970400c8b0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 shutdown_connections 2024-08-31T04:28:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f96f80720f0 0x7f96f8074600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f971c0c3c80 0x7f971c0c9350 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f971c0ca810 0x7f971c146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 --2- 172.21.15.89:0/1555304689 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f971c0b30f0 0x7f971c14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 >> 172.21.15.89:0/1555304689 conn(0x7f971c070c00 msgr2=0x7f971c06e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 shutdown_connections 2024-08-31T04:28:51.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:51.830+0000 7f9722600640 1 -- 172.21.15.89:0/1555304689 wait complete. 2024-08-31T04:28:51.853 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 25c2c3c7 --release --await' 2024-08-31T04:28:51.853 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 25c2c3c7 --release --await 2024-08-31T04:28:52.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.014+0000 7f5022000640 1 -- 172.21.15.89:0/3390183170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0b2860 msgr2=0x7f501c0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:52.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.014+0000 7f5022000640 1 --2- 172.21.15.89:0/3390183170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0b2860 0x7f501c0b2d20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f500c009900 tx=0x7f500c01c820 comp rx=0 tx=0).stop 2024-08-31T04:28:52.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.014+0000 7f5022000640 1 -- 172.21.15.89:0/3390183170 shutdown_connections 2024-08-31T04:28:52.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.014+0000 7f5022000640 1 --2- 172.21.15.89:0/3390183170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501c0c90e0 0x7f501c0747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.014+0000 7f5022000640 1 --2- 172.21.15.89:0/3390183170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0b2860 0x7f501c0b2d20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.014+0000 7f5022000640 1 -- 172.21.15.89:0/3390183170 >> 172.21.15.89:0/3390183170 conn(0x7f501c0c99b0 msgr2=0x7f501c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.014+0000 7f5022000640 1 -- 172.21.15.89:0/3390183170 shutdown_connections 2024-08-31T04:28:52.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.014+0000 7f5022000640 1 -- 172.21.15.89:0/3390183170 wait complete. 2024-08-31T04:28:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 Processor -- start 2024-08-31T04:28:52.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 -- start start 2024-08-31T04:28:52.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f501c0b2860 0x7f501c1f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501c0c1ed0 0x7f501c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0c90e0 0x7f501c14daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f501c158750 con 0x7f501c0c90e0 2024-08-31T04:28:52.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f501c1585d0 con 0x7f501c0b2860 2024-08-31T04:28:52.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f501c165770 con 0x7f501c0c1ed0 2024-08-31T04:28:52.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0c90e0 0x7f501c14daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0c90e0 0x7f501c14daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55806/0 (socket says 172.21.15.89:55806) 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501be00640 1 -- 172.21.15.89:0/2483286875 learned_addr learned my addr 172.21.15.89:0/2483286875 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501b400640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f501c0b2860 0x7f501c1f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501aa00640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501c0c1ed0 0x7f501c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501be00640 1 -- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501c0c1ed0 msgr2=0x7f501c153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501be00640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501c0c1ed0 0x7f501c153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501be00640 1 -- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f501c0b2860 msgr2=0x7f501c1f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501be00640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f501c0b2860 0x7f501c1f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501be00640 1 -- 172.21.15.89:0/2483286875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c1f8d90 con 0x7f501c0c90e0 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f501be00640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0c90e0 0x7f501c14daa0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f501400e970 tx=0x7f501400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5013400640 1 -- 172.21.15.89:0/2483286875 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014004d30 con 0x7f501c0c90e0 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5013400640 1 -- 172.21.15.89:0/2483286875 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f501400cb20 con 0x7f501c0c90e0 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 -- 172.21.15.89:0/2483286875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c152f30 con 0x7f501c0c90e0 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5013400640 1 -- 172.21.15.89:0/2483286875 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014005020 con 0x7f501c0c90e0 2024-08-31T04:28:52.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.018+0000 7f5022000640 1 -- 172.21.15.89:0/2483286875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c154bf0 con 0x7f501c0c90e0 2024-08-31T04:28:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.022+0000 7f5013400640 1 -- 172.21.15.89:0/2483286875 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f50140051c0 con 0x7f501c0c90e0 2024-08-31T04:28:52.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.022+0000 7f5013400640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ffc0720c0 0x7f4ffc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.022+0000 7f5013400640 1 -- 172.21.15.89:0/2483286875 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f50140938b0 con 0x7f501c0c90e0 2024-08-31T04:28:52.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.022+0000 7f5029569000 1 Processor -- start 2024-08-31T04:28:52.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.022+0000 7f5029569000 1 -- start start 2024-08-31T04:28:52.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.022+0000 7f501b400640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ffc0720c0 0x7f4ffc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.022+0000 7f501b400640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ffc0720c0 0x7f4ffc0745d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f500c0af000 tx=0x7f500c01b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:52.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 0x562c30b54e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30b59ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30b5a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562c309fff30 con 0x562c30a20930 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562c30975690 con 0x562c30a36950 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562c30964c20 con 0x562c30a11890 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30b59ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30b59ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55816/0 (socket says 172.21.15.89:55816) 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501aa00640 1 -- 172.21.15.89:0/3629226521 learned_addr learned my addr 172.21.15.89:0/3629226521 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501be00640 1 --2- 172.21.15.89:0/3629226521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30b5a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501b400640 1 --2- 172.21.15.89:0/3629226521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 0x562c30b54e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501aa00640 1 -- 172.21.15.89:0/3629226521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 msgr2=0x562c30b5a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501aa00640 1 --2- 172.21.15.89:0/3629226521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30b5a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501aa00640 1 -- 172.21.15.89:0/3629226521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 msgr2=0x562c30b54e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:52.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501aa00640 1 --2- 172.21.15.89:0/3629226521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 0x562c30b54e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501aa00640 1 -- 172.21.15.89:0/3629226521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c309198f0 con 0x562c30a20930 2024-08-31T04:28:52.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f501aa00640 1 --2- 172.21.15.89:0/3629226521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30b59ad0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5008001710 tx=0x7f5008001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388cbe255dfce4a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:52.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5007400640 1 -- 172.21.15.89:0/3629226521 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080052e0 con 0x562c30a20930 2024-08-31T04:28:52.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5007400640 1 -- 172.21.15.89:0/3629226521 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5008018070 con 0x562c30a20930 2024-08-31T04:28:52.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5007400640 1 -- 172.21.15.89:0/3629226521 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500800fa10 con 0x562c30a20930 2024-08-31T04:28:52.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 -- 172.21.15.89:0/3629226521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 msgr2=0x562c30b59ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:52.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 --2- 172.21.15.89:0/3629226521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30b59ad0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5008001710 tx=0x7f5008001bd0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 -- 172.21.15.89:0/3629226521 shutdown_connections 2024-08-31T04:28:52.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 --2- 172.21.15.89:0/3629226521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30b59ad0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 --2- 172.21.15.89:0/3629226521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30b5a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.028 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 --2- 172.21.15.89:0/3629226521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 0x562c30b54e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 -- 172.21.15.89:0/3629226521 >> 172.21.15.89:0/3629226521 conn(0x562c30a36540 msgr2=0x562c30b57890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:52.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 -- 172.21.15.89:0/3629226521 shutdown_connections 2024-08-31T04:28:52.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 -- 172.21.15.89:0/3629226521 wait complete. 2024-08-31T04:28:52.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 -- start start 2024-08-31T04:28:52.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.026+0000 7f5029569000 1 Processor -- start 2024-08-31T04:28:52.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a11890 0x562c30b53c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a20930 0x562c30b54150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b54690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562c308eb500 con 0x562c30a36950 2024-08-31T04:28:52.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562c30968bd0 con 0x562c30a11890 2024-08-31T04:28:52.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562c3090ca30 con 0x562c30a20930 2024-08-31T04:28:52.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 10 client.0 _ll_register_callbacks cb 0x562c30a1ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:52.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b54690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b54690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55828/0 (socket says 172.21.15.89:55828) 2024-08-31T04:28:52.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501be00640 1 -- 172.21.15.89:0/826533591 learned_addr learned my addr 172.21.15.89:0/826533591 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:52.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501b400640 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a11890 0x562c30b53c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501aa00640 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a20930 0x562c30b54150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501be00640 1 -- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a20930 msgr2=0x562c30b54150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:52.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501be00640 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a20930 0x562c30b54150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501be00640 1 -- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a11890 msgr2=0x562c30b53c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:52.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501be00640 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a11890 0x562c30b53c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501be00640 1 -- 172.21.15.89:0/826533591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c309046a0 con 0x562c30a36950 2024-08-31T04:28:52.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501be00640 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b54690 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f501400c640 tx=0x7f501405ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225888a6bb855a28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f4ffbe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f4ffbe00640 1 -- 172.21.15.89:0/826533591 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501401f070 con 0x562c30a36950 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f4ffbe00640 1 -- 172.21.15.89:0/826533591 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f501405d400 con 0x562c30a36950 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 -- 172.21.15.89:0/826533591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c308fe7e0 con 0x562c30a36950 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f4ffbe00640 1 -- 172.21.15.89:0/826533591 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f5014078080 con 0x562c30a36950 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 10 client.5850 fetch_fsmap learned FSMap version 9 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 -- 172.21.15.89:0/826533591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562c309231c0 con 0x562c30a36950 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f4ffbe00640 1 -- 172.21.15.89:0/826533591 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562c308fe7e0 con 0x562c30a36950 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f4ffbe00640 1 -- 172.21.15.89:0/826533591 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f501400f040 con 0x562c30a36950 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 10 client.5850 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 10 client.5850 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 20 client.5850 populate_metadata read hostname 'smithi089' 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562c309fafc0 0x562c30b6f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 4 client.5850 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:52.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f5029569000 1 -- 172.21.15.89:0/826533591 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c309775e0 con 0x562c309fafc0 2024-08-31T04:28:52.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.030+0000 7f501b400640 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562c309fafc0 0x562c30b6f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f501b400640 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562c309fafc0 0x562c30b6f010 crc :-1 s=READY pgs=1107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4daf4248a39598bd server_cookie=ff21318fbbf8db76 in_seq=0 out_seq=0 2024-08-31T04:28:52.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f4ffbe00640 10 client.5850 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:52.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f4ffbe00640 1 -- 172.21.15.89:0/826533591 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c309775e0 con 0x562c309fafc0 2024-08-31T04:28:52.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f4ffbe00640 10 client.5850 handle_command_reply: tid=0 2024-08-31T04:28:52.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 client.5850 shutdown 2024-08-31T04:28:52.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 -- 172.21.15.89:0/826533591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 msgr2=0x562c30b54690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:52.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b54690 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f501400c640 tx=0x7f501405ed50 comp rx=0 tx=0).stop 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 -- 172.21.15.89:0/826533591 shutdown_connections 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562c309fafc0 0x562c30b6f010 crc :-1 s=READY pgs=1107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b54690 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a20930 0x562c30b54150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 --2- 172.21.15.89:0/826533591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a11890 0x562c30b53c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f4ffbe00640 0 client.5850 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 -- 172.21.15.89:0/826533591 >> 172.21.15.89:0/826533591 conn(0x562c30a36540 msgr2=0x562c30b55040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 -- 172.21.15.89:0/826533591 shutdown_connections 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 1 -- 172.21.15.89:0/826533591 wait complete. 2024-08-31T04:28:52.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.034+0000 7f5029569000 20 client.5850 trim_cache size 0 max 16384 2024-08-31T04:28:52.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 Processor -- start 2024-08-31T04:28:52.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 -- start start 2024-08-31T04:28:52.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30b6d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a20930 0x562c30b6d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b6da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562c30b16e20 con 0x562c30a36950 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f501c2040d0 con 0x562c30a20930 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f501c202fb0 con 0x562c30a11890 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b6da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b6da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55832/0 (socket says 172.21.15.89:55832) 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501be00640 1 -- 172.21.15.89:0/3766897437 learned_addr learned my addr 172.21.15.89:0/3766897437 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501aa00640 1 --2- 172.21.15.89:0/3766897437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a20930 0x562c30b6d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501b400640 1 --2- 172.21.15.89:0/3766897437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30b6d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501be00640 1 -- 172.21.15.89:0/3766897437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 msgr2=0x562c30b6d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501be00640 1 --2- 172.21.15.89:0/3766897437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30b6d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501be00640 1 -- 172.21.15.89:0/3766897437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a20930 msgr2=0x562c30b6d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:52.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501be00640 1 --2- 172.21.15.89:0/3766897437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a20930 0x562c30b6d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501be00640 1 -- 172.21.15.89:0/3766897437 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c309e92f0 con 0x562c30a36950 2024-08-31T04:28:52.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f501be00640 1 --2- 172.21.15.89:0/3766897437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b6da80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f501400e940 tx=0x7f501405dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fb9a9544d84aaa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:52.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5006a00640 1 -- 172.21.15.89:0/3766897437 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501401f070 con 0x562c30a36950 2024-08-31T04:28:52.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5006a00640 1 -- 172.21.15.89:0/3766897437 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50140679a0 con 0x562c30a36950 2024-08-31T04:28:52.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5006a00640 1 -- 172.21.15.89:0/3766897437 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501405e780 con 0x562c30a36950 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 -- 172.21.15.89:0/3766897437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 msgr2=0x562c30b6da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 --2- 172.21.15.89:0/3766897437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b6da80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f501400e940 tx=0x7f501405dd60 comp rx=0 tx=0).stop 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 -- 172.21.15.89:0/3766897437 shutdown_connections 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 --2- 172.21.15.89:0/3766897437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a36950 0x562c30b6da80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 --2- 172.21.15.89:0/3766897437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a20930 0x562c30b6d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 --2- 172.21.15.89:0/3766897437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30b6d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 -- 172.21.15.89:0/3766897437 >> 172.21.15.89:0/3766897437 conn(0x562c30a36540 msgr2=0x562c30b53a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 -- 172.21.15.89:0/3766897437 shutdown_connections 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.054+0000 7f5029569000 1 -- 172.21.15.89:0/3766897437 wait complete. 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 -- start start 2024-08-31T04:28:52.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 Processor -- start 2024-08-31T04:28:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30bd3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30bd3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 0x562c30bd43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f501c2028e0 con 0x562c30a20930 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f501c201590 con 0x562c30a36950 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f501c201b40 con 0x562c30a11890 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 10 client.0 _ll_register_callbacks cb 0x7f5008007ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30bd3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30bd3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55846/0 (socket says 172.21.15.89:55846) 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501aa00640 1 -- 172.21.15.89:0/3205690602 learned_addr learned my addr 172.21.15.89:0/3205690602 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501be00640 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 0x562c30bd43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501b400640 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30bd3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501aa00640 1 -- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 msgr2=0x562c30bd3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:52.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501aa00640 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30bd3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501aa00640 1 -- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 msgr2=0x562c30bd43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501aa00640 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 0x562c30bd43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501aa00640 1 -- 172.21.15.89:0/3205690602 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c308eeb30 con 0x562c30a20930 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f501aa00640 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30bd3e80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x562c3090f340 tx=0x7f5008007270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2a27e9d49e1253 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f4ffbe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f4ffbe00640 1 -- 172.21.15.89:0/3205690602 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008007b20 con 0x562c30a20930 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f4ffbe00640 1 -- 172.21.15.89:0/3205690602 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f50080067c0 con 0x562c30a20930 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 -- 172.21.15.89:0/3205690602 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50140679a0 con 0x562c30a20930 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f4ffbe00640 1 -- 172.21.15.89:0/3205690602 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f500802e050 con 0x562c30a20930 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 10 client.5856 fetch_fsmap learned FSMap version 9 2024-08-31T04:28:52.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.058+0000 7f5029569000 1 -- 172.21.15.89:0/3205690602 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562c308fbc70 con 0x562c30a20930 2024-08-31T04:28:52.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f4ffbe00640 1 -- 172.21.15.89:0/3205690602 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50140679a0 con 0x562c30a20930 2024-08-31T04:28:52.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f4ffbe00640 1 -- 172.21.15.89:0/3205690602 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f5008031020 con 0x562c30a20930 2024-08-31T04:28:52.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f5029569000 10 client.5856 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:28:52.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f5029569000 10 client.5856 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:28:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f5029569000 20 client.5856 populate_metadata read hostname 'smithi089' 2024-08-31T04:28:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f5029569000 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562c305f6e80 0x562c30b71450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f5029569000 4 client.5856 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "25c2c3c7", "release": true, "await": true}] 2024-08-31T04:28:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f5029569000 1 -- 172.21.15.89:0/3205690602 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "25c2c3c7", "release": true, "await": true}) -- 0x562c30973080 con 0x562c305f6e80 2024-08-31T04:28:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f501b400640 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562c305f6e80 0x562c30b71450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f501b400640 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562c305f6e80 0x562c30b71450 crc :-1 s=READY pgs=1108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f08b300ec1ea95e server_cookie=9318f8e04c9534d3 in_seq=0 out_seq=0 2024-08-31T04:28:52.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.062+0000 7f4ffbe00640 10 client.5856 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:52.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f4ffbe00640 1 -- 172.21.15.89:0/3205690602 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x562c30973080 con 0x562c305f6e80 2024-08-31T04:28:52.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f4ffbe00640 10 client.5856 handle_command_reply: tid=0 2024-08-31T04:28:52.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 client.5856 shutdown 2024-08-31T04:28:52.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 -- 172.21.15.89:0/3205690602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 msgr2=0x562c30bd3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:52.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30bd3e80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x562c3090f340 tx=0x7f5008007270 comp rx=0 tx=0).stop 2024-08-31T04:28:52.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 -- 172.21.15.89:0/3205690602 shutdown_connections 2024-08-31T04:28:52.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562c305f6e80 0x562c30b71450 crc :-1 s=READY pgs=1108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c30a20930 0x562c30bd3e80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f4ffbe00640 0 client.5856 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:28:52.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562c30a36950 0x562c30bd43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 --2- 172.21.15.89:0/3205690602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562c30a11890 0x562c30bd3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 -- 172.21.15.89:0/3205690602 >> 172.21.15.89:0/3205690602 conn(0x562c30a36540 msgr2=0x562c30b53a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:52.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 -- 172.21.15.89:0/3205690602 shutdown_connections 2024-08-31T04:28:52.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 1 -- 172.21.15.89:0/3205690602 wait complete. 2024-08-31T04:28:52.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5029569000 20 client.5856 trim_cache size 0 max 16384 2024-08-31T04:28:52.205 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:28:52.205 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:28:52.205 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 84, 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "25c2c3c7": { 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 84, 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 131.3, 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:28:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:28:52.207 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:28:52.207 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:28:52.207 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:52.207 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:52.207 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:52.207 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:52.207 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:28:52.207 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:28:52.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 -- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ffc0720c0 msgr2=0x7f4ffc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:52.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ffc0720c0 0x7f4ffc0745d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f500c0af000 tx=0x7f500c01b060 comp rx=0 tx=0).stop 2024-08-31T04:28:52.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 -- 172.21.15.89:0/2483286875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0c90e0 msgr2=0x7f501c14daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:52.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0c90e0 0x7f501c14daa0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f501400e970 tx=0x7f501400ee30 comp rx=0 tx=0).stop 2024-08-31T04:28:52.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 -- 172.21.15.89:0/2483286875 shutdown_connections 2024-08-31T04:28:52.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ffc0720c0 0x7f4ffc0745d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f501c0c90e0 0x7f501c14daa0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f501c0c1ed0 0x7f501c153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 --2- 172.21.15.89:0/2483286875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f501c0b2860 0x7f501c1f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:52.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 -- 172.21.15.89:0/2483286875 >> 172.21.15.89:0/2483286875 conn(0x7f501c0c99b0 msgr2=0x7f501c161300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:52.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 -- 172.21.15.89:0/2483286875 shutdown_connections 2024-08-31T04:28:52.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:28:52.202+0000 7f5022000640 1 -- 172.21.15.89:0/2483286875 wait complete. 2024-08-31T04:28:52.223 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '25c2c3c7', total seconds elapsed: 12.0 2024-08-31T04:28:53.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:28:53.856 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:28:54.392 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 17% (40/226) Updating files: 18% (41/226) Updating files: 19% (43/226) Updating files: 20% (46/226) Updating files: 21% (48/226) Updating files: 22% (50/226) Updating files: 23% (52/226) Updating files: 24% (55/226) Updating files: 25% (57/226) Updating files: 26% (59/226) Updating files: 27% (62/226) Updating files: 28% (64/226) Updating files: 29% (66/226) Updating files: 30% (68/226) Updating files: 31% (71/226) Updating files: 32% (73/226) Updating files: 33% (75/226) Updating files: 34% (77/226) Updating files: 35% (80/226) Updating files: 36% (82/226) Updating files: 37% (84/226) Updating files: 38% (86/226) Updating files: 39% (89/226) Updating files: 40% (91/226) Updating files: 41% (93/226) Updating files: 42% (95/226) Updating files: 43% (98/226) Updating files: 44% (100/226) Updating files: 45% (102/226) Updating files: 46% (104/226) Updating files: 47% (107/226) Updating files: 48% (109/226) Updating files: 49% (111/226) Updating files: 50% (113/226) Updating files: 51% (116/226) Updating files: 52% (118/226) Updating files: 53% (120/226) Updating files: 54% (123/226) Updating files: 55% (125/226) Updating files: 56% (127/226) Updating files: 57% (129/226) Updating files: 58% (132/226) Updating files: 59% (134/226) Updating files: 60% (136/226) Updating files: 61% (138/226) Updating files: 62% (141/226) Updating files: 63% (143/226) Updating files: 64% (145/226) Updating files: 65% (147/226) Updating files: 66% (150/226) Updating files: 67% (152/226) Updating files: 68% (154/226) Updating files: 69% (156/226) Updating files: 70% (159/226) Updating files: 71% (161/226) Updating files: 72% (163/226) Updating files: 73% (165/226) Updating files: 74% (168/226) Updating files: 75% (170/226) Updating files: 76% (172/226) Updating files: 77% (175/226) Updating files: 78% (177/226) Updating files: 79% (179/226) Updating files: 80% (181/226) Updating files: 81% (184/226) Updating files: 82% (186/226) Updating files: 83% (188/226) Updating files: 84% (190/226) Updating files: 85% (193/226) Updating files: 86% (195/226) Updating files: 87% (197/226) Updating files: 88% (199/226) Updating files: 89% (202/226) Updating files: 90% (204/226) Updating files: 91% (206/226) Updating files: 92% (208/226) Updating files: 93% (211/226) Updating files: 94% (213/226) Updating files: 95% (215/226) Updating files: 96% (217/226) Updating files: 97% (220/226) Updating files: 98% (222/226) Updating files: 99% (224/226) Updating files: 100% (226/226) Updating files: 100% (226/226), done. 2024-08-31T04:28:54.616 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 7eea40ea37f v0.40 2024-08-31T04:28:54.687 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.40 2024-08-31T04:28:54.707 INFO:tasks.workunit.client.0.smithi089.stdout:v0.41 2024-08-31T04:28:54.707 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 41 -eq 48 ] 2024-08-31T04:28:54.707 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.41 2024-08-31T04:28:54.707 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.41 2024-08-31T04:28:54.707 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.41 2024-08-31T04:29:02.723 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 28% (25/87) Updating files: 29% (26/87) Updating files: 31% (27/87) Updating files: 32% (28/87) Updating files: 33% (29/87) Updating files: 34% (30/87) Updating files: 35% (31/87) Updating files: 36% (32/87) Updating files: 37% (33/87) Updating files: 39% (34/87) Updating files: 40% (35/87) Updating files: 41% (36/87) Updating files: 42% (37/87) Updating files: 43% (38/87) Updating files: 44% (39/87) Updating files: 45% (40/87) Updating files: 47% (41/87) Updating files: 48% (42/87) Updating files: 49% (43/87) Updating files: 50% (44/87) Updating files: 51% (45/87) Updating files: 52% (46/87) Updating files: 54% (47/87) Updating files: 55% (48/87) Updating files: 56% (49/87) Updating files: 57% (50/87) Updating files: 58% (51/87) Updating files: 59% (52/87) Updating files: 60% (53/87) Updating files: 62% (54/87) Updating files: 63% (55/87) Updating files: 64% (56/87) Updating files: 65% (57/87) Updating files: 66% (58/87) Updating files: 67% (59/87) Updating files: 68% (60/87) Updating files: 70% (61/87) Updating files: 71% (62/87) Updating files: 72% (63/87) Updating files: 73% (64/87) Updating files: 74% (65/87) Updating files: 75% (66/87) Updating files: 77% (67/87) Updating files: 78% (68/87) Updating files: 79% (69/87) Updating files: 80% (70/87) Updating files: 81% (71/87) Updating files: 82% (72/87) Updating files: 83% (73/87) Updating files: 85% (74/87) Updating files: 86% (75/87) Updating files: 87% (76/87) Updating files: 88% (77/87) Updating files: 89% (78/87) Updating files: 90% (79/87) Updating files: 91% (80/87) Updating files: 93% (81/87) Updating files: 94% (82/87) Updating files: 95% (83/87) Updating files: 96% (84/87) Updating files: 97% (85/87) Updating files: 98% (86/87) Updating files: 100% (87/87) Updating files: 100% (87/87), done. 2024-08-31T04:29:02.909 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at c1345f7136a v0.41 2024-08-31T04:29:02.912 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.41 2024-08-31T04:29:02.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 42 -eq 48 ] 2024-08-31T04:29:02.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.42 2024-08-31T04:29:02.995 INFO:tasks.workunit.client.0.smithi089.stdout:v0.42 2024-08-31T04:29:02.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.42 2024-08-31T04:29:02.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.42 2024-08-31T04:29:10.259 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 10% (27/250) Updating files: 11% (28/250) Updating files: 12% (30/250) Updating files: 13% (33/250) Updating files: 14% (35/250) Updating files: 15% (38/250) Updating files: 16% (40/250) Updating files: 17% (43/250) Updating files: 18% (45/250) Updating files: 19% (48/250) Updating files: 20% (50/250) Updating files: 21% (53/250) Updating files: 22% (55/250) Updating files: 23% (58/250) Updating files: 24% (60/250) Updating files: 25% (63/250) Updating files: 26% (65/250) Updating files: 27% (68/250) Updating files: 28% (70/250) Updating files: 29% (73/250) Updating files: 29% (74/250) Updating files: 30% (75/250) Updating files: 31% (78/250) Updating files: 32% (80/250) Updating files: 33% (83/250) Updating files: 34% (85/250) Updating files: 35% (88/250) Updating files: 36% (90/250) Updating files: 37% (93/250) Updating files: 38% (95/250) Updating files: 39% (98/250) Updating files: 40% (100/250) Updating files: 41% (103/250) Updating files: 42% (105/250) Updating files: 43% (108/250) Updating files: 44% (110/250) Updating files: 45% (113/250) Updating files: 46% (115/250) Updating files: 47% (118/250) Updating files: 48% (120/250) Updating files: 49% (123/250) Updating files: 50% (125/250) Updating files: 51% (128/250) Updating files: 52% (130/250) Updating files: 53% (133/250) Updating files: 54% (135/250) Updating files: 55% (138/250) Updating files: 56% (140/250) Updating files: 57% (143/250) Updating files: 58% (145/250) Updating files: 59% (148/250) Updating files: 60% (150/250) Updating files: 61% (153/250) Updating files: 62% (155/250) Updating files: 63% (158/250) Updating files: 64% (160/250) Updating files: 65% (163/250) Updating files: 66% (165/250) Updating files: 67% (168/250) Updating files: 68% (170/250) Updating files: 69% (173/250) Updating files: 70% (175/250) Updating files: 71% (178/250) Updating files: 72% (180/250) Updating files: 73% (183/250) Updating files: 74% (185/250) Updating files: 75% (188/250) Updating files: 76% (190/250) Updating files: 77% (193/250) Updating files: 78% (195/250) Updating files: 79% (198/250) Updating files: 80% (200/250) Updating files: 81% (203/250) Updating files: 82% (205/250) Updating files: 83% (208/250) Updating files: 84% (210/250) Updating files: 85% (213/250) Updating files: 86% (215/250) Updating files: 87% (218/250) Updating files: 88% (220/250) Updating files: 89% (223/250) Updating files: 90% (225/250) Updating files: 90% (227/250) Updating files: 91% (228/250) Updating files: 91% (229/250) Updating files: 92% (230/250) Updating files: 93% (233/250) Updating files: 94% (235/250) Updating files: 95% (238/250) Updating files: 96% (240/250) Updating files: 97% (243/250) Updating files: 98% (245/250) Updating files: 99% (248/250) Updating files: 100% (250/250) Updating files: 100% (250/250), done. 2024-08-31T04:29:10.414 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at b205c64c687 v0.42 2024-08-31T04:29:10.418 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.42 2024-08-31T04:29:10.464 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 43 -eq 48 ] 2024-08-31T04:29:10.464 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.43 2024-08-31T04:29:10.464 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.43 2024-08-31T04:29:10.465 INFO:tasks.workunit.client.0.smithi089.stdout:v0.43 2024-08-31T04:29:10.465 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.43 2024-08-31T04:29:11.807 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 97% (108/111) Updating files: 98% (109/111) Updating files: 99% (110/111) Updating files: 100% (111/111) Updating files: 100% (111/111), done. 2024-08-31T04:29:11.877 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 9fa8781c014 v0.43 2024-08-31T04:29:11.880 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.43 2024-08-31T04:29:12.563 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 44 -eq 48 ] 2024-08-31T04:29:12.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.44 2024-08-31T04:29:12.564 INFO:tasks.workunit.client.0.smithi089.stdout:v0.44 2024-08-31T04:29:12.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.44 2024-08-31T04:29:12.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.44 2024-08-31T04:29:13.210 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-08-31T04:29:13.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:29:13.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 -- 172.21.15.89:0/563034296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b400cea40 msgr2=0x7f3b4015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 --2- 172.21.15.89:0/563034296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b400cea40 0x7f3b4015a210 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3b400735d0 tx=0x7f3b2801f0b0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 -- 172.21.15.89:0/563034296 shutdown_connections 2024-08-31T04:29:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 --2- 172.21.15.89:0/563034296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b400cea40 0x7f3b4015a210 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 --2- 172.21.15.89:0/563034296 >> v2:172.21.15.170:3300/0 conn(0x7f3b4015dab0 0x7f3b401537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 -- 172.21.15.89:0/563034296 >> 172.21.15.89:0/563034296 conn(0x7f3b4006e340 msgr2=0x7f3b400cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 -- 172.21.15.89:0/563034296 shutdown_connections 2024-08-31T04:29:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 -- 172.21.15.89:0/563034296 wait complete. 2024-08-31T04:29:13.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 Processor -- start 2024-08-31T04:29:13.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 -- start start 2024-08-31T04:29:13.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b400c88c0 0x7f3b4015ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b400cea40 0x7f3b4014cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b4015c4b0 0x7f3b401514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4015d2b0 con 0x7f3b4015c4b0 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4015cfd0 con 0x7f3b400cea40 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.365+0000 7f3b46800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3b400716e0 con 0x7f3b400c88c0 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b4015c4b0 0x7f3b401514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b4015c4b0 0x7f3b401514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44160/0 (socket says 172.21.15.89:44160) 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3fe00640 1 -- 172.21.15.89:0/3409744360 learned_addr learned my addr 172.21.15.89:0/3409744360 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b37e00640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b400cea40 0x7f3b4014cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3f400640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b400c88c0 0x7f3b4015ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3fe00640 1 -- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b400c88c0 msgr2=0x7f3b4015ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3fe00640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b400c88c0 0x7f3b4015ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3fe00640 1 -- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b400cea40 msgr2=0x7f3b4014cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3fe00640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b400cea40 0x7f3b4014cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3fe00640 1 -- 172.21.15.89:0/3409744360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b40152010 con 0x7f3b4015c4b0 2024-08-31T04:29:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b3fe00640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b4015c4b0 0x7f3b401514e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3b38002240 tx=0x7f3b3800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b37400640 1 -- 172.21.15.89:0/3409744360 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38017070 con 0x7f3b4015c4b0 2024-08-31T04:29:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b37400640 1 -- 172.21.15.89:0/3409744360 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b38003c70 con 0x7f3b4015c4b0 2024-08-31T04:29:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b401f3690 con 0x7f3b4015c4b0 2024-08-31T04:29:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b37400640 1 -- 172.21.15.89:0/3409744360 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380052d0 con 0x7f3b4015c4b0 2024-08-31T04:29:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4015b360 con 0x7f3b4015c4b0 2024-08-31T04:29:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b400c8cd0 con 0x7f3b4015c4b0 2024-08-31T04:29:13.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.369+0000 7f3b37400640 1 -- 172.21.15.89:0/3409744360 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3b3801a070 con 0x7f3b4015c4b0 2024-08-31T04:29:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.373+0000 7f3b37400640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b1c0720c0 0x7f3b1c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.373+0000 7f3b37400640 1 -- 172.21.15.89:0/3409744360 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3b38092710 con 0x7f3b4015c4b0 2024-08-31T04:29:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.373+0000 7f3b3f400640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b1c0720c0 0x7f3b1c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.373+0000 7f3b3f400640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b1c0720c0 0x7f3b1c0745d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009ad0 tx=0x7f3b300091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:13.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.377+0000 7f3b37400640 1 -- 172.21.15.89:0/3409744360 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3b4015a750 con 0x7f3b4015c4b0 2024-08-31T04:29:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b40070bb0 con 0x7f3b4015c4b0 2024-08-31T04:29:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b37400640 1 -- 172.21.15.89:0/3409744360 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f3b380660a0 con 0x7f3b4015c4b0 2024-08-31T04:29:13.590 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:29:13.591 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:29:13.591 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:29:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b1c0720c0 msgr2=0x7f3b1c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b1c0720c0 0x7f3b1c0745d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009ad0 tx=0x7f3b300091e0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b4015c4b0 msgr2=0x7f3b401514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b4015c4b0 0x7f3b401514e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3b38002240 tx=0x7f3b3800cb90 comp rx=0 tx=0).stop 2024-08-31T04:29:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 shutdown_connections 2024-08-31T04:29:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3b1c0720c0 0x7f3b1c0745d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b4015c4b0 0x7f3b401514e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b400cea40 0x7f3b4014cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 --2- 172.21.15.89:0/3409744360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b400c88c0 0x7f3b4015ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 >> 172.21.15.89:0/3409744360 conn(0x7f3b4006e340 msgr2=0x7f3b400727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:13.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 shutdown_connections 2024-08-31T04:29:13.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.589+0000 7f3b46800640 1 -- 172.21.15.89:0/3409744360 wait complete. 2024-08-31T04:29:13.613 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-08-31T04:29:13.613 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-08-31T04:29:13.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.777+0000 7f59f8000640 1 -- 172.21.15.89:0/445699465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59f00c90e0 msgr2=0x7f59f00747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.777+0000 7f59f8000640 1 --2- 172.21.15.89:0/445699465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59f00c90e0 0x7f59f00747b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009c80 tx=0x7f59e801cd10 comp rx=0 tx=0).stop 2024-08-31T04:29:13.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.777+0000 7f59f8000640 1 -- 172.21.15.89:0/445699465 shutdown_connections 2024-08-31T04:29:13.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.777+0000 7f59f8000640 1 --2- 172.21.15.89:0/445699465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59f00c90e0 0x7f59f00747b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.777+0000 7f59f8000640 1 --2- 172.21.15.89:0/445699465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59f00b2d20 0x7f59f00c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.777+0000 7f59f8000640 1 -- 172.21.15.89:0/445699465 >> 172.21.15.89:0/445699465 conn(0x7f59f00c99b0 msgr2=0x7f59f00c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:13.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.777+0000 7f59f8000640 1 -- 172.21.15.89:0/445699465 shutdown_connections 2024-08-31T04:29:13.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.777+0000 7f59f8000640 1 -- 172.21.15.89:0/445699465 wait complete. 2024-08-31T04:29:13.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 Processor -- start 2024-08-31T04:29:13.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 -- start start 2024-08-31T04:29:13.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f00b2860 0x7f59f0151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59f00b2d20 0x7f59f01469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59f00c90e0 0x7f59f014d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f59f0165770 con 0x7f59f00b2860 2024-08-31T04:29:13.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f59f01658f0 con 0x7f59f00c90e0 2024-08-31T04:29:13.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f59f0165a70 con 0x7f59f00b2d20 2024-08-31T04:29:13.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f00b2860 0x7f59f0151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f00b2860 0x7f59f0151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44164/0 (socket says 172.21.15.89:44164) 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f5600640 1 -- 172.21.15.89:0/2834349868 learned_addr learned my addr 172.21.15.89:0/2834349868 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f6000640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59f00c90e0 0x7f59f014d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f4c00640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59f00b2d20 0x7f59f01469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f5600640 1 -- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59f00b2d20 msgr2=0x7f59f01469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f5600640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59f00b2d20 0x7f59f01469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f5600640 1 -- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59f00c90e0 msgr2=0x7f59f014d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f5600640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59f00c90e0 0x7f59f014d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f5600640 1 -- 172.21.15.89:0/2834349868 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f0148ad0 con 0x7f59f00b2860 2024-08-31T04:29:13.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f5600640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f00b2860 0x7f59f0151820 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c3c0 tx=0x7f59e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:13.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59ed600640 1 -- 172.21.15.89:0/2834349868 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4017070 con 0x7f59f00b2860 2024-08-31T04:29:13.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59ed600640 1 -- 172.21.15.89:0/2834349868 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59e40053c0 con 0x7f59f00b2860 2024-08-31T04:29:13.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59ed600640 1 -- 172.21.15.89:0/2834349868 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4003860 con 0x7f59f00b2860 2024-08-31T04:29:13.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 -- 172.21.15.89:0/2834349868 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f0150fc0 con 0x7f59f00b2860 2024-08-31T04:29:13.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.781+0000 7f59f8000640 1 -- 172.21.15.89:0/2834349868 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f014e630 con 0x7f59f00b2860 2024-08-31T04:29:13.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.785+0000 7f59ed600640 1 -- 172.21.15.89:0/2834349868 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f59e401a070 con 0x7f59f00b2860 2024-08-31T04:29:13.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.785+0000 7f59ed600640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59d00720f0 0x7f59d0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.785+0000 7f59ed600640 1 -- 172.21.15.89:0/2834349868 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f59e4092210 con 0x7f59f00b2860 2024-08-31T04:29:13.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.785+0000 7f59ff567000 1 Processor -- start 2024-08-31T04:29:13.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.785+0000 7f59f4c00640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59d00720f0 0x7f59d0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.785+0000 7f59ff567000 1 -- start start 2024-08-31T04:29:13.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f4c00640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59d00720f0 0x7f59d0074600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59f0071c20 tx=0x7f59dc0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:13.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393478d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x556393441ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x556393442220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556393297820 con 0x55639333f3f0 2024-08-31T04:29:13.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x556393286db0 con 0x556393334e90 2024-08-31T04:29:13.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55639328ad60 con 0x55639331e960 2024-08-31T04:29:13.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393478d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393478d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44180/0 (socket says 172.21.15.89:44180) 2024-08-31T04:29:13.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f5600640 1 -- 172.21.15.89:0/703030994 learned_addr learned my addr 172.21.15.89:0/703030994 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f4c00640 1 --2- 172.21.15.89:0/703030994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x556393441ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f6000640 1 --2- 172.21.15.89:0/703030994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x556393442220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f5600640 1 -- 172.21.15.89:0/703030994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 msgr2=0x556393442220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f5600640 1 --2- 172.21.15.89:0/703030994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x556393442220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f5600640 1 -- 172.21.15.89:0/703030994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 msgr2=0x556393441ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f5600640 1 --2- 172.21.15.89:0/703030994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x556393441ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f5600640 1 -- 172.21.15.89:0/703030994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556393221b70 con 0x55639333f3f0 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59f5600640 1 --2- 172.21.15.89:0/703030994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393478d20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f59e400a040 tx=0x7f59e405cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98c614af861113 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59e1c00640 1 -- 172.21.15.89:0/703030994 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4061870 con 0x55639333f3f0 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59e1c00640 1 -- 172.21.15.89:0/703030994 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59e4066290 con 0x55639333f3f0 2024-08-31T04:29:13.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59e1c00640 1 -- 172.21.15.89:0/703030994 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4064d60 con 0x55639333f3f0 2024-08-31T04:29:13.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 -- 172.21.15.89:0/703030994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 msgr2=0x556393478d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 --2- 172.21.15.89:0/703030994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393478d20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f59e400a040 tx=0x7f59e405cbc0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 -- 172.21.15.89:0/703030994 shutdown_connections 2024-08-31T04:29:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 --2- 172.21.15.89:0/703030994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x556393442220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 --2- 172.21.15.89:0/703030994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x556393441ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 --2- 172.21.15.89:0/703030994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393478d20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 -- 172.21.15.89:0/703030994 >> 172.21.15.89:0/703030994 conn(0x556392f46210 msgr2=0x55639347b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 -- 172.21.15.89:0/703030994 shutdown_connections 2024-08-31T04:29:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.789+0000 7f59ff567000 1 -- 172.21.15.89:0/703030994 wait complete. 2024-08-31T04:29:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 -- start start 2024-08-31T04:29:13.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 Processor -- start 2024-08-31T04:29:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639331e960 0x5563934778f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556393334e90 0x556393477e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55639333f3f0 0x556393478370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556392f4db10 con 0x55639331e960 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55639320d6f0 con 0x55639333f3f0 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55639328f390 con 0x556393334e90 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 10 client.0 _ll_register_callbacks cb 0x55639322eb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639331e960 0x5563934778f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639331e960 0x5563934778f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44194/0 (socket says 172.21.15.89:44194) 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f5600640 1 -- 172.21.15.89:0/811859733 learned_addr learned my addr 172.21.15.89:0/811859733 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f4c00640 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556393334e90 0x556393477e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f6000640 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55639333f3f0 0x556393478370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f5600640 1 -- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556393334e90 msgr2=0x556393477e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f5600640 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556393334e90 0x556393477e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f5600640 1 -- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55639333f3f0 msgr2=0x556393478370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f5600640 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55639333f3f0 0x556393478370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f5600640 1 -- 172.21.15.89:0/811859733 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556393245380 con 0x55639331e960 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59f5600640 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639331e960 0x5563934778f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f59e405a320 tx=0x7f59e40595f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ead3757816a4e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59d6000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59d6000640 1 -- 172.21.15.89:0/811859733 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4066290 con 0x55639331e960 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59d6000640 1 -- 172.21.15.89:0/811859733 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f59e405c310 con 0x55639331e960 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 -- 172.21.15.89:0/811859733 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556393295d20 con 0x55639331e960 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59d6000640 1 -- 172.21.15.89:0/811859733 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f59e405c510 con 0x55639331e960 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 10 client.5874 fetch_fsmap learned FSMap version 9 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 -- 172.21.15.89:0/811859733 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55639330be40 con 0x55639331e960 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59d6000640 1 -- 172.21.15.89:0/811859733 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556393295d20 con 0x55639331e960 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59d6000640 1 -- 172.21.15.89:0/811859733 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f59e4058a20 con 0x55639331e960 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 10 client.5874 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:29:13.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 10 client.5874 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:29:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 20 client.5874 populate_metadata read hostname 'smithi089' 2024-08-31T04:29:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x556392f2adc0 0x556393492f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 4 client.5874 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:13.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.793+0000 7f59ff567000 1 -- 172.21.15.89:0/811859733 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556393299770 con 0x556392f2adc0 2024-08-31T04:29:13.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59f4c00640 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x556392f2adc0 0x556393492f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59f4c00640 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x556392f2adc0 0x556393492f90 crc :-1 s=READY pgs=1126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a80a2a65c6b8aa6 server_cookie=1185f8461ec5e9dc in_seq=0 out_seq=0 2024-08-31T04:29:13.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59d6000640 10 client.5874 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:13.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59d6000640 1 -- 172.21.15.89:0/811859733 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556393299770 con 0x556392f2adc0 2024-08-31T04:29:13.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59d6000640 10 client.5874 handle_command_reply: tid=0 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 client.5874 shutdown 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 -- 172.21.15.89:0/811859733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639331e960 msgr2=0x5563934778f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639331e960 0x5563934778f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f59e405a320 tx=0x7f59e40595f0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 -- 172.21.15.89:0/811859733 shutdown_connections 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x556392f2adc0 0x556393492f90 crc :-1 s=READY pgs=1126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55639333f3f0 0x556393478370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x556393334e90 0x556393477e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 --2- 172.21.15.89:0/811859733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639331e960 0x5563934778f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59d6000640 0 client.5874 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 -- 172.21.15.89:0/811859733 >> 172.21.15.89:0/811859733 conn(0x556392f46210 msgr2=0x55639347a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 -- 172.21.15.89:0/811859733 shutdown_connections 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 1 -- 172.21.15.89:0/811859733 wait complete. 2024-08-31T04:29:13.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.797+0000 7f59ff567000 20 client.5874 trim_cache size 0 max 16384 2024-08-31T04:29:13.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59ff567000 1 Processor -- start 2024-08-31T04:29:13.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59ff567000 1 -- start start 2024-08-31T04:29:13.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59ff567000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x556393440860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59ff567000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x556393440da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59ff567000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393492f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59ff567000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f59f0150a00 con 0x55639333f3f0 2024-08-31T04:29:13.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59ff567000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f59f0207110 con 0x556393334e90 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59ff567000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f59f02063b0 con 0x55639331e960 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393492f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393492f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44204/0 (socket says 172.21.15.89:44204) 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f6000640 1 -- 172.21.15.89:0/1710597036 learned_addr learned my addr 172.21.15.89:0/1710597036 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f4c00640 1 --2- 172.21.15.89:0/1710597036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x556393440da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f5600640 1 --2- 172.21.15.89:0/1710597036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x556393440860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f6000640 1 -- 172.21.15.89:0/1710597036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 msgr2=0x556393440860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f6000640 1 --2- 172.21.15.89:0/1710597036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x556393440860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f6000640 1 -- 172.21.15.89:0/1710597036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 msgr2=0x556393440da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f6000640 1 --2- 172.21.15.89:0/1710597036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x556393440da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f6000640 1 -- 172.21.15.89:0/1710597036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639343cf60 con 0x55639333f3f0 2024-08-31T04:29:13.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59f6000640 1 --2- 172.21.15.89:0/1710597036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393492f90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009c80 tx=0x7f59e8019ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360bf869bf94c761 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:13.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59e1200640 1 -- 172.21.15.89:0/1710597036 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e80b2040 con 0x55639333f3f0 2024-08-31T04:29:13.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59e1200640 1 -- 172.21.15.89:0/1710597036 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59e8003980 con 0x55639333f3f0 2024-08-31T04:29:13.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.817+0000 7f59e1200640 1 -- 172.21.15.89:0/1710597036 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8003db0 con 0x55639333f3f0 2024-08-31T04:29:13.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 -- 172.21.15.89:0/1710597036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 msgr2=0x556393492f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:13.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 --2- 172.21.15.89:0/1710597036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393492f90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009c80 tx=0x7f59e8019ab0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 -- 172.21.15.89:0/1710597036 shutdown_connections 2024-08-31T04:29:13.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 --2- 172.21.15.89:0/1710597036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x556393492f90 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 --2- 172.21.15.89:0/1710597036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x556393440da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 --2- 172.21.15.89:0/1710597036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x556393440860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 -- 172.21.15.89:0/1710597036 >> 172.21.15.89:0/1710597036 conn(0x556392f46210 msgr2=0x556393441920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:13.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 -- 172.21.15.89:0/1710597036 shutdown_connections 2024-08-31T04:29:13.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 -- 172.21.15.89:0/1710597036 wait complete. 2024-08-31T04:29:13.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 -- start start 2024-08-31T04:29:13.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 Processor -- start 2024-08-31T04:29:13.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x5563934f5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x5563934f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x5563934f6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556393208eb0 con 0x55639333f3f0 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f59f0206a60 con 0x556393334e90 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55639322ef20 con 0x55639331e960 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59ff567000 10 client.0 _ll_register_callbacks cb 0x7f59e405ca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59f6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x5563934f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59f6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x5563934f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44206/0 (socket says 172.21.15.89:44206) 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59f6000640 1 -- 172.21.15.89:0/2718355429 learned_addr learned my addr 172.21.15.89:0/2718355429 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59f4c00640 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x5563934f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.821+0000 7f59f5600640 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x5563934f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59f6000640 1 -- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 msgr2=0x5563934f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59f6000640 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x5563934f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59f6000640 1 -- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 msgr2=0x5563934f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:13.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59f6000640 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x5563934f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59f6000640 1 -- 172.21.15.89:0/2718355429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563932e35b0 con 0x55639333f3f0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59f6000640 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x5563934f6310 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009bd0 tx=0x7f59e8005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a03fdb00fface66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59d6000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59d6000640 1 -- 172.21.15.89:0/2718355429 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e80b2070 con 0x55639333f3f0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59d6000640 1 -- 172.21.15.89:0/2718355429 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f59e8004230 con 0x55639333f3f0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59ff567000 1 -- 172.21.15.89:0/2718355429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59e8003980 con 0x55639333f3f0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59d6000640 1 -- 172.21.15.89:0/2718355429 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f59e80cc050 con 0x55639333f3f0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59ff567000 10 client.5880 fetch_fsmap learned FSMap version 9 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59ff567000 1 -- 172.21.15.89:0/2718355429 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x556393217fc0 con 0x55639333f3f0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59d6000640 1 -- 172.21.15.89:0/2718355429 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59e8003980 con 0x55639333f3f0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59d6000640 1 -- 172.21.15.89:0/2718355429 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f59e80cf020 con 0x55639333f3f0 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59ff567000 10 client.5880 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59ff567000 10 client.5880 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:29:13.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59ff567000 20 client.5880 populate_metadata read hostname 'smithi089' 2024-08-31T04:29:13.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59ff567000 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x556392f18e20 0x556393496410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:13.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59ff567000 4 client.5880 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-08-31T04:29:13.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59ff567000 1 -- 172.21.15.89:0/2718355429 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x556393295210 con 0x556392f18e20 2024-08-31T04:29:13.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59f5600640 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x556392f18e20 0x556393496410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:13.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59f5600640 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x556392f18e20 0x556393496410 crc :-1 s=READY pgs=1127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91b51259c6bf055 server_cookie=5501f12790f849b6 in_seq=0 out_seq=0 2024-08-31T04:29:13.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:13.825+0000 7f59d6000640 10 client.5880 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:16.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59d6000640 1 -- 172.21.15.89:0/2718355429 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556393295210 con 0x556392f18e20 2024-08-31T04:29:16.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59d6000640 10 client.5880 handle_command_reply: tid=0 2024-08-31T04:29:16.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 client.5880 shutdown 2024-08-31T04:29:16.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 -- 172.21.15.89:0/2718355429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 msgr2=0x5563934f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:16.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x5563934f6310 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009bd0 tx=0x7f59e8005be0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 -- 172.21.15.89:0/2718355429 shutdown_connections 2024-08-31T04:29:16.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x556392f18e20 0x556393496410 crc :-1 s=READY pgs=1127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55639333f3f0 0x5563934f6310 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556393334e90 0x5563934f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 --2- 172.21.15.89:0/2718355429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55639331e960 0x5563934f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59d6000640 0 client.5880 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:16.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 -- 172.21.15.89:0/2718355429 >> 172.21.15.89:0/2718355429 conn(0x556392f46210 msgr2=0x55639343a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:16.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 -- 172.21.15.89:0/2718355429 shutdown_connections 2024-08-31T04:29:16.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 1 -- 172.21.15.89:0/2718355429 wait complete. 2024-08-31T04:29:16.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59ff567000 20 client.5880 trim_cache size 0 max 16384 2024-08-31T04:29:16.325 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:29:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:29:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:29:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 86, 2024-08-31T04:29:16.325 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "5a5a3317": { 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 86, 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.0, 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:29:16.326 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:29:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:29:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:29:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:29:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:16.327 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:16.327 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:29:16.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 -- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59d00720f0 msgr2=0x7f59d0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:16.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59d00720f0 0x7f59d0074600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59f0071c20 tx=0x7f59dc0091e0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 -- 172.21.15.89:0/2834349868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f00b2860 msgr2=0x7f59f0151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:16.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f00b2860 0x7f59f0151820 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c3c0 tx=0x7f59e400c880 comp rx=0 tx=0).stop 2024-08-31T04:29:16.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 -- 172.21.15.89:0/2834349868 shutdown_connections 2024-08-31T04:29:16.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59d00720f0 0x7f59d0074600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59f00c90e0 0x7f59f014d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59f00b2d20 0x7f59f01469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 --2- 172.21.15.89:0/2834349868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59f00b2860 0x7f59f0151820 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:16.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 -- 172.21.15.89:0/2834349868 >> 172.21.15.89:0/2834349868 conn(0x7f59f00c99b0 msgr2=0x7f59f0074300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:16.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 -- 172.21.15.89:0/2834349868 shutdown_connections 2024-08-31T04:29:16.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:16.321+0000 7f59f8000640 1 -- 172.21.15.89:0/2834349868 wait complete. 2024-08-31T04:29:16.345 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5a5a3317', quiesce took 3.1 seconds. Will release after: 6.9 2024-08-31T04:29:23.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:29:23.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.409+0000 7fa109200640 1 -- 172.21.15.89:0/3813324092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1040c92b0 msgr2=0x7fa104164180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.409+0000 7fa109200640 1 --2- 172.21.15.89:0/3813324092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1040c92b0 0x7fa104164180 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009930 tx=0x7fa0fc01f0d0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.409+0000 7fa109200640 1 -- 172.21.15.89:0/3813324092 shutdown_connections 2024-08-31T04:29:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.409+0000 7fa109200640 1 --2- 172.21.15.89:0/3813324092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1040c92b0 0x7fa104164180 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.409+0000 7fa109200640 1 --2- 172.21.15.89:0/3813324092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa104156e10 0x7fa1040c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.409+0000 7fa109200640 1 -- 172.21.15.89:0/3813324092 >> 172.21.15.89:0/3813324092 conn(0x7fa1040ccf20 msgr2=0x7fa1040cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.409+0000 7fa109200640 1 -- 172.21.15.89:0/3813324092 shutdown_connections 2024-08-31T04:29:23.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.409+0000 7fa109200640 1 -- 172.21.15.89:0/3813324092 wait complete. 2024-08-31T04:29:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa109200640 1 Processor -- start 2024-08-31T04:29:23.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa109200640 1 -- start start 2024-08-31T04:29:23.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa109200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa104074e20 0x7fa1040cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa109200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1040c92b0 0x7fa1041f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa109200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa104156e10 0x7fa104151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa109200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa1041599b0 con 0x7fa104074e20 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa109200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa104069fc0 con 0x7fa1040c92b0 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa109200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa104159c90 con 0x7fa104156e10 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa101e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa104074e20 0x7fa1040cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa101e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa104074e20 0x7fa1040cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51312/0 (socket says 172.21.15.89:51312) 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa101e00640 1 -- 172.21.15.89:0/3513520749 learned_addr learned my addr 172.21.15.89:0/3513520749 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa0f9400640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1040c92b0 0x7fa1041f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa102800640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa104156e10 0x7fa104151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa101e00640 1 -- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa104156e10 msgr2=0x7fa104151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa101e00640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa104156e10 0x7fa104151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa101e00640 1 -- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1040c92b0 msgr2=0x7fa1041f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa101e00640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1040c92b0 0x7fa1041f2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.413+0000 7fa101e00640 1 -- 172.21.15.89:0/3513520749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1041e6960 con 0x7fa104074e20 2024-08-31T04:29:23.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa101e00640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa104074e20 0x7fa1040cb700 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c780 tx=0x7fa0f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:23.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa0faa00640 1 -- 172.21.15.89:0/3513520749 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4017070 con 0x7fa104074e20 2024-08-31T04:29:23.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa0faa00640 1 -- 172.21.15.89:0/3513520749 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0f4005070 con 0x7fa104074e20 2024-08-31T04:29:23.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1041f25e0 con 0x7fa104074e20 2024-08-31T04:29:23.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa0faa00640 1 -- 172.21.15.89:0/3513520749 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4005480 con 0x7fa104074e20 2024-08-31T04:29:23.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10415cd30 con 0x7fa104074e20 2024-08-31T04:29:23.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa104157220 con 0x7fa104074e20 2024-08-31T04:29:23.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa0faa00640 1 -- 172.21.15.89:0/3513520749 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa0f401a070 con 0x7fa104074e20 2024-08-31T04:29:23.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa0faa00640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0e00720f0 0x7fa0e0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.417+0000 7fa0faa00640 1 -- 172.21.15.89:0/3513520749 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa0f40925c0 con 0x7fa104074e20 2024-08-31T04:29:23.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.421+0000 7fa0f9400640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0e00720f0 0x7fa0e0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.421+0000 7fa0f9400640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0e00720f0 0x7fa0e0074600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0058d0 tx=0x7fa0ec005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:23.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.421+0000 7fa0faa00640 1 -- 172.21.15.89:0/3513520749 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa0f405db30 con 0x7fa104074e20 2024-08-31T04:29:23.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1040c8aa0 con 0x7fa104074e20 2024-08-31T04:29:23.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa0faa00640 1 -- 172.21.15.89:0/3513520749 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fa0f405d430 con 0x7fa104074e20 2024-08-31T04:29:23.626 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:29:23.626 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:29:23.626 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:29:23.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0e00720f0 msgr2=0x7fa0e0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0e00720f0 0x7fa0e0074600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0058d0 tx=0x7fa0ec005860 comp rx=0 tx=0).stop 2024-08-31T04:29:23.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa104074e20 msgr2=0x7fa1040cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa104074e20 0x7fa1040cb700 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400c780 tx=0x7fa0f400cc40 comp rx=0 tx=0).stop 2024-08-31T04:29:23.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 shutdown_connections 2024-08-31T04:29:23.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0e00720f0 0x7fa0e0074600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa104156e10 0x7fa104151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1040c92b0 0x7fa1041f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 --2- 172.21.15.89:0/3513520749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa104074e20 0x7fa1040cb700 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 >> 172.21.15.89:0/3513520749 conn(0x7fa1040ccf20 msgr2=0x7fa104153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:23.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 shutdown_connections 2024-08-31T04:29:23.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.625+0000 7fa109200640 1 -- 172.21.15.89:0/3513520749 wait complete. 2024-08-31T04:29:23.648 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 5a5a3317 --release --await' 2024-08-31T04:29:23.648 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 5a5a3317 --release --await 2024-08-31T04:29:23.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.809+0000 7f74f1200640 1 -- 172.21.15.89:0/1713499954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74d0004d50 msgr2=0x7f74d0005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.809+0000 7f74f1200640 1 --2- 172.21.15.89:0/1713499954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74d0004d50 0x7f74d0005160 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0734a0 tx=0x7f74e401fa20 comp rx=0 tx=0).stop 2024-08-31T04:29:23.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.809+0000 7f74ea800640 1 -- 172.21.15.89:0/1713499954 reap_dead start 2024-08-31T04:29:23.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.809+0000 7f74f1200640 1 -- 172.21.15.89:0/1713499954 shutdown_connections 2024-08-31T04:29:23.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.809+0000 7f74f1200640 1 -- 172.21.15.89:0/1713499954 >> 172.21.15.89:0/1713499954 conn(0x7f74ec0c99b0 msgr2=0x7f74ec0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:23.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.809+0000 7f74f1200640 1 -- 172.21.15.89:0/1713499954 shutdown_connections 2024-08-31T04:29:23.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.809+0000 7f74f1200640 1 -- 172.21.15.89:0/1713499954 wait complete. 2024-08-31T04:29:23.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.809+0000 7f74f1200640 1 Processor -- start 2024-08-31T04:29:23.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.809+0000 7f74f1200640 1 -- start start 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74f1200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74d0004d50 0x7f74ec150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74f1200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74ec157f20 0x7f74ec147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74f1200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74ec14e000 0x7f74ec14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74f1200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec0c22e0 con 0x7f74ec14e000 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74f1200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec0c2e80 con 0x7f74ec157f20 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74f1200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f74ec0c3160 con 0x7f74d0004d50 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74ea800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74ec14e000 0x7f74ec14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74ea800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74ec14e000 0x7f74ec14e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51326/0 (socket says 172.21.15.89:51326) 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74ea800640 1 -- 172.21.15.89:0/574003898 learned_addr learned my addr 172.21.15.89:0/574003898 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74e1400640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74ec157f20 0x7f74ec147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74e9e00640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74d0004d50 0x7f74ec150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74ea800640 1 -- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74d0004d50 msgr2=0x7f74ec150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74ea800640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74d0004d50 0x7f74ec150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74ea800640 1 -- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74ec157f20 msgr2=0x7f74ec147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74ea800640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74ec157f20 0x7f74ec147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74ea800640 1 -- 172.21.15.89:0/574003898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ec157b00 con 0x7f74ec14e000 2024-08-31T04:29:23.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74ea800640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74ec14e000 0x7f74ec14e410 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f74ec152e90 tx=0x7f74e4002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:23.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74e2a00640 1 -- 172.21.15.89:0/574003898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e40011d0 con 0x7f74ec14e000 2024-08-31T04:29:23.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74e2a00640 1 -- 172.21.15.89:0/574003898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e40039a0 con 0x7f74ec14e000 2024-08-31T04:29:23.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74e2a00640 1 -- 172.21.15.89:0/574003898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4003d50 con 0x7f74ec14e000 2024-08-31T04:29:23.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74f1200640 1 -- 172.21.15.89:0/574003898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74ec157540 con 0x7f74ec14e000 2024-08-31T04:29:23.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.813+0000 7f74f1200640 1 -- 172.21.15.89:0/574003898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74ec150350 con 0x7f74ec14e000 2024-08-31T04:29:23.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74e2a00640 1 -- 172.21.15.89:0/574003898 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f74e40a95f0 con 0x7f74ec14e000 2024-08-31T04:29:23.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74f89e9000 1 Processor -- start 2024-08-31T04:29:23.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74e2a00640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74c80720c0 0x7f74c80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74f89e9000 1 -- start start 2024-08-31T04:29:23.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74e2a00640 1 -- 172.21.15.89:0/574003898 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f74e4130230 con 0x7f74ec14e000 2024-08-31T04:29:23.819 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74e1400640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74c80720c0 0x7f74c80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74e1400640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74c80720c0 0x7f74c80745d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0746f0 tx=0x7f74d40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:23.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f478e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f47dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 0x56466f47e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74f89e9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56466f323f30 con 0x56466f344930 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74f89e9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56466f299690 con 0x56466f35a950 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74f89e9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56466f288c20 con 0x56466f335890 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74e1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f47dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74e9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f478e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74e1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f47dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51340/0 (socket says 172.21.15.89:51340) 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.817+0000 7f74e1400640 1 -- 172.21.15.89:0/3042795341 learned_addr learned my addr 172.21.15.89:0/3042795341 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74ea800640 1 --2- 172.21.15.89:0/3042795341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 0x56466f47e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74e1400640 1 -- 172.21.15.89:0/3042795341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 msgr2=0x56466f47e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74e1400640 1 --2- 172.21.15.89:0/3042795341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 0x56466f47e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74e1400640 1 -- 172.21.15.89:0/3042795341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 msgr2=0x56466f478e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74e1400640 1 --2- 172.21.15.89:0/3042795341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f478e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.822 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74e1400640 1 -- 172.21.15.89:0/3042795341 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466f23d8f0 con 0x56466f344930 2024-08-31T04:29:23.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74e1400640 1 --2- 172.21.15.89:0/3042795341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f47dad0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f74d4013dd0 tx=0x7f74d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67848f52c1aa57c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74daa00640 1 -- 172.21.15.89:0/3042795341 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d401c460 con 0x56466f344930 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74daa00640 1 -- 172.21.15.89:0/3042795341 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74d401c600 con 0x56466f344930 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74daa00640 1 -- 172.21.15.89:0/3042795341 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d401c9f0 con 0x56466f344930 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 -- 172.21.15.89:0/3042795341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 msgr2=0x56466f47dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3042795341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f47dad0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f74d4013dd0 tx=0x7f74d4016000 comp rx=0 tx=0).stop 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 -- 172.21.15.89:0/3042795341 shutdown_connections 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3042795341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f47dad0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3042795341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 0x56466f47e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3042795341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f478e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 -- 172.21.15.89:0/3042795341 >> 172.21.15.89:0/3042795341 conn(0x56466f35a540 msgr2=0x56466f47b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:23.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 -- 172.21.15.89:0/3042795341 shutdown_connections 2024-08-31T04:29:23.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 -- 172.21.15.89:0/3042795341 wait complete. 2024-08-31T04:29:23.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 -- start start 2024-08-31T04:29:23.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.821+0000 7f74f89e9000 1 Processor -- start 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f478030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f344930 0x56466f478570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f35a950 0x56466f482bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56466f20f500 con 0x56466f335890 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56466f28cbd0 con 0x56466f344930 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56466f230a30 con 0x56466f35a950 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 10 client.0 _ll_register_callbacks cb 0x56466f33eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f478030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f478030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51350/0 (socket says 172.21.15.89:51350) 2024-08-31T04:29:23.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e9e00640 1 -- 172.21.15.89:0/1451207535 learned_addr learned my addr 172.21.15.89:0/1451207535 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e1400640 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f344930 0x56466f478570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74ea800640 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f35a950 0x56466f482bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e9e00640 1 -- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f35a950 msgr2=0x56466f482bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e9e00640 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f35a950 0x56466f482bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e9e00640 1 -- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f344930 msgr2=0x56466f478570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e9e00640 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f344930 0x56466f478570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e9e00640 1 -- 172.21.15.89:0/1451207535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56466f2286a0 con 0x56466f335890 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e9e00640 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f478030 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0136f0 tx=0x7f74dc013bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d109b5f364ed99cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74cf400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74cf400640 1 -- 172.21.15.89:0/1451207535 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc021060 con 0x56466f335890 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 -- 172.21.15.89:0/1451207535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56466f2227e0 con 0x56466f335890 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74cf400640 1 -- 172.21.15.89:0/1451207535 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f74dc019070 con 0x56466f335890 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74cf400640 1 -- 172.21.15.89:0/1451207535 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f74dc027050 con 0x56466f335890 2024-08-31T04:29:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 10 client.5901 fetch_fsmap learned FSMap version 9 2024-08-31T04:29:23.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 -- 172.21.15.89:0/1451207535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56466f2471c0 con 0x56466f335890 2024-08-31T04:29:23.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74cf400640 1 -- 172.21.15.89:0/1451207535 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56466f2227e0 con 0x56466f335890 2024-08-31T04:29:23.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74cf400640 1 -- 172.21.15.89:0/1451207535 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f74dc02a020 con 0x56466f335890 2024-08-31T04:29:23.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 10 client.5901 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:29:23.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 10 client.5901 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:29:23.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 20 client.5901 populate_metadata read hostname 'smithi089' 2024-08-31T04:29:23.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56466f31efc0 0x56466f483910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 4 client.5901 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:23.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74f89e9000 1 -- 172.21.15.89:0/1451207535 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56466f29b5e0 con 0x56466f31efc0 2024-08-31T04:29:23.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e1400640 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56466f31efc0 0x56466f483910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74cf400640 10 client.5901 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:23.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.825+0000 7f74e1400640 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56466f31efc0 0x56466f483910 crc :-1 s=READY pgs=1134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3a591d4a77fb0fb server_cookie=aa9cae497e7cb9f1 in_seq=0 out_seq=0 2024-08-31T04:29:23.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74cf400640 1 -- 172.21.15.89:0/1451207535 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56466f29b5e0 con 0x56466f31efc0 2024-08-31T04:29:23.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74cf400640 10 client.5901 handle_command_reply: tid=0 2024-08-31T04:29:23.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 client.5901 shutdown 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 -- 172.21.15.89:0/1451207535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 msgr2=0x56466f478030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f478030 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0136f0 tx=0x7f74dc013bb0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 -- 172.21.15.89:0/1451207535 shutdown_connections 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56466f31efc0 0x56466f483910 crc :-1 s=READY pgs=1134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f35a950 0x56466f482bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f344930 0x56466f478570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 --2- 172.21.15.89:0/1451207535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f478030 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 -- 172.21.15.89:0/1451207535 >> 172.21.15.89:0/1451207535 conn(0x56466f35a540 msgr2=0x56466f479040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74cf400640 0 client.5901 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 -- 172.21.15.89:0/1451207535 shutdown_connections 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 1 -- 172.21.15.89:0/1451207535 wait complete. 2024-08-31T04:29:23.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.829+0000 7f74f89e9000 20 client.5901 trim_cache size 0 max 16384 2024-08-31T04:29:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.845+0000 7f74f89e9000 1 Processor -- start 2024-08-31T04:29:23.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.845+0000 7f74f89e9000 1 -- start start 2024-08-31T04:29:23.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f498c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f344930 0x56466f439040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f439580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec200f70 con 0x56466f335890 2024-08-31T04:29:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1ffe50 con 0x56466f35a950 2024-08-31T04:29:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f74ec14dd90 con 0x56466f344930 2024-08-31T04:29:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f498c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f498c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51360/0 (socket says 172.21.15.89:51360) 2024-08-31T04:29:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e9e00640 1 -- 172.21.15.89:0/3744946085 learned_addr learned my addr 172.21.15.89:0/3744946085 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:23.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74ea800640 1 --2- 172.21.15.89:0/3744946085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f439580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e1400640 1 --2- 172.21.15.89:0/3744946085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f344930 0x56466f439040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e9e00640 1 -- 172.21.15.89:0/3744946085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f344930 msgr2=0x56466f439040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e9e00640 1 --2- 172.21.15.89:0/3744946085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f344930 0x56466f439040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e9e00640 1 -- 172.21.15.89:0/3744946085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 msgr2=0x56466f439580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:23.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e9e00640 1 --2- 172.21.15.89:0/3744946085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f439580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e9e00640 1 -- 172.21.15.89:0/3744946085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466f482f40 con 0x56466f335890 2024-08-31T04:29:23.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74e9e00640 1 --2- 172.21.15.89:0/3744946085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f498c30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f74dc005790 tx=0x7f74dc011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3b5afd46bb6ad6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:23.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74da000640 1 -- 172.21.15.89:0/3744946085 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc030070 con 0x56466f335890 2024-08-31T04:29:23.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74da000640 1 -- 172.21.15.89:0/3744946085 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74dc000e50 con 0x56466f335890 2024-08-31T04:29:23.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74da000640 1 -- 172.21.15.89:0/3744946085 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc017070 con 0x56466f335890 2024-08-31T04:29:23.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 -- 172.21.15.89:0/3744946085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 msgr2=0x56466f498c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3744946085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f498c30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f74dc005790 tx=0x7f74dc011dd0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 -- 172.21.15.89:0/3744946085 shutdown_connections 2024-08-31T04:29:23.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3744946085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f439580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3744946085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f344930 0x56466f439040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3744946085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f335890 0x56466f498c30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 -- 172.21.15.89:0/3744946085 >> 172.21.15.89:0/3744946085 conn(0x56466f35a540 msgr2=0x56466f48e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:23.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 -- 172.21.15.89:0/3744946085 shutdown_connections 2024-08-31T04:29:23.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.849+0000 7f74f89e9000 1 -- 172.21.15.89:0/3744946085 wait complete. 2024-08-31T04:29:23.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 -- start start 2024-08-31T04:29:23.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 Processor -- start 2024-08-31T04:29:23.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 0x56466f493e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f4943b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f4948f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1fea20 con 0x56466f344930 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1ff780 con 0x56466f35a950 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f74ec1ff0d0 con 0x56466f335890 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 10 client.0 _ll_register_callbacks cb 0x7f74dc0097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f4943b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f4943b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51372/0 (socket says 172.21.15.89:51372) 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e1400640 1 -- 172.21.15.89:0/3539574132 learned_addr learned my addr 172.21.15.89:0/3539574132 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74ea800640 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f4948f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e9e00640 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 0x56466f493e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e1400640 1 -- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 msgr2=0x56466f493e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:23.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e1400640 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 0x56466f493e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e1400640 1 -- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 msgr2=0x56466f4948f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e1400640 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f4948f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e1400640 1 -- 172.21.15.89:0/3539574132 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56466f30d2f0 con 0x56466f344930 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74e1400640 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f4943b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x56466f233340 tx=0x7f74d4009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d002da6716993ca1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74cf400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74cf400640 1 -- 172.21.15.89:0/3539574132 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d401c660 con 0x56466f344930 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74cf400640 1 -- 172.21.15.89:0/3539574132 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f74d401c800 con 0x56466f344930 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 -- 172.21.15.89:0/3539574132 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74dc000e50 con 0x56466f344930 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74cf400640 1 -- 172.21.15.89:0/3539574132 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f74d401ca40 con 0x56466f344930 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 10 client.5907 fetch_fsmap learned FSMap version 9 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74f89e9000 1 -- 172.21.15.89:0/3539574132 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56466f212b30 con 0x56466f344930 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74cf400640 1 -- 172.21.15.89:0/3539574132 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74dc000e50 con 0x56466f344930 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.853+0000 7f74cf400640 1 -- 172.21.15.89:0/3539574132 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f74d4025070 con 0x56466f344930 2024-08-31T04:29:23.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.857+0000 7f74f89e9000 10 client.5907 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:29:23.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.857+0000 7f74f89e9000 10 client.5907 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:29:23.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.857+0000 7f74f89e9000 20 client.5907 populate_metadata read hostname 'smithi089' 2024-08-31T04:29:23.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.857+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56466ef1ae80 0x56466f494e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.857+0000 7f74f89e9000 4 client.5907 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5a5a3317", "release": true, "await": true}] 2024-08-31T04:29:23.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.857+0000 7f74f89e9000 1 -- 172.21.15.89:0/3539574132 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5a5a3317", "release": true, "await": true}) -- 0x56466f297080 con 0x56466ef1ae80 2024-08-31T04:29:23.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.857+0000 7f74e9e00640 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56466ef1ae80 0x56466f494e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.857+0000 7f74cf400640 10 client.5907 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:23.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:23.857+0000 7f74e9e00640 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56466ef1ae80 0x56466f494e30 crc :-1 s=READY pgs=1135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c74e4fd3af7faa90 server_cookie=e3ca6d126e57bab in_seq=0 out_seq=0 2024-08-31T04:29:23.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:29:23.911 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:29:24.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74cf400640 1 -- 172.21.15.89:0/3539574132 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56466f297080 con 0x56466ef1ae80 2024-08-31T04:29:24.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74cf400640 10 client.5907 handle_command_reply: tid=0 2024-08-31T04:29:24.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 client.5907 shutdown 2024-08-31T04:29:24.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 -- 172.21.15.89:0/3539574132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 msgr2=0x56466f4943b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:24.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f4943b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x56466f233340 tx=0x7f74d4009380 comp rx=0 tx=0).stop 2024-08-31T04:29:24.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 -- 172.21.15.89:0/3539574132 shutdown_connections 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56466ef1ae80 0x56466f494e30 crc :-1 s=READY pgs=1135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56466f344930 0x56466f4943b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56466f35a950 0x56466f4948f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74cf400640 0 client.5907 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 --2- 172.21.15.89:0/3539574132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56466f335890 0x56466f493e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 -- 172.21.15.89:0/3539574132 >> 172.21.15.89:0/3539574132 conn(0x56466f35a540 msgr2=0x56466f4816c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 -- 172.21.15.89:0/3539574132 shutdown_connections 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 1 -- 172.21.15.89:0/3539574132 wait complete. 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.001+0000 7f74f89e9000 20 client.5907 trim_cache size 0 max 16384 2024-08-31T04:29:24.006 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 88, 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "5a5a3317": { 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 88, 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.0, 2024-08-31T04:29:24.007 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:24.008 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:29:24.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 -- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74c80720c0 msgr2=0x7f74c80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:24.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74c80720c0 0x7f74c80745d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0746f0 tx=0x7f74d40091e0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 -- 172.21.15.89:0/574003898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74ec14e000 msgr2=0x7f74ec14e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:24.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74ec14e000 0x7f74ec14e410 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f74ec152e90 tx=0x7f74e4002080 comp rx=0 tx=0).stop 2024-08-31T04:29:24.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 -- 172.21.15.89:0/574003898 shutdown_connections 2024-08-31T04:29:24.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f74c80720c0 0x7f74c80745d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74ec14e000 0x7f74ec14e410 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74ec157f20 0x7f74ec147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 --2- 172.21.15.89:0/574003898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74d0004d50 0x7f74ec150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 -- 172.21.15.89:0/574003898 >> 172.21.15.89:0/574003898 conn(0x7f74ec0c99b0 msgr2=0x7f74ec0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:24.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 -- 172.21.15.89:0/574003898 shutdown_connections 2024-08-31T04:29:24.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:24.005+0000 7f74f1200640 1 -- 172.21.15.89:0/574003898 wait complete. 2024-08-31T04:29:24.027 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5a5a3317', total seconds elapsed: 10.8 2024-08-31T04:29:28.165 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 25% (47/186) Updating files: 26% (49/186) Updating files: 27% (51/186) Updating files: 28% (53/186) Updating files: 29% (54/186) Updating files: 30% (56/186) Updating files: 31% (58/186) Updating files: 32% (60/186) Updating files: 33% (62/186) Updating files: 34% (64/186) Updating files: 35% (66/186) Updating files: 36% (67/186) Updating files: 37% (69/186) Updating files: 38% (71/186) Updating files: 39% (73/186) Updating files: 40% (75/186) Updating files: 41% (77/186) Updating files: 41% (78/186) Updating files: 42% (79/186) Updating files: 43% (80/186) Updating files: 44% (82/186) Updating files: 45% (84/186) Updating files: 46% (86/186) Updating files: 47% (88/186) Updating files: 48% (90/186) Updating files: 49% (92/186) Updating files: 50% (93/186) Updating files: 51% (95/186) Updating files: 52% (97/186) Updating files: 53% (99/186) Updating files: 54% (101/186) Updating files: 55% (103/186) Updating files: 56% (105/186) Updating files: 57% (107/186) Updating files: 58% (108/186) Updating files: 59% (110/186) Updating files: 60% (112/186) Updating files: 61% (114/186) Updating files: 62% (116/186) Updating files: 63% (118/186) Updating files: 64% (120/186) Updating files: 65% (121/186) Updating files: 66% (123/186) Updating files: 67% (125/186) Updating files: 68% (127/186) Updating files: 69% (129/186) Updating files: 70% (131/186) Updating files: 71% (133/186) Updating files: 72% (134/186) Updating files: 73% (136/186) Updating files: 74% (138/186) Updating files: 75% (140/186) Updating files: 76% (142/186) Updating files: 77% (144/186) Updating files: 78% (146/186) Updating files: 79% (147/186) Updating files: 80% (149/186) Updating files: 81% (151/186) Updating files: 82% (153/186) Updating files: 83% (155/186) Updating files: 84% (157/186) Updating files: 85% (159/186) Updating files: 86% (160/186) Updating files: 87% (162/186) Updating files: 88% (164/186) Updating files: 89% (166/186) Updating files: 90% (168/186) Updating files: 91% (170/186) Updating files: 92% (172/186) Updating files: 93% (173/186) Updating files: 94% (175/186) Updating files: 95% (177/186) Updating files: 96% (179/186) Updating files: 97% (181/186) Updating files: 98% (183/186) Updating files: 99% (185/186) Updating files: 100% (186/186) Updating files: 100% (186/186), done. 2024-08-31T04:29:28.967 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at cdd5298d276 v0.44 2024-08-31T04:29:29.039 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.44 2024-08-31T04:29:29.062 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 45 -eq 48 ] 2024-08-31T04:29:29.063 INFO:tasks.workunit.client.0.smithi089.stdout:v0.45 2024-08-31T04:29:29.063 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.45 2024-08-31T04:29:29.063 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.45 2024-08-31T04:29:29.063 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.45 2024-08-31T04:29:39.459 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 39% (61/154) Updating files: 40% (62/154) Updating files: 41% (64/154) Updating files: 42% (65/154) Updating files: 43% (67/154) Updating files: 44% (68/154) Updating files: 45% (70/154) Updating files: 46% (71/154) Updating files: 47% (73/154) Updating files: 48% (74/154) Updating files: 49% (76/154) Updating files: 50% (77/154) Updating files: 51% (79/154) Updating files: 52% (81/154) Updating files: 53% (82/154) Updating files: 54% (84/154) Updating files: 55% (85/154) Updating files: 56% (87/154) Updating files: 57% (88/154) Updating files: 58% (90/154) Updating files: 59% (91/154) Updating files: 60% (93/154) Updating files: 61% (94/154) Updating files: 62% (96/154) Updating files: 63% (98/154) Updating files: 64% (99/154) Updating files: 65% (101/154) Updating files: 66% (102/154) Updating files: 67% (104/154) Updating files: 68% (105/154) Updating files: 69% (107/154) Updating files: 70% (108/154) Updating files: 71% (110/154) Updating files: 72% (111/154) Updating files: 73% (113/154) Updating files: 74% (114/154) Updating files: 75% (116/154) Updating files: 76% (118/154) Updating files: 77% (119/154) Updating files: 78% (121/154) Updating files: 79% (122/154) Updating files: 80% (124/154) Updating files: 81% (125/154) Updating files: 82% (127/154) Updating files: 83% (128/154) Updating files: 83% (129/154) Updating files: 84% (130/154) Updating files: 85% (131/154) Updating files: 86% (133/154) Updating files: 87% (134/154) Updating files: 88% (136/154) Updating files: 89% (138/154) Updating files: 90% (139/154) Updating files: 91% (141/154) Updating files: 92% (142/154) Updating files: 93% (144/154) Updating files: 94% (145/154) Updating files: 95% (147/154) Updating files: 96% (148/154) Updating files: 97% (150/154) Updating files: 98% (151/154) Updating files: 99% (153/154) Updating files: 100% (154/154) Updating files: 100% (154/154), done. 2024-08-31T04:29:39.609 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 0aea1cb1df5 v0.45 2024-08-31T04:29:39.612 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.45 2024-08-31T04:29:40.062 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 46 -eq 48 ] 2024-08-31T04:29:40.062 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.46 2024-08-31T04:29:40.062 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.46 2024-08-31T04:29:40.063 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.46 2024-08-31T04:29:40.063 INFO:tasks.workunit.client.0.smithi089.stdout:v0.46 2024-08-31T04:29:42.600 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.2 2024-08-31T04:29:42.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:29:42.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.760+0000 7fb57dc00640 1 -- 172.21.15.89:0/14496974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb55c003a10 msgr2=0x7fb55c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:42.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.760+0000 7fb57dc00640 1 --2- 172.21.15.89:0/14496974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb55c003a10 0x7fb55c003ea0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb568009b40 tx=0x7fb56801d300 comp rx=0 tx=0).stop 2024-08-31T04:29:42.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.760+0000 7fb577400640 1 -- 172.21.15.89:0/14496974 reap_dead start 2024-08-31T04:29:42.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.760+0000 7fb57dc00640 1 -- 172.21.15.89:0/14496974 shutdown_connections 2024-08-31T04:29:42.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.760+0000 7fb57dc00640 1 -- 172.21.15.89:0/14496974 >> 172.21.15.89:0/14496974 conn(0x7fb5780ccf20 msgr2=0x7fb5780cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:42.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.760+0000 7fb57dc00640 1 -- 172.21.15.89:0/14496974 shutdown_connections 2024-08-31T04:29:42.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.760+0000 7fb57dc00640 1 -- 172.21.15.89:0/14496974 wait complete. 2024-08-31T04:29:42.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb57dc00640 1 Processor -- start 2024-08-31T04:29:42.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb57dc00640 1 -- start start 2024-08-31T04:29:42.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb57dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb55c003a10 0x7fb57815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:42.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb57dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb578156960 0x7fb5781470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:42.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb57dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5780c4950 0x7fb57814c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb57dc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb578074fb0 con 0x7fb578156960 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb57dc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb578074e30 con 0x7fb5780c4950 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb57dc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb578152a10 con 0x7fb55c003a10 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb56e000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb578156960 0x7fb5781470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb56e000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb578156960 0x7fb5781470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55594/0 (socket says 172.21.15.89:55594) 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb56e000640 1 -- 172.21.15.89:0/1953512450 learned_addr learned my addr 172.21.15.89:0/1953512450 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.764+0000 7fb576a00640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb55c003a10 0x7fb57815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb577400640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5780c4950 0x7fb57814c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56e000640 1 -- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb55c003a10 msgr2=0x7fb57815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56e000640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb55c003a10 0x7fb57815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56e000640 1 -- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5780c4950 msgr2=0x7fb57814c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56e000640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5780c4950 0x7fb57814c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:42.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56e000640 1 -- 172.21.15.89:0/1953512450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57815a8e0 con 0x7fb578156960 2024-08-31T04:29:42.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56e000640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb578156960 0x7fb5781470d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb5600117d0 tx=0x7fb560011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:42.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56f400640 1 -- 172.21.15.89:0/1953512450 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560004460 con 0x7fb578156960 2024-08-31T04:29:42.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56f400640 1 -- 172.21.15.89:0/1953512450 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb560016070 con 0x7fb578156960 2024-08-31T04:29:42.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5781576b0 con 0x7fb578156960 2024-08-31T04:29:42.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56f400640 1 -- 172.21.15.89:0/1953512450 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56000fcb0 con 0x7fb578156960 2024-08-31T04:29:42.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb578157bb0 con 0x7fb578156960 2024-08-31T04:29:42.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5781560a0 con 0x7fb578156960 2024-08-31T04:29:42.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.768+0000 7fb56f400640 1 -- 172.21.15.89:0/1953512450 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb560018030 con 0x7fb578156960 2024-08-31T04:29:42.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.772+0000 7fb56f400640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5540720f0 0x7fb554074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:42.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.772+0000 7fb56f400640 1 -- 172.21.15.89:0/1953512450 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb560093610 con 0x7fb578156960 2024-08-31T04:29:42.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.772+0000 7fb576a00640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5540720f0 0x7fb554074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:42.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.772+0000 7fb576a00640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5540720f0 0x7fb554074600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb5680ad000 tx=0x7fb55c005840 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:42.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.776+0000 7fb56f400640 1 -- 172.21.15.89:0/1953512450 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb56005e530 con 0x7fb578156960 2024-08-31T04:29:42.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.980+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5780c82f0 con 0x7fb578156960 2024-08-31T04:29:42.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.980+0000 7fb56f400640 1 -- 172.21.15.89:0/1953512450 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fb560062cf0 con 0x7fb578156960 2024-08-31T04:29:42.980 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:29:42.980 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:29:42.980 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5540720f0 msgr2=0x7fb554074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5540720f0 0x7fb554074600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb5680ad000 tx=0x7fb55c005840 comp rx=0 tx=0).stop 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb578156960 msgr2=0x7fb5781470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb578156960 0x7fb5781470d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb5600117d0 tx=0x7fb560011c90 comp rx=0 tx=0).stop 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 shutdown_connections 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb5540720f0 0x7fb554074600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb578156960 0x7fb5781470d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5780c4950 0x7fb57814c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 --2- 172.21.15.89:0/1953512450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb55c003a10 0x7fb57815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:42.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 >> 172.21.15.89:0/1953512450 conn(0x7fb5780ccf20 msgr2=0x7fb5780735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:42.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 shutdown_connections 2024-08-31T04:29:42.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:42.984+0000 7fb57dc00640 1 -- 172.21.15.89:0/1953512450 wait complete. 2024-08-31T04:29:43.002 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0' 2024-08-31T04:29:43.002 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0 2024-08-31T04:29:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.168+0000 7f4567200640 1 -- 172.21.15.89:0/506100292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4560152900 msgr2=0x7f45600c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.168+0000 7f4567200640 1 --2- 172.21.15.89:0/506100292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4560152900 0x7f45600c5770 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f454c009900 tx=0x7f454c01f0d0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.168+0000 7f4567200640 1 -- 172.21.15.89:0/506100292 shutdown_connections 2024-08-31T04:29:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.168+0000 7f4567200640 1 --2- 172.21.15.89:0/506100292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4560152900 0x7f45600c5770 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.168+0000 7f4567200640 1 -- 172.21.15.89:0/506100292 >> 172.21.15.89:0/506100292 conn(0x7f45600ca360 msgr2=0x7f45600ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:43.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.168+0000 7f4567200640 1 -- 172.21.15.89:0/506100292 shutdown_connections 2024-08-31T04:29:43.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.168+0000 7f4567200640 1 -- 172.21.15.89:0/506100292 wait complete. 2024-08-31T04:29:43.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.168+0000 7f4567200640 1 Processor -- start 2024-08-31T04:29:43.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.168+0000 7f4567200640 1 -- start start 2024-08-31T04:29:43.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4567200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45600c5cb0 0x7f456014b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4567200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45600c8260 0x7f45601f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4567200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4560152900 0x7f4560074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4567200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4560073570 con 0x7f45600c8260 2024-08-31T04:29:43.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4567200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4560159220 con 0x7f45600c5cb0 2024-08-31T04:29:43.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4567200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f45600cae80 con 0x7f4560152900 2024-08-31T04:29:43.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45600c8260 0x7f45601f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45600c8260 0x7f45601f04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55608/0 (socket says 172.21.15.89:55608) 2024-08-31T04:29:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455f400640 1 -- 172.21.15.89:0/3625918240 learned_addr learned my addr 172.21.15.89:0/3625918240 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455fe00640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45600c5cb0 0x7f456014b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4565200640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4560152900 0x7f4560074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455f400640 1 -- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4560152900 msgr2=0x7f4560074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455f400640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4560152900 0x7f4560074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455f400640 1 -- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45600c5cb0 msgr2=0x7f456014b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455f400640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45600c5cb0 0x7f456014b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455f400640 1 -- 172.21.15.89:0/3625918240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456014c280 con 0x7f45600c8260 2024-08-31T04:29:43.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455fe00640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45600c5cb0 0x7f456014b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f455f400640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45600c8260 0x7f45601f04a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f454c009850 tx=0x7f454c0a8d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4557e00640 1 -- 172.21.15.89:0/3625918240 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c0be070 con 0x7f45600c8260 2024-08-31T04:29:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4557e00640 1 -- 172.21.15.89:0/3625918240 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f454c003970 con 0x7f45600c8260 2024-08-31T04:29:43.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4567200640 1 -- 172.21.15.89:0/3625918240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45601f31e0 con 0x7f45600c8260 2024-08-31T04:29:43.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4557e00640 1 -- 172.21.15.89:0/3625918240 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c0b5040 con 0x7f45600c8260 2024-08-31T04:29:43.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.172+0000 7f4567200640 1 -- 172.21.15.89:0/3625918240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456006d780 con 0x7f45600c8260 2024-08-31T04:29:43.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f4557e00640 1 -- 172.21.15.89:0/3625918240 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f454c0c1070 con 0x7f45600c8260 2024-08-31T04:29:43.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f4557e00640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f45400720c0 0x7f45400745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f4557e00640 1 -- 172.21.15.89:0/3625918240 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f454c130130 con 0x7f45600c8260 2024-08-31T04:29:43.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f456ea84000 1 Processor -- start 2024-08-31T04:29:43.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f455fe00640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f45400720c0 0x7f45400745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f456ea84000 1 -- start start 2024-08-31T04:29:43.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f455fe00640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f45400720c0 0x7f45400745d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4550001db0 tx=0x7f4550009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:43.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f456ea84000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 0x5636cf4694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f456ea84000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 0x5636cf49f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f456ea84000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf49fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f456ea84000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5636cf2be820 con 0x5636cf345960 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f456ea84000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5636cf2addb0 con 0x5636cf3663f0 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f456ea84000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5636cf2b1d60 con 0x5636cf35be90 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f4565200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf49fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f4565200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf49fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55624/0 (socket says 172.21.15.89:55624) 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f4565200640 1 -- 172.21.15.89:0/1595210930 learned_addr learned my addr 172.21.15.89:0/1595210930 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.176+0000 7f455fe00640 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 0x5636cf4694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f455f400640 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 0x5636cf49f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f4565200640 1 -- 172.21.15.89:0/1595210930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 msgr2=0x5636cf49f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f4565200640 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 0x5636cf49f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f4565200640 1 -- 172.21.15.89:0/1595210930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 msgr2=0x5636cf4694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f4565200640 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 0x5636cf4694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f4565200640 1 -- 172.21.15.89:0/1595210930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636cf248b70 con 0x5636cf345960 2024-08-31T04:29:43.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f455fe00640 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 0x5636cf4694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:43.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f4565200640 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf49fe40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4558001510 tx=0x7f45580019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc3b55b6060f131 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f4554c00640 1 -- 172.21.15.89:0/1595210930 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558019070 con 0x5636cf345960 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f4554c00640 1 -- 172.21.15.89:0/1595210930 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45580052e0 con 0x5636cf345960 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f4554c00640 1 -- 172.21.15.89:0/1595210930 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558003860 con 0x5636cf345960 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 -- 172.21.15.89:0/1595210930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 msgr2=0x5636cf49fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf49fe40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4558001510 tx=0x7f45580019d0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 -- 172.21.15.89:0/1595210930 shutdown_connections 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf49fe40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 0x5636cf49f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 --2- 172.21.15.89:0/1595210930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 0x5636cf4694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 -- 172.21.15.89:0/1595210930 >> 172.21.15.89:0/1595210930 conn(0x5636cef6d210 msgr2=0x5636cf4a2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:43.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 -- 172.21.15.89:0/1595210930 shutdown_connections 2024-08-31T04:29:43.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 -- 172.21.15.89:0/1595210930 wait complete. 2024-08-31T04:29:43.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 -- start start 2024-08-31T04:29:43.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.180+0000 7f456ea84000 1 Processor -- start 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 0x5636cf49f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf49fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 0x5636cf4a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5636cef74b10 con 0x5636cf35be90 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5636cf2346f0 con 0x5636cf345960 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5636cf2b6390 con 0x5636cf3663f0 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 10 client.0 _ll_register_callbacks cb 0x5636cf255b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf49fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf49fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55628/0 (socket says 172.21.15.89:55628) 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455f400640 1 -- 172.21.15.89:0/2476508405 learned_addr learned my addr 172.21.15.89:0/2476508405 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f4565200640 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 0x5636cf4a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455fe00640 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 0x5636cf49f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455f400640 1 -- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 msgr2=0x5636cf4a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455f400640 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 0x5636cf4a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455f400640 1 -- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 msgr2=0x5636cf49f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455f400640 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 0x5636cf49f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455f400640 1 -- 172.21.15.89:0/2476508405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636cf26c380 con 0x5636cf35be90 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455fe00640 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 0x5636cf49f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455f400640 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf49fda0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f454c0206e0 tx=0x7f454c0fa8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c981b05f9ce3d7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f4549600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f4549600640 1 -- 172.21.15.89:0/2476508405 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c103fe0 con 0x5636cf35be90 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f4549600640 1 -- 172.21.15.89:0/2476508405 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f454c102b40 con 0x5636cf35be90 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 -- 172.21.15.89:0/2476508405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5636cf2bcd20 con 0x5636cf35be90 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f4549600640 1 -- 172.21.15.89:0/2476508405 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f454c0ff850 con 0x5636cf35be90 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 10 client.5928 fetch_fsmap learned FSMap version 9 2024-08-31T04:29:43.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 -- 172.21.15.89:0/2476508405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5636cf332e40 con 0x5636cf35be90 2024-08-31T04:29:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f4549600640 1 -- 172.21.15.89:0/2476508405 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5636cf2bcd20 con 0x5636cf35be90 2024-08-31T04:29:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f4549600640 1 -- 172.21.15.89:0/2476508405 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f454c11f060 con 0x5636cf35be90 2024-08-31T04:29:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 10 client.5928 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:29:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 10 client.5928 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:29:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 20 client.5928 populate_metadata read hostname 'smithi089' 2024-08-31T04:29:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5636cef51dc0 0x5636cf4bea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 4 client.5928 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:43.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f456ea84000 1 -- 172.21.15.89:0/2476508405 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636cf2c0770 con 0x5636cef51dc0 2024-08-31T04:29:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455fe00640 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5636cef51dc0 0x5636cf4bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f455fe00640 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5636cef51dc0 0x5636cf4bea20 crc :-1 s=READY pgs=1153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82e20fda8377b675 server_cookie=ec02949b8ace4bac in_seq=0 out_seq=0 2024-08-31T04:29:43.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.184+0000 7f4549600640 10 client.5928 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f4549600640 1 -- 172.21.15.89:0/2476508405 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5636cf2c0770 con 0x5636cef51dc0 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f4549600640 10 client.5928 handle_command_reply: tid=0 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 client.5928 shutdown 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 -- 172.21.15.89:0/2476508405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 msgr2=0x5636cf49fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf49fda0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f454c0206e0 tx=0x7f454c0fa8a0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 -- 172.21.15.89:0/2476508405 shutdown_connections 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5636cef51dc0 0x5636cf4bea20 crc :-1 s=READY pgs=1153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf49fda0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 0x5636cf4a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 --2- 172.21.15.89:0/2476508405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 0x5636cf49f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f4549600640 0 client.5928 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 -- 172.21.15.89:0/2476508405 >> 172.21.15.89:0/2476508405 conn(0x5636cef6d210 msgr2=0x5636cf4a1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:43.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 -- 172.21.15.89:0/2476508405 shutdown_connections 2024-08-31T04:29:43.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 1 -- 172.21.15.89:0/2476508405 wait complete. 2024-08-31T04:29:43.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.188+0000 7f456ea84000 20 client.5928 trim_cache size 0 max 16384 2024-08-31T04:29:43.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.204+0000 7f456ea84000 1 Processor -- start 2024-08-31T04:29:43.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.204+0000 7f456ea84000 1 -- start start 2024-08-31T04:29:43.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 0x5636cf466070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf4665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 0x5636cf466d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4560158520 con 0x5636cf35be90 2024-08-31T04:29:43.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f45601fb280 con 0x5636cf345960 2024-08-31T04:29:43.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f45601fa500 con 0x5636cf3663f0 2024-08-31T04:29:43.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf4665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf4665b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55636/0 (socket says 172.21.15.89:55636) 2024-08-31T04:29:43.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455f400640 1 -- 172.21.15.89:0/405976809 learned_addr learned my addr 172.21.15.89:0/405976809 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:43.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f4565200640 1 --2- 172.21.15.89:0/405976809 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 0x5636cf466d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455fe00640 1 --2- 172.21.15.89:0/405976809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 0x5636cf466070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455f400640 1 -- 172.21.15.89:0/405976809 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 msgr2=0x5636cf466d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:43.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455f400640 1 --2- 172.21.15.89:0/405976809 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 0x5636cf466d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455f400640 1 -- 172.21.15.89:0/405976809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 msgr2=0x5636cf466070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:43.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455f400640 1 --2- 172.21.15.89:0/405976809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 0x5636cf466070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455f400640 1 -- 172.21.15.89:0/405976809 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636cf46e5f0 con 0x5636cf35be90 2024-08-31T04:29:43.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f455f400640 1 --2- 172.21.15.89:0/405976809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf4665b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f454c009900 tx=0x7f454c01f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dd03c0e8d19331 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:43.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f454be00640 1 -- 172.21.15.89:0/405976809 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c0fae40 con 0x5636cf35be90 2024-08-31T04:29:43.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f454be00640 1 -- 172.21.15.89:0/405976809 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f454c103de0 con 0x5636cf35be90 2024-08-31T04:29:43.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f454be00640 1 -- 172.21.15.89:0/405976809 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c102b40 con 0x5636cf35be90 2024-08-31T04:29:43.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 -- 172.21.15.89:0/405976809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 msgr2=0x5636cf4665b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:43.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 --2- 172.21.15.89:0/405976809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf4665b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f454c009900 tx=0x7f454c01f0d0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 -- 172.21.15.89:0/405976809 shutdown_connections 2024-08-31T04:29:43.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 --2- 172.21.15.89:0/405976809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf35be90 0x5636cf4665b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 --2- 172.21.15.89:0/405976809 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf3663f0 0x5636cf466d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 --2- 172.21.15.89:0/405976809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf345960 0x5636cf466070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 -- 172.21.15.89:0/405976809 >> 172.21.15.89:0/405976809 conn(0x5636cef6d210 msgr2=0x5636cf4ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:43.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 -- 172.21.15.89:0/405976809 shutdown_connections 2024-08-31T04:29:43.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.208+0000 7f456ea84000 1 -- 172.21.15.89:0/405976809 wait complete. 2024-08-31T04:29:43.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 -- start start 2024-08-31T04:29:43.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 Processor -- start 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf4c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 0x5636cf4c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 0x5636cf521530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5636cf22feb0 con 0x5636cf345960 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f45601fabb0 con 0x5636cf3663f0 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5636cf255f20 con 0x5636cf35be90 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 10 client.0 _ll_register_callbacks cb 0x7f454c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf4c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf4c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55652/0 (socket says 172.21.15.89:55652) 2024-08-31T04:29:43.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455fe00640 1 -- 172.21.15.89:0/3844274595 learned_addr learned my addr 172.21.15.89:0/3844274595 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455f400640 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 0x5636cf4c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f4565200640 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 0x5636cf521530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455fe00640 1 -- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 msgr2=0x5636cf4c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455fe00640 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 0x5636cf4c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455fe00640 1 -- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 msgr2=0x5636cf521530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455fe00640 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 0x5636cf521530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455fe00640 1 -- 172.21.15.89:0/3844274595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636cf30a5b0 con 0x5636cf345960 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f455fe00640 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf4c2aa0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5636cf26a8c0 tx=0x7f4550000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fbe734a222010f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f4549600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f4549600640 1 -- 172.21.15.89:0/3844274595 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45500055d0 con 0x5636cf345960 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f4549600640 1 -- 172.21.15.89:0/3844274595 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f4550010040 con 0x5636cf345960 2024-08-31T04:29:43.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 -- 172.21.15.89:0/3844274595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f454c103de0 con 0x5636cf345960 2024-08-31T04:29:43.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f4549600640 1 -- 172.21.15.89:0/3844274595 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4550037050 con 0x5636cf345960 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 10 client.5934 fetch_fsmap learned FSMap version 9 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 -- 172.21.15.89:0/3844274595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5636cf23efc0 con 0x5636cf345960 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f4549600640 1 -- 172.21.15.89:0/3844274595 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f454c103de0 con 0x5636cf345960 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f4549600640 1 -- 172.21.15.89:0/3844274595 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f455003a020 con 0x5636cf345960 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 10 client.5934 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 10 client.5934 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 20 client.5934 populate_metadata read hostname 'smithi089' 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5636cef3fe20 0x5636cf521a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 4 client.5934 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}] 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.212+0000 7f456ea84000 1 -- 172.21.15.89:0/3844274595 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}) -- 0x5636cf2bc210 con 0x5636cef3fe20 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.216+0000 7f455f400640 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5636cef3fe20 0x5636cf521a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.216+0000 7f455f400640 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5636cef3fe20 0x5636cf521a70 crc :-1 s=READY pgs=1154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=734ba0d107292dec server_cookie=db77c2503910ce61 in_seq=0 out_seq=0 2024-08-31T04:29:43.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:43.216+0000 7f4549600640 10 client.5934 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:45.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4549600640 1 -- 172.21.15.89:0/3844274595 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5636cf2bc210 con 0x5636cef3fe20 2024-08-31T04:29:45.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4549600640 10 client.5934 handle_command_reply: tid=0 2024-08-31T04:29:45.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 client.5934 shutdown 2024-08-31T04:29:45.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 -- 172.21.15.89:0/3844274595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 msgr2=0x5636cf4c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:45.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf4c2aa0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5636cf26a8c0 tx=0x7f4550000f50 comp rx=0 tx=0).stop 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 -- 172.21.15.89:0/3844274595 shutdown_connections 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5636cef3fe20 0x5636cf521a70 crc :-1 s=READY pgs=1154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636cf3663f0 0x5636cf521530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5636cf35be90 0x5636cf4c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 --2- 172.21.15.89:0/3844274595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636cf345960 0x5636cf4c2aa0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4549600640 0 client.5934 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 -- 172.21.15.89:0/3844274595 >> 172.21.15.89:0/3844274595 conn(0x5636cef6d210 msgr2=0x5636cf466070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 -- 172.21.15.89:0/3844274595 shutdown_connections 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 1 -- 172.21.15.89:0/3844274595 wait complete. 2024-08-31T04:29:45.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f456ea84000 20 client.5934 trim_cache size 0 max 16384 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 90, 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "5cb31da3": { 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 90, 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:29:45.966 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 150.2, 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:45.967 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:45.968 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:29:45.968 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:29:45.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 -- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f45400720c0 msgr2=0x7f45400745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f45400720c0 0x7f45400745d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4550001db0 tx=0x7f4550009040 comp rx=0 tx=0).stop 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 -- 172.21.15.89:0/3625918240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45600c8260 msgr2=0x7f45601f04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45600c8260 0x7f45601f04a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f454c009850 tx=0x7f454c0a8d60 comp rx=0 tx=0).stop 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 -- 172.21.15.89:0/3625918240 shutdown_connections 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f45400720c0 0x7f45400745d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45600c8260 0x7f45601f04a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4560152900 0x7f4560074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 --2- 172.21.15.89:0/3625918240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45600c5cb0 0x7f456014b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 -- 172.21.15.89:0/3625918240 >> 172.21.15.89:0/3625918240 conn(0x7f45600ca360 msgr2=0x7f45600c8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 -- 172.21.15.89:0/3625918240 shutdown_connections 2024-08-31T04:29:45.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:29:45.964+0000 7f4567200640 1 -- 172.21.15.89:0/3625918240 wait complete. 2024-08-31T04:29:45.985 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5cb31da3', quiesce took 3.4 seconds. Will release after: 26.8 2024-08-31T04:29:53.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:29:53.959 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:30:12.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:30:12.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.951+0000 7fc41ba00640 1 -- 172.21.15.89:0/3778315461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc414152a10 msgr2=0x7fc4140c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:12.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.951+0000 7fc41ba00640 1 --2- 172.21.15.89:0/3778315461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc414152a10 0x7fc4140c9330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009bc0 tx=0x7fc40c01f3b0 comp rx=0 tx=0).stop 2024-08-31T04:30:12.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.951+0000 7fc41ba00640 1 -- 172.21.15.89:0/3778315461 shutdown_connections 2024-08-31T04:30:12.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.951+0000 7fc41ba00640 1 --2- 172.21.15.89:0/3778315461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc414152a10 0x7fc4140c9330 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:12.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.951+0000 7fc41ba00640 1 -- 172.21.15.89:0/3778315461 >> 172.21.15.89:0/3778315461 conn(0x7fc4140ccf20 msgr2=0x7fc4140cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:12.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.951+0000 7fc41ba00640 1 -- 172.21.15.89:0/3778315461 shutdown_connections 2024-08-31T04:30:12.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.951+0000 7fc41ba00640 1 -- 172.21.15.89:0/3778315461 wait complete. 2024-08-31T04:30:12.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 Processor -- start 2024-08-31T04:30:12.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 -- start start 2024-08-31T04:30:12.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4140c1f40 0x7fc4141e3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:12.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc414152a10 0x7fc41414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:12.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc41415bc70 0x7fc41414c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:12.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc414074e30 con 0x7fc4140c1f40 2024-08-31T04:30:12.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc4140c8030 con 0x7fc414152a10 2024-08-31T04:30:12.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc414074fb0 con 0x7fc41415bc70 2024-08-31T04:30:12.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4140c1f40 0x7fc4141e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4140c1f40 0x7fc4141e3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58756/0 (socket says 172.21.15.89:58756) 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419000640 1 -- 172.21.15.89:0/4143141643 learned_addr learned my addr 172.21.15.89:0/4143141643 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419a00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc41415bc70 0x7fc41414c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc413e00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc414152a10 0x7fc41414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419000640 1 -- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc41415bc70 msgr2=0x7fc41414c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419000640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc41415bc70 0x7fc41414c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419000640 1 -- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc414152a10 msgr2=0x7fc41414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419000640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc414152a10 0x7fc41414eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419000640 1 -- 172.21.15.89:0/4143141643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4141e3950 con 0x7fc4140c1f40 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc419000640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4140c1f40 0x7fc4141e3410 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc40400c450 tx=0x7fc40400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc410c00640 1 -- 172.21.15.89:0/4143141643 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404016020 con 0x7fc4140c1f40 2024-08-31T04:30:12.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc410c00640 1 -- 172.21.15.89:0/4143141643 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc404012920 con 0x7fc4140c1f40 2024-08-31T04:30:12.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc410c00640 1 -- 172.21.15.89:0/4143141643 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404012d50 con 0x7fc4140c1f40 2024-08-31T04:30:12.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc414070f60 con 0x7fc4140c1f40 2024-08-31T04:30:12.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.955+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4141e47e0 con 0x7fc4140c1f40 2024-08-31T04:30:12.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.959+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4141e3b20 con 0x7fc4140c1f40 2024-08-31T04:30:12.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.959+0000 7fc410c00640 1 -- 172.21.15.89:0/4143141643 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fc404019020 con 0x7fc4140c1f40 2024-08-31T04:30:12.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.959+0000 7fc410c00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc3f40720c0 0x7fc3f40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:12.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.959+0000 7fc410c00640 1 -- 172.21.15.89:0/4143141643 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fc404092a10 con 0x7fc4140c1f40 2024-08-31T04:30:12.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.959+0000 7fc413e00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc3f40720c0 0x7fc3f40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:12.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.959+0000 7fc413e00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc3f40720c0 0x7fc3f40745d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc4140c4c50 tx=0x7fc400009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:12.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:12.963+0000 7fc410c00640 1 -- 172.21.15.89:0/4143141643 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc404020070 con 0x7fc4140c1f40 2024-08-31T04:30:13.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4140c9330 con 0x7fc4140c1f40 2024-08-31T04:30:13.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc410c00640 1 -- 172.21.15.89:0/4143141643 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fc40405def0 con 0x7fc4140c1f40 2024-08-31T04:30:13.171 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:30:13.172 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:30:13.172 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:30:13.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc3f40720c0 msgr2=0x7fc3f40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc3f40720c0 0x7fc3f40745d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc4140c4c50 tx=0x7fc400009040 comp rx=0 tx=0).stop 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4140c1f40 msgr2=0x7fc4141e3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4140c1f40 0x7fc4141e3410 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc40400c450 tx=0x7fc40400c910 comp rx=0 tx=0).stop 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 shutdown_connections 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fc3f40720c0 0x7fc3f40745d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc41415bc70 0x7fc41414c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc414152a10 0x7fc41414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 --2- 172.21.15.89:0/4143141643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4140c1f40 0x7fc4141e3410 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 >> 172.21.15.89:0/4143141643 conn(0x7fc4140ccf20 msgr2=0x7fc4141e1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.171+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 shutdown_connections 2024-08-31T04:30:13.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.175+0000 7fc41ba00640 1 -- 172.21.15.89:0/4143141643 wait complete. 2024-08-31T04:30:13.193 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 5cb31da3 --release --await' 2024-08-31T04:30:13.193 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 5cb31da3 --release --await 2024-08-31T04:30:13.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.351+0000 7f62c1e00640 1 -- 172.21.15.89:0/2220350704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0c1ed0 msgr2=0x7f62bc152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.351+0000 7f62c1e00640 1 --2- 172.21.15.89:0/2220350704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0c1ed0 0x7f62bc152780 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009900 tx=0x7f62a801c820 comp rx=0 tx=0).stop 2024-08-31T04:30:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.351+0000 7f62c1e00640 1 -- 172.21.15.89:0/2220350704 shutdown_connections 2024-08-31T04:30:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.351+0000 7f62c1e00640 1 --2- 172.21.15.89:0/2220350704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0c1ed0 0x7f62bc152780 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.351+0000 7f62c1e00640 1 --2- 172.21.15.89:0/2220350704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62bc0b2860 0x7f62bc0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.351+0000 7f62c1e00640 1 -- 172.21.15.89:0/2220350704 >> 172.21.15.89:0/2220350704 conn(0x7f62bc0c99b0 msgr2=0x7f62bc0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.351+0000 7f62c1e00640 1 -- 172.21.15.89:0/2220350704 shutdown_connections 2024-08-31T04:30:13.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.351+0000 7f62c1e00640 1 -- 172.21.15.89:0/2220350704 wait complete. 2024-08-31T04:30:13.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62c1e00640 1 Processor -- start 2024-08-31T04:30:13.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62c1e00640 1 -- start start 2024-08-31T04:30:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62c1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0b2860 0x7f62bc0c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62c1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62bc0c1ed0 0x7f62bc14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62c1e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62bc0c90e0 0x7f62bc149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62c1e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc0c32e0 con 0x7f62bc0b2860 2024-08-31T04:30:13.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62c1e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc0c3160 con 0x7f62bc0c1ed0 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62c1e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc074ec0 con 0x7f62bc0c90e0 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62baa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0b2860 0x7f62bc0c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62baa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0b2860 0x7f62bc0c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58776/0 (socket says 172.21.15.89:58776) 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62baa00640 1 -- 172.21.15.89:0/3801540644 learned_addr learned my addr 172.21.15.89:0/3801540644 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62ba000640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62bc0c1ed0 0x7f62bc14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62bb400640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62bc0c90e0 0x7f62bc149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62baa00640 1 -- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62bc0c90e0 msgr2=0x7f62bc149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62baa00640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62bc0c90e0 0x7f62bc149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.355+0000 7f62baa00640 1 -- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62bc0c1ed0 msgr2=0x7f62bc14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62baa00640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62bc0c1ed0 0x7f62bc14f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62baa00640 1 -- 172.21.15.89:0/3801540644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc161aa0 con 0x7f62bc0b2860 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62bb400640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62bc0c90e0 0x7f62bc149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62baa00640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0b2860 0x7f62bc0c4990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00dae0 tx=0x7f62ac00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:13.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62b3400640 1 -- 172.21.15.89:0/3801540644 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac017070 con 0x7f62bc0b2860 2024-08-31T04:30:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62b3400640 1 -- 172.21.15.89:0/3801540644 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62ac004b30 con 0x7f62bc0b2860 2024-08-31T04:30:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62c1e00640 1 -- 172.21.15.89:0/3801540644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62bc0c4ed0 con 0x7f62bc0b2860 2024-08-31T04:30:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62b3400640 1 -- 172.21.15.89:0/3801540644 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac005020 con 0x7f62bc0b2860 2024-08-31T04:30:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62c1e00640 1 -- 172.21.15.89:0/3801540644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62bc162000 con 0x7f62bc0b2860 2024-08-31T04:30:13.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62b3400640 1 -- 172.21.15.89:0/3801540644 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f62ac0051c0 con 0x7f62bc0b2860 2024-08-31T04:30:13.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.359+0000 7f62b3400640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f629c0720c0 0x7f629c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62b3400640 1 -- 172.21.15.89:0/3801540644 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f62ac093470 con 0x7f62bc0b2860 2024-08-31T04:30:13.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 Processor -- start 2024-08-31T04:30:13.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62ba000640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f629c0720c0 0x7f629c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 -- start start 2024-08-31T04:30:13.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62ba000640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f629c0720c0 0x7f629c0745d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f62a80af000 tx=0x7f62a801b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:13.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0699950 0x563ea07b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 0x563ea07bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0674890 0x563ea07bd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563ea0662f30 con 0x563ea0674890 2024-08-31T04:30:13.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563ea05d8690 con 0x563ea0699950 2024-08-31T04:30:13.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563ea05c7c20 con 0x563ea0683930 2024-08-31T04:30:13.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0674890 0x563ea07bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62baa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0699950 0x563ea07b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0674890 0x563ea07bd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58784/0 (socket says 172.21.15.89:58784) 2024-08-31T04:30:13.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62bb400640 1 -- 172.21.15.89:0/2326695917 learned_addr learned my addr 172.21.15.89:0/2326695917 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:30:13.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62ba000640 1 --2- 172.21.15.89:0/2326695917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 0x563ea07bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62bb400640 1 -- 172.21.15.89:0/2326695917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 msgr2=0x563ea07bcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:13.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62bb400640 1 --2- 172.21.15.89:0/2326695917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 0x563ea07bcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62bb400640 1 -- 172.21.15.89:0/2326695917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0699950 msgr2=0x563ea07b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62bb400640 1 --2- 172.21.15.89:0/2326695917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0699950 0x563ea07b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62bb400640 1 -- 172.21.15.89:0/2326695917 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ea057c8f0 con 0x563ea0674890 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62bb400640 1 --2- 172.21.15.89:0/2326695917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0674890 0x563ea07bd010 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f62b4001620 tx=0x7f62b4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace5a0937b8ee56 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62a7400640 1 -- 172.21.15.89:0/2326695917 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4016020 con 0x563ea0674890 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62a7400640 1 -- 172.21.15.89:0/2326695917 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62b400dc30 con 0x563ea0674890 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62a7400640 1 -- 172.21.15.89:0/2326695917 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4012650 con 0x563ea0674890 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 -- 172.21.15.89:0/2326695917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0674890 msgr2=0x563ea07bd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 --2- 172.21.15.89:0/2326695917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0674890 0x563ea07bd010 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f62b4001620 tx=0x7f62b4001ae0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 -- 172.21.15.89:0/2326695917 shutdown_connections 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 --2- 172.21.15.89:0/2326695917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0674890 0x563ea07bd010 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 --2- 172.21.15.89:0/2326695917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 0x563ea07bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 --2- 172.21.15.89:0/2326695917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0699950 0x563ea07b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 -- 172.21.15.89:0/2326695917 >> 172.21.15.89:0/2326695917 conn(0x563ea0699540 msgr2=0x563ea07ba890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 -- 172.21.15.89:0/2326695917 shutdown_connections 2024-08-31T04:30:13.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.363+0000 7f62c952e000 1 -- 172.21.15.89:0/2326695917 wait complete. 2024-08-31T04:30:13.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 -- start start 2024-08-31T04:30:13.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 Processor -- start 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 0x563ea07b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 0x563ea07b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07b7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563ea054e500 con 0x563ea0699950 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563ea05cbbd0 con 0x563ea0683930 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563ea056fa30 con 0x563ea0674890 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 10 client.0 _ll_register_callbacks cb 0x563ea067db00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07b7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58800/0 (socket says 172.21.15.89:58800) 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62bb400640 1 -- 172.21.15.89:0/984836156 learned_addr learned my addr 172.21.15.89:0/984836156 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:30:13.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62baa00640 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 0x563ea07b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62ba000640 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 0x563ea07b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62bb400640 1 -- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 msgr2=0x563ea07b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62bb400640 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 0x563ea07b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62bb400640 1 -- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 msgr2=0x563ea07b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62bb400640 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 0x563ea07b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62bb400640 1 -- 172.21.15.89:0/984836156 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ea05676a0 con 0x563ea0699950 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62bb400640 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07b7690 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f62b4014000 tx=0x7f62b4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12792641d59929ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f629be00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f629be00640 1 -- 172.21.15.89:0/984836156 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4016070 con 0x563ea0699950 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f629be00640 1 -- 172.21.15.89:0/984836156 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f62b400dd50 con 0x563ea0699950 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 -- 172.21.15.89:0/984836156 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ea05617e0 con 0x563ea0699950 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f629be00640 1 -- 172.21.15.89:0/984836156 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f62b402c050 con 0x563ea0699950 2024-08-31T04:30:13.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 10 client.5955 fetch_fsmap learned FSMap version 9 2024-08-31T04:30:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.367+0000 7f62c952e000 1 -- 172.21.15.89:0/984836156 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563ea05861c0 con 0x563ea0699950 2024-08-31T04:30:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f629be00640 1 -- 172.21.15.89:0/984836156 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563ea05617e0 con 0x563ea0699950 2024-08-31T04:30:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f629be00640 1 -- 172.21.15.89:0/984836156 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f62b402f020 con 0x563ea0699950 2024-08-31T04:30:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 10 client.5955 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:30:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 10 client.5955 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:30:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 20 client.5955 populate_metadata read hostname 'smithi089' 2024-08-31T04:30:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ea065dfc0 0x563ea07d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 4 client.5955 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:13.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 -- 172.21.15.89:0/984836156 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ea05da5e0 con 0x563ea065dfc0 2024-08-31T04:30:13.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62baa00640 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ea065dfc0 0x563ea07d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f629be00640 10 client.5955 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62baa00640 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ea065dfc0 0x563ea07d1630 crc :-1 s=READY pgs=1164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e65cf93e2a82435 server_cookie=46fdeb4074c95190 in_seq=0 out_seq=0 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f629be00640 1 -- 172.21.15.89:0/984836156 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ea05da5e0 con 0x563ea065dfc0 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f629be00640 10 client.5955 handle_command_reply: tid=0 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 client.5955 shutdown 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 -- 172.21.15.89:0/984836156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 msgr2=0x563ea07b7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07b7690 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f62b4014000 tx=0x7f62b4007d10 comp rx=0 tx=0).stop 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 -- 172.21.15.89:0/984836156 shutdown_connections 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ea065dfc0 0x563ea07d1630 crc :-1 s=READY pgs=1164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07b7690 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 0x563ea07b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f629be00640 0 client.5955 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 --2- 172.21.15.89:0/984836156 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 0x563ea07b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 -- 172.21.15.89:0/984836156 >> 172.21.15.89:0/984836156 conn(0x563ea0699540 msgr2=0x563ea07b8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:13.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 -- 172.21.15.89:0/984836156 shutdown_connections 2024-08-31T04:30:13.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.371+0000 7f62c952e000 1 -- 172.21.15.89:0/984836156 wait complete. 2024-08-31T04:30:13.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.375+0000 7f62c952e000 20 client.5955 trim_cache size 0 max 16384 2024-08-31T04:30:13.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62c952e000 1 Processor -- start 2024-08-31T04:30:13.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62c952e000 1 -- start start 2024-08-31T04:30:13.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62c952e000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0674890 0x563ea07d6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62c952e000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 0x563ea07d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62c952e000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62c952e000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc203f60 con 0x563ea0699950 2024-08-31T04:30:13.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62c952e000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc202e40 con 0x563ea0674890 2024-08-31T04:30:13.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62c952e000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc14ee00 con 0x563ea0683930 2024-08-31T04:30:13.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58808/0 (socket says 172.21.15.89:58808) 2024-08-31T04:30:13.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62bb400640 1 -- 172.21.15.89:0/309734933 learned_addr learned my addr 172.21.15.89:0/309734933 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62baa00640 1 --2- 172.21.15.89:0/309734933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0674890 0x563ea07d6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62ba000640 1 --2- 172.21.15.89:0/309734933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 0x563ea07d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62bb400640 1 -- 172.21.15.89:0/309734933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 msgr2=0x563ea07d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62bb400640 1 --2- 172.21.15.89:0/309734933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 0x563ea07d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62bb400640 1 -- 172.21.15.89:0/309734933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0674890 msgr2=0x563ea07d6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62bb400640 1 --2- 172.21.15.89:0/309734933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0674890 0x563ea07d6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.391+0000 7f62bb400640 1 -- 172.21.15.89:0/309734933 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ea064c2f0 con 0x563ea0699950 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62bb400640 1 --2- 172.21.15.89:0/309734933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d1b70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f62b400d650 tx=0x7f62b400d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7393405bc2816d64 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62a6a00640 1 -- 172.21.15.89:0/309734933 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4016040 con 0x563ea0699950 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62a6a00640 1 -- 172.21.15.89:0/309734933 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62b401f070 con 0x563ea0699950 2024-08-31T04:30:13.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62a6a00640 1 -- 172.21.15.89:0/309734933 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b400ddb0 con 0x563ea0699950 2024-08-31T04:30:13.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 -- 172.21.15.89:0/309734933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 msgr2=0x563ea07d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 --2- 172.21.15.89:0/309734933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d1b70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f62b400d650 tx=0x7f62b400d680 comp rx=0 tx=0).stop 2024-08-31T04:30:13.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 -- 172.21.15.89:0/309734933 shutdown_connections 2024-08-31T04:30:13.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 --2- 172.21.15.89:0/309734933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d1b70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 --2- 172.21.15.89:0/309734933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0683930 0x563ea07d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 --2- 172.21.15.89:0/309734933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0674890 0x563ea07d6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 -- 172.21.15.89:0/309734933 >> 172.21.15.89:0/309734933 conn(0x563ea0699540 msgr2=0x563ea07baa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:13.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 -- 172.21.15.89:0/309734933 shutdown_connections 2024-08-31T04:30:13.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 -- 172.21.15.89:0/309734933 wait complete. 2024-08-31T04:30:13.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 -- start start 2024-08-31T04:30:13.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 Processor -- start 2024-08-31T04:30:13.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 0x563ea07d6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 0x563ea07d5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc2019d0 con 0x563ea0699950 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc202770 con 0x563ea0683930 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc2020a0 con 0x563ea0674890 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62c952e000 10 client.0 _ll_register_callbacks cb 0x7f62ac0099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62bb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58814/0 (socket says 172.21.15.89:58814) 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.395+0000 7f62bb400640 1 -- 172.21.15.89:0/46499131 learned_addr learned my addr 172.21.15.89:0/46499131 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62ba000640 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 0x563ea07d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62baa00640 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 0x563ea07d6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62bb400640 1 -- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 msgr2=0x563ea07d6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62bb400640 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 0x563ea07d6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62bb400640 1 -- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 msgr2=0x563ea07d5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62bb400640 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 0x563ea07d5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62bb400640 1 -- 172.21.15.89:0/46499131 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ea0551b30 con 0x563ea0699950 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62bb400640 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d56c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f62b400d650 tx=0x7f62b4005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16029565af5a794 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f629be00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f629be00640 1 -- 172.21.15.89:0/46499131 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4037020 con 0x563ea0699950 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f629be00640 1 -- 172.21.15.89:0/46499131 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f62b4026ab0 con 0x563ea0699950 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62c952e000 1 -- 172.21.15.89:0/46499131 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b401f070 con 0x563ea0699950 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f629be00640 1 -- 172.21.15.89:0/46499131 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f62b4026cf0 con 0x563ea0699950 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62c952e000 10 client.5961 fetch_fsmap learned FSMap version 9 2024-08-31T04:30:13.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62c952e000 1 -- 172.21.15.89:0/46499131 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563ea055ec70 con 0x563ea0699950 2024-08-31T04:30:13.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f629be00640 1 -- 172.21.15.89:0/46499131 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62b401f070 con 0x563ea0699950 2024-08-31T04:30:13.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f629be00640 1 -- 172.21.15.89:0/46499131 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f62b402f070 con 0x563ea0699950 2024-08-31T04:30:13.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62c952e000 10 client.5961 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:30:13.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62c952e000 10 client.5961 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:30:13.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62c952e000 20 client.5961 populate_metadata read hostname 'smithi089' 2024-08-31T04:30:13.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62c952e000 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ea0259e80 0x563ea07f8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:13.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62c952e000 4 client.5961 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5cb31da3", "release": true, "await": true}] 2024-08-31T04:30:13.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62c952e000 1 -- 172.21.15.89:0/46499131 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5cb31da3", "release": true, "await": true}) -- 0x563ea05d6080 con 0x563ea0259e80 2024-08-31T04:30:13.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62baa00640 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ea0259e80 0x563ea07f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:13.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f62baa00640 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ea0259e80 0x563ea07f8060 crc :-1 s=READY pgs=1165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c350592492fff9f server_cookie=67aaf93874f5a66a in_seq=0 out_seq=0 2024-08-31T04:30:13.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.399+0000 7f629be00640 10 client.5961 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:30:13.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f629be00640 1 -- 172.21.15.89:0/46499131 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563ea05d6080 con 0x563ea0259e80 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f629be00640 10 client.5961 handle_command_reply: tid=0 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 client.5961 shutdown 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 -- 172.21.15.89:0/46499131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 msgr2=0x563ea07d56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d56c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f62b400d650 tx=0x7f62b4005590 comp rx=0 tx=0).stop 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 -- 172.21.15.89:0/46499131 shutdown_connections 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x563ea0259e80 0x563ea07f8060 crc :-1 s=READY pgs=1165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563ea0699950 0x563ea07d56c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563ea0683930 0x563ea07d5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 --2- 172.21.15.89:0/46499131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563ea0674890 0x563ea07d6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f629be00640 0 client.5961 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:30:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 -- 172.21.15.89:0/46499131 >> 172.21.15.89:0/46499131 conn(0x563ea0699540 msgr2=0x563ea07b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 -- 172.21.15.89:0/46499131 shutdown_connections 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 1 -- 172.21.15.89:0/46499131 wait complete. 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.551+0000 7f62c952e000 20 client.5961 trim_cache size 0 max 16384 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 92, 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stdout: "5cb31da3": { 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 92, 2024-08-31T04:30:13.555 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 150.2, 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:30:13.556 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:30:13.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:30:13.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:30:13.557 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:30:13.557 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:30:13.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 -- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f629c0720c0 msgr2=0x7f629c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f629c0720c0 0x7f629c0745d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f62a80af000 tx=0x7f62a801b060 comp rx=0 tx=0).stop 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 -- 172.21.15.89:0/3801540644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0b2860 msgr2=0x7f62bc0c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0b2860 0x7f62bc0c4990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00dae0 tx=0x7f62ac00b260 comp rx=0 tx=0).stop 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 -- 172.21.15.89:0/3801540644 shutdown_connections 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f629c0720c0 0x7f629c0745d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62bc0c90e0 0x7f62bc149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62bc0c1ed0 0x7f62bc14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 --2- 172.21.15.89:0/3801540644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62bc0b2860 0x7f62bc0c4990 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 -- 172.21.15.89:0/3801540644 >> 172.21.15.89:0/3801540644 conn(0x7f62bc0c99b0 msgr2=0x7f62bc1572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 -- 172.21.15.89:0/3801540644 shutdown_connections 2024-08-31T04:30:13.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:30:13.555+0000 7f62c1e00640 1 -- 172.21.15.89:0/3801540644 wait complete. 2024-08-31T04:30:13.574 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5cb31da3', total seconds elapsed: 31.0 2024-08-31T04:30:19.749 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 9% (29/309) Updating files: 10% (31/309) Updating files: 11% (34/309) Updating files: 12% (38/309) Updating files: 13% (41/309) Updating files: 14% (44/309) Updating files: 15% (47/309) Updating files: 16% (50/309) Updating files: 17% (53/309) Updating files: 18% (56/309) Updating files: 19% (59/309) Updating files: 20% (62/309) Updating files: 21% (65/309) Updating files: 22% (68/309) Updating files: 22% (69/309) Updating files: 23% (72/309) Updating files: 24% (75/309) Updating files: 24% (77/309) Updating files: 25% (78/309) Updating files: 26% (81/309) Updating files: 27% (84/309) Updating files: 28% (87/309) Updating files: 29% (90/309) Updating files: 30% (93/309) Updating files: 31% (96/309) Updating files: 32% (99/309) Updating files: 33% (102/309) Updating files: 34% (106/309) Updating files: 35% (109/309) Updating files: 36% (112/309) Updating files: 37% (115/309) Updating files: 38% (118/309) Updating files: 39% (121/309) Updating files: 40% (124/309) Updating files: 40% (125/309) Updating files: 41% (127/309) Updating files: 42% (130/309) Updating files: 43% (133/309) Updating files: 44% (136/309) Updating files: 45% (140/309) Updating files: 46% (143/309) Updating files: 47% (146/309) Updating files: 48% (149/309) Updating files: 49% (152/309) Updating files: 50% (155/309) Updating files: 51% (158/309) Updating files: 52% (161/309) Updating files: 53% (164/309) Updating files: 54% (167/309) Updating files: 55% (170/309) Updating files: 56% (174/309) Updating files: 57% (177/309) Updating files: 58% (180/309) Updating files: 59% (183/309) Updating files: 60% (186/309) Updating files: 61% (189/309) Updating files: 62% (192/309) Updating files: 63% (195/309) Updating files: 64% (198/309) Updating files: 65% (201/309) Updating files: 66% (204/309) Updating files: 67% (208/309) Updating files: 68% (211/309) Updating files: 69% (214/309) Updating files: 70% (217/309) Updating files: 71% (220/309) Updating files: 72% (223/309) Updating files: 73% (226/309) Updating files: 74% (229/309) Updating files: 75% (232/309) Updating files: 76% (235/309) Updating files: 77% (238/309) Updating files: 78% (242/309) Updating files: 79% (245/309) Updating files: 80% (248/309) Updating files: 81% (251/309) Updating files: 82% (254/309) Updating files: 83% (257/309) Updating files: 84% (260/309) Updating files: 85% (263/309) Updating files: 86% (266/309) Updating files: 87% (269/309) Updating files: 88% (272/309) Updating files: 89% (276/309) Updating files: 89% (278/309) Updating files: 90% (279/309) Updating files: 91% (282/309) Updating files: 92% (285/309) Updating files: 93% (288/309) Updating files: 94% (291/309) Updating files: 95% (294/309) Updating files: 96% (297/309) Updating files: 97% (300/309) Updating files: 98% (303/309) Updating files: 99% (306/309) Updating files: 100% (309/309) Updating files: 100% (309/309), done. 2024-08-31T04:30:20.697 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at cb7f1c9c752 v0.46 2024-08-31T04:30:20.772 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.46 2024-08-31T04:30:20.797 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 47 -eq 48 ] 2024-08-31T04:30:20.797 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.47 2024-08-31T04:30:20.797 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.47 2024-08-31T04:30:20.797 INFO:tasks.workunit.client.0.smithi089.stdout:v0.47 2024-08-31T04:30:20.797 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.47 2024-08-31T04:30:24.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:30:24.023 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:30:32.779 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 9% (20/219) Updating files: 10% (22/219) Updating files: 11% (25/219) Updating files: 12% (27/219) Updating files: 13% (29/219) Updating files: 14% (31/219) Updating files: 15% (33/219) Updating files: 16% (36/219) Updating files: 17% (38/219) Updating files: 18% (40/219) Updating files: 19% (42/219) Updating files: 20% (44/219) Updating files: 21% (46/219) Updating files: 22% (49/219) Updating files: 23% (51/219) Updating files: 24% (53/219) Updating files: 25% (55/219) Updating files: 26% (57/219) Updating files: 27% (60/219) Updating files: 28% (62/219) Updating files: 29% (64/219) Updating files: 30% (66/219) Updating files: 31% (68/219) Updating files: 32% (71/219) Updating files: 33% (73/219) Updating files: 34% (75/219) Updating files: 35% (77/219) Updating files: 36% (79/219) Updating files: 37% (82/219) Updating files: 38% (84/219) Updating files: 39% (86/219) Updating files: 40% (88/219) Updating files: 41% (90/219) Updating files: 42% (92/219) Updating files: 43% (95/219) Updating files: 44% (97/219) Updating files: 45% (99/219) Updating files: 46% (101/219) Updating files: 47% (103/219) Updating files: 48% (106/219) Updating files: 48% (107/219) Updating files: 49% (108/219) Updating files: 50% (110/219) Updating files: 51% (112/219) Updating files: 52% (114/219) Updating files: 53% (117/219) Updating files: 54% (119/219) Updating files: 55% (121/219) Updating files: 56% (123/219) Updating files: 57% (125/219) Updating files: 58% (128/219) Updating files: 59% (130/219) Updating files: 60% (132/219) Updating files: 61% (134/219) Updating files: 62% (136/219) Updating files: 63% (138/219) Updating files: 64% (141/219) Updating files: 65% (143/219) Updating files: 66% (145/219) Updating files: 67% (147/219) Updating files: 68% (149/219) Updating files: 69% (152/219) Updating files: 70% (154/219) Updating files: 71% (156/219) Updating files: 72% (158/219) Updating files: 73% (160/219) Updating files: 74% (163/219) Updating files: 75% (165/219) Updating files: 76% (167/219) Updating files: 77% (169/219) Updating files: 78% (171/219) Updating files: 79% (174/219) Updating files: 80% (176/219) Updating files: 81% (178/219) Updating files: 82% (180/219) Updating files: 83% (182/219) Updating files: 84% (184/219) Updating files: 85% (187/219) Updating files: 86% (189/219) Updating files: 87% (191/219) Updating files: 88% (193/219) Updating files: 89% (195/219) Updating files: 90% (198/219) Updating files: 91% (200/219) Updating files: 92% (202/219) Updating files: 93% (204/219) Updating files: 94% (206/219) Updating files: 95% (209/219) Updating files: 96% (211/219) Updating files: 97% (213/219) Updating files: 98% (215/219) Updating files: 99% (217/219) Updating files: 100% (219/219) Updating files: 100% (219/219), done. 2024-08-31T04:30:32.917 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at ad663d58c89 v0.47 2024-08-31T04:30:32.923 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.47 2024-08-31T04:30:33.045 INFO:tasks.workunit.client.0.smithi089.stdout:v0.49 2024-08-31T04:30:33.045 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 48 -eq 48 ] 2024-08-31T04:30:33.045 INFO:tasks.workunit.client.0.smithi089.stderr:+ continue 2024-08-31T04:30:33.046 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 49 -eq 48 ] 2024-08-31T04:30:33.046 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.49 2024-08-31T04:30:33.046 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.49 2024-08-31T04:30:33.046 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.49 2024-08-31T04:30:43.270 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 12% (62/481) Updating files: 13% (63/481) Updating files: 14% (68/481) Updating files: 15% (73/481) Updating files: 16% (77/481) Updating files: 17% (82/481) Updating files: 18% (87/481) Updating files: 19% (92/481) Updating files: 20% (97/481) Updating files: 21% (102/481) Updating files: 22% (106/481) Updating files: 23% (111/481) Updating files: 23% (114/481) Updating files: 24% (116/481) Updating files: 25% (121/481) Updating files: 26% (126/481) Updating files: 27% (130/481) Updating files: 28% (135/481) Updating files: 29% (140/481) Updating files: 30% (145/481) Updating files: 31% (150/481) Updating files: 32% (154/481) Updating files: 33% (159/481) Updating files: 34% (164/481) Updating files: 35% (169/481) Updating files: 36% (174/481) Updating files: 36% (176/481) Updating files: 37% (178/481) Updating files: 38% (183/481) Updating files: 39% (188/481) Updating files: 40% (193/481) Updating files: 41% (198/481) Updating files: 42% (203/481) Updating files: 43% (207/481) Updating files: 44% (212/481) Updating files: 45% (217/481) Updating files: 46% (222/481) Updating files: 47% (227/481) Updating files: 48% (231/481) Updating files: 49% (236/481) Updating files: 50% (241/481) Updating files: 51% (246/481) Updating files: 51% (250/481) Updating files: 52% (251/481) Updating files: 53% (255/481) Updating files: 54% (260/481) Updating files: 55% (265/481) Updating files: 56% (270/481) Updating files: 57% (275/481) Updating files: 58% (279/481) Updating files: 59% (284/481) Updating files: 59% (287/481) Updating files: 59% (288/481) Updating files: 60% (289/481) Updating files: 61% (294/481) Updating files: 62% (299/481) Updating files: 63% (304/481) Updating files: 64% (308/481) Updating files: 65% (313/481) Updating files: 66% (318/481) Updating files: 67% (323/481) Updating files: 68% (328/481) Updating files: 69% (332/481) Updating files: 70% (337/481) Updating files: 70% (338/481) Updating files: 71% (342/481) Updating files: 72% (347/481) Updating files: 73% (352/481) Updating files: 74% (356/481) Updating files: 75% (361/481) Updating files: 76% (366/481) Updating files: 77% (371/481) Updating files: 78% (376/481) Updating files: 79% (380/481) Updating files: 80% (385/481) Updating files: 81% (390/481) Updating files: 82% (395/481) Updating files: 83% (400/481) Updating files: 84% (405/481) Updating files: 85% (409/481) Updating files: 86% (414/481) Updating files: 87% (419/481) Updating files: 88% (424/481) Updating files: 89% (429/481) Updating files: 89% (432/481) Updating files: 90% (433/481) Updating files: 91% (438/481) Updating files: 92% (443/481) Updating files: 93% (448/481) Updating files: 94% (453/481) Updating files: 95% (457/481) Updating files: 96% (462/481) Updating files: 97% (467/481) Updating files: 98% (472/481) Updating files: 99% (477/481) Updating files: 100% (481/481) Updating files: 100% (481/481), done. 2024-08-31T04:30:43.447 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at ca6265d0f4d v0.49 2024-08-31T04:30:43.454 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.49 2024-08-31T04:30:43.474 INFO:tasks.workunit.client.0.smithi089.stdout:v0.50 2024-08-31T04:30:43.475 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 50 -eq 48 ] 2024-08-31T04:30:43.475 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.50 2024-08-31T04:30:43.475 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.50 2024-08-31T04:30:43.475 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.50 2024-08-31T04:30:46.152 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 54% (74/137) Updating files: 55% (76/137) Updating files: 56% (77/137) Updating files: 57% (79/137) Updating files: 58% (80/137) Updating files: 59% (81/137) Updating files: 60% (83/137) Updating files: 61% (84/137) Updating files: 62% (85/137) Updating files: 63% (87/137) Updating files: 64% (88/137) Updating files: 65% (90/137) Updating files: 66% (91/137) Updating files: 67% (92/137) Updating files: 68% (94/137) Updating files: 69% (95/137) Updating files: 70% (96/137) Updating files: 71% (98/137) Updating files: 72% (99/137) Updating files: 73% (101/137) Updating files: 74% (102/137) Updating files: 75% (103/137) Updating files: 76% (105/137) Updating files: 77% (106/137) Updating files: 78% (107/137) Updating files: 79% (109/137) Updating files: 80% (110/137) Updating files: 81% (111/137) Updating files: 82% (113/137) Updating files: 83% (114/137) Updating files: 84% (116/137) Updating files: 85% (117/137) Updating files: 86% (118/137) Updating files: 87% (120/137) Updating files: 88% (121/137) Updating files: 89% (122/137) Updating files: 90% (124/137) Updating files: 91% (125/137) Updating files: 92% (127/137) Updating files: 93% (128/137) Updating files: 94% (129/137) Updating files: 95% (131/137) Updating files: 96% (132/137) Updating files: 97% (133/137) Updating files: 98% (135/137) Updating files: 99% (136/137) Updating files: 100% (137/137) Updating files: 100% (137/137), done. 2024-08-31T04:30:46.369 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at a4428bd0e19 v0.50 2024-08-31T04:30:46.373 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.50 2024-08-31T04:30:46.400 INFO:tasks.workunit.client.0.smithi089.stdout:v0.51 2024-08-31T04:30:46.400 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 51 -eq 48 ] 2024-08-31T04:30:46.400 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.51 2024-08-31T04:30:46.400 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.51 2024-08-31T04:30:46.400 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.51 2024-08-31T04:30:54.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:30:54.388 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:30:57.897 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 28% (30/105) Updating files: 29% (31/105) Updating files: 30% (32/105) Updating files: 31% (33/105) Updating files: 32% (34/105) Updating files: 33% (35/105) Updating files: 34% (36/105) Updating files: 35% (37/105) Updating files: 36% (38/105) Updating files: 37% (39/105) Updating files: 38% (40/105) Updating files: 39% (41/105) Updating files: 40% (42/105) Updating files: 41% (44/105) Updating files: 42% (45/105) Updating files: 43% (46/105) Updating files: 44% (47/105) Updating files: 45% (48/105) Updating files: 46% (49/105) Updating files: 47% (50/105) Updating files: 48% (51/105) Updating files: 49% (52/105) Updating files: 50% (53/105) Updating files: 51% (54/105) Updating files: 52% (55/105) Updating files: 53% (56/105) Updating files: 54% (57/105) Updating files: 55% (58/105) Updating files: 56% (59/105) Updating files: 57% (60/105) Updating files: 58% (61/105) Updating files: 59% (62/105) Updating files: 60% (63/105) Updating files: 61% (65/105) Updating files: 62% (66/105) Updating files: 63% (67/105) Updating files: 64% (68/105) Updating files: 65% (69/105) Updating files: 66% (70/105) Updating files: 67% (71/105) Updating files: 68% (72/105) Updating files: 69% (73/105) Updating files: 70% (74/105) Updating files: 71% (75/105) Updating files: 72% (76/105) Updating files: 73% (77/105) Updating files: 74% (78/105) Updating files: 75% (79/105) Updating files: 76% (80/105) Updating files: 77% (81/105) Updating files: 78% (82/105) Updating files: 79% (83/105) Updating files: 80% (84/105) Updating files: 81% (86/105) Updating files: 82% (87/105) Updating files: 83% (88/105) Updating files: 84% (89/105) Updating files: 85% (90/105) Updating files: 86% (91/105) Updating files: 87% (92/105) Updating files: 88% (93/105) Updating files: 89% (94/105) Updating files: 90% (95/105) Updating files: 91% (96/105) Updating files: 92% (97/105) Updating files: 93% (98/105) Updating files: 94% (99/105) Updating files: 95% (100/105) Updating files: 96% (101/105) Updating files: 97% (102/105) Updating files: 98% (103/105) Updating files: 99% (104/105) Updating files: 100% (105/105) Updating files: 100% (105/105), done. 2024-08-31T04:30:57.951 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at c03ca95d235 v0.51 2024-08-31T04:30:57.955 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.51 2024-08-31T04:30:58.815 INFO:tasks.workunit.client.0.smithi089.stdout:v0.52 2024-08-31T04:30:58.815 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 52 -eq 48 ] 2024-08-31T04:30:58.815 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.52 2024-08-31T04:30:58.815 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.52 2024-08-31T04:30:58.815 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.52 2024-08-31T04:31:02.475 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 9% (17/183) Updating files: 10% (19/183) Updating files: 11% (21/183) Updating files: 12% (22/183) Updating files: 13% (24/183) Updating files: 14% (26/183) Updating files: 15% (28/183) Updating files: 16% (30/183) Updating files: 17% (32/183) Updating files: 18% (33/183) Updating files: 19% (35/183) Updating files: 20% (37/183) Updating files: 21% (39/183) Updating files: 22% (41/183) Updating files: 23% (43/183) Updating files: 24% (44/183) Updating files: 25% (46/183) Updating files: 26% (48/183) Updating files: 27% (50/183) Updating files: 28% (52/183) Updating files: 29% (54/183) Updating files: 30% (55/183) Updating files: 31% (57/183) Updating files: 32% (59/183) Updating files: 33% (61/183) Updating files: 34% (63/183) Updating files: 35% (65/183) Updating files: 36% (66/183) Updating files: 37% (68/183) Updating files: 38% (70/183) Updating files: 39% (72/183) Updating files: 40% (74/183) Updating files: 41% (76/183) Updating files: 42% (77/183) Updating files: 43% (79/183) Updating files: 44% (81/183) Updating files: 45% (83/183) Updating files: 46% (85/183) Updating files: 47% (87/183) Updating files: 48% (88/183) Updating files: 49% (90/183) Updating files: 50% (92/183) Updating files: 51% (94/183) Updating files: 52% (96/183) Updating files: 53% (97/183) Updating files: 54% (99/183) Updating files: 55% (101/183) Updating files: 56% (103/183) Updating files: 57% (105/183) Updating files: 58% (107/183) Updating files: 59% (108/183) Updating files: 60% (110/183) Updating files: 61% (112/183) Updating files: 62% (114/183) Updating files: 63% (116/183) Updating files: 64% (118/183) Updating files: 65% (119/183) Updating files: 66% (121/183) Updating files: 67% (123/183) Updating files: 68% (125/183) Updating files: 69% (127/183) Updating files: 70% (129/183) Updating files: 71% (130/183) Updating files: 72% (132/183) Updating files: 73% (134/183) Updating files: 74% (136/183) Updating files: 75% (138/183) Updating files: 76% (140/183) Updating files: 77% (141/183) Updating files: 77% (142/183) Updating files: 78% (143/183) Updating files: 79% (145/183) Updating files: 80% (147/183) Updating files: 81% (149/183) Updating files: 82% (151/183) Updating files: 83% (152/183) Updating files: 84% (154/183) Updating files: 85% (156/183) Updating files: 86% (158/183) Updating files: 87% (160/183) Updating files: 88% (162/183) Updating files: 89% (163/183) Updating files: 90% (165/183) Updating files: 91% (167/183) Updating files: 92% (169/183) Updating files: 93% (171/183) Updating files: 94% (173/183) Updating files: 95% (174/183) Updating files: 96% (176/183) Updating files: 97% (178/183) Updating files: 98% (180/183) Updating files: 99% (182/183) Updating files: 100% (183/183) Updating files: 100% (183/183), done. 2024-08-31T04:31:02.632 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at e48859474c4 v0.52 2024-08-31T04:31:02.637 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.52 2024-08-31T04:31:02.759 INFO:tasks.workunit.client.0.smithi089.stdout:v0.53 2024-08-31T04:31:02.759 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 53 -eq 48 ] 2024-08-31T04:31:02.759 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.53 2024-08-31T04:31:02.759 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.53 2024-08-31T04:31:02.759 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.53 2024-08-31T04:31:09.660 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-08-31T04:31:09.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:31:09.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.826+0000 7f8d81e00640 1 -- 172.21.15.89:0/1189576424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60004810 msgr2=0x7f8d60004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:09.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.826+0000 7f8d81e00640 1 --2- 172.21.15.89:0/1189576424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60004810 0x7f8d60004c20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8d64006f70 tx=0x7f8d6401cec0 comp rx=0 tx=0).stop 2024-08-31T04:31:09.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.826+0000 7f8d7b400640 1 -- 172.21.15.89:0/1189576424 reap_dead start 2024-08-31T04:31:09.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.826+0000 7f8d81e00640 1 -- 172.21.15.89:0/1189576424 shutdown_connections 2024-08-31T04:31:09.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.826+0000 7f8d81e00640 1 -- 172.21.15.89:0/1189576424 >> 172.21.15.89:0/1189576424 conn(0x7f8d7c071be0 msgr2=0x7f8d7c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:09.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.826+0000 7f8d81e00640 1 -- 172.21.15.89:0/1189576424 shutdown_connections 2024-08-31T04:31:09.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.826+0000 7f8d81e00640 1 -- 172.21.15.89:0/1189576424 wait complete. 2024-08-31T04:31:09.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.826+0000 7f8d81e00640 1 Processor -- start 2024-08-31T04:31:09.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.826+0000 7f8d81e00640 1 -- start start 2024-08-31T04:31:09.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d81e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60004810 0x7f8d7c155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:09.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d81e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d7c0cc060 0x7f8d7c155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:09.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d81e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7c0cc470 0x7f8d7c1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:09.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d81e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c0cabf0 con 0x7f8d60004810 2024-08-31T04:31:09.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d81e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c159ad0 con 0x7f8d7c0cc470 2024-08-31T04:31:09.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d81e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c08cff0 con 0x7f8d7c0cc060 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60004810 0x7f8d7c155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60004810 0x7f8d7c155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52478/0 (socket says 172.21.15.89:52478) 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7aa00640 1 -- 172.21.15.89:0/1810110110 learned_addr learned my addr 172.21.15.89:0/1810110110 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d72000640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d7c0cc060 0x7f8d7c155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7b400640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7c0cc470 0x7f8d7c1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7aa00640 1 -- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d7c0cc060 msgr2=0x7f8d7c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7aa00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d7c0cc060 0x7f8d7c155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7aa00640 1 -- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7c0cc470 msgr2=0x7f8d7c1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7aa00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7c0cc470 0x7f8d7c1555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7aa00640 1 -- 172.21.15.89:0/1810110110 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c1527c0 con 0x7f8d60004810 2024-08-31T04:31:09.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d7aa00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60004810 0x7f8d7c155dd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c005f20 tx=0x7f8d6c011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:09.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d73e00640 1 -- 172.21.15.89:0/1810110110 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c005320 con 0x7f8d60004810 2024-08-31T04:31:09.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d73e00640 1 -- 172.21.15.89:0/1810110110 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d6c018020 con 0x7f8d60004810 2024-08-31T04:31:09.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d73e00640 1 -- 172.21.15.89:0/1810110110 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c003860 con 0x7f8d60004810 2024-08-31T04:31:09.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c06e6f0 con 0x7f8d60004810 2024-08-31T04:31:09.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c1545e0 con 0x7f8d60004810 2024-08-31T04:31:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.830+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c0c5160 con 0x7f8d60004810 2024-08-31T04:31:09.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.834+0000 7f8d73e00640 1 -- 172.21.15.89:0/1810110110 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8d6c003a00 con 0x7f8d60004810 2024-08-31T04:31:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.834+0000 7f8d73e00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8d580720f0 0x7f8d58074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.834+0000 7f8d73e00640 1 -- 172.21.15.89:0/1810110110 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8d6c096600 con 0x7f8d60004810 2024-08-31T04:31:09.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.834+0000 7f8d72000640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8d580720f0 0x7f8d58074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:09.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.834+0000 7f8d72000640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8d580720f0 0x7f8d58074600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d640ac000 tx=0x7f8d64019d00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:09.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:09.838+0000 7f8d73e00640 1 -- 172.21.15.89:0/1810110110 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8d6c022020 con 0x7f8d60004810 2024-08-31T04:31:10.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.034+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d7c153930 con 0x7f8d60004810 2024-08-31T04:31:10.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.034+0000 7f8d73e00640 1 -- 172.21.15.89:0/1810110110 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f8d6c0615e0 con 0x7f8d60004810 2024-08-31T04:31:10.037 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:31:10.037 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:31:10.038 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:31:10.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8d580720f0 msgr2=0x7f8d58074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:10.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8d580720f0 0x7f8d58074600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d640ac000 tx=0x7f8d64019d00 comp rx=0 tx=0).stop 2024-08-31T04:31:10.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60004810 msgr2=0x7f8d7c155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:10.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60004810 0x7f8d7c155dd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c005f20 tx=0x7f8d6c011800 comp rx=0 tx=0).stop 2024-08-31T04:31:10.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 shutdown_connections 2024-08-31T04:31:10.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8d580720f0 0x7f8d58074600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7c0cc470 0x7f8d7c1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d7c0cc060 0x7f8d7c155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 --2- 172.21.15.89:0/1810110110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60004810 0x7f8d7c155dd0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 >> 172.21.15.89:0/1810110110 conn(0x7f8d7c071be0 msgr2=0x7f8d7c152e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:10.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 shutdown_connections 2024-08-31T04:31:10.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.038+0000 7f8d81e00640 1 -- 172.21.15.89:0/1810110110 wait complete. 2024-08-31T04:31:10.059 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-08-31T04:31:10.059 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-08-31T04:31:10.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 -- 172.21.15.89:0/1604810104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 msgr2=0x7fb2a415bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:10.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 --2- 172.21.15.89:0/1604810104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 0x7fb2a415bd70 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4073d90 tx=0x7fb29c01f580 comp rx=0 tx=0).stop 2024-08-31T04:31:10.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 -- 172.21.15.89:0/1604810104 shutdown_connections 2024-08-31T04:31:10.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 --2- 172.21.15.89:0/1604810104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 0x7fb2a415bd70 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 --2- 172.21.15.89:0/1604810104 >> v2:172.21.15.170:3300/0 conn(0x7fb2a4152900 0x7fb2a40c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 --2- 172.21.15.89:0/1604810104 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2a40c8260 0x7fb2a406df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 -- 172.21.15.89:0/1604810104 >> 172.21.15.89:0/1604810104 conn(0x7fb2a40ca360 msgr2=0x7fb2a40ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:10.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 -- 172.21.15.89:0/1604810104 shutdown_connections 2024-08-31T04:31:10.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 -- 172.21.15.89:0/1604810104 wait complete. 2024-08-31T04:31:10.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 Processor -- start 2024-08-31T04:31:10.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.222+0000 7fb2ac200640 1 -- start start 2024-08-31T04:31:10.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2ac200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 0x7fb2a4146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2ac200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2a40c8260 0x7fb2a414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2ac200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2a4152900 0x7fb2a414e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2ac200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a4159220 con 0x7fb2a40c5cb0 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2ac200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a40c53f0 con 0x7fb2a4152900 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2ac200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a4073570 con 0x7fb2a40c8260 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a9800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 0x7fb2a4146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a9800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 0x7fb2a4146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52504/0 (socket says 172.21.15.89:52504) 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a9800640 1 -- 172.21.15.89:0/3465354646 learned_addr learned my addr 172.21.15.89:0/3465354646 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a8e00640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2a40c8260 0x7fb2a414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2aa200640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2a4152900 0x7fb2a414e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a9800640 1 -- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2a40c8260 msgr2=0x7fb2a414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a9800640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2a40c8260 0x7fb2a414e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a9800640 1 -- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2a4152900 msgr2=0x7fb2a414e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:10.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a9800640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2a4152900 0x7fb2a414e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a9800640 1 -- 172.21.15.89:0/3465354646 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a4147fb0 con 0x7fb2a40c5cb0 2024-08-31T04:31:10.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2aa200640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2a4152900 0x7fb2a414e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:31:10.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a9800640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 0x7fb2a4146560 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb29800d6a0 tx=0x7fb29800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:10.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a1600640 1 -- 172.21.15.89:0/3465354646 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298017070 con 0x7fb2a40c5cb0 2024-08-31T04:31:10.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a1600640 1 -- 172.21.15.89:0/3465354646 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb298004310 con 0x7fb2a40c5cb0 2024-08-31T04:31:10.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2ac200640 1 -- 172.21.15.89:0/3465354646 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a41f5960 con 0x7fb2a40c5cb0 2024-08-31T04:31:10.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2a1600640 1 -- 172.21.15.89:0/3465354646 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298005280 con 0x7fb2a40c5cb0 2024-08-31T04:31:10.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.226+0000 7fb2ac200640 1 -- 172.21.15.89:0/3465354646 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a41568e0 con 0x7fb2a40c5cb0 2024-08-31T04:31:10.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2a1600640 1 -- 172.21.15.89:0/3465354646 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb298005420 con 0x7fb2a40c5cb0 2024-08-31T04:31:10.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2a1600640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb2840720c0 0x7fb2840745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2a1600640 1 -- 172.21.15.89:0/3465354646 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb2980932c0 con 0x7fb2a40c5cb0 2024-08-31T04:31:10.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2a8e00640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb2840720c0 0x7fb2840745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2b37c7000 1 Processor -- start 2024-08-31T04:31:10.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2b37c7000 1 -- start start 2024-08-31T04:31:10.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2a8e00640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb2840720c0 0x7fb2840745d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2900058d0 tx=0x7fb290005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 0x5597d399bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 0x5597d399c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5597d37f1820 con 0x5597d38993f0 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5597d37e0db0 con 0x5597d3878960 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.230+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5597d37e4d60 con 0x5597d388ee90 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a9800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a9800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39d2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52514/0 (socket says 172.21.15.89:52514) 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a9800640 1 -- 172.21.15.89:0/2641067485 learned_addr learned my addr 172.21.15.89:0/2641067485 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a8e00640 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 0x5597d399bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2aa200640 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 0x5597d399c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a9800640 1 -- 172.21.15.89:0/2641067485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 msgr2=0x5597d399bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a9800640 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 0x5597d399bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a9800640 1 -- 172.21.15.89:0/2641067485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 msgr2=0x5597d399c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a9800640 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 0x5597d399c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a9800640 1 -- 172.21.15.89:0/2641067485 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d377bb70 con 0x5597d38993f0 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2aa200640 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 0x5597d399c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2a9800640 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39d2d20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb29805b3a0 tx=0x7fb29805dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8774af55ddb1c77 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb296000640 1 -- 172.21.15.89:0/2641067485 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29805e130 con 0x5597d38993f0 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb296000640 1 -- 172.21.15.89:0/2641067485 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2980629a0 con 0x5597d38993f0 2024-08-31T04:31:10.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb296000640 1 -- 172.21.15.89:0/2641067485 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298047d60 con 0x5597d38993f0 2024-08-31T04:31:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2641067485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 msgr2=0x5597d39d2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39d2d20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb29805b3a0 tx=0x7fb29805dc40 comp rx=0 tx=0).stop 2024-08-31T04:31:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2641067485 shutdown_connections 2024-08-31T04:31:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 0x5597d399c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 0x5597d399bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2641067485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39d2d20 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2641067485 >> 172.21.15.89:0/2641067485 conn(0x5597d34a0210 msgr2=0x5597d39d5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2641067485 shutdown_connections 2024-08-31T04:31:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2641067485 wait complete. 2024-08-31T04:31:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 -- start start 2024-08-31T04:31:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.234+0000 7fb2b37c7000 1 Processor -- start 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d3878960 0x5597d39d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 0x5597d39d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d38993f0 0x5597d39d2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5597d34a7b10 con 0x5597d3878960 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5597d37676f0 con 0x5597d388ee90 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5597d37e9390 con 0x5597d38993f0 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 10 client.0 _ll_register_callbacks cb 0x5597d3788b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a9800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d3878960 0x5597d39d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a9800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d3878960 0x5597d39d18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52530/0 (socket says 172.21.15.89:52530) 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a9800640 1 -- 172.21.15.89:0/1402336535 learned_addr learned my addr 172.21.15.89:0/1402336535 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a8e00640 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 0x5597d39d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2aa200640 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d38993f0 0x5597d39d2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a9800640 1 -- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d38993f0 msgr2=0x5597d39d2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a9800640 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d38993f0 0x5597d39d2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a9800640 1 -- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 msgr2=0x5597d39d1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a9800640 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 0x5597d39d1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a9800640 1 -- 172.21.15.89:0/1402336535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597d379f380 con 0x5597d3878960 2024-08-31T04:31:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2aa200640 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d38993f0 0x5597d39d2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2a9800640 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d3878960 0x5597d39d18f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb29805b3a0 tx=0x7fb29805a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7716c264120f1f4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb28aa00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb28aa00640 1 -- 172.21.15.89:0/1402336535 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2980673c0 con 0x5597d3878960 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb28aa00640 1 -- 172.21.15.89:0/1402336535 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb298063b30 con 0x5597d3878960 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 1 -- 172.21.15.89:0/1402336535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597d37efd20 con 0x5597d3878960 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb28aa00640 1 -- 172.21.15.89:0/1402336535 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb29805e130 con 0x5597d3878960 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 10 client.5979 fetch_fsmap learned FSMap version 9 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.238+0000 7fb2b37c7000 1 -- 172.21.15.89:0/1402336535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5597d3865e40 con 0x5597d3878960 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb28aa00640 1 -- 172.21.15.89:0/1402336535 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5597d37efd20 con 0x5597d3878960 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb28aa00640 1 -- 172.21.15.89:0/1402336535 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fb29805d390 con 0x5597d3878960 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2b37c7000 10 client.5979 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2b37c7000 10 client.5979 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:31:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2b37c7000 20 client.5979 populate_metadata read hostname 'smithi089' 2024-08-31T04:31:10.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597d3484dc0 0x5597d39ecf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2b37c7000 4 client.5979 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:10.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2b37c7000 1 -- 172.21.15.89:0/1402336535 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597d37f3770 con 0x5597d3484dc0 2024-08-31T04:31:10.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2a8e00640 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597d3484dc0 0x5597d39ecf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2a8e00640 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597d3484dc0 0x5597d39ecf90 crc :-1 s=READY pgs=1205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5410c52961be9753 server_cookie=a0086bca919a7961 in_seq=0 out_seq=0 2024-08-31T04:31:10.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb28aa00640 10 client.5979 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:10.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb28aa00640 1 -- 172.21.15.89:0/1402336535 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597d37f3770 con 0x5597d3484dc0 2024-08-31T04:31:10.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb28aa00640 10 client.5979 handle_command_reply: tid=0 2024-08-31T04:31:10.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2b37c7000 1 client.5979 shutdown 2024-08-31T04:31:10.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2b37c7000 1 -- 172.21.15.89:0/1402336535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d3878960 msgr2=0x5597d39d18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:10.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.242+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d3878960 0x5597d39d18f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb29805b3a0 tx=0x7fb29805a670 comp rx=0 tx=0).stop 2024-08-31T04:31:10.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb2b37c7000 1 -- 172.21.15.89:0/1402336535 shutdown_connections 2024-08-31T04:31:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597d3484dc0 0x5597d39ecf90 crc :-1 s=READY pgs=1205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d38993f0 0x5597d39d2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 0x5597d39d1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb28aa00640 0 client.5979 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/1402336535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d3878960 0x5597d39d18f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb2b37c7000 1 -- 172.21.15.89:0/1402336535 >> 172.21.15.89:0/1402336535 conn(0x5597d34a0210 msgr2=0x5597d39d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb2b37c7000 1 -- 172.21.15.89:0/1402336535 shutdown_connections 2024-08-31T04:31:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb2b37c7000 1 -- 172.21.15.89:0/1402336535 wait complete. 2024-08-31T04:31:10.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.246+0000 7fb2b37c7000 20 client.5979 trim_cache size 0 max 16384 2024-08-31T04:31:10.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.262+0000 7fb2b37c7000 1 Processor -- start 2024-08-31T04:31:10.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.262+0000 7fb2b37c7000 1 -- start start 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 0x5597d399b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 0x5597d399a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d399ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a41e2670 con 0x5597d38993f0 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a41ff620 con 0x5597d3878960 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a41fe8b0 con 0x5597d388ee90 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2aa200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d399ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2aa200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d399ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52540/0 (socket says 172.21.15.89:52540) 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2aa200640 1 -- 172.21.15.89:0/43941080 learned_addr learned my addr 172.21.15.89:0/43941080 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:10.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2a9800640 1 --2- 172.21.15.89:0/43941080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 0x5597d399b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2a8e00640 1 --2- 172.21.15.89:0/43941080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 0x5597d399a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2aa200640 1 -- 172.21.15.89:0/43941080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 msgr2=0x5597d399a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:10.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2aa200640 1 --2- 172.21.15.89:0/43941080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 0x5597d399a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2aa200640 1 -- 172.21.15.89:0/43941080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 msgr2=0x5597d399b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:10.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2aa200640 1 --2- 172.21.15.89:0/43941080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 0x5597d399b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2aa200640 1 -- 172.21.15.89:0/43941080 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d383d5b0 con 0x5597d38993f0 2024-08-31T04:31:10.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2aa200640 1 --2- 172.21.15.89:0/43941080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d399ada0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb29c005e40 tx=0x7fb29c01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2592b162ed57a7d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:10.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb295600640 1 -- 172.21.15.89:0/43941080 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0b5040 con 0x5597d38993f0 2024-08-31T04:31:10.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb295600640 1 -- 172.21.15.89:0/43941080 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb29c004c40 con 0x5597d38993f0 2024-08-31T04:31:10.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb295600640 1 -- 172.21.15.89:0/43941080 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c003980 con 0x5597d38993f0 2024-08-31T04:31:10.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 -- 172.21.15.89:0/43941080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 msgr2=0x5597d399ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:10.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/43941080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d399ada0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb29c005e40 tx=0x7fb29c01c320 comp rx=0 tx=0).stop 2024-08-31T04:31:10.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 -- 172.21.15.89:0/43941080 shutdown_connections 2024-08-31T04:31:10.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/43941080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d399ada0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/43941080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d388ee90 0x5597d399a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/43941080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d3878960 0x5597d399b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 -- 172.21.15.89:0/43941080 >> 172.21.15.89:0/43941080 conn(0x5597d34a0210 msgr2=0x5597d39d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:10.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 -- 172.21.15.89:0/43941080 shutdown_connections 2024-08-31T04:31:10.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 -- 172.21.15.89:0/43941080 wait complete. 2024-08-31T04:31:10.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 -- start start 2024-08-31T04:31:10.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.266+0000 7fb2b37c7000 1 Processor -- start 2024-08-31T04:31:10.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d3878960 0x5597d39eff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 0x5597d39f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5597d3762eb0 con 0x5597d38993f0 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a41fef80 con 0x5597d388ee90 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5597d3788f20 con 0x5597d3878960 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 10 client.0 _ll_register_callbacks cb 0x7fb290015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2aa200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2aa200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52546/0 (socket says 172.21.15.89:52546) 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2a9800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d3878960 0x5597d39eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2aa200640 1 -- 172.21.15.89:0/2957870532 learned_addr learned my addr 172.21.15.89:0/2957870532 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:10.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2a8e00640 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 0x5597d39f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2aa200640 1 -- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d3878960 msgr2=0x5597d39eff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:10.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2aa200640 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d3878960 0x5597d39eff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2aa200640 1 -- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 msgr2=0x5597d39f04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:10.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2aa200640 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 0x5597d39f04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:10.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2aa200640 1 -- 172.21.15.89:0/2957870532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597d3771fc0 con 0x5597d38993f0 2024-08-31T04:31:10.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2aa200640 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39f0a10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0094e0 tx=0x7fb29c003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4606dec041f9f1ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb28aa00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb28aa00640 1 -- 172.21.15.89:0/2957870532 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0ca060 con 0x5597d38993f0 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb28aa00640 1 -- 172.21.15.89:0/2957870532 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb29c005c40 con 0x5597d38993f0 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2957870532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb29c004c40 con 0x5597d38993f0 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb28aa00640 1 -- 172.21.15.89:0/2957870532 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb29c0d0050 con 0x5597d38993f0 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 10 client.5985 fetch_fsmap learned FSMap version 9 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2957870532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5597d376ae00 con 0x5597d38993f0 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb28aa00640 1 -- 172.21.15.89:0/2957870532 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb29c004c40 con 0x5597d38993f0 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb28aa00640 1 -- 172.21.15.89:0/2957870532 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fb29c0d3020 con 0x5597d38993f0 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 10 client.5985 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 10 client.5985 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 20 client.5985 populate_metadata read hostname 'smithi089' 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597d3472e20 0x5597d39f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:10.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 4 client.5985 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-08-31T04:31:10.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2957870532 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x5597d37ef210 con 0x5597d3472e20 2024-08-31T04:31:10.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.270+0000 7fb2a9800640 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597d3472e20 0x5597d39f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:10.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.274+0000 7fb2a9800640 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597d3472e20 0x5597d39f0f50 crc :-1 s=READY pgs=1206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b5bd4b5c666b774 server_cookie=c91b9504bf3dbf93 in_seq=0 out_seq=0 2024-08-31T04:31:10.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:10.274+0000 7fb28aa00640 10 client.5985 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:12.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.906+0000 7fb28aa00640 1 -- 172.21.15.89:0/2957870532 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x5597d37ef210 con 0x5597d3472e20 2024-08-31T04:31:12.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.906+0000 7fb28aa00640 10 client.5985 handle_command_reply: tid=0 2024-08-31T04:31:12.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.906+0000 7fb2b37c7000 1 client.5985 shutdown 2024-08-31T04:31:12.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.910+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2957870532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 msgr2=0x5597d39f0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:12.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.910+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39f0a10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0094e0 tx=0x7fb29c003ec0 comp rx=0 tx=0).stop 2024-08-31T04:31:12.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.910+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2957870532 shutdown_connections 2024-08-31T04:31:12.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.910+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5597d3472e20 0x5597d39f0f50 crc :-1 s=READY pgs=1206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:12.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.910+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5597d38993f0 0x5597d39f0a10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:12.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.910+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5597d388ee90 0x5597d39f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:12.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.910+0000 7fb2b37c7000 1 --2- 172.21.15.89:0/2957870532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5597d3878960 0x5597d39eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:12.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.910+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2957870532 >> 172.21.15.89:0/2957870532 conn(0x5597d34a0210 msgr2=0x5597d39d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:12.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.910+0000 7fb28aa00640 0 client.5985 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.914+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2957870532 shutdown_connections 2024-08-31T04:31:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.918+0000 7fb2b37c7000 1 -- 172.21.15.89:0/2957870532 wait complete. 2024-08-31T04:31:12.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.918+0000 7fb2b37c7000 20 client.5985 trim_cache size 0 max 16384 2024-08-31T04:31:12.920 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 94, 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "eb76f5": { 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 94, 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:31:12.921 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.0, 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:12.922 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:31:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 -- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb2840720c0 msgr2=0x7fb2840745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb2840720c0 0x7fb2840745d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2900058d0 tx=0x7fb290005860 comp rx=0 tx=0).stop 2024-08-31T04:31:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 -- 172.21.15.89:0/3465354646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 msgr2=0x7fb2a4146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 0x7fb2a4146560 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb29800d6a0 tx=0x7fb29800db60 comp rx=0 tx=0).stop 2024-08-31T04:31:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 -- 172.21.15.89:0/3465354646 shutdown_connections 2024-08-31T04:31:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb2840720c0 0x7fb2840745d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2a4152900 0x7fb2a414e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2a40c8260 0x7fb2a414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 --2- 172.21.15.89:0/3465354646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2a40c5cb0 0x7fb2a4146560 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.922+0000 7fb2ac200640 1 -- 172.21.15.89:0/3465354646 >> 172.21.15.89:0/3465354646 conn(0x7fb2a40ca360 msgr2=0x7fb2a40c8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:12.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.926+0000 7fb2ac200640 1 -- 172.21.15.89:0/3465354646 shutdown_connections 2024-08-31T04:31:12.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:12.926+0000 7fb2ac200640 1 -- 172.21.15.89:0/3465354646 wait complete. 2024-08-31T04:31:12.958 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'eb76f5', quiesce took 3.3 seconds. Will release after: 6.7 2024-08-31T04:31:19.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:31:19.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.825+0000 7f6caf400640 1 -- 172.21.15.89:0/1500533381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 msgr2=0x7f6ca80c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.825+0000 7f6caf400640 1 --2- 172.21.15.89:0/1500533381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 0x7f6ca80c8d70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009840 tx=0x7f6c9401f010 comp rx=0 tx=0).stop 2024-08-31T04:31:19.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.825+0000 7f6caf400640 1 -- 172.21.15.89:0/1500533381 shutdown_connections 2024-08-31T04:31:19.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.825+0000 7f6caf400640 1 --2- 172.21.15.89:0/1500533381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 0x7f6ca80c8d70 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.825+0000 7f6caf400640 1 -- 172.21.15.89:0/1500533381 >> 172.21.15.89:0/1500533381 conn(0x7f6ca80ccf20 msgr2=0x7f6ca80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:19.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.825+0000 7f6caf400640 1 -- 172.21.15.89:0/1500533381 shutdown_connections 2024-08-31T04:31:19.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.825+0000 7f6caf400640 1 -- 172.21.15.89:0/1500533381 wait complete. 2024-08-31T04:31:19.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.825+0000 7f6caf400640 1 Processor -- start 2024-08-31T04:31:19.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.825+0000 7f6caf400640 1 -- start start 2024-08-31T04:31:19.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caf400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca8074e20 0x7f6ca8150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caf400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ca80c92b0 0x7f6ca81f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caf400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 0x7f6ca80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caf400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca81599b0 con 0x7f6ca8156e10 2024-08-31T04:31:19.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caf400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca815a2e0 con 0x7f6ca8074e20 2024-08-31T04:31:19.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caf400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca8159c90 con 0x7f6ca80c92b0 2024-08-31T04:31:19.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6cad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 0x7f6ca80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6cad400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 0x7f6ca80cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45390/0 (socket says 172.21.15.89:45390) 2024-08-31T04:31:19.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6cad400640 1 -- 172.21.15.89:0/1128868372 learned_addr learned my addr 172.21.15.89:0/1128868372 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:19.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caca00640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca8074e20 0x7f6ca8150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6ca7e00640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ca80c92b0 0x7f6ca81f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6cad400640 1 -- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ca80c92b0 msgr2=0x7f6ca81f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6cad400640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ca80c92b0 0x7f6ca81f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6cad400640 1 -- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca8074e20 msgr2=0x7f6ca8150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:19.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6cad400640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca8074e20 0x7f6ca8150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:19.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6cad400640 1 -- 172.21.15.89:0/1128868372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca81f5df0 con 0x7f6ca8156e10 2024-08-31T04:31:19.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caca00640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca8074e20 0x7f6ca8150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:19.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6cad400640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 0x7f6ca80cbf40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000c740 tx=0x7f6ca000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:19.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6ca4c00640 1 -- 172.21.15.89:0/1128868372 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0003b80 con 0x7f6ca8156e10 2024-08-31T04:31:19.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6ca4c00640 1 -- 172.21.15.89:0/1128868372 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ca000ce50 con 0x7f6ca8156e10 2024-08-31T04:31:19.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6ca4c00640 1 -- 172.21.15.89:0/1128868372 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000a850 con 0x7f6ca8156e10 2024-08-31T04:31:19.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca80b1e20 con 0x7f6ca8156e10 2024-08-31T04:31:19.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca81551a0 con 0x7f6ca8156e10 2024-08-31T04:31:19.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.829+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca81553e0 con 0x7f6ca8156e10 2024-08-31T04:31:19.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.833+0000 7f6ca4c00640 1 -- 172.21.15.89:0/1128868372 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6ca000a9f0 con 0x7f6ca8156e10 2024-08-31T04:31:19.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.833+0000 7f6ca4c00640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6c880720c0 0x7f6c880745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:19.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.833+0000 7f6ca4c00640 1 -- 172.21.15.89:0/1128868372 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f6ca0092e20 con 0x7f6ca8156e10 2024-08-31T04:31:19.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.833+0000 7f6caca00640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6c880720c0 0x7f6c880745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:19.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.833+0000 7f6caca00640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6c880720c0 0x7f6c880745d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c000f70 tx=0x7f6c9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:19.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:19.837+0000 7f6ca4c00640 1 -- 172.21.15.89:0/1128868372 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6ca81553e0 con 0x7f6ca8156e10 2024-08-31T04:31:20.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ca8074c00 con 0x7f6ca8156e10 2024-08-31T04:31:20.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6ca4c00640 1 -- 172.21.15.89:0/1128868372 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f6ca005e300 con 0x7f6ca8156e10 2024-08-31T04:31:20.043 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:31:20.043 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:31:20.043 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:31:20.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6c880720c0 msgr2=0x7f6c880745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6c880720c0 0x7f6c880745d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c000f70 tx=0x7f6c9c009040 comp rx=0 tx=0).stop 2024-08-31T04:31:20.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 msgr2=0x7f6ca80cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 0x7f6ca80cbf40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000c740 tx=0x7f6ca000cc00 comp rx=0 tx=0).stop 2024-08-31T04:31:20.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 shutdown_connections 2024-08-31T04:31:20.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6c880720c0 0x7f6c880745d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca8156e10 0x7f6ca80cbf40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ca80c92b0 0x7f6ca81f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 --2- 172.21.15.89:0/1128868372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ca8074e20 0x7f6ca8150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 >> 172.21.15.89:0/1128868372 conn(0x7f6ca80ccf20 msgr2=0x7f6ca80c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:20.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 shutdown_connections 2024-08-31T04:31:20.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.041+0000 7f6caf400640 1 -- 172.21.15.89:0/1128868372 wait complete. 2024-08-31T04:31:20.065 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id eb76f5 --release --await' 2024-08-31T04:31:20.065 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id eb76f5 --release --await 2024-08-31T04:31:20.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 -- 172.21.15.89:0/10228853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 msgr2=0x7f69780747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 --2- 172.21.15.89:0/10228853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 0x7f69780747b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f69780cdf70 tx=0x7f697001ccc0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 -- 172.21.15.89:0/10228853 shutdown_connections 2024-08-31T04:31:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 --2- 172.21.15.89:0/10228853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 0x7f69780747b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 --2- 172.21.15.89:0/10228853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69780c1ed0 0x7f6978152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 --2- 172.21.15.89:0/10228853 >> v2:172.21.15.170:3300/0 conn(0x7f69780b2860 0x7f69780b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 -- 172.21.15.89:0/10228853 >> 172.21.15.89:0/10228853 conn(0x7f69780c99b0 msgr2=0x7f69780c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 -- 172.21.15.89:0/10228853 shutdown_connections 2024-08-31T04:31:20.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 -- 172.21.15.89:0/10228853 wait complete. 2024-08-31T04:31:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 Processor -- start 2024-08-31T04:31:20.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.225+0000 7f697f400640 1 -- start start 2024-08-31T04:31:20.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69780b2860 0x7f697815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697f400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69780c1ed0 0x7f697814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 0x7f6978146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697f400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f69780c32e0 con 0x7f69780c90e0 2024-08-31T04:31:20.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697f400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f69780c3160 con 0x7f69780b2860 2024-08-31T04:31:20.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697f400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f69781585d0 con 0x7f69780c1ed0 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 0x7f6978146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 0x7f6978146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45414/0 (socket says 172.21.15.89:45414) 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697d400640 1 -- 172.21.15.89:0/2648102255 learned_addr learned my addr 172.21.15.89:0/2648102255 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f696fe00640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69780c1ed0 0x7f697814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697ca00640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69780b2860 0x7f697815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697d400640 1 -- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69780c1ed0 msgr2=0x7f697814f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697d400640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69780c1ed0 0x7f697814f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697d400640 1 -- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69780b2860 msgr2=0x7f697815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697d400640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69780b2860 0x7f697815a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697d400640 1 -- 172.21.15.89:0/2648102255 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697815af00 con 0x7f69780c90e0 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f696fe00640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69780c1ed0 0x7f697814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697ca00640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69780b2860 0x7f697815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:20.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697d400640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 0x7f6978146820 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f697001b370 tx=0x7f6970005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:20.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f6975600640 1 -- 172.21.15.89:0/2648102255 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69700bc070 con 0x7f69780c90e0 2024-08-31T04:31:20.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f6975600640 1 -- 172.21.15.89:0/2648102255 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69700042f0 con 0x7f69780c90e0 2024-08-31T04:31:20.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f6975600640 1 -- 172.21.15.89:0/2648102255 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69700b2040 con 0x7f69780c90e0 2024-08-31T04:31:20.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697f400640 1 -- 172.21.15.89:0/2648102255 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69780cb8d0 con 0x7f69780c90e0 2024-08-31T04:31:20.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.229+0000 7f697f400640 1 -- 172.21.15.89:0/2648102255 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69780cbe90 con 0x7f69780c90e0 2024-08-31T04:31:20.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6975600640 1 -- 172.21.15.89:0/2648102255 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f69700bf070 con 0x7f69780c90e0 2024-08-31T04:31:20.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6975600640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69540720c0 0x7f69540745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6975600640 1 -- 172.21.15.89:0/2648102255 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f697012d030 con 0x7f69780c90e0 2024-08-31T04:31:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6986c59000 1 Processor -- start 2024-08-31T04:31:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f697ca00640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69540720c0 0x7f69540745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6986c59000 1 -- start start 2024-08-31T04:31:20.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f697ca00640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69540720c0 0x7f69540745d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f696800bbd0 tx=0x7f696800b5b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6986c59000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 0x55c4c37dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6986c59000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37e4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6986c59000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 0x55c4c37e5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6986c59000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c4c368af30 con 0x55c4c36ab930 2024-08-31T04:31:20.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6986c59000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c4c3600690 con 0x55c4c36c1950 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f6986c59000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c4c35efc20 con 0x55c4c369c890 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f696fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37e4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f696fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37e4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45422/0 (socket says 172.21.15.89:45422) 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f696fe00640 1 -- 172.21.15.89:0/1488333839 learned_addr learned my addr 172.21.15.89:0/1488333839 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f697ca00640 1 --2- 172.21.15.89:0/1488333839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 0x55c4c37dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.233+0000 7f697d400640 1 --2- 172.21.15.89:0/1488333839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 0x55c4c37e5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f696fe00640 1 -- 172.21.15.89:0/1488333839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 msgr2=0x55c4c37e5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f696fe00640 1 --2- 172.21.15.89:0/1488333839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 0x55c4c37e5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f696fe00640 1 -- 172.21.15.89:0/1488333839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 msgr2=0x55c4c37dfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f696fe00640 1 --2- 172.21.15.89:0/1488333839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 0x55c4c37dfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f696fe00640 1 -- 172.21.15.89:0/1488333839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c35a48f0 con 0x55c4c36ab930 2024-08-31T04:31:20.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f696fe00640 1 --2- 172.21.15.89:0/1488333839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37e4ad0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f696000db80 tx=0x7f696000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ec04a1dc9c0b38 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f696d200640 1 -- 172.21.15.89:0/1488333839 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696000de70 con 0x55c4c36ab930 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f696d200640 1 -- 172.21.15.89:0/1488333839 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6960011440 con 0x55c4c36ab930 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f696d200640 1 -- 172.21.15.89:0/1488333839 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960011870 con 0x55c4c36ab930 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 -- 172.21.15.89:0/1488333839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 msgr2=0x55c4c37e4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 --2- 172.21.15.89:0/1488333839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37e4ad0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f696000db80 tx=0x7f696000f730 comp rx=0 tx=0).stop 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 -- 172.21.15.89:0/1488333839 shutdown_connections 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 --2- 172.21.15.89:0/1488333839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37e4ad0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 --2- 172.21.15.89:0/1488333839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 0x55c4c37e5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 --2- 172.21.15.89:0/1488333839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 0x55c4c37dfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 -- 172.21.15.89:0/1488333839 >> 172.21.15.89:0/1488333839 conn(0x55c4c36c1540 msgr2=0x55c4c37e2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 -- 172.21.15.89:0/1488333839 shutdown_connections 2024-08-31T04:31:20.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 -- 172.21.15.89:0/1488333839 wait complete. 2024-08-31T04:31:20.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 -- start start 2024-08-31T04:31:20.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.237+0000 7f6986c59000 1 Processor -- start 2024-08-31T04:31:20.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 0x55c4c37df030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37df570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 0x55c4c37e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c4c3576500 con 0x55c4c36ab930 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c4c35f3bd0 con 0x55c4c36c1950 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c4c3597a30 con 0x55c4c369c890 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 10 client.0 _ll_register_callbacks cb 0x55c4c36a5b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f696fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37df570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f696fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37df570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45428/0 (socket says 172.21.15.89:45428) 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f696fe00640 1 -- 172.21.15.89:0/848927117 learned_addr learned my addr 172.21.15.89:0/848927117 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f697ca00640 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 0x55c4c37df030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f697d400640 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 0x55c4c37e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f696fe00640 1 -- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 msgr2=0x55c4c37df030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f696fe00640 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 0x55c4c37df030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f696fe00640 1 -- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 msgr2=0x55c4c37e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:20.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f696fe00640 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 0x55c4c37e9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f696fe00640 1 -- 172.21.15.89:0/848927117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c358f6a0 con 0x55c4c36ab930 2024-08-31T04:31:20.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f696fe00640 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37df570 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f696000fc30 tx=0x7f696000df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ba8f5f5f4bb875 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:20.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6965600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:31:20.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6965600640 1 -- 172.21.15.89:0/848927117 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960012960 con 0x55c4c36ab930 2024-08-31T04:31:20.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 -- 172.21.15.89:0/848927117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c4c35897e0 con 0x55c4c36ab930 2024-08-31T04:31:20.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6965600640 1 -- 172.21.15.89:0/848927117 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f6960012b00 con 0x55c4c36ab930 2024-08-31T04:31:20.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6965600640 1 -- 172.21.15.89:0/848927117 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f696002e050 con 0x55c4c36ab930 2024-08-31T04:31:20.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 10 client.6006 fetch_fsmap learned FSMap version 9 2024-08-31T04:31:20.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 -- 172.21.15.89:0/848927117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c4c35ae1c0 con 0x55c4c36ab930 2024-08-31T04:31:20.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6965600640 1 -- 172.21.15.89:0/848927117 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c4c35897e0 con 0x55c4c36ab930 2024-08-31T04:31:20.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6965600640 1 -- 172.21.15.89:0/848927117 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f6960026450 con 0x55c4c36ab930 2024-08-31T04:31:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 10 client.6006 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:31:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 10 client.6006 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:31:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 20 client.6006 populate_metadata read hostname 'smithi089' 2024-08-31T04:31:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c4c3685fc0 0x55c4c37ea970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 4 client.6006 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6986c59000 1 -- 172.21.15.89:0/848927117 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4c36025e0 con 0x55c4c3685fc0 2024-08-31T04:31:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f697ca00640 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c4c3685fc0 0x55c4c37ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f697ca00640 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c4c3685fc0 0x55c4c37ea970 crc :-1 s=READY pgs=1218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7659fcb4428c0c2 server_cookie=b2437bd18fe0c31a in_seq=0 out_seq=0 2024-08-31T04:31:20.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.241+0000 7f6965600640 10 client.6006 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:20.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6965600640 1 -- 172.21.15.89:0/848927117 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c4c36025e0 con 0x55c4c3685fc0 2024-08-31T04:31:20.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6965600640 10 client.6006 handle_command_reply: tid=0 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 client.6006 shutdown 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 -- 172.21.15.89:0/848927117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 msgr2=0x55c4c37df570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37df570 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f696000fc30 tx=0x7f696000df10 comp rx=0 tx=0).stop 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 -- 172.21.15.89:0/848927117 shutdown_connections 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c4c3685fc0 0x55c4c37ea970 crc :-1 s=READY pgs=1218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37df570 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c36c1950 0x55c4c37e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6965600640 0 client.6006 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 --2- 172.21.15.89:0/848927117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c369c890 0x55c4c37df030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 -- 172.21.15.89:0/848927117 >> 172.21.15.89:0/848927117 conn(0x55c4c36c1540 msgr2=0x55c4c37e0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 -- 172.21.15.89:0/848927117 shutdown_connections 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 1 -- 172.21.15.89:0/848927117 wait complete. 2024-08-31T04:31:20.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.245+0000 7f6986c59000 20 client.6006 trim_cache size 0 max 16384 2024-08-31T04:31:20.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.261+0000 7f6986c59000 1 Processor -- start 2024-08-31T04:31:20.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 -- start start 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 0x55c4c37ff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 0x55c4c37f8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f69782042a0 con 0x55c4c36ab930 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6978203180 con 0x55c4c369c890 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6978201770 con 0x55c4c36c1950 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f696fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f696fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45432/0 (socket says 172.21.15.89:45432) 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f696fe00640 1 -- 172.21.15.89:0/391724985 learned_addr learned my addr 172.21.15.89:0/391724985 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f697d400640 1 --2- 172.21.15.89:0/391724985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 0x55c4c37f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f697ca00640 1 --2- 172.21.15.89:0/391724985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 0x55c4c37ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f696fe00640 1 -- 172.21.15.89:0/391724985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 msgr2=0x55c4c37f8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f696fe00640 1 --2- 172.21.15.89:0/391724985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 0x55c4c37f8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f696fe00640 1 -- 172.21.15.89:0/391724985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 msgr2=0x55c4c37ff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f696fe00640 1 --2- 172.21.15.89:0/391724985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 0x55c4c37ff600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f696fe00640 1 -- 172.21.15.89:0/391724985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c37e9f40 con 0x55c4c36ab930 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f696fe00640 1 --2- 172.21.15.89:0/391724985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f696000d760 tx=0x7f696000d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5a9796cdc2d7db server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6967e00640 1 -- 172.21.15.89:0/391724985 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696000dc70 con 0x55c4c36ab930 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6967e00640 1 -- 172.21.15.89:0/391724985 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f696002b070 con 0x55c4c36ab930 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6967e00640 1 -- 172.21.15.89:0/391724985 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960012030 con 0x55c4c36ab930 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 -- 172.21.15.89:0/391724985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 msgr2=0x55c4c37ffb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 --2- 172.21.15.89:0/391724985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f696000d760 tx=0x7f696000d4c0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 -- 172.21.15.89:0/391724985 shutdown_connections 2024-08-31T04:31:20.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 --2- 172.21.15.89:0/391724985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 --2- 172.21.15.89:0/391724985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 0x55c4c37f8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 --2- 172.21.15.89:0/391724985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 0x55c4c37ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 -- 172.21.15.89:0/391724985 >> 172.21.15.89:0/391724985 conn(0x55c4c36c1540 msgr2=0x55c4c37a0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:20.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 -- 172.21.15.89:0/391724985 shutdown_connections 2024-08-31T04:31:20.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.265+0000 7f6986c59000 1 -- 172.21.15.89:0/391724985 wait complete. 2024-08-31T04:31:20.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6986c59000 1 -- start start 2024-08-31T04:31:20.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6986c59000 1 Processor -- start 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6986c59000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 0x55c4c37ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6986c59000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6986c59000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 0x55c4c37fe950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6986c59000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6978201d10 con 0x55c4c36ab930 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6986c59000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6978202ab0 con 0x55c4c369c890 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6986c59000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f69782023e0 con 0x55c4c36c1950 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6986c59000 10 client.0 _ll_register_callbacks cb 0x7f6960015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f696fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f696fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45440/0 (socket says 172.21.15.89:45440) 2024-08-31T04:31:20.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f696fe00640 1 -- 172.21.15.89:0/3703857277 learned_addr learned my addr 172.21.15.89:0/3703857277 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:20.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f697d400640 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 0x55c4c37fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f697ca00640 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 0x55c4c37ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f696fe00640 1 -- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 msgr2=0x55c4c37fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:20.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f696fe00640 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 0x55c4c37fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f696fe00640 1 -- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 msgr2=0x55c4c37ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:20.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f696fe00640 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 0x55c4c37ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f696fe00640 1 -- 172.21.15.89:0/3703857277 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c36742f0 con 0x55c4c36ab930 2024-08-31T04:31:20.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f696fe00640 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6960026830 tx=0x7f6960005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a4eb4ad0167f48 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:20.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.269+0000 7f6965600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6965600640 1 -- 172.21.15.89:0/3703857277 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960012240 con 0x55c4c36ab930 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6965600640 1 -- 172.21.15.89:0/3703857277 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f6960005020 con 0x55c4c36ab930 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6986c59000 1 -- 172.21.15.89:0/3703857277 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f696002b070 con 0x55c4c36ab930 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6965600640 1 -- 172.21.15.89:0/3703857277 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f6960005240 con 0x55c4c36ab930 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6986c59000 10 client.6012 fetch_fsmap learned FSMap version 9 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6986c59000 1 -- 172.21.15.89:0/3703857277 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c4c3579b30 con 0x55c4c36ab930 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6965600640 1 -- 172.21.15.89:0/3703857277 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f696002b070 con 0x55c4c36ab930 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6965600640 1 -- 172.21.15.89:0/3703857277 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f69600053e0 con 0x55c4c36ab930 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6986c59000 10 client.6012 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6986c59000 10 client.6012 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6986c59000 20 client.6012 populate_metadata read hostname 'smithi089' 2024-08-31T04:31:20.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6986c59000 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c4c3281e80 0x55c4c37fee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:20.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6986c59000 4 client.6012 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "eb76f5", "release": true, "await": true}] 2024-08-31T04:31:20.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6986c59000 1 -- 172.21.15.89:0/3703857277 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "eb76f5", "release": true, "await": true}) -- 0x55c4c35fe080 con 0x55c4c3281e80 2024-08-31T04:31:20.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f697ca00640 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c4c3281e80 0x55c4c37fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:20.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f697ca00640 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c4c3281e80 0x55c4c37fee90 crc :-1 s=READY pgs=1219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd892bc09b0d8a76 server_cookie=4eb8540c144bc6d0 in_seq=0 out_seq=0 2024-08-31T04:31:20.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.273+0000 7f6965600640 10 client.6012 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6965600640 1 -- 172.21.15.89:0/3703857277 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55c4c35fe080 con 0x55c4c3281e80 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6965600640 10 client.6012 handle_command_reply: tid=0 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 client.6012 shutdown 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 -- 172.21.15.89:0/3703857277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 msgr2=0x55c4c37ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6960026830 tx=0x7f6960005f20 comp rx=0 tx=0).stop 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 -- 172.21.15.89:0/3703857277 shutdown_connections 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c4c3281e80 0x55c4c37fee90 crc :-1 s=READY pgs=1219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c4c36ab930 0x55c4c37ffb30 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c4c36c1950 0x55c4c37fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 --2- 172.21.15.89:0/3703857277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c4c369c890 0x55c4c37ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6965600640 0 client.6012 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 -- 172.21.15.89:0/3703857277 >> 172.21.15.89:0/3703857277 conn(0x55c4c36c1540 msgr2=0x55c4c379f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 -- 172.21.15.89:0/3703857277 shutdown_connections 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 1 -- 172.21.15.89:0/3703857277 wait complete. 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.437+0000 7f6986c59000 20 client.6012 trim_cache size 0 max 16384 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 96, 2024-08-31T04:31:20.443 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "eb76f5": { 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 96, 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.0, 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:31:20.444 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:31:20.445 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:31:20.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:20.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:20.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:20.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:20.445 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:20.445 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 -- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69540720c0 msgr2=0x7f69540745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69540720c0 0x7f69540745d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f696800bbd0 tx=0x7f696800b5b0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 -- 172.21.15.89:0/2648102255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 msgr2=0x7f6978146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 0x7f6978146820 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f697001b370 tx=0x7f6970005b10 comp rx=0 tx=0).stop 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 -- 172.21.15.89:0/2648102255 shutdown_connections 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f69540720c0 0x7f69540745d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69780c90e0 0x7f6978146820 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f69780c1ed0 0x7f697814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 --2- 172.21.15.89:0/2648102255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69780b2860 0x7f697815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 -- 172.21.15.89:0/2648102255 >> 172.21.15.89:0/2648102255 conn(0x7f69780c99b0 msgr2=0x7f6978157af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:20.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 -- 172.21.15.89:0/2648102255 shutdown_connections 2024-08-31T04:31:20.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:20.441+0000 7f697f400640 1 -- 172.21.15.89:0/2648102255 wait complete. 2024-08-31T04:31:20.462 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'eb76f5', total seconds elapsed: 10.8 2024-08-31T04:31:21.751 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 30% (118/386) Updating files: 31% (120/386) Updating files: 32% (124/386) Updating files: 33% (128/386) Updating files: 34% (132/386) Updating files: 35% (136/386) Updating files: 36% (139/386) Updating files: 37% (143/386) Updating files: 38% (147/386) Updating files: 39% (151/386) Updating files: 40% (155/386) Updating files: 41% (159/386) Updating files: 42% (163/386) Updating files: 43% (166/386) Updating files: 44% (170/386) Updating files: 45% (174/386) Updating files: 46% (178/386) Updating files: 47% (182/386) Updating files: 48% (186/386) Updating files: 49% (190/386) Updating files: 50% (193/386) Updating files: 51% (197/386) Updating files: 52% (201/386) Updating files: 53% (205/386) Updating files: 53% (206/386) Updating files: 54% (209/386) Updating files: 55% (213/386) Updating files: 56% (217/386) Updating files: 57% (221/386) Updating files: 58% (224/386) Updating files: 59% (228/386) Updating files: 60% (232/386) Updating files: 61% (236/386) Updating files: 62% (240/386) Updating files: 63% (244/386) Updating files: 63% (247/386) Updating files: 64% (248/386) Updating files: 65% (251/386) Updating files: 66% (255/386) Updating files: 67% (259/386) Updating files: 68% (263/386) Updating files: 69% (267/386) Updating files: 70% (271/386) Updating files: 71% (275/386) Updating files: 72% (278/386) Updating files: 73% (282/386) Updating files: 73% (285/386) Updating files: 74% (286/386) Updating files: 74% (287/386) Updating files: 75% (290/386) Updating files: 76% (294/386) Updating files: 77% (298/386) Updating files: 78% (302/386) Updating files: 79% (305/386) Updating files: 80% (309/386) Updating files: 81% (313/386) Updating files: 82% (317/386) Updating files: 83% (321/386) Updating files: 84% (325/386) Updating files: 85% (329/386) Updating files: 86% (332/386) Updating files: 87% (336/386) Updating files: 88% (340/386) Updating files: 89% (344/386) Updating files: 89% (347/386) Updating files: 90% (348/386) Updating files: 91% (352/386) Updating files: 92% (356/386) Updating files: 93% (359/386) Updating files: 94% (363/386) Updating files: 95% (367/386) Updating files: 96% (371/386) Updating files: 97% (375/386) Updating files: 98% (379/386) Updating files: 99% (383/386) Updating files: 100% (386/386) Updating files: 100% (386/386), done. 2024-08-31T04:31:22.473 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 2528b5ee105 v0.43 2024-08-31T04:31:22.553 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.53 2024-08-31T04:31:22.582 INFO:tasks.workunit.client.0.smithi089.stdout:v0.54 2024-08-31T04:31:22.582 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 54 -eq 48 ] 2024-08-31T04:31:22.582 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.54 2024-08-31T04:31:22.582 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.54 2024-08-31T04:31:22.582 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.54 2024-08-31T04:31:24.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:31:24.525 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:31:33.480 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 16% (35/212) Updating files: 17% (37/212) Updating files: 18% (39/212) Updating files: 19% (41/212) Updating files: 20% (43/212) Updating files: 21% (45/212) Updating files: 22% (47/212) Updating files: 23% (49/212) Updating files: 24% (51/212) Updating files: 25% (53/212) Updating files: 26% (56/212) Updating files: 27% (58/212) Updating files: 28% (60/212) Updating files: 29% (62/212) Updating files: 30% (64/212) Updating files: 31% (66/212) Updating files: 32% (68/212) Updating files: 33% (70/212) Updating files: 34% (73/212) Updating files: 35% (75/212) Updating files: 36% (77/212) Updating files: 37% (79/212) Updating files: 38% (81/212) Updating files: 39% (83/212) Updating files: 40% (85/212) Updating files: 41% (87/212) Updating files: 42% (90/212) Updating files: 43% (92/212) Updating files: 44% (94/212) Updating files: 45% (96/212) Updating files: 46% (98/212) Updating files: 47% (100/212) Updating files: 48% (102/212) Updating files: 49% (104/212) Updating files: 50% (106/212) Updating files: 51% (109/212) Updating files: 52% (111/212) Updating files: 53% (113/212) Updating files: 54% (115/212) Updating files: 55% (117/212) Updating files: 56% (119/212) Updating files: 57% (121/212) Updating files: 57% (122/212) Updating files: 58% (123/212) Updating files: 59% (126/212) Updating files: 60% (128/212) Updating files: 61% (130/212) Updating files: 62% (132/212) Updating files: 63% (134/212) Updating files: 64% (136/212) Updating files: 65% (138/212) Updating files: 66% (140/212) Updating files: 67% (143/212) Updating files: 68% (145/212) Updating files: 69% (147/212) Updating files: 70% (149/212) Updating files: 71% (151/212) Updating files: 72% (153/212) Updating files: 73% (155/212) Updating files: 74% (157/212) Updating files: 75% (159/212) Updating files: 76% (162/212) Updating files: 77% (164/212) Updating files: 78% (166/212) Updating files: 79% (168/212) Updating files: 80% (170/212) Updating files: 81% (172/212) Updating files: 82% (174/212) Updating files: 82% (175/212) Updating files: 83% (176/212) Updating files: 84% (179/212) Updating files: 85% (181/212) Updating files: 86% (183/212) Updating files: 87% (185/212) Updating files: 88% (187/212) Updating files: 89% (189/212) Updating files: 90% (191/212) Updating files: 91% (193/212) Updating files: 92% (196/212) Updating files: 93% (198/212) Updating files: 94% (200/212) Updating files: 95% (202/212) Updating files: 96% (204/212) Updating files: 97% (206/212) Updating files: 98% (208/212) Updating files: 99% (210/212) Updating files: 100% (212/212) Updating files: 100% (212/212), done. 2024-08-31T04:31:34.581 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 60b84b095b1 v0.54 2024-08-31T04:31:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.54 2024-08-31T04:31:34.616 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 55 -eq 48 ] 2024-08-31T04:31:34.617 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.55 2024-08-31T04:31:34.617 INFO:tasks.workunit.client.0.smithi089.stdout:v0.55 2024-08-31T04:31:34.617 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.55 2024-08-31T04:31:34.617 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.55 2024-08-31T04:31:39.035 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.8 2024-08-31T04:31:39.035 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:31:39.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.293+0000 7f841e800640 1 -- 172.21.15.89:0/1890098911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 msgr2=0x7f84180cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.293+0000 7f841e800640 1 --2- 172.21.15.89:0/1890098911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 0x7f84180cee10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8410009c80 tx=0x7f841001f5a0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.293+0000 7f841e800640 1 -- 172.21.15.89:0/1890098911 shutdown_connections 2024-08-31T04:31:39.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.293+0000 7f841e800640 1 --2- 172.21.15.89:0/1890098911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 0x7f84180cee10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.293+0000 7f841e800640 1 --2- 172.21.15.89:0/1890098911 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84180ca0e0 0x7f84180c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.293+0000 7f841e800640 1 -- 172.21.15.89:0/1890098911 >> 172.21.15.89:0/1890098911 conn(0x7f841806cc30 msgr2=0x7f841806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:39.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.293+0000 7f841e800640 1 -- 172.21.15.89:0/1890098911 shutdown_connections 2024-08-31T04:31:39.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.293+0000 7f841e800640 1 -- 172.21.15.89:0/1890098911 wait complete. 2024-08-31T04:31:39.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841e800640 1 Processor -- start 2024-08-31T04:31:39.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841e800640 1 -- start start 2024-08-31T04:31:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84180ca0e0 0x7f84181e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841e800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84180ca930 0x7f84181f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 0x7f84181495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841e800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f84180b1c90 con 0x7f841815d9f0 2024-08-31T04:31:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841e800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f841815d4d0 con 0x7f84180ca0e0 2024-08-31T04:31:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841e800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f841815a920 con 0x7f84180ca930 2024-08-31T04:31:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 0x7f84181495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841ca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84180ca930 0x7f84181f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 0x7f84181495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38924/0 (socket says 172.21.15.89:38924) 2024-08-31T04:31:39.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841de00640 1 -- 172.21.15.89:0/394460601 learned_addr learned my addr 172.21.15.89:0/394460601 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:39.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841d400640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84180ca0e0 0x7f84181e7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841de00640 1 -- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84180ca930 msgr2=0x7f84181f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841de00640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84180ca930 0x7f84181f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841de00640 1 -- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84180ca0e0 msgr2=0x7f84181e7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841de00640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84180ca0e0 0x7f84181e7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841de00640 1 -- 172.21.15.89:0/394460601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84181f5e70 con 0x7f841815d9f0 2024-08-31T04:31:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841ca00640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84180ca930 0x7f84181f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f841de00640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 0x7f84181495a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8410009bd0 tx=0x7f84100092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:39.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.297+0000 7f8415600640 1 -- 172.21.15.89:0/394460601 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410004a50 con 0x7f841815d9f0 2024-08-31T04:31:39.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.301+0000 7f8415600640 1 -- 172.21.15.89:0/394460601 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8410004ce0 con 0x7f841815d9f0 2024-08-31T04:31:39.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.301+0000 7f8415600640 1 -- 172.21.15.89:0/394460601 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100afb00 con 0x7f841815d9f0 2024-08-31T04:31:39.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.301+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84181e73a0 con 0x7f841815d9f0 2024-08-31T04:31:39.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.301+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841806fcf0 con 0x7f841815d9f0 2024-08-31T04:31:39.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.301+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84180ca5e0 con 0x7f841815d9f0 2024-08-31T04:31:39.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.301+0000 7f8415600640 1 -- 172.21.15.89:0/394460601 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f84100afca0 con 0x7f841815d9f0 2024-08-31T04:31:39.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.301+0000 7f8415600640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83f80720c0 0x7f83f80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.301+0000 7f8415600640 1 -- 172.21.15.89:0/394460601 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8410131720 con 0x7f841815d9f0 2024-08-31T04:31:39.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.301+0000 7f841d400640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83f80720c0 0x7f83f80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.305+0000 7f841d400640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83f80720c0 0x7f83f80745d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f840c007fd0 tx=0x7f840c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:39.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.305+0000 7f8415600640 1 -- 172.21.15.89:0/394460601 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f84100ca030 con 0x7f841815d9f0 2024-08-31T04:31:39.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.513+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84180cb220 con 0x7f841815d9f0 2024-08-31T04:31:39.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.513+0000 7f8415600640 1 -- 172.21.15.89:0/394460601 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f84100ac050 con 0x7f841815d9f0 2024-08-31T04:31:39.517 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:31:39.517 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:31:39.517 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83f80720c0 msgr2=0x7f83f80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83f80720c0 0x7f83f80745d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f840c007fd0 tx=0x7f840c009040 comp rx=0 tx=0).stop 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 msgr2=0x7f84181495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 0x7f84181495a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8410009bd0 tx=0x7f84100092c0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 shutdown_connections 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f83f80720c0 0x7f83f80745d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f841815d9f0 0x7f84181495a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84180ca930 0x7f84181f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 --2- 172.21.15.89:0/394460601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84180ca0e0 0x7f84181e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 >> 172.21.15.89:0/394460601 conn(0x7f841806cc30 msgr2=0x7f8418159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:39.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 shutdown_connections 2024-08-31T04:31:39.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.517+0000 7f841e800640 1 -- 172.21.15.89:0/394460601 wait complete. 2024-08-31T04:31:39.538 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 150.8 --await-for 45.0' 2024-08-31T04:31:39.539 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 150.8 --await-for 45.0 2024-08-31T04:31:39.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.701+0000 7f261d600640 1 -- 172.21.15.89:0/1801879949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26180b2860 msgr2=0x7f26180b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.701+0000 7f261d600640 1 --2- 172.21.15.89:0/1801879949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26180b2860 0x7f26180b2d20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2608009900 tx=0x7f260801c820 comp rx=0 tx=0).stop 2024-08-31T04:31:39.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.701+0000 7f261d600640 1 -- 172.21.15.89:0/1801879949 shutdown_connections 2024-08-31T04:31:39.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.701+0000 7f261d600640 1 --2- 172.21.15.89:0/1801879949 >> v2:172.21.15.170:3300/0 conn(0x7f26180c1ed0 0x7f2618152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.701+0000 7f261d600640 1 --2- 172.21.15.89:0/1801879949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26180b2860 0x7f26180b2d20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.701+0000 7f261d600640 1 -- 172.21.15.89:0/1801879949 >> 172.21.15.89:0/1801879949 conn(0x7f26180c99b0 msgr2=0x7f26180c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:39.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.701+0000 7f261d600640 1 -- 172.21.15.89:0/1801879949 shutdown_connections 2024-08-31T04:31:39.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.701+0000 7f261d600640 1 -- 172.21.15.89:0/1801879949 wait complete. 2024-08-31T04:31:39.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f261d600640 1 Processor -- start 2024-08-31T04:31:39.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f261d600640 1 -- start start 2024-08-31T04:31:39.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f261d600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26180b2860 0x7f2618148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f261d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26180c1ed0 0x7f26181f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f261d600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26180c90e0 0x7f2618142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f261d600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f26180c32e0 con 0x7f26180c90e0 2024-08-31T04:31:39.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f261d600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f26180c3160 con 0x7f26180c1ed0 2024-08-31T04:31:39.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f261d600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2618074ec0 con 0x7f26180b2860 2024-08-31T04:31:39.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2617400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26180c90e0 0x7f2618142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2617400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26180c90e0 0x7f2618142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38932/0 (socket says 172.21.15.89:38932) 2024-08-31T04:31:39.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2617400640 1 -- 172.21.15.89:0/330925244 learned_addr learned my addr 172.21.15.89:0/330925244 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:39.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2616000640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26180c1ed0 0x7f26181f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2616a00640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26180b2860 0x7f2618148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2617400640 1 -- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26180b2860 msgr2=0x7f2618148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2617400640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26180b2860 0x7f2618148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2617400640 1 -- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26180c1ed0 msgr2=0x7f26181f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2617400640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26180c1ed0 0x7f26181f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2617400640 1 -- 172.21.15.89:0/330925244 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26181485a0 con 0x7f26180c90e0 2024-08-31T04:31:39.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.705+0000 7f2617400640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26180c90e0 0x7f2618142770 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f261000c730 tx=0x7f261000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:39.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.709+0000 7f260ea00640 1 -- 172.21.15.89:0/330925244 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610003ba0 con 0x7f26180c90e0 2024-08-31T04:31:39.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.709+0000 7f260ea00640 1 -- 172.21.15.89:0/330925244 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2610003d60 con 0x7f26180c90e0 2024-08-31T04:31:39.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.709+0000 7f260ea00640 1 -- 172.21.15.89:0/330925244 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610005330 con 0x7f26180c90e0 2024-08-31T04:31:39.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.709+0000 7f261d600640 1 -- 172.21.15.89:0/330925244 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26180cc840 con 0x7f26180c90e0 2024-08-31T04:31:39.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.709+0000 7f261d600640 1 -- 172.21.15.89:0/330925244 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2618147b40 con 0x7f26180c90e0 2024-08-31T04:31:39.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.709+0000 7f260ea00640 1 -- 172.21.15.89:0/330925244 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f26100056e0 con 0x7f26180c90e0 2024-08-31T04:31:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f260ea00640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f25f80720c0 0x7f25f80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f260ea00640 1 -- 172.21.15.89:0/330925244 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2610092cd0 con 0x7f26180c90e0 2024-08-31T04:31:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2624d4c000 1 Processor -- start 2024-08-31T04:31:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2624d4c000 1 -- start start 2024-08-31T04:31:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2616a00640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f25f80720c0 0x7f25f80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2616a00640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f25f80720c0 0x7f25f80745d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f26080af000 tx=0x7f260801b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 0x555a9d7ebd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6a7e90 0x555a9d7b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d691960 0x555a9d7b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2624d4c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555a9d60a820 con 0x555a9d691960 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2624d4c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555a9d5f9db0 con 0x555a9d6a7e90 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2624d4c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555a9d5fdd60 con 0x555a9d6b23f0 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2617400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d691960 0x555a9d7b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2617400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d691960 0x555a9d7b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38946/0 (socket says 172.21.15.89:38946) 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2617400640 1 -- 172.21.15.89:0/3691948521 learned_addr learned my addr 172.21.15.89:0/3691948521 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:39.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2616a00640 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 0x555a9d7ebd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2616000640 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6a7e90 0x555a9d7b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2617400640 1 -- 172.21.15.89:0/3691948521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 msgr2=0x555a9d7ebd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2617400640 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 0x555a9d7ebd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2617400640 1 -- 172.21.15.89:0/3691948521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6a7e90 msgr2=0x555a9d7b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2617400640 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6a7e90 0x555a9d7b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2617400640 1 -- 172.21.15.89:0/3691948521 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9d594b70 con 0x555a9d691960 2024-08-31T04:31:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2616000640 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6a7e90 0x555a9d7b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2617400640 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d691960 0x555a9d7b5220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2610001380 tx=0x7f261005d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d380cd320c65c73 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:39.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2603000640 1 -- 172.21.15.89:0/3691948521 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610062220 con 0x555a9d691960 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2603000640 1 -- 172.21.15.89:0/3691948521 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2610062070 con 0x555a9d691960 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.713+0000 7f2603000640 1 -- 172.21.15.89:0/3691948521 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261005d150 con 0x555a9d691960 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 -- 172.21.15.89:0/3691948521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d691960 msgr2=0x555a9d7b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d691960 0x555a9d7b5220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2610001380 tx=0x7f261005d400 comp rx=0 tx=0).stop 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 -- 172.21.15.89:0/3691948521 shutdown_connections 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d691960 0x555a9d7b5220 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6a7e90 0x555a9d7b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3691948521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 0x555a9d7ebd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 -- 172.21.15.89:0/3691948521 >> 172.21.15.89:0/3691948521 conn(0x555a9d2b9210 msgr2=0x555a9d7ee990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 -- 172.21.15.89:0/3691948521 shutdown_connections 2024-08-31T04:31:39.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 -- 172.21.15.89:0/3691948521 wait complete. 2024-08-31T04:31:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 -- start start 2024-08-31T04:31:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 Processor -- start 2024-08-31T04:31:39.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d691960 0x555a9d7ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7eae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 0x555a9d7eb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555a9d2c0b10 con 0x555a9d6a7e90 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555a9d5806f0 con 0x555a9d691960 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555a9d602390 con 0x555a9d6b23f0 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2624d4c000 10 client.0 _ll_register_callbacks cb 0x555a9d5a1b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7eae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38950/0 (socket says 172.21.15.89:38950) 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616000640 1 -- 172.21.15.89:0/866727763 learned_addr learned my addr 172.21.15.89:0/866727763 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616a00640 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d691960 0x555a9d7ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2617400640 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 0x555a9d7eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616000640 1 -- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 msgr2=0x555a9d7eb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616000640 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 0x555a9d7eb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616000640 1 -- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d691960 msgr2=0x555a9d7ea8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616000640 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d691960 0x555a9d7ea8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616000640 1 -- 172.21.15.89:0/866727763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9d5b8380 con 0x555a9d6a7e90 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2616a00640 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d691960 0x555a9d7ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.717+0000 7f2617400640 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 0x555a9d7eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2616000640 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7eae30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2604012450 tx=0x7f2604012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a005347aeb74dbb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f25f7400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f25f7400640 1 -- 172.21.15.89:0/866727763 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604004050 con 0x555a9d6a7e90 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2624d4c000 1 -- 172.21.15.89:0/866727763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555a9d608d20 con 0x555a9d6a7e90 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f25f7400640 1 -- 172.21.15.89:0/866727763 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f26040041f0 con 0x555a9d6a7e90 2024-08-31T04:31:39.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f25f7400640 1 -- 172.21.15.89:0/866727763 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2604024050 con 0x555a9d6a7e90 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2624d4c000 10 client.6027 fetch_fsmap learned FSMap version 9 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2624d4c000 1 -- 172.21.15.89:0/866727763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x555a9d67ee40 con 0x555a9d6a7e90 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f25f7400640 1 -- 172.21.15.89:0/866727763 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x555a9d608d20 con 0x555a9d6a7e90 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f25f7400640 1 -- 172.21.15.89:0/866727763 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2604027020 con 0x555a9d6a7e90 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2624d4c000 10 client.6027 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2624d4c000 10 client.6027 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2624d4c000 20 client.6027 populate_metadata read hostname 'smithi089' 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2624d4c000 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x555a9d29ddc0 0x555a9d805f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2624d4c000 4 client.6027 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:39.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2624d4c000 1 -- 172.21.15.89:0/866727763 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a9d60c770 con 0x555a9d29ddc0 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2616a00640 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x555a9d29ddc0 0x555a9d805f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f2616a00640 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x555a9d29ddc0 0x555a9d805f90 crc :-1 s=READY pgs=1245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e579f2983c67a575 server_cookie=2435dcbd07872e13 in_seq=0 out_seq=0 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.721+0000 7f25f7400640 10 client.6027 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f25f7400640 1 -- 172.21.15.89:0/866727763 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a9d60c770 con 0x555a9d29ddc0 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f25f7400640 10 client.6027 handle_command_reply: tid=0 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 client.6027 shutdown 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 -- 172.21.15.89:0/866727763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 msgr2=0x555a9d7eae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7eae30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2604012450 tx=0x7f2604012910 comp rx=0 tx=0).stop 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 -- 172.21.15.89:0/866727763 shutdown_connections 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x555a9d29ddc0 0x555a9d805f90 crc :-1 s=READY pgs=1245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7eae30 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d6b23f0 0x555a9d7eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 --2- 172.21.15.89:0/866727763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d691960 0x555a9d7ea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f25f7400640 0 client.6027 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 -- 172.21.15.89:0/866727763 >> 172.21.15.89:0/866727763 conn(0x555a9d2b9210 msgr2=0x555a9d7ed340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 -- 172.21.15.89:0/866727763 shutdown_connections 2024-08-31T04:31:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 1 -- 172.21.15.89:0/866727763 wait complete. 2024-08-31T04:31:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.725+0000 7f2624d4c000 20 client.6027 trim_cache size 0 max 16384 2024-08-31T04:31:39.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 Processor -- start 2024-08-31T04:31:39.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- start start 2024-08-31T04:31:39.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 0x555a9d7ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 0x555a9d85b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f26181ff3d0 con 0x555a9d6a7e90 2024-08-31T04:31:39.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f26182007a0 con 0x555a9d6b23f0 2024-08-31T04:31:39.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f26181ffa20 con 0x555a9d691960 2024-08-31T04:31:39.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38952/0 (socket says 172.21.15.89:38952) 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616000640 1 -- 172.21.15.89:0/1801671754 learned_addr learned my addr 172.21.15.89:0/1801671754 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616a00640 1 --2- 172.21.15.89:0/1801671754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 0x555a9d7ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2617400640 1 --2- 172.21.15.89:0/1801671754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 0x555a9d85b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616000640 1 -- 172.21.15.89:0/1801671754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 msgr2=0x555a9d7ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616000640 1 --2- 172.21.15.89:0/1801671754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 0x555a9d7ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616000640 1 -- 172.21.15.89:0/1801671754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 msgr2=0x555a9d85b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616000640 1 --2- 172.21.15.89:0/1801671754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 0x555a9d85b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616000640 1 -- 172.21.15.89:0/1801671754 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9d6565b0 con 0x555a9d6a7e90 2024-08-31T04:31:39.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2616000640 1 --2- 172.21.15.89:0/1801671754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7ae7f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2604003730 tx=0x7f2604009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28edd621095375d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:39.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2602600640 1 -- 172.21.15.89:0/1801671754 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604021070 con 0x555a9d6a7e90 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2602600640 1 -- 172.21.15.89:0/1801671754 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2604000e50 con 0x555a9d6a7e90 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2602600640 1 -- 172.21.15.89:0/1801671754 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260400f920 con 0x555a9d6a7e90 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- 172.21.15.89:0/1801671754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 msgr2=0x555a9d7ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 --2- 172.21.15.89:0/1801671754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7ae7f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2604003730 tx=0x7f2604009c80 comp rx=0 tx=0).stop 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- 172.21.15.89:0/1801671754 shutdown_connections 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 --2- 172.21.15.89:0/1801671754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d7ae7f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 --2- 172.21.15.89:0/1801671754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 0x555a9d85b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 --2- 172.21.15.89:0/1801671754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 0x555a9d7ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- 172.21.15.89:0/1801671754 >> 172.21.15.89:0/1801671754 conn(0x555a9d2b9210 msgr2=0x555a9d860460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- 172.21.15.89:0/1801671754 shutdown_connections 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- 172.21.15.89:0/1801671754 wait complete. 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 -- start start 2024-08-31T04:31:39.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.745+0000 7f2624d4c000 1 Processor -- start 2024-08-31T04:31:39.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 0x555a9d86f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d86fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 0x555a9d870410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555a9d57beb0 con 0x555a9d6a7e90 2024-08-31T04:31:39.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f26182000d0 con 0x555a9d6b23f0 2024-08-31T04:31:39.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555a9d5a1f20 con 0x555a9d691960 2024-08-31T04:31:39.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 10 client.0 _ll_register_callbacks cb 0x7f2604009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d86fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d86fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38966/0 (socket says 172.21.15.89:38966) 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616000640 1 -- 172.21.15.89:0/3564071245 learned_addr learned my addr 172.21.15.89:0/3564071245 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616a00640 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 0x555a9d86f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2617400640 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 0x555a9d870410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616000640 1 -- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 msgr2=0x555a9d86f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616000640 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 0x555a9d86f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616000640 1 -- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 msgr2=0x555a9d870410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616000640 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 0x555a9d870410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616000640 1 -- 172.21.15.89:0/3564071245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9d58afc0 con 0x555a9d6a7e90 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2617400640 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 0x555a9d870410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616000640 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d86fed0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2604012450 tx=0x7f260400fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ea767c446b1165 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f25f7400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f25f7400640 1 -- 172.21.15.89:0/3564071245 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604036060 con 0x555a9d6a7e90 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f25f7400640 1 -- 172.21.15.89:0/3564071245 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f260401eab0 con 0x555a9d6a7e90 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 -- 172.21.15.89:0/3564071245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2604000e50 con 0x555a9d6a7e90 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f25f7400640 1 -- 172.21.15.89:0/3564071245 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2604021040 con 0x555a9d6a7e90 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 10 client.6033 fetch_fsmap learned FSMap version 9 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 -- 172.21.15.89:0/3564071245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x555a9d583e00 con 0x555a9d6a7e90 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f25f7400640 1 -- 172.21.15.89:0/3564071245 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2604000e50 con 0x555a9d6a7e90 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f25f7400640 1 -- 172.21.15.89:0/3564071245 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2604027040 con 0x555a9d6a7e90 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 10 client.6033 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 10 client.6033 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:31:39.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 20 client.6033 populate_metadata read hostname 'smithi089' 2024-08-31T04:31:39.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x555a9d28be20 0x555a9d85ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:39.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 4 client.6033 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.8, "await_for": 45.0}] 2024-08-31T04:31:39.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2624d4c000 1 -- 172.21.15.89:0/3564071245 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.8, "await_for": 45.0}) -- 0x555a9d608210 con 0x555a9d28be20 2024-08-31T04:31:39.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.749+0000 7f2616a00640 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x555a9d28be20 0x555a9d85ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:39.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.753+0000 7f25f7400640 10 client.6033 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:39.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:39.753+0000 7f2616a00640 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x555a9d28be20 0x555a9d85ddf0 crc :-1 s=READY pgs=1246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa719e2d68f60db server_cookie=afce984409a5912e in_seq=0 out_seq=0 2024-08-31T04:31:42.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f25f7400640 1 -- 172.21.15.89:0/3564071245 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555a9d608210 con 0x555a9d28be20 2024-08-31T04:31:42.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f25f7400640 10 client.6033 handle_command_reply: tid=0 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 client.6033 shutdown 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 -- 172.21.15.89:0/3564071245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 msgr2=0x555a9d86fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d86fed0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2604012450 tx=0x7f260400fd30 comp rx=0 tx=0).stop 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 -- 172.21.15.89:0/3564071245 shutdown_connections 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x555a9d28be20 0x555a9d85ddf0 crc :-1 s=READY pgs=1246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a9d6a7e90 0x555a9d86fed0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555a9d6b23f0 0x555a9d870410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f25f7400640 0 client.6033 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 --2- 172.21.15.89:0/3564071245 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555a9d691960 0x555a9d86f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 -- 172.21.15.89:0/3564071245 >> 172.21.15.89:0/3564071245 conn(0x555a9d2b9210 msgr2=0x555a9d7adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 -- 172.21.15.89:0/3564071245 shutdown_connections 2024-08-31T04:31:42.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 1 -- 172.21.15.89:0/3564071245 wait complete. 2024-08-31T04:31:42.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f2624d4c000 20 client.6033 trim_cache size 0 max 16384 2024-08-31T04:31:42.281 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:31:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:31:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:31:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 98, 2024-08-31T04:31:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:31:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "fbda7f80": { 2024-08-31T04:31:42.281 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 98, 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 150.8, 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:42.282 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:42.283 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:31:42.283 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:31:42.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 -- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f25f80720c0 msgr2=0x7f25f80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f25f80720c0 0x7f25f80745d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f26080af000 tx=0x7f260801b060 comp rx=0 tx=0).stop 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 -- 172.21.15.89:0/330925244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26180c90e0 msgr2=0x7f2618142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26180c90e0 0x7f2618142770 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f261000c730 tx=0x7f261000cbf0 comp rx=0 tx=0).stop 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 -- 172.21.15.89:0/330925244 shutdown_connections 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f25f80720c0 0x7f25f80745d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26180c90e0 0x7f2618142770 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26180c1ed0 0x7f26181f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 --2- 172.21.15.89:0/330925244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26180b2860 0x7f2618148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 -- 172.21.15.89:0/330925244 >> 172.21.15.89:0/330925244 conn(0x7f26180c99b0 msgr2=0x7f2618071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 -- 172.21.15.89:0/330925244 shutdown_connections 2024-08-31T04:31:42.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:31:42.281+0000 7f261d600640 1 -- 172.21.15.89:0/330925244 wait complete. 2024-08-31T04:31:42.299 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fbda7f80', quiesce took 3.3 seconds. Will release after: 27.5 2024-08-31T04:31:54.585 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:31:54.590 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:32:09.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:32:09.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.968+0000 7f6144600640 1 -- 172.21.15.89:0/2129109998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 msgr2=0x7f612400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:09.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.968+0000 7f6144600640 1 --2- 172.21.15.89:0/2129109998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 0x7f612400b9d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f613c0cadf0 tx=0x7f613401cad0 comp rx=0 tx=0).stop 2024-08-31T04:32:09.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.968+0000 7f6144600640 1 -- 172.21.15.89:0/2129109998 shutdown_connections 2024-08-31T04:32:09.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.968+0000 7f6144600640 1 --2- 172.21.15.89:0/2129109998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 0x7f612400b9d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:09.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.968+0000 7f6144600640 1 -- 172.21.15.89:0/2129109998 >> 172.21.15.89:0/2129109998 conn(0x7f613c0ccf20 msgr2=0x7f613c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:09.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.968+0000 7f6144600640 1 -- 172.21.15.89:0/2129109998 shutdown_connections 2024-08-31T04:32:09.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.968+0000 7f6144600640 1 -- 172.21.15.89:0/2129109998 wait complete. 2024-08-31T04:32:09.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.968+0000 7f6144600640 1 Processor -- start 2024-08-31T04:32:09.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.968+0000 7f6144600640 1 -- start start 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6144600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 0x7f613c1f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6144600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f613c0c4fd0 0x7f613c1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6144600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c14fc80 0x7f613c15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6144600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0c3150 con 0x7f6124005260 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6144600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0c26e0 con 0x7f613c14fc80 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6144600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f613c152a10 con 0x7f613c0c4fd0 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 0x7f613c1f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 0x7f613c1f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35514/0 (socket says 172.21.15.89:35514) 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141c00640 1 -- 172.21.15.89:0/1489015162 learned_addr learned my addr 172.21.15.89:0/1489015162 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6142600640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c14fc80 0x7f613c15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:09.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141200640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f613c0c4fd0 0x7f613c1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141c00640 1 -- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f613c0c4fd0 msgr2=0x7f613c1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141c00640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f613c0c4fd0 0x7f613c1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141c00640 1 -- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c14fc80 msgr2=0x7f613c15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141c00640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c14fc80 0x7f613c15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141c00640 1 -- 172.21.15.89:0/1489015162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c0c5fa0 con 0x7f6124005260 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6141c00640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 0x7f613c1f29f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6130006600 tx=0x7f61300039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6139600640 1 -- 172.21.15.89:0/1489015162 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130015020 con 0x7f6124005260 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6139600640 1 -- 172.21.15.89:0/1489015162 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6130011900 con 0x7f6124005260 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c0c6280 con 0x7f6124005260 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6139600640 1 -- 172.21.15.89:0/1489015162 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130011d30 con 0x7f6124005260 2024-08-31T04:32:09.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c0c4ab0 con 0x7f6124005260 2024-08-31T04:32:09.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.972+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f613c0c7920 con 0x7f6124005260 2024-08-31T04:32:09.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.976+0000 7f6139600640 1 -- 172.21.15.89:0/1489015162 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6130018020 con 0x7f6124005260 2024-08-31T04:32:09.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.976+0000 7f6139600640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f611c0720c0 0x7f611c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:09.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.976+0000 7f6139600640 1 -- 172.21.15.89:0/1489015162 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f6130093b70 con 0x7f6124005260 2024-08-31T04:32:09.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.976+0000 7f6141200640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f611c0720c0 0x7f611c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:09.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.976+0000 7f6141200640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f611c0720c0 0x7f611c0745d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f613c156070 tx=0x7f61280091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:09.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:09.980+0000 7f6139600640 1 -- 172.21.15.89:0/1489015162 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f613001f030 con 0x7f6124005260 2024-08-31T04:32:10.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.188+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f613c1560a0 con 0x7f6124005260 2024-08-31T04:32:10.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.188+0000 7f6139600640 1 -- 172.21.15.89:0/1489015162 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f613005f160 con 0x7f6124005260 2024-08-31T04:32:10.189 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:32:10.190 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:32:10.190 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:32:10.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f611c0720c0 msgr2=0x7f611c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f611c0720c0 0x7f611c0745d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f613c156070 tx=0x7f61280091e0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 msgr2=0x7f613c1f29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 0x7f613c1f29f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6130006600 tx=0x7f61300039d0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 shutdown_connections 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f611c0720c0 0x7f611c0745d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f613c14fc80 0x7f613c15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f613c0c4fd0 0x7f613c1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 --2- 172.21.15.89:0/1489015162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6124005260 0x7f613c1f29f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 >> 172.21.15.89:0/1489015162 conn(0x7f613c0ccf20 msgr2=0x7f613c1516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 shutdown_connections 2024-08-31T04:32:10.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.192+0000 7f6144600640 1 -- 172.21.15.89:0/1489015162 wait complete. 2024-08-31T04:32:10.211 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id fbda7f80 --release --await' 2024-08-31T04:32:10.211 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id fbda7f80 --release --await 2024-08-31T04:32:10.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.372+0000 7f3a4fa00640 1 -- 172.21.15.89:0/1915007716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a2c003a10 msgr2=0x7f3a2c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.372+0000 7f3a4fa00640 1 --2- 172.21.15.89:0/1915007716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a2c003a10 0x7f3a2c003e80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009b60 tx=0x7f3a3801d2b0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.372+0000 7f3a4da00640 1 -- 172.21.15.89:0/1915007716 reap_dead start 2024-08-31T04:32:10.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.372+0000 7f3a4fa00640 1 -- 172.21.15.89:0/1915007716 shutdown_connections 2024-08-31T04:32:10.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.372+0000 7f3a4fa00640 1 -- 172.21.15.89:0/1915007716 >> 172.21.15.89:0/1915007716 conn(0x7f3a480c99b0 msgr2=0x7f3a480c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:10.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.372+0000 7f3a4fa00640 1 -- 172.21.15.89:0/1915007716 shutdown_connections 2024-08-31T04:32:10.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.372+0000 7f3a4fa00640 1 -- 172.21.15.89:0/1915007716 wait complete. 2024-08-31T04:32:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4fa00640 1 Processor -- start 2024-08-31T04:32:10.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4fa00640 1 -- start start 2024-08-31T04:32:10.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4fa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a2c003a10 0x7f3a480c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4fa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a48154e60 0x7f3a48146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4fa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481566f0 0x7f3a48156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4fa00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4806fc10 con 0x7f3a481566f0 2024-08-31T04:32:10.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4fa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48073e70 con 0x7f3a48154e60 2024-08-31T04:32:10.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4fa00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a48069fc0 con 0x7f3a2c003a10 2024-08-31T04:32:10.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481566f0 0x7f3a48156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481566f0 0x7f3a48156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35538/0 (socket says 172.21.15.89:35538) 2024-08-31T04:32:10.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4da00640 1 -- 172.21.15.89:0/3646645135 learned_addr learned my addr 172.21.15.89:0/3646645135 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:32:10.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4d000640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a2c003a10 0x7f3a480c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a48154e60 0x7f3a48146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4da00640 1 -- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a2c003a10 msgr2=0x7f3a480c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4da00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a2c003a10 0x7f3a480c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4da00640 1 -- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a48154e60 msgr2=0x7f3a48146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4da00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a48154e60 0x7f3a48146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4da00640 1 -- 172.21.15.89:0/3646645135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a480c9790 con 0x7f3a481566f0 2024-08-31T04:32:10.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a4da00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481566f0 0x7f3a48156b00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3a480b2770 tx=0x7f3a4000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:10.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.376+0000 7f3a45600640 1 -- 172.21.15.89:0/3646645135 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40015020 con 0x7f3a481566f0 2024-08-31T04:32:10.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a45600640 1 -- 172.21.15.89:0/3646645135 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a4000cad0 con 0x7f3a481566f0 2024-08-31T04:32:10.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a4fa00640 1 -- 172.21.15.89:0/3646645135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a481f3990 con 0x7f3a481566f0 2024-08-31T04:32:10.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a45600640 1 -- 172.21.15.89:0/3646645135 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40011460 con 0x7f3a481566f0 2024-08-31T04:32:10.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a4fa00640 1 -- 172.21.15.89:0/3646645135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a480c8f90 con 0x7f3a481566f0 2024-08-31T04:32:10.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a45600640 1 -- 172.21.15.89:0/3646645135 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3a40018020 con 0x7f3a481566f0 2024-08-31T04:32:10.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a45600640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a240720c0 0x7f3a240745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a45600640 1 -- 172.21.15.89:0/3646645135 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3a40093450 con 0x7f3a481566f0 2024-08-31T04:32:10.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a57285000 1 Processor -- start 2024-08-31T04:32:10.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a4d000640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a240720c0 0x7f3a240745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.380+0000 7f3a57285000 1 -- start start 2024-08-31T04:32:10.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4d000640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a240720c0 0x7f3a240745d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a380ae000 tx=0x7f3a3801a050 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:10.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b3eee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3f4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56327b299f30 con 0x56327b2ab890 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56327b20f690 con 0x56327b2d0950 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56327b1fec20 con 0x56327b2ba930 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3f4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35548/0 (socket says 172.21.15.89:35548) 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4da00640 1 -- 172.21.15.89:0/3639734272 learned_addr learned my addr 172.21.15.89:0/3639734272 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4d000640 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b3eee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4da00640 1 -- 172.21.15.89:0/3639734272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 msgr2=0x56327b3f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4da00640 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4da00640 1 -- 172.21.15.89:0/3639734272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 msgr2=0x56327b3eee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:10.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4da00640 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b3eee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4da00640 1 -- 172.21.15.89:0/3639734272 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327b1b38f0 con 0x56327b2ab890 2024-08-31T04:32:10.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:10.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a4da00640 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3f4010 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3a4005e040 tx=0x7f3a4005dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8257650965f920d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:10.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a3d600640 1 -- 172.21.15.89:0/3639734272 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4005e340 con 0x56327b2ab890 2024-08-31T04:32:10.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a3d600640 1 -- 172.21.15.89:0/3639734272 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a40062bb0 con 0x56327b2ab890 2024-08-31T04:32:10.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a3d600640 1 -- 172.21.15.89:0/3639734272 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400675d0 con 0x56327b2ab890 2024-08-31T04:32:10.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 -- 172.21.15.89:0/3639734272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 msgr2=0x56327b3f4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3f4010 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3a4005e040 tx=0x7f3a4005dab0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 -- 172.21.15.89:0/3639734272 shutdown_connections 2024-08-31T04:32:10.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3f4010 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 --2- 172.21.15.89:0/3639734272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b3eee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 -- 172.21.15.89:0/3639734272 >> 172.21.15.89:0/3639734272 conn(0x56327b2d0540 msgr2=0x56327b3f1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:10.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 -- 172.21.15.89:0/3639734272 shutdown_connections 2024-08-31T04:32:10.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.384+0000 7f3a57285000 1 -- 172.21.15.89:0/3639734272 wait complete. 2024-08-31T04:32:10.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 -- start start 2024-08-31T04:32:10.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 Processor -- start 2024-08-31T04:32:10.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3ee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b3ee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56327b185500 con 0x56327b2ab890 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56327b202bd0 con 0x56327b2d0950 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56327b1a6a30 con 0x56327b2ba930 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 10 client.0 _ll_register_callbacks cb 0x56327b2b4b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4d000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4d000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3edc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35564/0 (socket says 172.21.15.89:35564) 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4d000640 1 -- 172.21.15.89:0/449209677 learned_addr learned my addr 172.21.15.89:0/449209677 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4da00640 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b3ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4d000640 1 -- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 msgr2=0x56327b3ee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:10.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4d000640 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3ee150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4d000640 1 -- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 msgr2=0x56327b3ee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4d000640 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b3ee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4d000640 1 -- 172.21.15.89:0/449209677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56327b19e6a0 con 0x56327b2ab890 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a4d000640 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3edc10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3a38000c10 tx=0x7f3a380091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d89e82ebbb4043 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a36000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a36000640 1 -- 172.21.15.89:0/449209677 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a380b1040 con 0x56327b2ab890 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a36000640 1 -- 172.21.15.89:0/449209677 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3a38004990 con 0x56327b2ab890 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 -- 172.21.15.89:0/449209677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56327b1987e0 con 0x56327b2ab890 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a36000640 1 -- 172.21.15.89:0/449209677 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3a380d4050 con 0x56327b2ab890 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 10 client.6051 fetch_fsmap learned FSMap version 9 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.388+0000 7f3a57285000 1 -- 172.21.15.89:0/449209677 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56327b1bd1c0 con 0x56327b2ab890 2024-08-31T04:32:10.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a36000640 1 -- 172.21.15.89:0/449209677 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56327b1987e0 con 0x56327b2ab890 2024-08-31T04:32:10.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a36000640 1 -- 172.21.15.89:0/449209677 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f3a380d7020 con 0x56327b2ab890 2024-08-31T04:32:10.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 10 client.6051 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:32:10.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 10 client.6051 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:32:10.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 20 client.6051 populate_metadata read hostname 'smithi089' 2024-08-31T04:32:10.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56327b294fc0 0x56327b409010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 4 client.6051 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:10.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 -- 172.21.15.89:0/449209677 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56327b2115e0 con 0x56327b294fc0 2024-08-31T04:32:10.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56327b294fc0 0x56327b409010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56327b294fc0 0x56327b409010 crc :-1 s=READY pgs=1258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c41dc3bfebe14a2 server_cookie=5936d69659aa6d1d in_seq=0 out_seq=0 2024-08-31T04:32:10.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a36000640 10 client.6051 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:32:10.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a36000640 1 -- 172.21.15.89:0/449209677 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56327b2115e0 con 0x56327b294fc0 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a36000640 10 client.6051 handle_command_reply: tid=0 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 client.6051 shutdown 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 -- 172.21.15.89:0/449209677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 msgr2=0x56327b3edc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3edc10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3a38000c10 tx=0x7f3a380091e0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 -- 172.21.15.89:0/449209677 shutdown_connections 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56327b294fc0 0x56327b409010 crc :-1 s=READY pgs=1258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b3ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b3ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 --2- 172.21.15.89:0/449209677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ab890 0x56327b3edc10 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a36000640 0 client.6051 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 -- 172.21.15.89:0/449209677 >> 172.21.15.89:0/449209677 conn(0x56327b2d0540 msgr2=0x56327b3ef040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 -- 172.21.15.89:0/449209677 shutdown_connections 2024-08-31T04:32:10.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.392+0000 7f3a57285000 1 -- 172.21.15.89:0/449209677 wait complete. 2024-08-31T04:32:10.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.396+0000 7f3a57285000 20 client.6051 trim_cache size 0 max 16384 2024-08-31T04:32:10.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a57285000 1 Processor -- start 2024-08-31T04:32:10.412 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a57285000 1 -- start start 2024-08-31T04:32:10.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a57285000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2ab890 0x56327b405560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a57285000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b407000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a57285000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2d0950 0x56327b407540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a57285000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48202240 con 0x56327b2d0950 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a57285000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48201120 con 0x56327b2ab890 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a57285000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a481f6ef0 con 0x56327b2ba930 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2d0950 0x56327b407540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2d0950 0x56327b407540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35566/0 (socket says 172.21.15.89:35566) 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4da00640 1 -- 172.21.15.89:0/2457230893 learned_addr learned my addr 172.21.15.89:0/2457230893 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4d000640 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2ab890 0x56327b405560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b407000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4da00640 1 -- 172.21.15.89:0/2457230893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 msgr2=0x56327b407000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4da00640 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b407000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4da00640 1 -- 172.21.15.89:0/2457230893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2ab890 msgr2=0x56327b405560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:10.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4da00640 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2ab890 0x56327b405560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4da00640 1 -- 172.21.15.89:0/2457230893 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327b2832f0 con 0x56327b2d0950 2024-08-31T04:32:10.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.412+0000 7f3a4d000640 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2ab890 0x56327b405560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:10.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a4da00640 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2d0950 0x56327b407540 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000d010 tx=0x7f3a40000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5928afbd97b22754 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:10.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a3cc00640 1 -- 172.21.15.89:0/2457230893 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4004b030 con 0x56327b2d0950 2024-08-31T04:32:10.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a3cc00640 1 -- 172.21.15.89:0/2457230893 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a4005e340 con 0x56327b2d0950 2024-08-31T04:32:10.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a3cc00640 1 -- 172.21.15.89:0/2457230893 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400675d0 con 0x56327b2d0950 2024-08-31T04:32:10.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 -- 172.21.15.89:0/2457230893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2d0950 msgr2=0x56327b407540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2d0950 0x56327b407540 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000d010 tx=0x7f3a40000f50 comp rx=0 tx=0).stop 2024-08-31T04:32:10.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 -- 172.21.15.89:0/2457230893 shutdown_connections 2024-08-31T04:32:10.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2d0950 0x56327b407540 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ba930 0x56327b407000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 --2- 172.21.15.89:0/2457230893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2ab890 0x56327b405560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 -- 172.21.15.89:0/2457230893 >> 172.21.15.89:0/2457230893 conn(0x56327b2d0540 msgr2=0x56327b3b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:10.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 -- 172.21.15.89:0/2457230893 shutdown_connections 2024-08-31T04:32:10.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 -- 172.21.15.89:0/2457230893 wait complete. 2024-08-31T04:32:10.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 -- start start 2024-08-31T04:32:10.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 Processor -- start 2024-08-31T04:32:10.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ab890 0x56327b46d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ba930 0x56327b46de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b46e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481ffcf0 con 0x56327b2ba930 2024-08-31T04:32:10.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48200a50 con 0x56327b2d0950 2024-08-31T04:32:10.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a48200380 con 0x56327b2ab890 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.416+0000 7f3a57285000 10 client.0 _ll_register_callbacks cb 0x7f3a2c00b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a3fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ba930 0x56327b46de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a3fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ba930 0x56327b46de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35574/0 (socket says 172.21.15.89:35574) 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a3fe00640 1 -- 172.21.15.89:0/646812796 learned_addr learned my addr 172.21.15.89:0/646812796 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a4d000640 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ab890 0x56327b46d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a4da00640 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b46e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a3fe00640 1 -- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ab890 msgr2=0x56327b46d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ab890 0x56327b46d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a3fe00640 1 -- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 msgr2=0x56327b46e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b46e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a3fe00640 1 -- 172.21.15.89:0/646812796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56327b188b30 con 0x56327b2ba930 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a4d000640 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ab890 0x56327b46d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:10.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a4da00640 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b46e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a3fe00640 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ba930 0x56327b46de80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009b60 tx=0x7f3a30012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7e2151679a5e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a36000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a36000640 1 -- 172.21.15.89:0/646812796 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a30029060 con 0x56327b2ba930 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a36000640 1 -- 172.21.15.89:0/646812796 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3a30004460 con 0x56327b2ba930 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a57285000 1 -- 172.21.15.89:0/646812796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a4005e340 con 0x56327b2ba930 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a36000640 1 -- 172.21.15.89:0/646812796 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3a3002f050 con 0x56327b2ba930 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a57285000 10 client.6057 fetch_fsmap learned FSMap version 9 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a57285000 1 -- 172.21.15.89:0/646812796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56327b195c70 con 0x56327b2ba930 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a36000640 1 -- 172.21.15.89:0/646812796 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a4005e340 con 0x56327b2ba930 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a36000640 1 -- 172.21.15.89:0/646812796 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f3a30032020 con 0x56327b2ba930 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a57285000 10 client.6057 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a57285000 10 client.6057 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a57285000 20 client.6057 populate_metadata read hostname 'smithi089' 2024-08-31T04:32:10.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a57285000 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56327ae90e80 0x56327b40ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a57285000 4 client.6057 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fbda7f80", "release": true, "await": true}] 2024-08-31T04:32:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a57285000 1 -- 172.21.15.89:0/646812796 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fbda7f80", "release": true, "await": true}) -- 0x56327b20d080 con 0x56327ae90e80 2024-08-31T04:32:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a4d000640 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56327ae90e80 0x56327b40ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a4d000640 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56327ae90e80 0x56327b40ba60 crc :-1 s=READY pgs=1259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e73af16600b7dab server_cookie=92170312813bbc3e in_seq=0 out_seq=0 2024-08-31T04:32:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.420+0000 7f3a36000640 10 client.6057 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:32:10.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a36000640 1 -- 172.21.15.89:0/646812796 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56327b20d080 con 0x56327ae90e80 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a36000640 10 client.6057 handle_command_reply: tid=0 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 client.6057 shutdown 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 -- 172.21.15.89:0/646812796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ba930 msgr2=0x56327b46de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ba930 0x56327b46de80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009b60 tx=0x7f3a30012820 comp rx=0 tx=0).stop 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 -- 172.21.15.89:0/646812796 shutdown_connections 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56327ae90e80 0x56327b40ba60 crc :-1 s=READY pgs=1259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56327b2ba930 0x56327b46de80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56327b2d0950 0x56327b46e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 --2- 172.21.15.89:0/646812796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56327b2ab890 0x56327b46d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a36000640 0 client.6057 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 -- 172.21.15.89:0/646812796 >> 172.21.15.89:0/646812796 conn(0x56327b2d0540 msgr2=0x56327b3b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 -- 172.21.15.89:0/646812796 shutdown_connections 2024-08-31T04:32:10.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 1 -- 172.21.15.89:0/646812796 wait complete. 2024-08-31T04:32:10.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a57285000 20 client.6057 trim_cache size 0 max 16384 2024-08-31T04:32:10.617 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:32:10.617 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:32:10.617 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:32:10.617 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 100, 2024-08-31T04:32:10.617 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:32:10.617 INFO:teuthology.orchestra.run.smithi089.stdout: "fbda7f80": { 2024-08-31T04:32:10.617 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 100, 2024-08-31T04:32:10.617 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 150.8, 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:32:10.618 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:32:10.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:32:10.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:32:10.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:32:10.619 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:32:10.619 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:32:10.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 -- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a240720c0 msgr2=0x7f3a240745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a240720c0 0x7f3a240745d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a380ae000 tx=0x7f3a3801a050 comp rx=0 tx=0).stop 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 -- 172.21.15.89:0/3646645135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481566f0 msgr2=0x7f3a48156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481566f0 0x7f3a48156b00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3a480b2770 tx=0x7f3a4000ec30 comp rx=0 tx=0).stop 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 -- 172.21.15.89:0/3646645135 shutdown_connections 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a240720c0 0x7f3a240745d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a481566f0 0x7f3a48156b00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a48154e60 0x7f3a48146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 --2- 172.21.15.89:0/3646645135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a2c003a10 0x7f3a480c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 -- 172.21.15.89:0/3646645135 >> 172.21.15.89:0/3646645135 conn(0x7f3a480c99b0 msgr2=0x7f3a480765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 -- 172.21.15.89:0/3646645135 shutdown_connections 2024-08-31T04:32:10.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:32:10.616+0000 7f3a4fa00640 1 -- 172.21.15.89:0/3646645135 wait complete. 2024-08-31T04:32:10.640 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fbda7f80', total seconds elapsed: 31.6 2024-08-31T04:32:15.815 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 4% (22/540) Updating files: 5% (27/540) Updating files: 6% (33/540) Updating files: 7% (38/540) Updating files: 8% (44/540) Updating files: 9% (49/540) Updating files: 10% (54/540) Updating files: 11% (60/540) Updating files: 12% (65/540) Updating files: 12% (66/540) Updating files: 13% (71/540) Updating files: 14% (76/540) Updating files: 15% (81/540) Updating files: 16% (87/540) Updating files: 17% (92/540) Updating files: 18% (98/540) Updating files: 19% (103/540) Updating files: 20% (108/540) Updating files: 21% (114/540) Updating files: 22% (119/540) Updating files: 23% (125/540) Updating files: 24% (130/540) Updating files: 25% (135/540) Updating files: 26% (141/540) Updating files: 27% (146/540) Updating files: 28% (152/540) Updating files: 29% (157/540) Updating files: 30% (162/540) Updating files: 30% (165/540) Updating files: 31% (168/540) Updating files: 32% (173/540) Updating files: 33% (179/540) Updating files: 34% (184/540) Updating files: 35% (189/540) Updating files: 36% (195/540) Updating files: 37% (200/540) Updating files: 38% (206/540) Updating files: 39% (211/540) Updating files: 40% (216/540) Updating files: 41% (222/540) Updating files: 42% (227/540) Updating files: 43% (233/540) Updating files: 44% (238/540) Updating files: 45% (243/540) Updating files: 46% (249/540) Updating files: 47% (254/540) Updating files: 47% (257/540) Updating files: 48% (260/540) Updating files: 49% (265/540) Updating files: 50% (270/540) Updating files: 51% (276/540) Updating files: 52% (281/540) Updating files: 53% (287/540) Updating files: 54% (292/540) Updating files: 55% (297/540) Updating files: 56% (303/540) Updating files: 57% (308/540) Updating files: 58% (314/540) Updating files: 59% (319/540) Updating files: 60% (324/540) Updating files: 60% (327/540) Updating files: 60% (328/540) Updating files: 61% (330/540) Updating files: 62% (335/540) Updating files: 62% (339/540) Updating files: 63% (341/540) Updating files: 64% (346/540) Updating files: 65% (351/540) Updating files: 66% (357/540) Updating files: 67% (362/540) Updating files: 68% (368/540) Updating files: 69% (373/540) Updating files: 70% (378/540) Updating files: 71% (384/540) Updating files: 71% (387/540) Updating files: 72% (389/540) Updating files: 73% (395/540) Updating files: 74% (400/540) Updating files: 75% (405/540) Updating files: 76% (411/540) Updating files: 77% (416/540) Updating files: 77% (421/540) Updating files: 78% (422/540) Updating files: 79% (427/540) Updating files: 80% (432/540) Updating files: 81% (438/540) Updating files: 81% (439/540) Updating files: 82% (443/540) Updating files: 83% (449/540) Updating files: 84% (454/540) Updating files: 85% (459/540) Updating files: 86% (465/540) Updating files: 87% (470/540) Updating files: 88% (476/540) Updating files: 89% (481/540) Updating files: 89% (482/540) Updating files: 90% (486/540) Updating files: 91% (492/540) Updating files: 92% (497/540) Updating files: 93% (503/540) Updating files: 94% (508/540) Updating files: 95% (513/540) Updating files: 96% (519/540) Updating files: 97% (524/540) Updating files: 98% (530/540) Updating files: 99% (535/540) Updating files: 100% (540/540) Updating files: 100% (540/540), done. 2024-08-31T04:32:16.294 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 690f8175606 v0.55 2024-08-31T04:32:16.392 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.55 2024-08-31T04:32:16.405 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 56 -eq 48 ] 2024-08-31T04:32:16.405 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.56 2024-08-31T04:32:16.405 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.56 2024-08-31T04:32:16.405 INFO:tasks.workunit.client.0.smithi089.stdout:v0.56 2024-08-31T04:32:16.405 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.56 2024-08-31T04:32:24.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:32:24.712 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:32:31.415 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 22% (55/246) Updating files: 23% (57/246) Updating files: 23% (58/246) Updating files: 24% (60/246) Updating files: 25% (62/246) Updating files: 26% (64/246) Updating files: 27% (67/246) Updating files: 28% (69/246) Updating files: 29% (72/246) Updating files: 30% (74/246) Updating files: 31% (77/246) Updating files: 32% (79/246) Updating files: 33% (82/246) Updating files: 34% (84/246) Updating files: 35% (87/246) Updating files: 36% (89/246) Updating files: 37% (92/246) Updating files: 38% (94/246) Updating files: 39% (96/246) Updating files: 40% (99/246) Updating files: 41% (101/246) Updating files: 42% (104/246) Updating files: 43% (106/246) Updating files: 43% (108/246) Updating files: 44% (109/246) Updating files: 45% (111/246) Updating files: 46% (114/246) Updating files: 47% (116/246) Updating files: 48% (119/246) Updating files: 49% (121/246) Updating files: 50% (123/246) Updating files: 51% (126/246) Updating files: 52% (128/246) Updating files: 53% (131/246) Updating files: 54% (133/246) Updating files: 55% (136/246) Updating files: 56% (138/246) Updating files: 57% (141/246) Updating files: 57% (142/246) Updating files: 58% (143/246) Updating files: 59% (146/246) Updating files: 60% (148/246) Updating files: 61% (151/246) Updating files: 62% (153/246) Updating files: 63% (155/246) Updating files: 64% (158/246) Updating files: 65% (160/246) Updating files: 66% (163/246) Updating files: 67% (165/246) Updating files: 68% (168/246) Updating files: 69% (170/246) Updating files: 70% (173/246) Updating files: 71% (175/246) Updating files: 72% (178/246) Updating files: 73% (180/246) Updating files: 74% (183/246) Updating files: 75% (185/246) Updating files: 76% (187/246) Updating files: 77% (190/246) Updating files: 78% (192/246) Updating files: 79% (195/246) Updating files: 79% (196/246) Updating files: 80% (197/246) Updating files: 81% (200/246) Updating files: 82% (202/246) Updating files: 83% (205/246) Updating files: 84% (207/246) Updating files: 85% (210/246) Updating files: 86% (212/246) Updating files: 87% (215/246) Updating files: 88% (217/246) Updating files: 89% (219/246) Updating files: 90% (222/246) Updating files: 91% (224/246) Updating files: 92% (227/246) Updating files: 93% (229/246) Updating files: 94% (232/246) Updating files: 95% (234/246) Updating files: 96% (237/246) Updating files: 97% (239/246) Updating files: 98% (242/246) Updating files: 99% (244/246) Updating files: 100% (246/246) Updating files: 100% (246/246), done. 2024-08-31T04:32:31.548 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 1a32f0a0b42 v0.56 2024-08-31T04:32:31.554 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.56 2024-08-31T04:32:31.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 57 -eq 48 ] 2024-08-31T04:32:31.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.57 2024-08-31T04:32:31.578 INFO:tasks.workunit.client.0.smithi089.stdout:v0.57 2024-08-31T04:32:31.579 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.57 2024-08-31T04:32:31.579 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.57 2024-08-31T04:32:36.512 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 40% (122/304) Updating files: 41% (125/304) Updating files: 42% (128/304) Updating files: 43% (131/304) Updating files: 44% (134/304) Updating files: 45% (137/304) Updating files: 46% (140/304) Updating files: 47% (143/304) Updating files: 48% (146/304) Updating files: 49% (149/304) Updating files: 50% (152/304) Updating files: 51% (156/304) Updating files: 52% (159/304) Updating files: 53% (162/304) Updating files: 54% (165/304) Updating files: 54% (167/304) Updating files: 55% (168/304) Updating files: 56% (171/304) Updating files: 57% (174/304) Updating files: 58% (177/304) Updating files: 59% (180/304) Updating files: 60% (183/304) Updating files: 61% (186/304) Updating files: 62% (189/304) Updating files: 63% (192/304) Updating files: 64% (195/304) Updating files: 65% (198/304) Updating files: 66% (201/304) Updating files: 67% (204/304) Updating files: 68% (207/304) Updating files: 69% (210/304) Updating files: 70% (213/304) Updating files: 71% (216/304) Updating files: 72% (219/304) Updating files: 73% (222/304) Updating files: 74% (225/304) Updating files: 75% (228/304) Updating files: 76% (232/304) Updating files: 77% (235/304) Updating files: 78% (238/304) Updating files: 79% (241/304) Updating files: 80% (244/304) Updating files: 81% (247/304) Updating files: 81% (248/304) Updating files: 82% (250/304) Updating files: 83% (253/304) Updating files: 84% (256/304) Updating files: 85% (259/304) Updating files: 86% (262/304) Updating files: 87% (265/304) Updating files: 88% (268/304) Updating files: 89% (271/304) Updating files: 90% (274/304) Updating files: 91% (277/304) Updating files: 92% (280/304) Updating files: 93% (283/304) Updating files: 94% (286/304) Updating files: 95% (289/304) Updating files: 96% (292/304) Updating files: 97% (295/304) Updating files: 98% (298/304) Updating files: 99% (301/304) Updating files: 100% (304/304) Updating files: 100% (304/304), done. 2024-08-31T04:32:36.585 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 9a7a9d06c06 v0.57 2024-08-31T04:32:36.595 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.57 2024-08-31T04:32:36.670 INFO:tasks.workunit.client.0.smithi089.stdout:v0.58 2024-08-31T04:32:36.671 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 58 -eq 48 ] 2024-08-31T04:32:36.671 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.58 2024-08-31T04:32:36.671 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.58 2024-08-31T04:32:36.671 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.58 2024-08-31T04:32:51.837 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 5% (14/268) Updating files: 6% (17/268) Updating files: 7% (19/268) Updating files: 8% (22/268) Updating files: 9% (25/268) Updating files: 10% (27/268) Updating files: 11% (30/268) Updating files: 12% (33/268) Updating files: 13% (35/268) Updating files: 14% (38/268) Updating files: 15% (41/268) Updating files: 16% (43/268) Updating files: 17% (46/268) Updating files: 18% (49/268) Updating files: 19% (51/268) Updating files: 20% (54/268) Updating files: 21% (57/268) Updating files: 22% (59/268) Updating files: 23% (62/268) Updating files: 24% (65/268) Updating files: 24% (66/268) Updating files: 25% (67/268) Updating files: 26% (70/268) Updating files: 27% (73/268) Updating files: 27% (74/268) Updating files: 28% (76/268) Updating files: 29% (78/268) Updating files: 30% (81/268) Updating files: 31% (84/268) Updating files: 32% (86/268) Updating files: 33% (89/268) Updating files: 34% (92/268) Updating files: 35% (94/268) Updating files: 36% (97/268) Updating files: 37% (100/268) Updating files: 38% (102/268) Updating files: 39% (105/268) Updating files: 40% (108/268) Updating files: 41% (110/268) Updating files: 42% (113/268) Updating files: 43% (116/268) Updating files: 44% (118/268) Updating files: 45% (121/268) Updating files: 46% (124/268) Updating files: 47% (126/268) Updating files: 48% (129/268) Updating files: 49% (132/268) Updating files: 50% (134/268) Updating files: 51% (137/268) Updating files: 52% (140/268) Updating files: 53% (143/268) Updating files: 54% (145/268) Updating files: 55% (148/268) Updating files: 56% (151/268) Updating files: 56% (152/268) Updating files: 57% (153/268) Updating files: 58% (156/268) Updating files: 59% (159/268) Updating files: 60% (161/268) Updating files: 61% (164/268) Updating files: 62% (167/268) Updating files: 63% (169/268) Updating files: 64% (172/268) Updating files: 65% (175/268) Updating files: 66% (177/268) Updating files: 67% (180/268) Updating files: 68% (183/268) Updating files: 69% (185/268) Updating files: 70% (188/268) Updating files: 71% (191/268) Updating files: 72% (193/268) Updating files: 73% (196/268) Updating files: 74% (199/268) Updating files: 75% (201/268) Updating files: 76% (204/268) Updating files: 77% (207/268) Updating files: 78% (210/268) Updating files: 79% (212/268) Updating files: 80% (215/268) Updating files: 81% (218/268) Updating files: 82% (220/268) Updating files: 82% (222/268) Updating files: 83% (223/268) Updating files: 84% (226/268) Updating files: 85% (228/268) Updating files: 86% (231/268) Updating files: 87% (234/268) Updating files: 88% (236/268) Updating files: 89% (239/268) Updating files: 90% (242/268) Updating files: 91% (244/268) Updating files: 92% (247/268) Updating files: 93% (250/268) Updating files: 94% (252/268) Updating files: 95% (255/268) Updating files: 96% (258/268) Updating files: 97% (260/268) Updating files: 98% (263/268) Updating files: 99% (266/268) Updating files: 100% (268/268) Updating files: 100% (268/268), done. 2024-08-31T04:32:51.912 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at ba3f91e7504 v0.58 2024-08-31T04:32:51.920 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.58 2024-08-31T04:32:51.979 INFO:tasks.workunit.client.0.smithi089.stdout:v0.59 2024-08-31T04:32:51.980 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 59 -eq 48 ] 2024-08-31T04:32:51.980 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.59 2024-08-31T04:32:51.980 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.59 2024-08-31T04:32:51.980 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.59 2024-08-31T04:32:54.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:32:54.777 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:32:56.905 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 49% (104/211) Updating files: 50% (106/211) Updating files: 51% (108/211) Updating files: 52% (110/211) Updating files: 53% (112/211) Updating files: 54% (114/211) Updating files: 55% (117/211) Updating files: 56% (119/211) Updating files: 57% (121/211) Updating files: 58% (123/211) Updating files: 59% (125/211) Updating files: 60% (127/211) Updating files: 61% (129/211) Updating files: 62% (131/211) Updating files: 63% (133/211) Updating files: 64% (136/211) Updating files: 65% (138/211) Updating files: 66% (140/211) Updating files: 67% (142/211) Updating files: 68% (144/211) Updating files: 69% (146/211) Updating files: 70% (148/211) Updating files: 71% (150/211) Updating files: 72% (152/211) Updating files: 73% (155/211) Updating files: 74% (157/211) Updating files: 75% (159/211) Updating files: 76% (161/211) Updating files: 77% (163/211) Updating files: 78% (165/211) Updating files: 79% (167/211) Updating files: 80% (169/211) Updating files: 81% (171/211) Updating files: 82% (174/211) Updating files: 83% (176/211) Updating files: 84% (178/211) Updating files: 85% (180/211) Updating files: 86% (182/211) Updating files: 87% (184/211) Updating files: 88% (186/211) Updating files: 89% (188/211) Updating files: 90% (190/211) Updating files: 91% (193/211) Updating files: 92% (195/211) Updating files: 93% (197/211) Updating files: 94% (199/211) Updating files: 95% (201/211) Updating files: 96% (203/211) Updating files: 97% (205/211) Updating files: 98% (207/211) Updating files: 99% (209/211) Updating files: 100% (211/211) Updating files: 100% (211/211), done. 2024-08-31T04:32:56.978 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at cbae6a435c6 v0.59 2024-08-31T04:32:56.985 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.59 2024-08-31T04:32:58.184 INFO:tasks.workunit.client.0.smithi089.stdout:v0.60 2024-08-31T04:32:58.184 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 60 -eq 48 ] 2024-08-31T04:32:58.184 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.60 2024-08-31T04:32:58.184 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.60 2024-08-31T04:32:58.184 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.60 2024-08-31T04:33:07.841 INFO:tasks.quiescer.fs.[cephfs]:Total duration (58.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:33:07.841 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.4 2024-08-31T04:33:07.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:33:08.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 -- 172.21.15.89:0/1117490351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04ac15d9f0 msgr2=0x7f04ac0cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 --2- 172.21.15.89:0/1117490351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04ac15d9f0 0x7f04ac0cee10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009c80 tx=0x7f04a401f5a0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 -- 172.21.15.89:0/1117490351 shutdown_connections 2024-08-31T04:33:08.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 --2- 172.21.15.89:0/1117490351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04ac15d9f0 0x7f04ac0cee10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 --2- 172.21.15.89:0/1117490351 >> v2:172.21.15.170:3300/0 conn(0x7f04ac0ca0e0 0x7f04ac0c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 -- 172.21.15.89:0/1117490351 >> 172.21.15.89:0/1117490351 conn(0x7f04ac06cc30 msgr2=0x7f04ac06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:08.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 -- 172.21.15.89:0/1117490351 shutdown_connections 2024-08-31T04:33:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 -- 172.21.15.89:0/1117490351 wait complete. 2024-08-31T04:33:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 Processor -- start 2024-08-31T04:33:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.003+0000 7f04abe00640 1 -- start start 2024-08-31T04:33:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04abe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04ac0ca0e0 0x7f04ac15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04abe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac0ca930 0x7f04ac158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04ac15d9f0 0x7f04ac15c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04abe00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac0b1c90 con 0x7f04ac0ca930 2024-08-31T04:33:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04abe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac15d4d0 con 0x7f04ac15d9f0 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04abe00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac1f3190 con 0x7f04ac0ca0e0 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac0ca930 0x7f04ac158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac0ca930 0x7f04ac158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35708/0 (socket says 172.21.15.89:35708) 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a2000640 1 -- 172.21.15.89:0/346050995 learned_addr learned my addr 172.21.15.89:0/346050995 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04aaa00640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04ac0ca0e0 0x7f04ac15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04ab400640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04ac15d9f0 0x7f04ac15c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a2000640 1 -- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04ac0ca0e0 msgr2=0x7f04ac15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a2000640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04ac0ca0e0 0x7f04ac15b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a2000640 1 -- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04ac15d9f0 msgr2=0x7f04ac15c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a2000640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04ac15d9f0 0x7f04ac15c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a2000640 1 -- 172.21.15.89:0/346050995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac0b18e0 con 0x7f04ac0ca930 2024-08-31T04:33:08.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a2000640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac0ca930 0x7f04ac158c40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f049400e9a0 tx=0x7f049400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:08.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a3400640 1 -- 172.21.15.89:0/346050995 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049400cd20 con 0x7f04ac0ca930 2024-08-31T04:33:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a3400640 1 -- 172.21.15.89:0/346050995 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0494004020 con 0x7f04ac0ca930 2024-08-31T04:33:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ac14da30 con 0x7f04ac0ca930 2024-08-31T04:33:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04a3400640 1 -- 172.21.15.89:0/346050995 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494004450 con 0x7f04ac0ca930 2024-08-31T04:33:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac15aae0 con 0x7f04ac0ca930 2024-08-31T04:33:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.007+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ac148630 con 0x7f04ac0ca930 2024-08-31T04:33:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.011+0000 7f04a3400640 1 -- 172.21.15.89:0/346050995 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0494003600 con 0x7f04ac0ca930 2024-08-31T04:33:08.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.011+0000 7f04a3400640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f04880720c0 0x7f04880745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.011+0000 7f04a3400640 1 -- 172.21.15.89:0/346050995 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f0494093810 con 0x7f04ac0ca930 2024-08-31T04:33:08.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.011+0000 7f04aaa00640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f04880720c0 0x7f04880745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.011+0000 7f04aaa00640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f04880720c0 0x7f04880745d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f049c001780 tx=0x7f049c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:08.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.015+0000 7f04a3400640 1 -- 172.21.15.89:0/346050995 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f04ac148630 con 0x7f04ac0ca930 2024-08-31T04:33:08.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.227+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04ac0ca540 con 0x7f04ac0ca930 2024-08-31T04:33:08.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.227+0000 7f04a3400640 1 -- 172.21.15.89:0/346050995 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f049405ecf0 con 0x7f04ac0ca930 2024-08-31T04:33:08.229 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:33:08.230 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:33:08.230 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:33:08.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f04880720c0 msgr2=0x7f04880745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f04880720c0 0x7f04880745d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f049c001780 tx=0x7f049c009040 comp rx=0 tx=0).stop 2024-08-31T04:33:08.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac0ca930 msgr2=0x7f04ac158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac0ca930 0x7f04ac158c40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f049400e9a0 tx=0x7f049400ee60 comp rx=0 tx=0).stop 2024-08-31T04:33:08.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 shutdown_connections 2024-08-31T04:33:08.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f04880720c0 0x7f04880745d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac0ca930 0x7f04ac158c40 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04ac15d9f0 0x7f04ac15c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 --2- 172.21.15.89:0/346050995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04ac0ca0e0 0x7f04ac15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 >> 172.21.15.89:0/346050995 conn(0x7f04ac06cc30 msgr2=0x7f04ac0c45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:08.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 shutdown_connections 2024-08-31T04:33:08.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.231+0000 7f04abe00640 1 -- 172.21.15.89:0/346050995 wait complete. 2024-08-31T04:33:08.252 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 149.4 --await-for 45.0' 2024-08-31T04:33:08.252 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 149.4 --await-for 45.0 2024-08-31T04:33:08.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.475+0000 7fca80600640 1 -- 172.21.15.89:0/3038564456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 msgr2=0x7fca780b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.475+0000 7fca80600640 1 --2- 172.21.15.89:0/3038564456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 0x7fca780b2d20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fca780725d0 tx=0x7fca6c01c800 comp rx=0 tx=0).stop 2024-08-31T04:33:08.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.475+0000 7fca80600640 1 -- 172.21.15.89:0/3038564456 shutdown_connections 2024-08-31T04:33:08.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.475+0000 7fca80600640 1 --2- 172.21.15.89:0/3038564456 >> v2:172.21.15.170:3300/0 conn(0x7fca780c1ed0 0x7fca78152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.475+0000 7fca80600640 1 --2- 172.21.15.89:0/3038564456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 0x7fca780b2d20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.475+0000 7fca80600640 1 -- 172.21.15.89:0/3038564456 >> 172.21.15.89:0/3038564456 conn(0x7fca780c99b0 msgr2=0x7fca780c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:08.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.475+0000 7fca80600640 1 -- 172.21.15.89:0/3038564456 shutdown_connections 2024-08-31T04:33:08.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.475+0000 7fca80600640 1 -- 172.21.15.89:0/3038564456 wait complete. 2024-08-31T04:33:08.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.475+0000 7fca80600640 1 Processor -- start 2024-08-31T04:33:08.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca80600640 1 -- start start 2024-08-31T04:33:08.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca80600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 0x7fca780cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca80600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca780c1ed0 0x7fca78142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca80600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca780c90e0 0x7fca780c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca80600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fca780c32e0 con 0x7fca780b2860 2024-08-31T04:33:08.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca80600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fca780c3160 con 0x7fca780c1ed0 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca80600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fca78074ec0 con 0x7fca780c90e0 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 0x7fca780cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca780c1ed0 0x7fca78142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 0x7fca780cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35736/0 (socket says 172.21.15.89:35736) 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca780c1ed0 0x7fca78142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:33410/0 (socket says 172.21.15.89:33410) 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7dc00640 1 -- 172.21.15.89:0/1495874212 learned_addr learned my addr 172.21.15.89:0/1495874212 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7e600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca780c90e0 0x7fca780c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7d200640 1 -- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca780c90e0 msgr2=0x7fca780c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7d200640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca780c90e0 0x7fca780c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7d200640 1 -- 172.21.15.89:0/1495874212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 msgr2=0x7fca780cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7d200640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 0x7fca780cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7d200640 1 -- 172.21.15.89:0/1495874212 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7814ebc0 con 0x7fca780c1ed0 2024-08-31T04:33:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7dc00640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 0x7fca780cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7e600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca780c90e0 0x7fca780c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca7d200640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca780c1ed0 0x7fca78142b40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca6400e6c0 tx=0x7fca6400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca75600640 1 -- 172.21.15.89:0/1495874212 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64004230 con 0x7fca780c1ed0 2024-08-31T04:33:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca75600640 1 -- 172.21.15.89:0/1495874212 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca640043d0 con 0x7fca780c1ed0 2024-08-31T04:33:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca75600640 1 -- 172.21.15.89:0/1495874212 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6400cb10 con 0x7fca780c1ed0 2024-08-31T04:33:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca80600640 1 -- 172.21.15.89:0/1495874212 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca780cc520 con 0x7fca780c1ed0 2024-08-31T04:33:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.479+0000 7fca80600640 1 -- 172.21.15.89:0/1495874212 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7814ee30 con 0x7fca780c1ed0 2024-08-31T04:33:08.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.483+0000 7fca75600640 1 -- 172.21.15.89:0/1495874212 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fca6400ccb0 con 0x7fca780c1ed0 2024-08-31T04:33:08.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.483+0000 7fca87e80000 1 Processor -- start 2024-08-31T04:33:08.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.483+0000 7fca75600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fca580720c0 0x7fca580745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.483+0000 7fca75600640 1 -- 172.21.15.89:0/1495874212 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fca640937d0 con 0x7fca780c1ed0 2024-08-31T04:33:08.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.483+0000 7fca87e80000 1 -- start start 2024-08-31T04:33:08.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.483+0000 7fca7e600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fca580720c0 0x7fca580745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.483+0000 7fca7e600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fca580720c0 0x7fca580745d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca70007de0 tx=0x7fca70009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:08.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x5594560a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f63e90 0x559456070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 0x559456071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559455ec6820 con 0x559455f4d960 2024-08-31T04:33:08.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x559455eb5db0 con 0x559455f63e90 2024-08-31T04:33:08.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x559455eb9d60 con 0x559455f6e3f0 2024-08-31T04:33:08.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x5594560a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x5594560a7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:36960/0 (socket says 172.21.15.89:36960) 2024-08-31T04:33:08.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7dc00640 1 -- 172.21.15.89:0/2077004254 learned_addr learned my addr 172.21.15.89:0/2077004254 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:08.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7e600640 1 --2- 172.21.15.89:0/2077004254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 0x559456071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7d200640 1 --2- 172.21.15.89:0/2077004254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f63e90 0x559456070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7dc00640 1 -- 172.21.15.89:0/2077004254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f63e90 msgr2=0x559456070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:08.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7dc00640 1 --2- 172.21.15.89:0/2077004254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f63e90 0x559456070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7dc00640 1 -- 172.21.15.89:0/2077004254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 msgr2=0x559456071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7dc00640 1 --2- 172.21.15.89:0/2077004254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 0x559456071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7dc00640 1 -- 172.21.15.89:0/2077004254 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559455e50b70 con 0x559455f6e3f0 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca7dc00640 1 --2- 172.21.15.89:0/2077004254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x5594560a7d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca6c019410 tx=0x7fca6c0195a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82013c79364fb6df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca6a000640 1 -- 172.21.15.89:0/2077004254 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0bd020 con 0x559455f6e3f0 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca6a000640 1 -- 172.21.15.89:0/2077004254 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca6c004040 con 0x559455f6e3f0 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca6a000640 1 -- 172.21.15.89:0/2077004254 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0b2040 con 0x559455f6e3f0 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 -- 172.21.15.89:0/2077004254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 msgr2=0x5594560a7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 --2- 172.21.15.89:0/2077004254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x5594560a7d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca6c019410 tx=0x7fca6c0195a0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 -- 172.21.15.89:0/2077004254 shutdown_connections 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 --2- 172.21.15.89:0/2077004254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 0x559456071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 --2- 172.21.15.89:0/2077004254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f63e90 0x559456070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 --2- 172.21.15.89:0/2077004254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x5594560a7d20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 -- 172.21.15.89:0/2077004254 >> 172.21.15.89:0/2077004254 conn(0x559455b75210 msgr2=0x5594560aa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:08.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 -- 172.21.15.89:0/2077004254 shutdown_connections 2024-08-31T04:33:08.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 -- 172.21.15.89:0/2077004254 wait complete. 2024-08-31T04:33:08.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 -- start start 2024-08-31T04:33:08.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.487+0000 7fca87e80000 1 Processor -- start 2024-08-31T04:33:08.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca87e80000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f4d960 0x5594560a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca87e80000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca87e80000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 0x5594560a7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca87e80000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559455b7cb10 con 0x559455f63e90 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca87e80000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x559455e3c6f0 con 0x559455f6e3f0 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca87e80000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x559455ebe390 con 0x559455f4d960 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca87e80000 10 client.0 _ll_register_callbacks cb 0x559455e5db60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f4d960 0x5594560a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f4d960 0x5594560a68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:36972/0 (socket says 172.21.15.89:36972) 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7dc00640 1 -- 172.21.15.89:0/22532901 learned_addr learned my addr 172.21.15.89:0/22532901 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7e600640 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 0x5594560a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7d200640 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7dc00640 1 -- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 msgr2=0x5594560a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7dc00640 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 0x5594560a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7dc00640 1 -- 172.21.15.89:0/22532901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 msgr2=0x5594560a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:08.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7dc00640 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7dc00640 1 -- 172.21.15.89:0/22532901 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x559455e74380 con 0x559455f4d960 2024-08-31T04:33:08.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca7dc00640 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f4d960 0x5594560a68f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0bc040 tx=0x7fca6c004460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43db81c0f0da90fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3301/0 2024-08-31T04:33:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca5ea00640 1 -- 172.21.15.89:0/22532901 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0b2050 con 0x559455f4d960 2024-08-31T04:33:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca5ea00640 1 -- 172.21.15.89:0/22532901 <== mon.2 v2:172.21.15.170:3301/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fca6c005d60 con 0x559455f4d960 2024-08-31T04:33:08.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.491+0000 7fca87e80000 1 -- 172.21.15.89:0/22532901 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x559455ec4d20 con 0x559455f4d960 2024-08-31T04:33:08.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca5ea00640 1 -- 172.21.15.89:0/22532901 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fca6c0d2050 con 0x559455f4d960 2024-08-31T04:33:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 10 client.5765 fetch_fsmap learned FSMap version 9 2024-08-31T04:33:08.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 1 -- 172.21.15.89:0/22532901 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x559455f3ae40 con 0x559455f4d960 2024-08-31T04:33:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca5ea00640 1 -- 172.21.15.89:0/22532901 <== mon.2 v2:172.21.15.170:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559455ec4d20 con 0x559455f4d960 2024-08-31T04:33:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca5ea00640 1 -- 172.21.15.89:0/22532901 <== mon.2 v2:172.21.15.170:3301/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fca6c0d5020 con 0x559455f4d960 2024-08-31T04:33:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 10 client.5765 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:33:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 10 client.5765 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:33:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 20 client.5765 populate_metadata read hostname 'smithi089' 2024-08-31T04:33:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x559455b59dc0 0x5594560c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 4 client.5765 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 1 -- 172.21.15.89:0/22532901 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559455ec8770 con 0x559455b59dc0 2024-08-31T04:33:08.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca7d200640 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x559455b59dc0 0x5594560c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca7d200640 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x559455b59dc0 0x5594560c1f90 crc :-1 s=READY pgs=1290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85cb3ee6adf276e9 server_cookie=2eb14a2338300a4f in_seq=0 out_seq=0 2024-08-31T04:33:08.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca5ea00640 10 client.5765 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:08.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca5ea00640 1 -- 172.21.15.89:0/22532901 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559455ec8770 con 0x559455b59dc0 2024-08-31T04:33:08.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca5ea00640 10 client.5765 handle_command_reply: tid=0 2024-08-31T04:33:08.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 1 client.5765 shutdown 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 1 -- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f4d960 msgr2=0x5594560a68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.499+0000 7fca87e80000 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f4d960 0x5594560a68f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0bc040 tx=0x7fca6c004460 comp rx=0 tx=0).stop 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca87e80000 1 -- 172.21.15.89:0/22532901 shutdown_connections 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca87e80000 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x559455b59dc0 0x5594560c1f90 crc :-1 s=READY pgs=1290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca87e80000 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca87e80000 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 0x5594560a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca87e80000 1 --2- 172.21.15.89:0/22532901 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f4d960 0x5594560a68f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca87e80000 1 -- 172.21.15.89:0/22532901 >> 172.21.15.89:0/22532901 conn(0x559455b75210 msgr2=0x5594560a9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca5ea00640 0 client.5765 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:08.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca87e80000 1 -- 172.21.15.89:0/22532901 shutdown_connections 2024-08-31T04:33:08.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca87e80000 1 -- 172.21.15.89:0/22532901 wait complete. 2024-08-31T04:33:08.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.503+0000 7fca87e80000 20 client.5765 trim_cache size 0 max 16384 2024-08-31T04:33:08.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.519+0000 7fca87e80000 1 Processor -- start 2024-08-31T04:33:08.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.519+0000 7fca87e80000 1 -- start start 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 0x559456069c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f63e90 0x55945606a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 0x5594560c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fca78201110 con 0x559455f4d960 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fca78202500 con 0x559455f6e3f0 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fca78201760 con 0x559455f63e90 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 0x559456069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7d200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f63e90 0x55945606a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 0x5594560c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7d200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f63e90 0x55945606a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:36976/0 (socket says 172.21.15.89:36976) 2024-08-31T04:33:08.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7d200640 1 -- 172.21.15.89:0/2452570586 learned_addr learned my addr 172.21.15.89:0/2452570586 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7d200640 1 -- 172.21.15.89:0/2452570586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 msgr2=0x5594560c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7d200640 1 --2- 172.21.15.89:0/2452570586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 0x5594560c0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7d200640 1 -- 172.21.15.89:0/2452570586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 msgr2=0x559456069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7d200640 1 --2- 172.21.15.89:0/2452570586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 0x559456069c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7d200640 1 -- 172.21.15.89:0/2452570586 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559455f125b0 con 0x559455f63e90 2024-08-31T04:33:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7dc00640 1 --2- 172.21.15.89:0/2452570586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 0x559456069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca7d200640 1 --2- 172.21.15.89:0/2452570586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f63e90 0x55945606a1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca6405e5d0 tx=0x7fca64081040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3049c7cfb6be78a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca69600640 1 -- 172.21.15.89:0/2452570586 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6405ac90 con 0x559455f63e90 2024-08-31T04:33:08.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca69600640 1 -- 172.21.15.89:0/2452570586 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca6405ed40 con 0x559455f63e90 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca69600640 1 -- 172.21.15.89:0/2452570586 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6405e640 con 0x559455f63e90 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 -- 172.21.15.89:0/2452570586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f63e90 msgr2=0x55945606a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 --2- 172.21.15.89:0/2452570586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f63e90 0x55945606a1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca6405e5d0 tx=0x7fca64081040 comp rx=0 tx=0).stop 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 -- 172.21.15.89:0/2452570586 shutdown_connections 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 --2- 172.21.15.89:0/2452570586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f6e3f0 0x5594560c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 --2- 172.21.15.89:0/2452570586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f63e90 0x55945606a1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 --2- 172.21.15.89:0/2452570586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f4d960 0x559456069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 -- 172.21.15.89:0/2452570586 >> 172.21.15.89:0/2452570586 conn(0x559455b75210 msgr2=0x5594560a6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 -- 172.21.15.89:0/2452570586 shutdown_connections 2024-08-31T04:33:08.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.523+0000 7fca87e80000 1 -- 172.21.15.89:0/2452570586 wait complete. 2024-08-31T04:33:08.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 -- start start 2024-08-31T04:33:08.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 Processor -- start 2024-08-31T04:33:08.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f4d960 0x5594560c4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x559456122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559455e37eb0 con 0x559455f63e90 2024-08-31T04:33:08.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fca78201e30 con 0x559455f4d960 2024-08-31T04:33:08.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x559455e5df20 con 0x559455f6e3f0 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 10 client.0 _ll_register_callbacks cb 0x7fca70001640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7e600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x559456122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35768/0 (socket says 172.21.15.89:35768) 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7d200640 1 -- 172.21.15.89:0/3379657122 learned_addr learned my addr 172.21.15.89:0/3379657122 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7dc00640 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f4d960 0x5594560c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7d200640 1 -- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 msgr2=0x559456122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7d200640 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x559456122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7d200640 1 -- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f4d960 msgr2=0x5594560c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7d200640 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f4d960 0x5594560c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7d200640 1 -- 172.21.15.89:0/3379657122 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559455e46fc0 con 0x559455f63e90 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7d200640 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560c4a70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fca6405a6c0 tx=0x7fca64005b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd843ada127108b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:08.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:33:08.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca5ea00640 1 -- 172.21.15.89:0/3379657122 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6405e150 con 0x559455f63e90 2024-08-31T04:33:08.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca5ea00640 1 -- 172.21.15.89:0/3379657122 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fca64067440 con 0x559455f63e90 2024-08-31T04:33:08.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 -- 172.21.15.89:0/3379657122 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca6405ed40 con 0x559455f63e90 2024-08-31T04:33:08.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca5ea00640 1 -- 172.21.15.89:0/3379657122 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fca64062eb0 con 0x559455f63e90 2024-08-31T04:33:08.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 10 client.6078 fetch_fsmap learned FSMap version 9 2024-08-31T04:33:08.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 -- 172.21.15.89:0/3379657122 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x559455e3fe00 con 0x559455f63e90 2024-08-31T04:33:08.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca5ea00640 1 -- 172.21.15.89:0/3379657122 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca6405ed40 con 0x559455f63e90 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca5ea00640 1 -- 172.21.15.89:0/3379657122 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fca6405d8a0 con 0x559455f63e90 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 10 client.6078 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 10 client.6078 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 20 client.6078 populate_metadata read hostname 'smithi089' 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x559455b47e20 0x559456123570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 4 client.6078 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.4, "await_for": 45.0}] 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca87e80000 1 -- 172.21.15.89:0/3379657122 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.4, "await_for": 45.0}) -- 0x559455ec4210 con 0x559455b47e20 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.527+0000 7fca7dc00640 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x559455b47e20 0x559456123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.531+0000 7fca5ea00640 10 client.6078 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:08.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:08.531+0000 7fca7dc00640 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x559455b47e20 0x559456123570 crc :-1 s=READY pgs=1291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b7729fb8aef8bad server_cookie=951c009fee6c72be in_seq=0 out_seq=0 2024-08-31T04:33:11.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca5ea00640 1 -- 172.21.15.89:0/3379657122 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559455ec4210 con 0x559455b47e20 2024-08-31T04:33:11.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca5ea00640 10 client.6078 handle_command_reply: tid=0 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca87e80000 1 client.6078 shutdown 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca87e80000 1 -- 172.21.15.89:0/3379657122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 msgr2=0x5594560c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca87e80000 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560c4a70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fca6405a6c0 tx=0x7fca64005b30 comp rx=0 tx=0).stop 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca87e80000 1 -- 172.21.15.89:0/3379657122 shutdown_connections 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca87e80000 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x559455b47e20 0x559456123570 crc :-1 s=READY pgs=1291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca87e80000 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559455f63e90 0x5594560c4a70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca87e80000 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559455f6e3f0 0x559456122ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca87e80000 1 --2- 172.21.15.89:0/3379657122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559455f4d960 0x5594560c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca87e80000 1 -- 172.21.15.89:0/3379657122 >> 172.21.15.89:0/3379657122 conn(0x559455b75210 msgr2=0x559456069c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.242+0000 7fca5ea00640 0 client.6078 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca87e80000 1 -- 172.21.15.89:0/3379657122 shutdown_connections 2024-08-31T04:33:11.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca87e80000 1 -- 172.21.15.89:0/3379657122 wait complete. 2024-08-31T04:33:11.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca87e80000 20 client.6078 trim_cache size 0 max 16384 2024-08-31T04:33:11.248 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:33:11.248 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:33:11.248 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:33:11.248 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 102, 2024-08-31T04:33:11.248 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "d4f1b1b4": { 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 102, 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 149.4, 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:33:11.249 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:33:11.250 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:33:11.250 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:33:11.250 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:11.250 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:11.250 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:11.250 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:11.250 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:11.250 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 -- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fca580720c0 msgr2=0x7fca580745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fca580720c0 0x7fca580745d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca70007de0 tx=0x7fca70009040 comp rx=0 tx=0).stop 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 -- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca780c1ed0 msgr2=0x7fca78142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca780c1ed0 0x7fca78142b40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca6400e6c0 tx=0x7fca6400eb80 comp rx=0 tx=0).stop 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 -- 172.21.15.89:0/1495874212 shutdown_connections 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fca580720c0 0x7fca580745d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca780c90e0 0x7fca780c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca780c1ed0 0x7fca78142b40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 --2- 172.21.15.89:0/1495874212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca780b2860 0x7fca780cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 -- 172.21.15.89:0/1495874212 >> 172.21.15.89:0/1495874212 conn(0x7fca780c99b0 msgr2=0x7fca781501a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:11.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 -- 172.21.15.89:0/1495874212 shutdown_connections 2024-08-31T04:33:11.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:11.246+0000 7fca80600640 1 -- 172.21.15.89:0/1495874212 wait complete. 2024-08-31T04:33:11.270 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd4f1b1b4', quiesce took 3.4 seconds. Will release after: 26.0 2024-08-31T04:33:24.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:33:24.910 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:33:37.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:33:37.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.434+0000 7fa6a5c00640 1 -- 172.21.15.89:0/3211395839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6a015bc70 msgr2=0x7fa6a0152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.434+0000 7fa6a5c00640 1 --2- 172.21.15.89:0/3211395839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6a015bc70 0x7fa6a0152a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00c9020 tx=0x7fa69001f0d0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.434+0000 7fa6a5c00640 1 -- 172.21.15.89:0/3211395839 shutdown_connections 2024-08-31T04:33:37.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.434+0000 7fa6a5c00640 1 --2- 172.21.15.89:0/3211395839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6a00c1f40 0x7fa6a00c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.434+0000 7fa6a5c00640 1 --2- 172.21.15.89:0/3211395839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6a015bc70 0x7fa6a0152a10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.434+0000 7fa6a5c00640 1 -- 172.21.15.89:0/3211395839 >> 172.21.15.89:0/3211395839 conn(0x7fa6a00ccf20 msgr2=0x7fa6a00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:37.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.434+0000 7fa6a5c00640 1 -- 172.21.15.89:0/3211395839 shutdown_connections 2024-08-31T04:33:37.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.434+0000 7fa6a5c00640 1 -- 172.21.15.89:0/3211395839 wait complete. 2024-08-31T04:33:37.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 Processor -- start 2024-08-31T04:33:37.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 -- start start 2024-08-31T04:33:37.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6a00c1f40 0x7fa6a015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6a00c7920 0x7fa6a01e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a015bc70 0x7fa6a014fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a0074fb0 con 0x7fa6a015bc70 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a0074e30 con 0x7fa6a00c7920 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a00c7d30 con 0x7fa6a00c1f40 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a015bc70 0x7fa6a014fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a015bc70 0x7fa6a014fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40928/0 (socket says 172.21.15.89:40928) 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69f400640 1 -- 172.21.15.89:0/1194259006 learned_addr learned my addr 172.21.15.89:0/1194259006 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa696000640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6a00c7920 0x7fa6a01e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69ea00640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6a00c1f40 0x7fa6a015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69f400640 1 -- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6a00c1f40 msgr2=0x7fa6a015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69f400640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6a00c1f40 0x7fa6a015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69f400640 1 -- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6a00c7920 msgr2=0x7fa6a01e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69f400640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6a00c7920 0x7fa6a01e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69f400640 1 -- 172.21.15.89:0/1194259006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a00cae20 con 0x7fa6a015bc70 2024-08-31T04:33:37.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa69f400640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a015bc70 0x7fa6a014fc60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c730 tx=0x7fa69800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:37.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa697400640 1 -- 172.21.15.89:0/1194259006 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698003b80 con 0x7fa6a015bc70 2024-08-31T04:33:37.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa697400640 1 -- 172.21.15.89:0/1194259006 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa698003d20 con 0x7fa6a015bc70 2024-08-31T04:33:37.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a015a540 con 0x7fa6a015bc70 2024-08-31T04:33:37.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa697400640 1 -- 172.21.15.89:0/1194259006 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698005330 con 0x7fa6a015bc70 2024-08-31T04:33:37.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.438+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a01e6320 con 0x7fa6a015bc70 2024-08-31T04:33:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.442+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a015a710 con 0x7fa6a015bc70 2024-08-31T04:33:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.442+0000 7fa697400640 1 -- 172.21.15.89:0/1194259006 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa6980056e0 con 0x7fa6a015bc70 2024-08-31T04:33:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.442+0000 7fa697400640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa67c0720c0 0x7fa67c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.442+0000 7fa697400640 1 -- 172.21.15.89:0/1194259006 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa698092ea0 con 0x7fa6a015bc70 2024-08-31T04:33:37.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.442+0000 7fa69ea00640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa67c0720c0 0x7fa67c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.446+0000 7fa69ea00640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa67c0720c0 0x7fa67c0745d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa6900b2000 tx=0x7fa69001d910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:37.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.446+0000 7fa697400640 1 -- 172.21.15.89:0/1194259006 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa69805dcb0 con 0x7fa6a015bc70 2024-08-31T04:33:37.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6a00c9330 con 0x7fa6a015bc70 2024-08-31T04:33:37.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa697400640 1 -- 172.21.15.89:0/1194259006 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fa698062470 con 0x7fa6a015bc70 2024-08-31T04:33:37.656 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:33:37.657 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:33:37.657 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:33:37.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa67c0720c0 msgr2=0x7fa67c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa67c0720c0 0x7fa67c0745d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa6900b2000 tx=0x7fa69001d910 comp rx=0 tx=0).stop 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a015bc70 msgr2=0x7fa6a014fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a015bc70 0x7fa6a014fc60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c730 tx=0x7fa69800cbf0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 shutdown_connections 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa67c0720c0 0x7fa67c0745d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a015bc70 0x7fa6a014fc60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6a00c7920 0x7fa6a01e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 --2- 172.21.15.89:0/1194259006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6a00c1f40 0x7fa6a015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.654+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 >> 172.21.15.89:0/1194259006 conn(0x7fa6a00ccf20 msgr2=0x7fa6a01e7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.658+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 shutdown_connections 2024-08-31T04:33:37.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.658+0000 7fa6a5c00640 1 -- 172.21.15.89:0/1194259006 wait complete. 2024-08-31T04:33:37.678 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id d4f1b1b4 --release --await' 2024-08-31T04:33:37.678 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id d4f1b1b4 --release --await 2024-08-31T04:33:37.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.834+0000 7f2ab7000640 1 -- 172.21.15.89:0/3871491882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab01581a0 msgr2=0x7f2ab01585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.834+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3871491882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab01581a0 0x7f2ab01585b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0073210 tx=0x7f2aa80203e0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.834+0000 7f2ab7000640 1 -- 172.21.15.89:0/3871491882 shutdown_connections 2024-08-31T04:33:37.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.834+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3871491882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab01581a0 0x7f2ab01585b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.834+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3871491882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ab006fd80 0x7f2ab0070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.834+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3871491882 >> v2:172.21.15.170:3300/0 conn(0x7f2ab0151dc0 0x7f2ab00749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.834+0000 7f2ab7000640 1 -- 172.21.15.89:0/3871491882 >> 172.21.15.89:0/3871491882 conn(0x7f2ab00c99b0 msgr2=0x7f2ab00c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:37.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.834+0000 7f2ab7000640 1 -- 172.21.15.89:0/3871491882 shutdown_connections 2024-08-31T04:33:37.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.834+0000 7f2ab7000640 1 -- 172.21.15.89:0/3871491882 wait complete. 2024-08-31T04:33:37.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2ab7000640 1 Processor -- start 2024-08-31T04:33:37.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2ab7000640 1 -- start start 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2ab7000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab006fd80 0x7f2ab0157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2ab7000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ab0151dc0 0x7f2ab00cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2ab7000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ab01581a0 0x7f2ab0145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2ab7000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab00c2770 con 0x7f2ab006fd80 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2ab7000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab00c2490 con 0x7f2ab0151dc0 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2ab7000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab01521d0 con 0x7f2ab01581a0 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab006fd80 0x7f2ab0157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab006fd80 0x7f2ab0157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40948/0 (socket says 172.21.15.89:40948) 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2aafe00640 1 -- 172.21.15.89:0/3355243527 learned_addr learned my addr 172.21.15.89:0/3355243527 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2ab5000640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ab01581a0 0x7f2ab0145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.838+0000 7f2aaf400640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ab0151dc0 0x7f2ab00cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aafe00640 1 -- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ab01581a0 msgr2=0x7f2ab0145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aafe00640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ab01581a0 0x7f2ab0145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aafe00640 1 -- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ab0151dc0 msgr2=0x7f2ab00cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aafe00640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ab0151dc0 0x7f2ab00cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aafe00640 1 -- 172.21.15.89:0/3355243527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab00cb1f0 con 0x7f2ab006fd80 2024-08-31T04:33:37.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aafe00640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab006fd80 0x7f2ab0157300 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000ead0 tx=0x7f2aa000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:37.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aa7e00640 1 -- 172.21.15.89:0/3355243527 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000ce40 con 0x7f2ab006fd80 2024-08-31T04:33:37.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aa7e00640 1 -- 172.21.15.89:0/3355243527 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2aa0011470 con 0x7f2ab006fd80 2024-08-31T04:33:37.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2ab7000640 1 -- 172.21.15.89:0/3355243527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab00cc640 con 0x7f2ab006fd80 2024-08-31T04:33:37.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aa7e00640 1 -- 172.21.15.89:0/3355243527 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00118a0 con 0x7f2ab006fd80 2024-08-31T04:33:37.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2ab7000640 1 -- 172.21.15.89:0/3355243527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab01f2150 con 0x7f2ab006fd80 2024-08-31T04:33:37.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.842+0000 7f2aa7e00640 1 -- 172.21.15.89:0/3355243527 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2aa0011a40 con 0x7f2ab006fd80 2024-08-31T04:33:37.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aa7e00640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a900720c0 0x7f2a900745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aa7e00640 1 -- 172.21.15.89:0/3355243527 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2aa0093ad0 con 0x7f2ab006fd80 2024-08-31T04:33:37.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 Processor -- start 2024-08-31T04:33:37.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aaf400640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a900720c0 0x7f2a900745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 -- start start 2024-08-31T04:33:37.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aaf400640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a900720c0 0x7f2a900745d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0076dc0 tx=0x7f2a9c00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:37.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1dc0950 0x5603e1edee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1daa930 0x5603e1ee3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1d9b890 0x5603e1ee4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5603e1d89f30 con 0x5603e1dc0950 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5603e1cff690 con 0x5603e1d9b890 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5603e1ceec20 con 0x5603e1daa930 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1dc0950 0x5603e1edee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1dc0950 0x5603e1edee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40952/0 (socket says 172.21.15.89:40952) 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aafe00640 1 -- 172.21.15.89:0/1370112284 learned_addr learned my addr 172.21.15.89:0/1370112284 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aaf400640 1 --2- 172.21.15.89:0/1370112284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1daa930 0x5603e1ee3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2ab5000640 1 --2- 172.21.15.89:0/1370112284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1d9b890 0x5603e1ee4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aafe00640 1 -- 172.21.15.89:0/1370112284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1daa930 msgr2=0x5603e1ee3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aafe00640 1 --2- 172.21.15.89:0/1370112284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1daa930 0x5603e1ee3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aafe00640 1 -- 172.21.15.89:0/1370112284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1d9b890 msgr2=0x5603e1ee4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aafe00640 1 --2- 172.21.15.89:0/1370112284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1d9b890 0x5603e1ee4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aafe00640 1 -- 172.21.15.89:0/1370112284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603e1ca38f0 con 0x5603e1dc0950 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aafe00640 1 --2- 172.21.15.89:0/1370112284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1dc0950 0x5603e1edee30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2aa005aa70 tx=0x7f2aa005e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae410194229bf0b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aa4c00640 1 -- 172.21.15.89:0/1370112284 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0083070 con 0x5603e1dc0950 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aa4c00640 1 -- 172.21.15.89:0/1370112284 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2aa0067b40 con 0x5603e1dc0950 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2aa4c00640 1 -- 172.21.15.89:0/1370112284 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00653c0 con 0x5603e1dc0950 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 -- 172.21.15.89:0/1370112284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1dc0950 msgr2=0x5603e1edee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1370112284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1dc0950 0x5603e1edee30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2aa005aa70 tx=0x7f2aa005e640 comp rx=0 tx=0).stop 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 -- 172.21.15.89:0/1370112284 shutdown_connections 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1370112284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1d9b890 0x5603e1ee4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1370112284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1daa930 0x5603e1ee3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.846+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1370112284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1dc0950 0x5603e1edee30 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 -- 172.21.15.89:0/1370112284 >> 172.21.15.89:0/1370112284 conn(0x5603e1dc0540 msgr2=0x5603e1ee1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 -- 172.21.15.89:0/1370112284 shutdown_connections 2024-08-31T04:33:37.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 -- 172.21.15.89:0/1370112284 wait complete. 2024-08-31T04:33:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 -- start start 2024-08-31T04:33:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 Processor -- start 2024-08-31T04:33:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1d9b890 0x5603e1ede030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1daa930 0x5603e1ede570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1dc0950 0x5603e1ee8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5603e1c75500 con 0x5603e1daa930 2024-08-31T04:33:37.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5603e1cf2bd0 con 0x5603e1dc0950 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5603e1c96a30 con 0x5603e1d9b890 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2abe74d000 10 client.0 _ll_register_callbacks cb 0x5603e1da4b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aaf400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1daa930 0x5603e1ede570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aaf400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1daa930 0x5603e1ede570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40966/0 (socket says 172.21.15.89:40966) 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aaf400640 1 -- 172.21.15.89:0/1086531408 learned_addr learned my addr 172.21.15.89:0/1086531408 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aafe00640 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1d9b890 0x5603e1ede030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2ab5000640 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1dc0950 0x5603e1ee8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aaf400640 1 -- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1d9b890 msgr2=0x5603e1ede030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aaf400640 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1d9b890 0x5603e1ede030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aaf400640 1 -- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1dc0950 msgr2=0x5603e1ee8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aaf400640 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1dc0950 0x5603e1ee8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aaf400640 1 -- 172.21.15.89:0/1086531408 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603e1c8e6a0 con 0x5603e1daa930 2024-08-31T04:33:37.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2aaf400640 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1daa930 0x5603e1ede570 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00bdd0 tx=0x7f2a9c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11be00615b1e5489 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2a99600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.850+0000 7f2a99600640 1 -- 172.21.15.89:0/1086531408 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c005020 con 0x5603e1daa930 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2a99600640 1 -- 172.21.15.89:0/1086531408 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2a9c0051c0 con 0x5603e1daa930 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 1 -- 172.21.15.89:0/1086531408 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603e1c887e0 con 0x5603e1daa930 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2a99600640 1 -- 172.21.15.89:0/1086531408 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2a9c02f050 con 0x5603e1daa930 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 10 client.6093 fetch_fsmap learned FSMap version 9 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 1 -- 172.21.15.89:0/1086531408 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5603e1cad1c0 con 0x5603e1daa930 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2a99600640 1 -- 172.21.15.89:0/1086531408 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5603e1c887e0 con 0x5603e1daa930 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2a99600640 1 -- 172.21.15.89:0/1086531408 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2a9c0053c0 con 0x5603e1daa930 2024-08-31T04:33:37.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 10 client.6093 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:33:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 10 client.6093 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:33:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 20 client.6093 populate_metadata read hostname 'smithi089' 2024-08-31T04:33:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5603e1d84fc0 0x5603e1ee9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 4 client.6093 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 1 -- 172.21.15.89:0/1086531408 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603e1d015e0 con 0x5603e1d84fc0 2024-08-31T04:33:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2aafe00640 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5603e1d84fc0 0x5603e1ee9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2a99600640 10 client.6093 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:37.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2aafe00640 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5603e1d84fc0 0x5603e1ee9970 crc :-1 s=READY pgs=1304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddc3bfc345b9ab6 server_cookie=d6e2e456b871f30f in_seq=0 out_seq=0 2024-08-31T04:33:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2a99600640 1 -- 172.21.15.89:0/1086531408 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603e1d015e0 con 0x5603e1d84fc0 2024-08-31T04:33:37.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2a99600640 10 client.6093 handle_command_reply: tid=0 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 1 client.6093 shutdown 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 1 -- 172.21.15.89:0/1086531408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1daa930 msgr2=0x5603e1ede570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.854+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1daa930 0x5603e1ede570 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00bdd0 tx=0x7f2a9c004740 comp rx=0 tx=0).stop 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2abe74d000 1 -- 172.21.15.89:0/1086531408 shutdown_connections 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5603e1d84fc0 0x5603e1ee9970 crc :-1 s=READY pgs=1304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1daa930 0x5603e1ede570 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1dc0950 0x5603e1ee8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2a99600640 0 client.6093 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1086531408 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1d9b890 0x5603e1ede030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2abe74d000 1 -- 172.21.15.89:0/1086531408 >> 172.21.15.89:0/1086531408 conn(0x5603e1dc0540 msgr2=0x5603e1edf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:37.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2abe74d000 1 -- 172.21.15.89:0/1086531408 shutdown_connections 2024-08-31T04:33:37.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2abe74d000 1 -- 172.21.15.89:0/1086531408 wait complete. 2024-08-31T04:33:37.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.858+0000 7f2abe74d000 20 client.6093 trim_cache size 0 max 16384 2024-08-31T04:33:37.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2abe74d000 1 Processor -- start 2024-08-31T04:33:37.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2abe74d000 1 -- start start 2024-08-31T04:33:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1e9f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 0x5603e1e9f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 0x5603e1ef7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2abe74d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab0200e50 con 0x5603e1d9b890 2024-08-31T04:33:37.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2abe74d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01ffd30 con 0x5603e1daa930 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2abe74d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab01fe250 con 0x5603e1dc0950 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1e9f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1e9f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40970/0 (socket says 172.21.15.89:40970) 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aafe00640 1 -- 172.21.15.89:0/2899204162 learned_addr learned my addr 172.21.15.89:0/2899204162 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2ab5000640 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 0x5603e1ef7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aaf400640 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 0x5603e1e9f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aafe00640 1 -- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 msgr2=0x5603e1ef7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aafe00640 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 0x5603e1ef7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aafe00640 1 -- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 msgr2=0x5603e1e9f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aafe00640 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 0x5603e1e9f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aafe00640 1 -- 172.21.15.89:0/2899204162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603e1d732f0 con 0x5603e1d9b890 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2aaf400640 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 0x5603e1e9f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:33:37.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.874+0000 7f2ab5000640 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 0x5603e1ef7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:33:37.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2aafe00640 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1e9f040 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2aa005afe0 tx=0x7f2aa0061070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6817cd63c4fcfc47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:37.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2a9be00640 1 -- 172.21.15.89:0/2899204162 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0083040 con 0x5603e1d9b890 2024-08-31T04:33:37.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2a9be00640 1 -- 172.21.15.89:0/2899204162 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2aa005ae10 con 0x5603e1d9b890 2024-08-31T04:33:37.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2a9be00640 1 -- 172.21.15.89:0/2899204162 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa005a8b0 con 0x5603e1d9b890 2024-08-31T04:33:37.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 -- 172.21.15.89:0/2899204162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 msgr2=0x5603e1e9f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:37.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1e9f040 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2aa005afe0 tx=0x7f2aa0061070 comp rx=0 tx=0).stop 2024-08-31T04:33:37.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 -- 172.21.15.89:0/2899204162 shutdown_connections 2024-08-31T04:33:37.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 0x5603e1ef7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 0x5603e1e9f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 --2- 172.21.15.89:0/2899204162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1e9f040 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 -- 172.21.15.89:0/2899204162 >> 172.21.15.89:0/2899204162 conn(0x5603e1dc0540 msgr2=0x5603e1ef47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:37.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 -- 172.21.15.89:0/2899204162 shutdown_connections 2024-08-31T04:33:37.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 -- 172.21.15.89:0/2899204162 wait complete. 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 -- start start 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 Processor -- start 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1efa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 0x5603e1efa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 0x5603e1efae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01fe8c0 con 0x5603e1d9b890 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab01ff660 con 0x5603e1daa930 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab01fef90 con 0x5603e1dc0950 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.878+0000 7f2abe74d000 10 client.0 _ll_register_callbacks cb 0x7f2a9c00b780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:37.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1efa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1efa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40984/0 (socket says 172.21.15.89:40984) 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aafe00640 1 -- 172.21.15.89:0/1339733006 learned_addr learned my addr 172.21.15.89:0/1339733006 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aaf400640 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 0x5603e1efa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2ab5000640 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 0x5603e1efae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aafe00640 1 -- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 msgr2=0x5603e1efae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aafe00640 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 0x5603e1efae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aafe00640 1 -- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 msgr2=0x5603e1efa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aafe00640 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 0x5603e1efa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aafe00640 1 -- 172.21.15.89:0/1339733006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603e1c78b30 con 0x5603e1d9b890 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aafe00640 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1efa380 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000c700 tx=0x7f2aa004c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f01e29d4d847843 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2a99600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2a99600640 1 -- 172.21.15.89:0/1339733006 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0087030 con 0x5603e1d9b890 2024-08-31T04:33:37.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2a99600640 1 -- 172.21.15.89:0/1339733006 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2aa0091050 con 0x5603e1d9b890 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2abe74d000 1 -- 172.21.15.89:0/1339733006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2aa005ae10 con 0x5603e1d9b890 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2a99600640 1 -- 172.21.15.89:0/1339733006 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2aa0083040 con 0x5603e1d9b890 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2abe74d000 10 client.6099 fetch_fsmap learned FSMap version 9 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2abe74d000 1 -- 172.21.15.89:0/1339733006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5603e1c85c70 con 0x5603e1d9b890 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2a99600640 1 -- 172.21.15.89:0/1339733006 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2aa005ae10 con 0x5603e1d9b890 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2a99600640 1 -- 172.21.15.89:0/1339733006 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2aa0022030 con 0x5603e1d9b890 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2abe74d000 10 client.6099 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2abe74d000 10 client.6099 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2abe74d000 20 client.6099 populate_metadata read hostname 'smithi089' 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5603e1980e80 0x5603e1efb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2abe74d000 4 client.6099 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d4f1b1b4", "release": true, "await": true}] 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2abe74d000 1 -- 172.21.15.89:0/1339733006 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d4f1b1b4", "release": true, "await": true}) -- 0x5603e1ee22e0 con 0x5603e1980e80 2024-08-31T04:33:37.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aaf400640 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5603e1980e80 0x5603e1efb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:37.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2aaf400640 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5603e1980e80 0x5603e1efb340 crc :-1 s=READY pgs=1305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78f814206a043739 server_cookie=688dbaf4bfa4dbaa in_seq=0 out_seq=0 2024-08-31T04:33:37.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:37.882+0000 7f2a99600640 10 client.6099 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2a99600640 1 -- 172.21.15.89:0/1339733006 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5603e1ee22e0 con 0x5603e1980e80 2024-08-31T04:33:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2a99600640 10 client.6099 handle_command_reply: tid=0 2024-08-31T04:33:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 client.6099 shutdown 2024-08-31T04:33:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 -- 172.21.15.89:0/1339733006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 msgr2=0x5603e1efa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1efa380 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000c700 tx=0x7f2aa004c170 comp rx=0 tx=0).stop 2024-08-31T04:33:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 -- 172.21.15.89:0/1339733006 shutdown_connections 2024-08-31T04:33:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5603e1980e80 0x5603e1efb340 crc :-1 s=READY pgs=1305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5603e1dc0950 0x5603e1efae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603e1daa930 0x5603e1efa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2a99600640 0 client.6099 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 --2- 172.21.15.89:0/1339733006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5603e1d9b890 0x5603e1efa380 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 -- 172.21.15.89:0/1339733006 >> 172.21.15.89:0/1339733006 conn(0x5603e1dc0540 msgr2=0x5603e1ee76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 -- 172.21.15.89:0/1339733006 shutdown_connections 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.030+0000 7f2abe74d000 1 -- 172.21.15.89:0/1339733006 wait complete. 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2abe74d000 20 client.6099 trim_cache size 0 max 16384 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:33:38.036 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 104, 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "d4f1b1b4": { 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 104, 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 149.4, 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:33:38.037 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:33:38.038 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:33:38.038 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:33:38.038 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:38.038 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:38.038 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:38.038 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:38.038 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:38.038 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 -- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a900720c0 msgr2=0x7f2a900745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a900720c0 0x7f2a900745d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0076dc0 tx=0x7f2a9c00b2e0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 -- 172.21.15.89:0/3355243527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab006fd80 msgr2=0x7f2ab0157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab006fd80 0x7f2ab0157300 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000ead0 tx=0x7f2aa000ef90 comp rx=0 tx=0).stop 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 -- 172.21.15.89:0/3355243527 shutdown_connections 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a900720c0 0x7f2a900745d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ab01581a0 0x7f2ab0145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ab0151dc0 0x7f2ab00cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 --2- 172.21.15.89:0/3355243527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab006fd80 0x7f2ab0157300 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 -- 172.21.15.89:0/3355243527 >> 172.21.15.89:0/3355243527 conn(0x7f2ab00c99b0 msgr2=0x7f2ab00c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:38.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 -- 172.21.15.89:0/3355243527 shutdown_connections 2024-08-31T04:33:38.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.034+0000 7f2ab7000640 1 -- 172.21.15.89:0/3355243527 wait complete. 2024-08-31T04:33:38.054 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd4f1b1b4', total seconds elapsed: 30.2 2024-08-31T04:33:38.054 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.4 2024-08-31T04:33:38.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:33:38.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 -- 172.21.15.89:0/1198721974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d800c1f40 msgr2=0x7f3d800c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 --2- 172.21.15.89:0/1198721974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d800c1f40 0x7f3d800c9330 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3d800c9020 tx=0x7f3d6801f0d0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 -- 172.21.15.89:0/1198721974 shutdown_connections 2024-08-31T04:33:38.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 --2- 172.21.15.89:0/1198721974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d800c1f40 0x7f3d800c9330 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 --2- 172.21.15.89:0/1198721974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d8015bc70 0x7f3d80152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 -- 172.21.15.89:0/1198721974 >> 172.21.15.89:0/1198721974 conn(0x7f3d800ccf20 msgr2=0x7f3d800cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:38.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 -- 172.21.15.89:0/1198721974 shutdown_connections 2024-08-31T04:33:38.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 -- 172.21.15.89:0/1198721974 wait complete. 2024-08-31T04:33:38.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 Processor -- start 2024-08-31T04:33:38.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.206+0000 7f3d85e00640 1 -- start start 2024-08-31T04:33:38.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d85e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d800c1f40 0x7f3d80148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d85e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d800c7920 0x7f3d80146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d85e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d8015bc70 0x7f3d80146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d85e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3d80074fb0 con 0x7f3d8015bc70 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d85e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3d80074e30 con 0x7f3d800c1f40 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d85e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3d800c7d30 con 0x7f3d800c7920 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d8015bc70 0x7f3d80146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d8015bc70 0x7f3d80146dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41002/0 (socket says 172.21.15.89:41002) 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7f400640 1 -- 172.21.15.89:0/160798636 learned_addr learned my addr 172.21.15.89:0/160798636 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d76000640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d800c7920 0x7f3d80146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7ea00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d800c1f40 0x7f3d80148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7f400640 1 -- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d800c7920 msgr2=0x7f3d80146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7f400640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d800c7920 0x7f3d80146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7f400640 1 -- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d800c1f40 msgr2=0x7f3d80148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7f400640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d800c1f40 0x7f3d80148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7f400640 1 -- 172.21.15.89:0/160798636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8015ab90 con 0x7f3d8015bc70 2024-08-31T04:33:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d7f400640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d8015bc70 0x7f3d80146dd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c760 tx=0x7f3d7800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d77e00640 1 -- 172.21.15.89:0/160798636 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78003db0 con 0x7f3d8015bc70 2024-08-31T04:33:38.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d77e00640 1 -- 172.21.15.89:0/160798636 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d7800ce10 con 0x7f3d8015bc70 2024-08-31T04:33:38.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d800b1bc0 con 0x7f3d8015bc70 2024-08-31T04:33:38.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d77e00640 1 -- 172.21.15.89:0/160798636 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780052d0 con 0x7f3d8015bc70 2024-08-31T04:33:38.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d800ccbf0 con 0x7f3d8015bc70 2024-08-31T04:33:38.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.210+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d800b1e00 con 0x7f3d8015bc70 2024-08-31T04:33:38.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.214+0000 7f3d77e00640 1 -- 172.21.15.89:0/160798636 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3d78005470 con 0x7f3d8015bc70 2024-08-31T04:33:38.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.214+0000 7f3d77e00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3d5c0720f0 0x7f3d5c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.214+0000 7f3d77e00640 1 -- 172.21.15.89:0/160798636 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3d78092be0 con 0x7f3d8015bc70 2024-08-31T04:33:38.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.214+0000 7f3d7ea00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3d5c0720f0 0x7f3d5c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.214+0000 7f3d7ea00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3d5c0720f0 0x7f3d5c074600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d70005fd0 tx=0x7f3d70005e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:38.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.218+0000 7f3d77e00640 1 -- 172.21.15.89:0/160798636 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3d800b1e00 con 0x7f3d8015bc70 2024-08-31T04:33:38.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d80159e00 con 0x7f3d8015bc70 2024-08-31T04:33:38.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d77e00640 1 -- 172.21.15.89:0/160798636 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f3d7805db00 con 0x7f3d8015bc70 2024-08-31T04:33:38.420 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:33:38.420 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:33:38.420 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:33:38.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3d5c0720f0 msgr2=0x7f3d5c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3d5c0720f0 0x7f3d5c074600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d70005fd0 tx=0x7f3d70005e40 comp rx=0 tx=0).stop 2024-08-31T04:33:38.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d8015bc70 msgr2=0x7f3d80146dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d8015bc70 0x7f3d80146dd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c760 tx=0x7f3d7800cc20 comp rx=0 tx=0).stop 2024-08-31T04:33:38.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 shutdown_connections 2024-08-31T04:33:38.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3d5c0720f0 0x7f3d5c074600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d8015bc70 0x7f3d80146dd0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d800c7920 0x7f3d80146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 --2- 172.21.15.89:0/160798636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d800c1f40 0x7f3d80148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 >> 172.21.15.89:0/160798636 conn(0x7f3d800ccf20 msgr2=0x7f3d800765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:38.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 shutdown_connections 2024-08-31T04:33:38.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.418+0000 7f3d85e00640 1 -- 172.21.15.89:0/160798636 wait complete. 2024-08-31T04:33:38.441 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 149.4 --await-for 45.0' 2024-08-31T04:33:38.442 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 149.4 --await-for 45.0 2024-08-31T04:33:38.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.606+0000 7f167d400640 1 -- 172.21.15.89:0/3907771343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 msgr2=0x7f165c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.606+0000 7f167d400640 1 --2- 172.21.15.89:0/3907771343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 0x7f165c00b9d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1670009e90 tx=0x7f167001d5f0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.606+0000 7f167d400640 1 -- 172.21.15.89:0/3907771343 shutdown_connections 2024-08-31T04:33:38.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.606+0000 7f167d400640 1 --2- 172.21.15.89:0/3907771343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 0x7f165c00b9d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.606+0000 7f167d400640 1 -- 172.21.15.89:0/3907771343 >> 172.21.15.89:0/3907771343 conn(0x7f16780c99b0 msgr2=0x7f16780c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:38.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.606+0000 7f167d400640 1 -- 172.21.15.89:0/3907771343 shutdown_connections 2024-08-31T04:33:38.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.606+0000 7f167d400640 1 -- 172.21.15.89:0/3907771343 wait complete. 2024-08-31T04:33:38.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f167d400640 1 Processor -- start 2024-08-31T04:33:38.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f167d400640 1 -- start start 2024-08-31T04:33:38.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f167d400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 0x7f1678155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f167d400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f167815ad40 0x7f16780ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f167d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16781ef9d0 0x7f16780cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f167d400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16780c22e0 con 0x7f165c005360 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f167d400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f16780c8c50 con 0x7f16781ef9d0 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f167d400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f16780c3160 con 0x7f167815ad40 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1676800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 0x7f1678155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1676800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 0x7f1678155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41014/0 (socket says 172.21.15.89:41014) 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1676800640 1 -- 172.21.15.89:0/913145997 learned_addr learned my addr 172.21.15.89:0/913145997 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f166de00640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f167815ad40 0x7f16780ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1677200640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16781ef9d0 0x7f16780cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1676800640 1 -- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f167815ad40 msgr2=0x7f16780ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1676800640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f167815ad40 0x7f16780ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1676800640 1 -- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16781ef9d0 msgr2=0x7f16780cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1676800640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16781ef9d0 0x7f16780cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1676800640 1 -- 172.21.15.89:0/913145997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16780aa8e0 con 0x7f165c005360 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1677200640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16781ef9d0 0x7f16780cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f166de00640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f167815ad40 0x7f16780ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.610+0000 7f1676800640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 0x7f1678155910 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f16680016a0 tx=0x7f166800e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.614+0000 7f166f400640 1 -- 172.21.15.89:0/913145997 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668012640 con 0x7f165c005360 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.614+0000 7f166f400640 1 -- 172.21.15.89:0/913145997 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16680128d0 con 0x7f165c005360 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.614+0000 7f167d400640 1 -- 172.21.15.89:0/913145997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16781f31d0 con 0x7f165c005360 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.614+0000 7f166f400640 1 -- 172.21.15.89:0/913145997 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668012d20 con 0x7f165c005360 2024-08-31T04:33:38.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.614+0000 7f167d400640 1 -- 172.21.15.89:0/913145997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16781f3790 con 0x7f165c005360 2024-08-31T04:33:38.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.614+0000 7f166f400640 1 -- 172.21.15.89:0/913145997 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f166800d030 con 0x7f165c005360 2024-08-31T04:33:38.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.614+0000 7f166f400640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720f0 0x7f1654074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.614+0000 7f166f400640 1 -- 172.21.15.89:0/913145997 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f16680961c0 con 0x7f165c005360 2024-08-31T04:33:38.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f166de00640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720f0 0x7f1654074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 Processor -- start 2024-08-31T04:33:38.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 -- start start 2024-08-31T04:33:38.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f166de00640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720f0 0x7f1654074600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1678076740 tx=0x7f1660006050 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:38.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e55613f0 0x5580e569ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 0x5580e5663ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5540960 0x5580e5664220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5580e54b9820 con 0x5580e55613f0 2024-08-31T04:33:38.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5580e54a8db0 con 0x5580e5540960 2024-08-31T04:33:38.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5580e54acd60 con 0x5580e5556e90 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1676800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e55613f0 0x5580e569ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1676800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e55613f0 0x5580e569ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41016/0 (socket says 172.21.15.89:41016) 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1676800640 1 -- 172.21.15.89:0/2064881640 learned_addr learned my addr 172.21.15.89:0/2064881640 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1677200640 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5540960 0x5580e5664220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f166de00640 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 0x5580e5663ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1676800640 1 -- 172.21.15.89:0/2064881640 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 msgr2=0x5580e5663ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1676800640 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 0x5580e5663ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1676800640 1 -- 172.21.15.89:0/2064881640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5540960 msgr2=0x5580e5664220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1676800640 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5540960 0x5580e5664220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1676800640 1 -- 172.21.15.89:0/2064881640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e5443b70 con 0x5580e55613f0 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1677200640 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5540960 0x5580e5664220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1676800640 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e55613f0 0x5580e569ad20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f166805d0b0 tx=0x7f1668060860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e139537e704f5594 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:38.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1667000640 1 -- 172.21.15.89:0/2064881640 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668061030 con 0x5580e55613f0 2024-08-31T04:33:38.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1667000640 1 -- 172.21.15.89:0/2064881640 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16680658a0 con 0x5580e55613f0 2024-08-31T04:33:38.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f1667000640 1 -- 172.21.15.89:0/2064881640 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166806a030 con 0x5580e55613f0 2024-08-31T04:33:38.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 -- 172.21.15.89:0/2064881640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e55613f0 msgr2=0x5580e569ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e55613f0 0x5580e569ad20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f166805d0b0 tx=0x7f1668060860 comp rx=0 tx=0).stop 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 -- 172.21.15.89:0/2064881640 shutdown_connections 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5540960 0x5580e5664220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 0x5580e5663ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 --2- 172.21.15.89:0/2064881640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e55613f0 0x5580e569ad20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 -- 172.21.15.89:0/2064881640 >> 172.21.15.89:0/2064881640 conn(0x5580e5168210 msgr2=0x5580e569d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 -- 172.21.15.89:0/2064881640 shutdown_connections 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.618+0000 7f16849c1000 1 -- 172.21.15.89:0/2064881640 wait complete. 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 -- start start 2024-08-31T04:33:38.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 Processor -- start 2024-08-31T04:33:38.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e56998f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5556e90 0x5580e5699e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e55613f0 0x5580e569a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5580e516fb10 con 0x5580e5540960 2024-08-31T04:33:38.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5580e542f6f0 con 0x5580e5556e90 2024-08-31T04:33:38.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5580e54b1390 con 0x5580e55613f0 2024-08-31T04:33:38.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 10 client.0 _ll_register_callbacks cb 0x5580e5450b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:38.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1676800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e56998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1676800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e56998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41030/0 (socket says 172.21.15.89:41030) 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1676800640 1 -- 172.21.15.89:0/3382609011 learned_addr learned my addr 172.21.15.89:0/3382609011 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1677200640 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e55613f0 0x5580e569a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f166de00640 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5556e90 0x5580e5699e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1676800640 1 -- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e55613f0 msgr2=0x5580e569a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1676800640 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e55613f0 0x5580e569a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1676800640 1 -- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5556e90 msgr2=0x5580e5699e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1676800640 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5556e90 0x5580e5699e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1676800640 1 -- 172.21.15.89:0/3382609011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e5467380 con 0x5580e5540960 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f1676800640 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e56998f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f166805e2a0 tx=0x7f166805d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7557823732efcb27 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f165b400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f165b400640 1 -- 172.21.15.89:0/3382609011 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668061030 con 0x5580e5540960 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f165b400640 1 -- 172.21.15.89:0/3382609011 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f1668068b90 con 0x5580e5540960 2024-08-31T04:33:38.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 -- 172.21.15.89:0/3382609011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5580e54b7d20 con 0x5580e5540960 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f165b400640 1 -- 172.21.15.89:0/3382609011 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f16680658a0 con 0x5580e5540960 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 10 client.6120 fetch_fsmap learned FSMap version 9 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.622+0000 7f16849c1000 1 -- 172.21.15.89:0/3382609011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5580e552de40 con 0x5580e5540960 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f165b400640 1 -- 172.21.15.89:0/3382609011 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1668087080 con 0x5580e5540960 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f165b400640 1 -- 172.21.15.89:0/3382609011 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f1668084070 con 0x5580e5540960 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f16849c1000 10 client.6120 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f16849c1000 10 client.6120 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f16849c1000 20 client.6120 populate_metadata read hostname 'smithi089' 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f16849c1000 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5580e514cdc0 0x5580e56b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f16849c1000 4 client.6120 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:38.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f16849c1000 1 -- 172.21.15.89:0/3382609011 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580e54bb770 con 0x5580e514cdc0 2024-08-31T04:33:38.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f166de00640 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5580e514cdc0 0x5580e56b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f166de00640 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5580e514cdc0 0x5580e56b4f90 crc :-1 s=READY pgs=1307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a45dc1657d138da1 server_cookie=2ab5dc74e86247ee in_seq=0 out_seq=0 2024-08-31T04:33:38.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.626+0000 7f165b400640 10 client.6120 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.630+0000 7f165b400640 1 -- 172.21.15.89:0/3382609011 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580e54bb770 con 0x5580e514cdc0 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.630+0000 7f165b400640 10 client.6120 handle_command_reply: tid=0 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.630+0000 7f16849c1000 1 client.6120 shutdown 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 -- 172.21.15.89:0/3382609011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 msgr2=0x5580e56998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e56998f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f166805e2a0 tx=0x7f166805d4f0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 -- 172.21.15.89:0/3382609011 shutdown_connections 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5580e514cdc0 0x5580e56b4f90 crc :-1 s=READY pgs=1307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e55613f0 0x5580e569a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e5556e90 0x5580e5699e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 --2- 172.21.15.89:0/3382609011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e56998f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f165b400640 0 client.6120 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:38.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 -- 172.21.15.89:0/3382609011 >> 172.21.15.89:0/3382609011 conn(0x5580e5168210 msgr2=0x5580e569c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:38.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 -- 172.21.15.89:0/3382609011 shutdown_connections 2024-08-31T04:33:38.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 1 -- 172.21.15.89:0/3382609011 wait complete. 2024-08-31T04:33:38.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.634+0000 7f16849c1000 20 client.6120 trim_cache size 0 max 16384 2024-08-31T04:33:38.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 Processor -- start 2024-08-31T04:33:38.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 -- start start 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5540960 0x5580e570f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5556e90 0x5580e570fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 0x5580e5710290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16780c6800 con 0x5580e5556e90 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f16781ff740 con 0x5580e55613f0 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f16781fea10 con 0x5580e5540960 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f166de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5556e90 0x5580e570fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f1676800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5540960 0x5580e570f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f166de00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5556e90 0x5580e570fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41034/0 (socket says 172.21.15.89:41034) 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f166de00640 1 -- 172.21.15.89:0/1256328687 learned_addr learned my addr 172.21.15.89:0/1256328687 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:38.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f1677200640 1 --2- 172.21.15.89:0/1256328687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 0x5580e5710290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f166de00640 1 -- 172.21.15.89:0/1256328687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5540960 msgr2=0x5580e570f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:38.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f166de00640 1 --2- 172.21.15.89:0/1256328687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5540960 0x5580e570f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f166de00640 1 -- 172.21.15.89:0/1256328687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 msgr2=0x5580e5710290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:38.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f166de00640 1 --2- 172.21.15.89:0/1256328687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 0x5580e5710290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f166de00640 1 -- 172.21.15.89:0/1256328687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e55055b0 con 0x5580e5556e90 2024-08-31T04:33:38.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f166de00640 1 --2- 172.21.15.89:0/1256328687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5556e90 0x5580e570fd50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x5580e54637b0 tx=0x7f1660006680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b669410b96b8781f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f1666600640 1 -- 172.21.15.89:0/1256328687 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660016070 con 0x5580e5556e90 2024-08-31T04:33:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f1666600640 1 -- 172.21.15.89:0/1256328687 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f166001fa40 con 0x5580e5556e90 2024-08-31T04:33:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f1666600640 1 -- 172.21.15.89:0/1256328687 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166001fe50 con 0x5580e5556e90 2024-08-31T04:33:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 -- 172.21.15.89:0/1256328687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5556e90 msgr2=0x5580e570fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 --2- 172.21.15.89:0/1256328687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5556e90 0x5580e570fd50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x5580e54637b0 tx=0x7f1660006680 comp rx=0 tx=0).stop 2024-08-31T04:33:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 -- 172.21.15.89:0/1256328687 shutdown_connections 2024-08-31T04:33:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 --2- 172.21.15.89:0/1256328687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5556e90 0x5580e570fd50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 --2- 172.21.15.89:0/1256328687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 0x5580e5710290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 --2- 172.21.15.89:0/1256328687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5540960 0x5580e570f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 -- 172.21.15.89:0/1256328687 >> 172.21.15.89:0/1256328687 conn(0x5580e5168210 msgr2=0x5580e569a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 -- 172.21.15.89:0/1256328687 shutdown_connections 2024-08-31T04:33:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.654+0000 7f16849c1000 1 -- 172.21.15.89:0/1256328687 wait complete. 2024-08-31T04:33:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 -- start start 2024-08-31T04:33:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 Processor -- start 2024-08-31T04:33:38.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e571a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 0x5580e571aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 0x5580e571af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5580e542aeb0 con 0x5580e5540960 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f16781ff070 con 0x5580e55613f0 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5580e5450f20 con 0x5580e5556e90 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 10 client.0 _ll_register_callbacks cb 0x7f166804d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1676800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e571a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1676800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e571a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41050/0 (socket says 172.21.15.89:41050) 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1676800640 1 -- 172.21.15.89:0/1123241662 learned_addr learned my addr 172.21.15.89:0/1123241662 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f166de00640 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 0x5580e571aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1677200640 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 0x5580e571af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1676800640 1 -- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 msgr2=0x5580e571aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:38.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1676800640 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 0x5580e571aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1676800640 1 -- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 msgr2=0x5580e571af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:38.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1676800640 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 0x5580e571af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:38.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1676800640 1 -- 172.21.15.89:0/1123241662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e5439fc0 con 0x5580e5540960 2024-08-31T04:33:38.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f166de00640 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 0x5580e571aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:38.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f1676800640 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e571a510 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f166806a480 tx=0x7f16680941c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45040ca005a2d3a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:38.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f165b400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:33:38.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f165b400640 1 -- 172.21.15.89:0/1123241662 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668060490 con 0x5580e5540960 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f165b400640 1 -- 172.21.15.89:0/1123241662 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f166805c9a0 con 0x5580e5540960 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 -- 172.21.15.89:0/1123241662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f166001fa40 con 0x5580e5540960 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f165b400640 1 -- 172.21.15.89:0/1123241662 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1668061030 con 0x5580e5540960 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 10 client.6126 fetch_fsmap learned FSMap version 9 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f16849c1000 1 -- 172.21.15.89:0/1123241662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5580e5432e00 con 0x5580e5540960 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.658+0000 7f165b400640 1 -- 172.21.15.89:0/1123241662 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f166001fa40 con 0x5580e5540960 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f165b400640 1 -- 172.21.15.89:0/1123241662 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f1668084040 con 0x5580e5540960 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f16849c1000 10 client.6126 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f16849c1000 10 client.6126 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f16849c1000 20 client.6126 populate_metadata read hostname 'smithi089' 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f16849c1000 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5580e513ae20 0x5580e56b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f16849c1000 4 client.6126 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.4, "await_for": 45.0}] 2024-08-31T04:33:38.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f16849c1000 1 -- 172.21.15.89:0/1123241662 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.4, "await_for": 45.0}) -- 0x5580e54b7210 con 0x5580e513ae20 2024-08-31T04:33:38.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f166de00640 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5580e513ae20 0x5580e56b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:38.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f165b400640 10 client.6126 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:38.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:38.662+0000 7f166de00640 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5580e513ae20 0x5580e56b79b0 crc :-1 s=READY pgs=1308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32d7c1bc9a822d70 server_cookie=5ce6d709fac5acc8 in_seq=0 out_seq=0 2024-08-31T04:33:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f165b400640 1 -- 172.21.15.89:0/1123241662 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5580e54b7210 con 0x5580e513ae20 2024-08-31T04:33:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f165b400640 10 client.6126 handle_command_reply: tid=0 2024-08-31T04:33:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 client.6126 shutdown 2024-08-31T04:33:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 -- 172.21.15.89:0/1123241662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 msgr2=0x5580e571a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e571a510 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f166806a480 tx=0x7f16680941c0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 -- 172.21.15.89:0/1123241662 shutdown_connections 2024-08-31T04:33:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5580e513ae20 0x5580e56b79b0 crc :-1 s=READY pgs=1308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5580e55613f0 0x5580e571af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5580e5556e90 0x5580e571aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 --2- 172.21.15.89:0/1123241662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5580e5540960 0x5580e571a510 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f165b400640 0 client.6126 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 -- 172.21.15.89:0/1123241662 >> 172.21.15.89:0/1123241662 conn(0x5580e5168210 msgr2=0x5580e56997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 -- 172.21.15.89:0/1123241662 shutdown_connections 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 1 -- 172.21.15.89:0/1123241662 wait complete. 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f16849c1000 20 client.6126 trim_cache size 0 max 16384 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:33:41.461 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 106, 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "df4507ad": { 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 106, 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 149.4, 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:33:41.462 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:33:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:33:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:33:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:33:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:41.463 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:33:41.463 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 -- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720f0 msgr2=0x7f1654074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720f0 0x7f1654074600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1678076740 tx=0x7f1660006050 comp rx=0 tx=0).stop 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 -- 172.21.15.89:0/913145997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 msgr2=0x7f1678155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 0x7f1678155910 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f16680016a0 tx=0x7f166800e6b0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 -- 172.21.15.89:0/913145997 shutdown_connections 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720f0 0x7f1654074600 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16781ef9d0 0x7f16780cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f167815ad40 0x7f16780ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 --2- 172.21.15.89:0/913145997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c005360 0x7f1678155910 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:41.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 -- 172.21.15.89:0/913145997 >> 172.21.15.89:0/913145997 conn(0x7f16780c99b0 msgr2=0x7f167814fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:41.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 -- 172.21.15.89:0/913145997 shutdown_connections 2024-08-31T04:33:41.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:33:41.458+0000 7f167d400640 1 -- 172.21.15.89:0/913145997 wait complete. 2024-08-31T04:33:41.480 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'df4507ad', quiesce took 3.4 seconds. Will release after: 26.0 2024-08-31T04:33:54.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:33:54.981 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:34:07.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:34:07.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 -- 172.21.15.89:0/2218307222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d815bc70 msgr2=0x7ff6d8152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 --2- 172.21.15.89:0/2218307222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d815bc70 0x7ff6d8152a10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8070b70 tx=0x7ff6c801f0b0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 -- 172.21.15.89:0/2218307222 shutdown_connections 2024-08-31T04:34:07.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 --2- 172.21.15.89:0/2218307222 >> v2:172.21.15.170:3300/0 conn(0x7ff6d80c1f40 0x7ff6d80c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 --2- 172.21.15.89:0/2218307222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d815bc70 0x7ff6d8152a10 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 -- 172.21.15.89:0/2218307222 >> 172.21.15.89:0/2218307222 conn(0x7ff6d80ccf20 msgr2=0x7ff6d80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:07.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 -- 172.21.15.89:0/2218307222 shutdown_connections 2024-08-31T04:34:07.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 -- 172.21.15.89:0/2218307222 wait complete. 2024-08-31T04:34:07.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 Processor -- start 2024-08-31T04:34:07.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.645+0000 7ff6dea00640 1 -- start start 2024-08-31T04:34:07.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dea00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6d80c1f40 0x7ff6d815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d80c7920 0x7ff6d81f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d815bc70 0x7ff6d815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dea00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8074fb0 con 0x7ff6d80c7920 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8074e30 con 0x7ff6d815bc70 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dea00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d80c7d30 con 0x7ff6d80c1f40 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6cfe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d80c7920 0x7ff6d81f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6cfe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d80c7920 0x7ff6d81f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58768/0 (socket says 172.21.15.89:58768) 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6cfe00640 1 -- 172.21.15.89:0/1922471506 learned_addr learned my addr 172.21.15.89:0/1922471506 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6d7e00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6d80c1f40 0x7ff6d815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dca00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d815bc70 0x7ff6d815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6cfe00640 1 -- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6d80c1f40 msgr2=0x7ff6d815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6cfe00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6d80c1f40 0x7ff6d815a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6cfe00640 1 -- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d815bc70 msgr2=0x7ff6d815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6cfe00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d815bc70 0x7ff6d815afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6cfe00640 1 -- 172.21.15.89:0/1922471506 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d8153560 con 0x7ff6d80c7920 2024-08-31T04:34:07.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6cfe00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d80c7920 0x7ff6d81f5cf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000d750 tx=0x7ff6c000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:07.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6d4c00640 1 -- 172.21.15.89:0/1922471506 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0017070 con 0x7ff6d80c7920 2024-08-31T04:34:07.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6d4c00640 1 -- 172.21.15.89:0/1922471506 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6c0009d20 con 0x7ff6d80c7920 2024-08-31T04:34:07.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6d4c00640 1 -- 172.21.15.89:0/1922471506 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0005280 con 0x7ff6d80c7920 2024-08-31T04:34:07.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d81f6230 con 0x7ff6d80c7920 2024-08-31T04:34:07.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d8076910 con 0x7ff6d80c7920 2024-08-31T04:34:07.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.649+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d80c9330 con 0x7ff6d80c7920 2024-08-31T04:34:07.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.653+0000 7ff6d4c00640 1 -- 172.21.15.89:0/1922471506 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff6c0005420 con 0x7ff6d80c7920 2024-08-31T04:34:07.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.653+0000 7ff6d4c00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff6b4072120 0x7ff6b4074630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.653+0000 7ff6d4c00640 1 -- 172.21.15.89:0/1922471506 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff6c0093010 con 0x7ff6d80c7920 2024-08-31T04:34:07.656 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.653+0000 7ff6d7e00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff6b4072120 0x7ff6b4074630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:07.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.653+0000 7ff6d7e00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff6b4072120 0x7ff6b4074630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80b2000 tx=0x7ff6c801d8f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:07.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.657+0000 7ff6d4c00640 1 -- 172.21.15.89:0/1922471506 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff6c000de60 con 0x7ff6d80c7920 2024-08-31T04:34:07.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6d80c82f0 con 0x7ff6d80c7920 2024-08-31T04:34:07.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6d4c00640 1 -- 172.21.15.89:0/1922471506 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7ff6c005dea0 con 0x7ff6d80c7920 2024-08-31T04:34:07.860 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:34:07.860 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:34:07.860 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:34:07.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff6b4072120 msgr2=0x7ff6b4074630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff6b4072120 0x7ff6b4074630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80b2000 tx=0x7ff6c801d8f0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d80c7920 msgr2=0x7ff6d81f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:07.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d80c7920 0x7ff6d81f5cf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000d750 tx=0x7ff6c000dc10 comp rx=0 tx=0).stop 2024-08-31T04:34:07.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 shutdown_connections 2024-08-31T04:34:07.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff6b4072120 0x7ff6b4074630 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6d80c7920 0x7ff6d81f5cf0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d815bc70 0x7ff6d815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 --2- 172.21.15.89:0/1922471506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6d80c1f40 0x7ff6d815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:07.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 >> 172.21.15.89:0/1922471506 conn(0x7ff6d80ccf20 msgr2=0x7ff6d80b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:07.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 shutdown_connections 2024-08-31T04:34:07.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:07.857+0000 7ff6dea00640 1 -- 172.21.15.89:0/1922471506 wait complete. 2024-08-31T04:34:07.882 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id df4507ad --release --await' 2024-08-31T04:34:07.883 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id df4507ad --release --await 2024-08-31T04:34:08.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.041+0000 7fa828e00640 1 -- 172.21.15.89:0/1483866198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8241581a0 msgr2=0x7fa8241585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:08.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.041+0000 7fa828e00640 1 --2- 172.21.15.89:0/1483866198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8241581a0 0x7fa8241585b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa824070810 tx=0x7fa81c01f580 comp rx=0 tx=0).stop 2024-08-31T04:34:08.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.041+0000 7fa828e00640 1 -- 172.21.15.89:0/1483866198 shutdown_connections 2024-08-31T04:34:08.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.041+0000 7fa828e00640 1 --2- 172.21.15.89:0/1483866198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8241581a0 0x7fa8241585b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.041+0000 7fa828e00640 1 --2- 172.21.15.89:0/1483866198 >> v2:172.21.15.170:3300/0 conn(0x7fa82406fd80 0x7fa824070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.041+0000 7fa828e00640 1 --2- 172.21.15.89:0/1483866198 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa824151dc0 0x7fa8240749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.041+0000 7fa828e00640 1 -- 172.21.15.89:0/1483866198 >> 172.21.15.89:0/1483866198 conn(0x7fa8240c99b0 msgr2=0x7fa8240c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:08.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.041+0000 7fa828e00640 1 -- 172.21.15.89:0/1483866198 shutdown_connections 2024-08-31T04:34:08.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.041+0000 7fa828e00640 1 -- 172.21.15.89:0/1483866198 wait complete. 2024-08-31T04:34:08.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 Processor -- start 2024-08-31T04:34:08.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 -- start start 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82406fd80 0x7fa824142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa824151dc0 0x7fa8241f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8241581a0 0x7fa8240cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa8240c2770 con 0x7fa824151dc0 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa8240c2490 con 0x7fa82406fd80 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa8241521d0 con 0x7fa8241581a0 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa819400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa824151dc0 0x7fa8241f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa819400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa824151dc0 0x7fa8241f2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58784/0 (socket says 172.21.15.89:58784) 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa819400640 1 -- 172.21.15.89:0/2839940672 learned_addr learned my addr 172.21.15.89:0/2839940672 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:34:08.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa821e00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82406fd80 0x7fa824142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa822800640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8241581a0 0x7fa8240cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa819400640 1 -- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8241581a0 msgr2=0x7fa8240cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa819400640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8241581a0 0x7fa8240cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa819400640 1 -- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82406fd80 msgr2=0x7fa824142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa819400640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82406fd80 0x7fa824142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa819400640 1 -- 172.21.15.89:0/2839940672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8241657a0 con 0x7fa824151dc0 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa819400640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa824151dc0 0x7fa8241f2080 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00d950 tx=0x7fa80c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa81aa00640 1 -- 172.21.15.89:0/2839940672 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c017070 con 0x7fa824151dc0 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa81aa00640 1 -- 172.21.15.89:0/2839940672 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa80c009d20 con 0x7fa824151dc0 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 -- 172.21.15.89:0/2839940672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa824141120 con 0x7fa824151dc0 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa81aa00640 1 -- 172.21.15.89:0/2839940672 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0106c0 con 0x7fa824151dc0 2024-08-31T04:34:08.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.045+0000 7fa828e00640 1 -- 172.21.15.89:0/2839940672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82414d900 con 0x7fa824151dc0 2024-08-31T04:34:08.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.049+0000 7fa81aa00640 1 -- 172.21.15.89:0/2839940672 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa80c01a070 con 0x7fa824151dc0 2024-08-31T04:34:08.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.049+0000 7fa81aa00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa8000720c0 0x7fa8000745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.049+0000 7fa81aa00640 1 -- 172.21.15.89:0/2839940672 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa80c0930f0 con 0x7fa824151dc0 2024-08-31T04:34:08.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.049+0000 7fa830652000 1 Processor -- start 2024-08-31T04:34:08.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.049+0000 7fa821e00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa8000720c0 0x7fa8000745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.049+0000 7fa830652000 1 -- start start 2024-08-31T04:34:08.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa821e00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa8000720c0 0x7fa8000745d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8140045b0 tx=0x7fa81400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:08.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce92fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce934ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 0x55a8ce935010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a8ce7daf30 con 0x55a8ce7fb930 2024-08-31T04:34:08.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a8ce750690 con 0x55a8ce811950 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a8ce73fc20 con 0x55a8ce7ec890 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa819400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce934ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa819400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce934ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58798/0 (socket says 172.21.15.89:58798) 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa819400640 1 -- 172.21.15.89:0/3063102676 learned_addr learned my addr 172.21.15.89:0/3063102676 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa821e00640 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce92fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa822800640 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 0x55a8ce935010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa819400640 1 -- 172.21.15.89:0/3063102676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 msgr2=0x55a8ce935010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa819400640 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 0x55a8ce935010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa819400640 1 -- 172.21.15.89:0/3063102676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 msgr2=0x55a8ce92fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa819400640 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce92fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa819400640 1 -- 172.21.15.89:0/3063102676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ce6f48f0 con 0x55a8ce7fb930 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa821e00640 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce92fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:34:08.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa819400640 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce934ad0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa80c05a570 tx=0x7fa80c05d6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5ec54bb05e71fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:08.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa812a00640 1 -- 172.21.15.89:0/3063102676 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c021040 con 0x55a8ce7fb930 2024-08-31T04:34:08.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa812a00640 1 -- 172.21.15.89:0/3063102676 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa80c062740 con 0x55a8ce7fb930 2024-08-31T04:34:08.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa812a00640 1 -- 172.21.15.89:0/3063102676 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c067160 con 0x55a8ce7fb930 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 -- 172.21.15.89:0/3063102676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 msgr2=0x55a8ce934ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce934ad0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa80c05a570 tx=0x7fa80c05d6f0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 -- 172.21.15.89:0/3063102676 shutdown_connections 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce934ad0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 0x55a8ce935010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 --2- 172.21.15.89:0/3063102676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce92fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 -- 172.21.15.89:0/3063102676 >> 172.21.15.89:0/3063102676 conn(0x55a8ce811540 msgr2=0x55a8ce932890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 -- 172.21.15.89:0/3063102676 shutdown_connections 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 -- 172.21.15.89:0/3063102676 wait complete. 2024-08-31T04:34:08.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.053+0000 7fa830652000 1 -- start start 2024-08-31T04:34:08.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 Processor -- start 2024-08-31T04:34:08.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce92ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce7fb930 0x55a8ce92f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce811950 0x55a8ce92f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a8ce6c6500 con 0x55a8ce7ec890 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a8ce743bd0 con 0x55a8ce7fb930 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a8ce6e7a30 con 0x55a8ce811950 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 10 client.0 _ll_register_callbacks cb 0x55a8ce7f5b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa821e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce92ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa821e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce92ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58810/0 (socket says 172.21.15.89:58810) 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa821e00640 1 -- 172.21.15.89:0/2737334027 learned_addr learned my addr 172.21.15.89:0/2737334027 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa822800640 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce811950 0x55a8ce92f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa819400640 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce7fb930 0x55a8ce92f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa821e00640 1 -- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce811950 msgr2=0x55a8ce92f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa821e00640 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce811950 0x55a8ce92f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa821e00640 1 -- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce7fb930 msgr2=0x55a8ce92f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:08.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa821e00640 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce7fb930 0x55a8ce92f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa821e00640 1 -- 172.21.15.89:0/2737334027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ce6df6a0 con 0x55a8ce7ec890 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa821e00640 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce92ec10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa81400b550 tx=0x7fa814004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ed7efe32a5baec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa807400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa807400640 1 -- 172.21.15.89:0/2737334027 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814028670 con 0x55a8ce7ec890 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa807400640 1 -- 172.21.15.89:0/2737334027 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa81401f430 con 0x55a8ce7ec890 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 -- 172.21.15.89:0/2737334027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8ce6d97e0 con 0x55a8ce7ec890 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa807400640 1 -- 172.21.15.89:0/2737334027 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa814028810 con 0x55a8ce7ec890 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 10 client.6144 fetch_fsmap learned FSMap version 9 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 -- 172.21.15.89:0/2737334027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a8ce6fe1c0 con 0x55a8ce7ec890 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa807400640 1 -- 172.21.15.89:0/2737334027 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a8ce6d97e0 con 0x55a8ce7ec890 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa807400640 1 -- 172.21.15.89:0/2737334027 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fa8140289b0 con 0x55a8ce7ec890 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 10 client.6144 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 10 client.6144 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:34:08.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 20 client.6144 populate_metadata read hostname 'smithi089' 2024-08-31T04:34:08.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a8ce7d5fc0 0x55a8ce94a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 4 client.6144 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:08.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa830652000 1 -- 172.21.15.89:0/2737334027 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8ce7525e0 con 0x55a8ce7d5fc0 2024-08-31T04:34:08.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.057+0000 7fa819400640 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a8ce7d5fc0 0x55a8ce94a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa819400640 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a8ce7d5fc0 0x55a8ce94a010 crc :-1 s=READY pgs=1312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ad3e5aab006572 server_cookie=57eec9ee1c5c8997 in_seq=0 out_seq=0 2024-08-31T04:34:08.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa807400640 10 client.6144 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:34:08.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa807400640 1 -- 172.21.15.89:0/2737334027 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8ce7525e0 con 0x55a8ce7d5fc0 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa807400640 10 client.6144 handle_command_reply: tid=0 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 client.6144 shutdown 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 -- 172.21.15.89:0/2737334027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 msgr2=0x55a8ce92ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce92ec10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa81400b550 tx=0x7fa814004740 comp rx=0 tx=0).stop 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 -- 172.21.15.89:0/2737334027 shutdown_connections 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a8ce7d5fc0 0x55a8ce94a010 crc :-1 s=READY pgs=1312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce811950 0x55a8ce92f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce7fb930 0x55a8ce92f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 --2- 172.21.15.89:0/2737334027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce92ec10 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 -- 172.21.15.89:0/2737334027 >> 172.21.15.89:0/2737334027 conn(0x55a8ce811540 msgr2=0x55a8ce930040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa807400640 0 client.6144 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 -- 172.21.15.89:0/2737334027 shutdown_connections 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 1 -- 172.21.15.89:0/2737334027 wait complete. 2024-08-31T04:34:08.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.061+0000 7fa830652000 20 client.6144 trim_cache size 0 max 16384 2024-08-31T04:34:08.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 Processor -- start 2024-08-31T04:34:08.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 -- start start 2024-08-31T04:34:08.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce94d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7fb930 0x55a8ce8f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce8f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa824200e40 con 0x55a8ce7ec890 2024-08-31T04:34:08.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241ffd20 con 0x55a8ce811950 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa82414ce70 con 0x55a8ce7fb930 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa821e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce94d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa821e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce94d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58824/0 (socket says 172.21.15.89:58824) 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa821e00640 1 -- 172.21.15.89:0/199035134 learned_addr learned my addr 172.21.15.89:0/199035134 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa819400640 1 --2- 172.21.15.89:0/199035134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7fb930 0x55a8ce8f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa822800640 1 --2- 172.21.15.89:0/199035134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce8f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa821e00640 1 -- 172.21.15.89:0/199035134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7fb930 msgr2=0x55a8ce8f31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa821e00640 1 --2- 172.21.15.89:0/199035134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7fb930 0x55a8ce8f31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa821e00640 1 -- 172.21.15.89:0/199035134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 msgr2=0x55a8ce8f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa821e00640 1 --2- 172.21.15.89:0/199035134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce8f36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa821e00640 1 -- 172.21.15.89:0/199035134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ce7c42f0 con 0x55a8ce7ec890 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa821e00640 1 --2- 172.21.15.89:0/199035134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce94d890 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa814011fd0 tx=0x7fa814028b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1808283e1ef3b639 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa812000640 1 -- 172.21.15.89:0/199035134 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81400b930 con 0x55a8ce7ec890 2024-08-31T04:34:08.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa812000640 1 -- 172.21.15.89:0/199035134 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa814023070 con 0x55a8ce7ec890 2024-08-31T04:34:08.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa812000640 1 -- 172.21.15.89:0/199035134 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81401f630 con 0x55a8ce7ec890 2024-08-31T04:34:08.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 -- 172.21.15.89:0/199035134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 msgr2=0x55a8ce94d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 --2- 172.21.15.89:0/199035134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce94d890 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa814011fd0 tx=0x7fa814028b00 comp rx=0 tx=0).stop 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 -- 172.21.15.89:0/199035134 shutdown_connections 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 --2- 172.21.15.89:0/199035134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce8f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 --2- 172.21.15.89:0/199035134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7fb930 0x55a8ce8f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 --2- 172.21.15.89:0/199035134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7ec890 0x55a8ce94d890 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 -- 172.21.15.89:0/199035134 >> 172.21.15.89:0/199035134 conn(0x55a8ce811540 msgr2=0x55a8ce92f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 -- 172.21.15.89:0/199035134 shutdown_connections 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.081+0000 7fa830652000 1 -- 172.21.15.89:0/199035134 wait complete. 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 -- start start 2024-08-31T04:34:08.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 Processor -- start 2024-08-31T04:34:08.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 0x55a8ce94bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce94c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce94cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241fe8f0 con 0x55a8ce7fb930 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241ff650 con 0x55a8ce811950 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa8241fef80 con 0x55a8ce7ec890 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 10 client.0 _ll_register_callbacks cb 0x7fa814005c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa819400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce94c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa819400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce94c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58828/0 (socket says 172.21.15.89:58828) 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa819400640 1 -- 172.21.15.89:0/2095357998 learned_addr learned my addr 172.21.15.89:0/2095357998 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa821e00640 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 0x55a8ce94bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa822800640 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce94cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa819400640 1 -- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 msgr2=0x55a8ce94bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa819400640 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 0x55a8ce94bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa819400640 1 -- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 msgr2=0x55a8ce94cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa819400640 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce94cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa819400640 1 -- 172.21.15.89:0/2095357998 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ce6c9b30 con 0x55a8ce7fb930 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa819400640 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce94c9b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009610 tx=0x7fa80c091080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f084f60c105b0c51 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa807400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa807400640 1 -- 172.21.15.89:0/2095357998 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c021040 con 0x55a8ce7fb930 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa807400640 1 -- 172.21.15.89:0/2095357998 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa80c05d1e0 con 0x55a8ce7fb930 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 -- 172.21.15.89:0/2095357998 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa814023070 con 0x55a8ce7fb930 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa807400640 1 -- 172.21.15.89:0/2095357998 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa80c067160 con 0x55a8ce7fb930 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 10 client.6150 fetch_fsmap learned FSMap version 9 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 -- 172.21.15.89:0/2095357998 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a8ce6d6c70 con 0x55a8ce7fb930 2024-08-31T04:34:08.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa807400640 1 -- 172.21.15.89:0/2095357998 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa814023070 con 0x55a8ce7fb930 2024-08-31T04:34:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa807400640 1 -- 172.21.15.89:0/2095357998 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fa80c0598f0 con 0x55a8ce7fb930 2024-08-31T04:34:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 10 client.6150 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:34:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 10 client.6150 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:34:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 20 client.6150 populate_metadata read hostname 'smithi089' 2024-08-31T04:34:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a8ce3d1e80 0x55a8ce94aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 4 client.6150 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "df4507ad", "release": true, "await": true}] 2024-08-31T04:34:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.085+0000 7fa830652000 1 -- 172.21.15.89:0/2095357998 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "df4507ad", "release": true, "await": true}) -- 0x55a8ce74e080 con 0x55a8ce3d1e80 2024-08-31T04:34:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.089+0000 7fa821e00640 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a8ce3d1e80 0x55a8ce94aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:08.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.089+0000 7fa807400640 10 client.6150 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:34:08.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.089+0000 7fa821e00640 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a8ce3d1e80 0x55a8ce94aaf0 crc :-1 s=READY pgs=1313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20ca3545f3b69b85 server_cookie=ef661e9a7531afdc in_seq=0 out_seq=0 2024-08-31T04:34:08.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa807400640 1 -- 172.21.15.89:0/2095357998 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a8ce74e080 con 0x55a8ce3d1e80 2024-08-31T04:34:08.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa807400640 10 client.6150 handle_command_reply: tid=0 2024-08-31T04:34:08.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 client.6150 shutdown 2024-08-31T04:34:08.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 -- 172.21.15.89:0/2095357998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 msgr2=0x55a8ce94c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:08.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce94c9b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009610 tx=0x7fa80c091080 comp rx=0 tx=0).stop 2024-08-31T04:34:08.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 -- 172.21.15.89:0/2095357998 shutdown_connections 2024-08-31T04:34:08.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a8ce3d1e80 0x55a8ce94aaf0 crc :-1 s=READY pgs=1313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8ce7fb930 0x55a8ce94c9b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8ce811950 0x55a8ce94cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa807400640 0 client.6150 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 --2- 172.21.15.89:0/2095357998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a8ce7ec890 0x55a8ce94bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 -- 172.21.15.89:0/2095357998 >> 172.21.15.89:0/2095357998 conn(0x55a8ce811540 msgr2=0x55a8ce94d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 -- 172.21.15.89:0/2095357998 shutdown_connections 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 1 -- 172.21.15.89:0/2095357998 wait complete. 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa830652000 20 client.6150 trim_cache size 0 max 16384 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 108, 2024-08-31T04:34:08.238 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "df4507ad": { 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 108, 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 149.4, 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:34:08.239 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:34:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:34:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:34:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:34:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:34:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:34:08.240 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:34:08.240 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 -- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa8000720c0 msgr2=0x7fa8000745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa8000720c0 0x7fa8000745d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8140045b0 tx=0x7fa81400b2e0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 -- 172.21.15.89:0/2839940672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa824151dc0 msgr2=0x7fa8241f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa824151dc0 0x7fa8241f2080 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00d950 tx=0x7fa80c00de10 comp rx=0 tx=0).stop 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 -- 172.21.15.89:0/2839940672 shutdown_connections 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa8000720c0 0x7fa8000745d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa824151dc0 0x7fa8241f2080 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8241581a0 0x7fa8240cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 --2- 172.21.15.89:0/2839940672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82406fd80 0x7fa824142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 -- 172.21.15.89:0/2839940672 >> 172.21.15.89:0/2839940672 conn(0x7fa8240c99b0 msgr2=0x7fa8241402e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 -- 172.21.15.89:0/2839940672 shutdown_connections 2024-08-31T04:34:08.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:34:08.233+0000 7fa828e00640 1 -- 172.21.15.89:0/2839940672 wait complete. 2024-08-31T04:34:08.257 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'df4507ad', total seconds elapsed: 30.2 2024-08-31T04:34:10.083 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 1% (5/256) Updating files: 2% (6/256) Updating files: 3% (8/256) Updating files: 4% (11/256) Updating files: 5% (13/256) Updating files: 6% (16/256) Updating files: 7% (18/256) Updating files: 8% (21/256) Updating files: 9% (24/256) Updating files: 10% (26/256) Updating files: 11% (29/256) Updating files: 12% (31/256) Updating files: 13% (34/256) Updating files: 14% (36/256) Updating files: 15% (39/256) Updating files: 15% (40/256) Updating files: 16% (41/256) Updating files: 17% (44/256) Updating files: 18% (47/256) Updating files: 19% (49/256) Updating files: 20% (52/256) Updating files: 21% (54/256) Updating files: 22% (57/256) Updating files: 23% (59/256) Updating files: 24% (62/256) Updating files: 25% (64/256) Updating files: 26% (67/256) Updating files: 27% (70/256) Updating files: 28% (72/256) Updating files: 29% (75/256) Updating files: 30% (77/256) Updating files: 31% (80/256) Updating files: 32% (82/256) Updating files: 33% (85/256) Updating files: 34% (88/256) Updating files: 35% (90/256) Updating files: 36% (93/256) Updating files: 36% (94/256) Updating files: 37% (95/256) Updating files: 38% (98/256) Updating files: 39% (100/256) Updating files: 40% (103/256) Updating files: 40% (104/256) Updating files: 41% (105/256) Updating files: 42% (108/256) Updating files: 43% (111/256) Updating files: 44% (113/256) Updating files: 45% (116/256) Updating files: 46% (118/256) Updating files: 47% (121/256) Updating files: 48% (123/256) Updating files: 49% (126/256) Updating files: 50% (128/256) Updating files: 51% (131/256) Updating files: 52% (134/256) Updating files: 53% (136/256) Updating files: 54% (139/256) Updating files: 55% (141/256) Updating files: 56% (144/256) Updating files: 57% (146/256) Updating files: 58% (149/256) Updating files: 59% (152/256) Updating files: 60% (154/256) Updating files: 60% (156/256) Updating files: 61% (157/256) Updating files: 62% (159/256) Updating files: 63% (162/256) Updating files: 64% (164/256) Updating files: 65% (167/256) Updating files: 66% (169/256) Updating files: 67% (172/256) Updating files: 68% (175/256) Updating files: 69% (177/256) Updating files: 70% (180/256) Updating files: 71% (182/256) Updating files: 72% (185/256) Updating files: 73% (187/256) Updating files: 74% (190/256) Updating files: 75% (192/256) Updating files: 76% (195/256) Updating files: 77% (198/256) Updating files: 78% (200/256) Updating files: 79% (203/256) Updating files: 80% (205/256) Updating files: 81% (208/256) Updating files: 82% (210/256) Updating files: 83% (213/256) Updating files: 84% (216/256) Updating files: 85% (218/256) Updating files: 86% (221/256) Updating files: 87% (223/256) Updating files: 88% (226/256) Updating files: 89% (228/256) Updating files: 90% (231/256) Updating files: 91% (233/256) Updating files: 92% (236/256) Updating files: 93% (239/256) Updating files: 94% (241/256) Updating files: 95% (244/256) Updating files: 96% (246/256) Updating files: 97% (249/256) Updating files: 98% (251/256) Updating files: 99% (254/256) Updating files: 100% (256/256) Updating files: 100% (256/256), done. 2024-08-31T04:34:10.918 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at f26f7a39021 v0.60 2024-08-31T04:34:11.005 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.60 2024-08-31T04:34:11.027 INFO:tasks.workunit.client.0.smithi089.stdout:v0.61 2024-08-31T04:34:11.027 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 61 -eq 48 ] 2024-08-31T04:34:11.027 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.61 2024-08-31T04:34:11.027 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.61 2024-08-31T04:34:11.028 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.61 2024-08-31T04:34:25.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:34:25.177 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:34:27.465 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 19% (75/376) Updating files: 20% (76/376) Updating files: 21% (79/376) Updating files: 22% (83/376) Updating files: 23% (87/376) Updating files: 24% (91/376) Updating files: 25% (94/376) Updating files: 26% (98/376) Updating files: 27% (102/376) Updating files: 28% (106/376) Updating files: 28% (108/376) Updating files: 29% (110/376) Updating files: 30% (113/376) Updating files: 31% (117/376) Updating files: 32% (121/376) Updating files: 33% (125/376) Updating files: 34% (128/376) Updating files: 35% (132/376) Updating files: 36% (136/376) Updating files: 37% (140/376) Updating files: 38% (143/376) Updating files: 39% (147/376) Updating files: 40% (151/376) Updating files: 41% (155/376) Updating files: 42% (158/376) Updating files: 43% (162/376) Updating files: 44% (166/376) Updating files: 45% (170/376) Updating files: 46% (173/376) Updating files: 47% (177/376) Updating files: 48% (181/376) Updating files: 49% (185/376) Updating files: 50% (188/376) Updating files: 51% (192/376) Updating files: 52% (196/376) Updating files: 52% (199/376) Updating files: 53% (200/376) Updating files: 54% (204/376) Updating files: 55% (207/376) Updating files: 56% (211/376) Updating files: 57% (215/376) Updating files: 58% (219/376) Updating files: 59% (222/376) Updating files: 60% (226/376) Updating files: 61% (230/376) Updating files: 62% (234/376) Updating files: 63% (237/376) Updating files: 64% (241/376) Updating files: 65% (245/376) Updating files: 66% (249/376) Updating files: 67% (252/376) Updating files: 68% (256/376) Updating files: 69% (260/376) Updating files: 70% (264/376) Updating files: 71% (267/376) Updating files: 72% (271/376) Updating files: 73% (275/376) Updating files: 74% (279/376) Updating files: 74% (281/376) Updating files: 75% (282/376) Updating files: 76% (286/376) Updating files: 77% (290/376) Updating files: 78% (294/376) Updating files: 79% (298/376) Updating files: 80% (301/376) Updating files: 81% (305/376) Updating files: 82% (309/376) Updating files: 83% (313/376) Updating files: 84% (316/376) Updating files: 85% (320/376) Updating files: 86% (324/376) Updating files: 87% (328/376) Updating files: 87% (330/376) Updating files: 88% (331/376) Updating files: 89% (335/376) Updating files: 90% (339/376) Updating files: 91% (343/376) Updating files: 92% (346/376) Updating files: 93% (350/376) Updating files: 94% (354/376) Updating files: 95% (358/376) Updating files: 96% (361/376) Updating files: 97% (365/376) Updating files: 98% (369/376) Updating files: 99% (373/376) Updating files: 100% (376/376) Updating files: 100% (376/376), done. 2024-08-31T04:34:27.561 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 237f3f1e8d8 v0.61 2024-08-31T04:34:27.570 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.61 2024-08-31T04:34:27.697 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 62 -eq 48 ] 2024-08-31T04:34:27.697 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.62 2024-08-31T04:34:27.697 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.62 2024-08-31T04:34:27.697 INFO:tasks.workunit.client.0.smithi089.stdout:v0.62 2024-08-31T04:34:27.698 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.62 2024-08-31T04:34:29.218 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 15% (9/59) Updating files: 16% (10/59) Updating files: 18% (11/59) Updating files: 20% (12/59) Updating files: 22% (13/59) Updating files: 23% (14/59) Updating files: 25% (15/59) Updating files: 27% (16/59) Updating files: 28% (17/59) Updating files: 30% (18/59) Updating files: 32% (19/59) Updating files: 33% (20/59) Updating files: 35% (21/59) Updating files: 37% (22/59) Updating files: 38% (23/59) Updating files: 40% (24/59) Updating files: 42% (25/59) Updating files: 44% (26/59) Updating files: 45% (27/59) Updating files: 47% (28/59) Updating files: 49% (29/59) Updating files: 50% (30/59) Updating files: 52% (31/59) Updating files: 54% (32/59) Updating files: 55% (33/59) Updating files: 57% (34/59) Updating files: 59% (35/59) Updating files: 61% (36/59) Updating files: 62% (37/59) Updating files: 64% (38/59) Updating files: 66% (39/59) Updating files: 67% (40/59) Updating files: 69% (41/59) Updating files: 71% (42/59) Updating files: 72% (43/59) Updating files: 74% (44/59) Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-08-31T04:34:29.316 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 9382379cc6b v0.62 2024-08-31T04:34:29.318 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.62 2024-08-31T04:34:29.434 INFO:tasks.workunit.client.0.smithi089.stdout:v0.63 2024-08-31T04:34:29.434 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 63 -eq 48 ] 2024-08-31T04:34:29.434 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.63 2024-08-31T04:34:29.434 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.63 2024-08-31T04:34:29.435 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.63 2024-08-31T04:34:33.184 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 6% (10/146) Updating files: 7% (11/146) Updating files: 8% (12/146) Updating files: 9% (14/146) Updating files: 10% (15/146) Updating files: 11% (17/146) Updating files: 12% (18/146) Updating files: 13% (19/146) Updating files: 14% (21/146) Updating files: 15% (22/146) Updating files: 16% (24/146) Updating files: 17% (25/146) Updating files: 18% (27/146) Updating files: 19% (28/146) Updating files: 20% (30/146) Updating files: 21% (31/146) Updating files: 22% (33/146) Updating files: 23% (34/146) Updating files: 24% (36/146) Updating files: 25% (37/146) Updating files: 26% (38/146) Updating files: 27% (40/146) Updating files: 28% (41/146) Updating files: 29% (43/146) Updating files: 30% (44/146) Updating files: 31% (46/146) Updating files: 32% (47/146) Updating files: 33% (49/146) Updating files: 34% (50/146) Updating files: 35% (52/146) Updating files: 36% (53/146) Updating files: 37% (55/146) Updating files: 38% (56/146) Updating files: 39% (57/146) Updating files: 40% (59/146) Updating files: 41% (60/146) Updating files: 42% (62/146) Updating files: 43% (63/146) Updating files: 44% (65/146) Updating files: 45% (66/146) Updating files: 46% (68/146) Updating files: 47% (69/146) Updating files: 48% (71/146) Updating files: 49% (72/146) Updating files: 50% (73/146) Updating files: 51% (75/146) Updating files: 52% (76/146) Updating files: 53% (78/146) Updating files: 54% (79/146) Updating files: 55% (81/146) Updating files: 56% (82/146) Updating files: 57% (84/146) Updating files: 58% (85/146) Updating files: 59% (87/146) Updating files: 60% (88/146) Updating files: 61% (90/146) Updating files: 62% (91/146) Updating files: 63% (92/146) Updating files: 64% (94/146) Updating files: 65% (95/146) Updating files: 66% (97/146) Updating files: 67% (98/146) Updating files: 68% (100/146) Updating files: 69% (101/146) Updating files: 70% (103/146) Updating files: 71% (104/146) Updating files: 72% (106/146) Updating files: 73% (107/146) Updating files: 74% (109/146) Updating files: 75% (110/146) Updating files: 76% (111/146) Updating files: 77% (113/146) Updating files: 78% (114/146) Updating files: 79% (116/146) Updating files: 80% (117/146) Updating files: 81% (119/146) Updating files: 82% (120/146) Updating files: 83% (122/146) Updating files: 84% (123/146) Updating files: 85% (125/146) Updating files: 86% (126/146) Updating files: 87% (128/146) Updating files: 88% (129/146) Updating files: 89% (130/146) Updating files: 90% (132/146) Updating files: 91% (133/146) Updating files: 92% (135/146) Updating files: 93% (136/146) Updating files: 94% (138/146) Updating files: 95% (139/146) Updating files: 96% (141/146) Updating files: 97% (142/146) Updating files: 98% (144/146) Updating files: 99% (145/146) Updating files: 100% (146/146) Updating files: 100% (146/146), done. 2024-08-31T04:34:33.268 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 054e96cf79e v0.63 2024-08-31T04:34:33.275 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.63 2024-08-31T04:34:33.396 INFO:tasks.workunit.client.0.smithi089.stdout:v0.64 2024-08-31T04:34:33.396 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 64 -eq 48 ] 2024-08-31T04:34:33.396 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.64 2024-08-31T04:34:33.396 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.64 2024-08-31T04:34:33.396 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.64 2024-08-31T04:34:36.739 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 40% (58/143) Updating files: 41% (59/143) Updating files: 42% (61/143) Updating files: 43% (62/143) Updating files: 44% (63/143) Updating files: 45% (65/143) Updating files: 46% (66/143) Updating files: 47% (68/143) Updating files: 48% (69/143) Updating files: 49% (71/143) Updating files: 50% (72/143) Updating files: 51% (73/143) Updating files: 52% (75/143) Updating files: 53% (76/143) Updating files: 54% (78/143) Updating files: 55% (79/143) Updating files: 56% (81/143) Updating files: 57% (82/143) Updating files: 58% (83/143) Updating files: 59% (85/143) Updating files: 60% (86/143) Updating files: 61% (88/143) Updating files: 62% (89/143) Updating files: 63% (91/143) Updating files: 64% (92/143) Updating files: 65% (93/143) Updating files: 66% (95/143) Updating files: 67% (96/143) Updating files: 68% (98/143) Updating files: 69% (99/143) Updating files: 70% (101/143) Updating files: 71% (102/143) Updating files: 72% (103/143) Updating files: 73% (105/143) Updating files: 74% (106/143) Updating files: 75% (108/143) Updating files: 76% (109/143) Updating files: 77% (111/143) Updating files: 78% (112/143) Updating files: 79% (113/143) Updating files: 80% (115/143) Updating files: 81% (116/143) Updating files: 82% (118/143) Updating files: 83% (119/143) Updating files: 84% (121/143) Updating files: 85% (122/143) Updating files: 86% (123/143) Updating files: 87% (125/143) Updating files: 88% (126/143) Updating files: 89% (128/143) Updating files: 90% (129/143) Updating files: 91% (131/143) Updating files: 92% (132/143) Updating files: 93% (133/143) Updating files: 94% (135/143) Updating files: 95% (136/143) Updating files: 96% (138/143) Updating files: 97% (139/143) Updating files: 98% (141/143) Updating files: 99% (142/143) Updating files: 100% (143/143) Updating files: 100% (143/143), done. 2024-08-31T04:34:36.828 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 42e06c12db6 v0.64 2024-08-31T04:34:36.836 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.64 2024-08-31T04:34:36.889 INFO:tasks.workunit.client.0.smithi089.stdout:v0.65 2024-08-31T04:34:36.889 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 65 -eq 48 ] 2024-08-31T04:34:36.889 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.65 2024-08-31T04:34:36.889 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.65 2024-08-31T04:34:36.889 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.65 2024-08-31T04:34:48.876 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 25% (51/203) Updating files: 25% (52/203) Updating files: 26% (53/203) Updating files: 27% (55/203) Updating files: 28% (57/203) Updating files: 29% (59/203) Updating files: 30% (61/203) Updating files: 31% (63/203) Updating files: 32% (65/203) Updating files: 33% (67/203) Updating files: 34% (70/203) Updating files: 35% (72/203) Updating files: 36% (74/203) Updating files: 37% (76/203) Updating files: 38% (78/203) Updating files: 39% (80/203) Updating files: 40% (82/203) Updating files: 41% (84/203) Updating files: 42% (86/203) Updating files: 43% (88/203) Updating files: 44% (90/203) Updating files: 45% (92/203) Updating files: 46% (94/203) Updating files: 47% (96/203) Updating files: 48% (98/203) Updating files: 49% (100/203) Updating files: 50% (102/203) Updating files: 51% (104/203) Updating files: 52% (106/203) Updating files: 53% (108/203) Updating files: 54% (110/203) Updating files: 55% (112/203) Updating files: 56% (114/203) Updating files: 57% (116/203) Updating files: 58% (118/203) Updating files: 59% (120/203) Updating files: 60% (122/203) Updating files: 61% (124/203) Updating files: 62% (126/203) Updating files: 63% (128/203) Updating files: 64% (130/203) Updating files: 65% (132/203) Updating files: 66% (134/203) Updating files: 67% (137/203) Updating files: 68% (139/203) Updating files: 69% (141/203) Updating files: 70% (143/203) Updating files: 71% (145/203) Updating files: 72% (147/203) Updating files: 73% (149/203) Updating files: 74% (151/203) Updating files: 75% (153/203) Updating files: 76% (155/203) Updating files: 77% (157/203) Updating files: 78% (159/203) Updating files: 78% (160/203) Updating files: 79% (161/203) Updating files: 80% (163/203) Updating files: 81% (165/203) Updating files: 82% (167/203) Updating files: 83% (169/203) Updating files: 84% (171/203) Updating files: 85% (173/203) Updating files: 86% (175/203) Updating files: 87% (177/203) Updating files: 88% (179/203) Updating files: 89% (181/203) Updating files: 90% (183/203) Updating files: 91% (185/203) Updating files: 92% (187/203) Updating files: 93% (189/203) Updating files: 94% (191/203) Updating files: 95% (193/203) Updating files: 96% (195/203) Updating files: 97% (197/203) Updating files: 98% (199/203) Updating files: 99% (201/203) Updating files: 100% (203/203) Updating files: 100% (203/203), done. 2024-08-31T04:34:49.178 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at c2d517ef966 v0.65 2024-08-31T04:34:49.185 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.65 2024-08-31T04:34:49.296 INFO:tasks.workunit.client.0.smithi089.stdout:v0.66 2024-08-31T04:34:49.296 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 66 -eq 48 ] 2024-08-31T04:34:49.297 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.66 2024-08-31T04:34:49.297 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.66 2024-08-31T04:34:49.297 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.66 2024-08-31T04:34:51.762 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 74% (113/152) Updating files: 75% (114/152) Updating files: 76% (116/152) Updating files: 77% (118/152) Updating files: 78% (119/152) Updating files: 79% (121/152) Updating files: 80% (122/152) Updating files: 81% (124/152) Updating files: 82% (125/152) Updating files: 83% (127/152) Updating files: 84% (128/152) Updating files: 85% (130/152) Updating files: 86% (131/152) Updating files: 87% (133/152) Updating files: 88% (134/152) Updating files: 89% (136/152) Updating files: 90% (137/152) Updating files: 91% (139/152) Updating files: 92% (140/152) Updating files: 93% (142/152) Updating files: 94% (143/152) Updating files: 95% (145/152) Updating files: 96% (146/152) Updating files: 97% (148/152) Updating files: 98% (149/152) Updating files: 99% (151/152) Updating files: 100% (152/152) Updating files: 100% (152/152), done. 2024-08-31T04:34:51.821 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at b6b48dbefad v0.66 2024-08-31T04:34:51.827 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.66 2024-08-31T04:34:52.390 INFO:tasks.workunit.client.0.smithi089.stdout:v0.67 2024-08-31T04:34:52.390 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 67 -eq 48 ] 2024-08-31T04:34:52.390 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.67 2024-08-31T04:34:52.390 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.67 2024-08-31T04:34:52.390 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.67 2024-08-31T04:34:55.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:34:55.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:35:07.003 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 18% (64/355) Updating files: 19% (68/355) Updating files: 20% (71/355) Updating files: 21% (75/355) Updating files: 22% (79/355) Updating files: 23% (82/355) Updating files: 24% (86/355) Updating files: 25% (89/355) Updating files: 26% (93/355) Updating files: 27% (96/355) Updating files: 28% (100/355) Updating files: 29% (103/355) Updating files: 30% (107/355) Updating files: 31% (111/355) Updating files: 32% (114/355) Updating files: 33% (118/355) Updating files: 34% (121/355) Updating files: 35% (125/355) Updating files: 36% (128/355) Updating files: 37% (132/355) Updating files: 38% (135/355) Updating files: 39% (139/355) Updating files: 40% (142/355) Updating files: 41% (146/355) Updating files: 42% (150/355) Updating files: 43% (153/355) Updating files: 43% (155/355) Updating files: 44% (157/355) Updating files: 45% (160/355) Updating files: 46% (164/355) Updating files: 47% (167/355) Updating files: 48% (171/355) Updating files: 49% (174/355) Updating files: 50% (178/355) Updating files: 51% (182/355) Updating files: 52% (185/355) Updating files: 53% (189/355) Updating files: 54% (192/355) Updating files: 55% (196/355) Updating files: 56% (199/355) Updating files: 57% (203/355) Updating files: 58% (206/355) Updating files: 59% (210/355) Updating files: 60% (213/355) Updating files: 61% (217/355) Updating files: 62% (221/355) Updating files: 63% (224/355) Updating files: 64% (228/355) Updating files: 65% (231/355) Updating files: 66% (235/355) Updating files: 67% (238/355) Updating files: 68% (242/355) Updating files: 69% (245/355) Updating files: 70% (249/355) Updating files: 71% (253/355) Updating files: 72% (256/355) Updating files: 73% (260/355) Updating files: 74% (263/355) Updating files: 75% (267/355) Updating files: 76% (270/355) Updating files: 77% (274/355) Updating files: 78% (277/355) Updating files: 79% (281/355) Updating files: 80% (284/355) Updating files: 81% (288/355) Updating files: 81% (291/355) Updating files: 82% (292/355) Updating files: 83% (295/355) Updating files: 84% (299/355) Updating files: 85% (302/355) Updating files: 86% (306/355) Updating files: 87% (309/355) Updating files: 88% (313/355) Updating files: 88% (314/355) Updating files: 89% (316/355) Updating files: 90% (320/355) Updating files: 91% (324/355) Updating files: 92% (327/355) Updating files: 93% (331/355) Updating files: 94% (334/355) Updating files: 95% (338/355) Updating files: 96% (341/355) Updating files: 97% (345/355) Updating files: 98% (348/355) Updating files: 99% (352/355) Updating files: 100% (355/355) Updating files: 100% (355/355), done. 2024-08-31T04:35:07.406 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at e3b7bc5bce8 v0.67 2024-08-31T04:35:07.415 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.67 2024-08-31T04:35:07.449 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 68 -eq 48 ] 2024-08-31T04:35:07.449 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.68 2024-08-31T04:35:07.449 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.68 2024-08-31T04:35:07.449 INFO:tasks.workunit.client.0.smithi089.stdout:v0.68 2024-08-31T04:35:07.450 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.68 2024-08-31T04:35:13.923 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 44% (108/241) Updating files: 45% (109/241) Updating files: 46% (111/241) Updating files: 47% (114/241) Updating files: 48% (116/241) Updating files: 48% (117/241) Updating files: 49% (119/241) Updating files: 50% (121/241) Updating files: 51% (123/241) Updating files: 52% (126/241) Updating files: 53% (128/241) Updating files: 54% (131/241) Updating files: 55% (133/241) Updating files: 56% (135/241) Updating files: 57% (138/241) Updating files: 58% (140/241) Updating files: 59% (143/241) Updating files: 60% (145/241) Updating files: 61% (148/241) Updating files: 62% (150/241) Updating files: 63% (152/241) Updating files: 64% (155/241) Updating files: 65% (157/241) Updating files: 66% (160/241) Updating files: 67% (162/241) Updating files: 68% (164/241) Updating files: 69% (167/241) Updating files: 70% (169/241) Updating files: 71% (172/241) Updating files: 72% (174/241) Updating files: 73% (176/241) Updating files: 74% (179/241) Updating files: 75% (181/241) Updating files: 76% (184/241) Updating files: 77% (186/241) Updating files: 78% (188/241) Updating files: 79% (191/241) Updating files: 80% (193/241) Updating files: 81% (196/241) Updating files: 82% (198/241) Updating files: 83% (201/241) Updating files: 84% (203/241) Updating files: 85% (205/241) Updating files: 86% (208/241) Updating files: 87% (210/241) Updating files: 88% (213/241) Updating files: 89% (215/241) Updating files: 89% (216/241) Updating files: 90% (217/241) Updating files: 91% (220/241) Updating files: 92% (222/241) Updating files: 93% (225/241) Updating files: 94% (227/241) Updating files: 94% (228/241) Updating files: 95% (229/241) Updating files: 96% (232/241) Updating files: 97% (234/241) Updating files: 98% (237/241) Updating files: 99% (239/241) Updating files: 100% (241/241) Updating files: 100% (241/241), done. 2024-08-31T04:35:14.003 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at b4cf0f2574b v0.68 2024-08-31T04:35:14.010 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.68 2024-08-31T04:35:14.098 INFO:tasks.workunit.client.0.smithi089.stdout:v0.69 2024-08-31T04:35:14.099 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 69 -eq 48 ] 2024-08-31T04:35:14.099 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.69 2024-08-31T04:35:14.099 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.69 2024-08-31T04:35:14.099 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.69 2024-08-31T04:35:18.846 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 40% (62/155) Updating files: 41% (64/155) Updating files: 42% (66/155) Updating files: 43% (67/155) Updating files: 44% (69/155) Updating files: 45% (70/155) Updating files: 46% (72/155) Updating files: 47% (73/155) Updating files: 48% (75/155) Updating files: 49% (76/155) Updating files: 50% (78/155) Updating files: 51% (80/155) Updating files: 52% (81/155) Updating files: 53% (83/155) Updating files: 54% (84/155) Updating files: 55% (86/155) Updating files: 56% (87/155) Updating files: 57% (89/155) Updating files: 58% (90/155) Updating files: 59% (92/155) Updating files: 60% (93/155) Updating files: 61% (95/155) Updating files: 62% (97/155) Updating files: 63% (98/155) Updating files: 64% (100/155) Updating files: 65% (101/155) Updating files: 66% (103/155) Updating files: 67% (104/155) Updating files: 68% (106/155) Updating files: 69% (107/155) Updating files: 70% (109/155) Updating files: 71% (111/155) Updating files: 72% (112/155) Updating files: 73% (114/155) Updating files: 74% (115/155) Updating files: 75% (117/155) Updating files: 76% (118/155) Updating files: 77% (120/155) Updating files: 78% (121/155) Updating files: 79% (123/155) Updating files: 80% (124/155) Updating files: 81% (126/155) Updating files: 82% (128/155) Updating files: 83% (129/155) Updating files: 84% (131/155) Updating files: 85% (132/155) Updating files: 86% (134/155) Updating files: 87% (135/155) Updating files: 88% (137/155) Updating files: 89% (138/155) Updating files: 90% (140/155) Updating files: 91% (142/155) Updating files: 92% (143/155) Updating files: 93% (145/155) Updating files: 94% (146/155) Updating files: 95% (148/155) Updating files: 96% (149/155) Updating files: 97% (151/155) Updating files: 98% (152/155) Updating files: 99% (154/155) Updating files: 100% (155/155) Updating files: 100% (155/155), done. 2024-08-31T04:35:18.906 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 6ca6f2f9f75 v0.69 2024-08-31T04:35:18.913 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.69 2024-08-31T04:35:19.338 INFO:tasks.workunit.client.0.smithi089.stdout:v0.70 2024-08-31T04:35:19.339 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 70 -eq 48 ] 2024-08-31T04:35:19.339 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.70 2024-08-31T04:35:19.339 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.70 2024-08-31T04:35:19.339 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.70 2024-08-31T04:35:24.025 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 63% (28/44) Updating files: 65% (29/44) Updating files: 68% (30/44) Updating files: 70% (31/44) Updating files: 72% (32/44) Updating files: 75% (33/44) Updating files: 77% (34/44) Updating files: 79% (35/44) Updating files: 81% (36/44) Updating files: 84% (37/44) Updating files: 86% (38/44) Updating files: 88% (39/44) Updating files: 90% (40/44) Updating files: 93% (41/44) Updating files: 95% (42/44) Updating files: 97% (43/44) Updating files: 100% (44/44) Updating files: 100% (44/44), done. 2024-08-31T04:35:24.128 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at e3bb0656d92 v0.70 2024-08-31T04:35:24.131 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.70 2024-08-31T04:35:24.254 INFO:tasks.workunit.client.0.smithi089.stdout:v0.71 2024-08-31T04:35:24.254 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 71 -eq 48 ] 2024-08-31T04:35:24.254 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.71 2024-08-31T04:35:24.254 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.71 2024-08-31T04:35:24.254 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.71 2024-08-31T04:35:25.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:35:25.930 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:35:34.482 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 0% (4/405) Updating files: 1% (5/405) Updating files: 2% (9/405) Updating files: 2% (11/405) Updating files: 3% (13/405) Updating files: 4% (17/405) Updating files: 5% (21/405) Updating files: 6% (25/405) Updating files: 7% (29/405) Updating files: 8% (33/405) Updating files: 9% (37/405) Updating files: 10% (41/405) Updating files: 11% (45/405) Updating files: 12% (49/405) Updating files: 13% (53/405) Updating files: 14% (57/405) Updating files: 15% (61/405) Updating files: 16% (65/405) Updating files: 17% (69/405) Updating files: 18% (73/405) Updating files: 19% (77/405) Updating files: 20% (81/405) Updating files: 20% (83/405) Updating files: 21% (86/405) Updating files: 22% (90/405) Updating files: 23% (94/405) Updating files: 24% (98/405) Updating files: 25% (102/405) Updating files: 26% (106/405) Updating files: 27% (110/405) Updating files: 28% (114/405) Updating files: 29% (118/405) Updating files: 30% (122/405) Updating files: 31% (126/405) Updating files: 32% (130/405) Updating files: 33% (134/405) Updating files: 34% (138/405) Updating files: 35% (142/405) Updating files: 36% (146/405) Updating files: 37% (150/405) Updating files: 38% (154/405) Updating files: 39% (158/405) Updating files: 40% (162/405) Updating files: 40% (165/405) Updating files: 41% (167/405) Updating files: 42% (171/405) Updating files: 43% (175/405) Updating files: 44% (179/405) Updating files: 45% (183/405) Updating files: 46% (187/405) Updating files: 47% (191/405) Updating files: 48% (195/405) Updating files: 49% (199/405) Updating files: 50% (203/405) Updating files: 51% (207/405) Updating files: 52% (211/405) Updating files: 52% (213/405) Updating files: 53% (215/405) Updating files: 54% (219/405) Updating files: 55% (223/405) Updating files: 56% (227/405) Updating files: 57% (231/405) Updating files: 58% (235/405) Updating files: 59% (239/405) Updating files: 59% (241/405) Updating files: 60% (243/405) Updating files: 61% (248/405) Updating files: 62% (252/405) Updating files: 63% (256/405) Updating files: 64% (260/405) Updating files: 65% (264/405) Updating files: 66% (268/405) Updating files: 67% (272/405) Updating files: 68% (276/405) Updating files: 69% (280/405) Updating files: 70% (284/405) Updating files: 71% (288/405) Updating files: 72% (292/405) Updating files: 73% (296/405) Updating files: 74% (300/405) Updating files: 75% (304/405) Updating files: 76% (308/405) Updating files: 77% (312/405) Updating files: 78% (316/405) Updating files: 79% (320/405) Updating files: 80% (324/405) Updating files: 81% (329/405) Updating files: 82% (333/405) Updating files: 83% (337/405) Updating files: 84% (341/405) Updating files: 85% (345/405) Updating files: 86% (349/405) Updating files: 87% (353/405) Updating files: 87% (355/405) Updating files: 88% (357/405) Updating files: 89% (361/405) Updating files: 90% (365/405) Updating files: 91% (369/405) Updating files: 92% (373/405) Updating files: 93% (377/405) Updating files: 94% (381/405) Updating files: 95% (385/405) Updating files: 96% (389/405) Updating files: 97% (393/405) Updating files: 98% (397/405) Updating files: 99% (401/405) Updating files: 100% (405/405) Updating files: 100% (405/405), done. 2024-08-31T04:35:34.881 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at e509cb1e69c v0.71 2024-08-31T04:35:34.898 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.71 2024-08-31T04:35:34.971 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 72 -eq 48 ] 2024-08-31T04:35:34.971 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.72 2024-08-31T04:35:34.971 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.72 2024-08-31T04:35:34.971 INFO:tasks.workunit.client.0.smithi089.stdout:v0.72 2024-08-31T04:35:34.972 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.72 2024-08-31T04:35:39.025 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 26% (50/191) Updating files: 27% (52/191) Updating files: 28% (54/191) Updating files: 29% (56/191) Updating files: 30% (58/191) Updating files: 31% (60/191) Updating files: 31% (61/191) Updating files: 32% (62/191) Updating files: 33% (64/191) Updating files: 34% (65/191) Updating files: 35% (67/191) Updating files: 36% (69/191) Updating files: 37% (71/191) Updating files: 38% (73/191) Updating files: 39% (75/191) Updating files: 40% (77/191) Updating files: 41% (79/191) Updating files: 42% (81/191) Updating files: 43% (83/191) Updating files: 44% (85/191) Updating files: 45% (86/191) Updating files: 46% (88/191) Updating files: 47% (90/191) Updating files: 48% (92/191) Updating files: 49% (94/191) Updating files: 50% (96/191) Updating files: 51% (98/191) Updating files: 52% (100/191) Updating files: 53% (102/191) Updating files: 54% (104/191) Updating files: 55% (106/191) Updating files: 56% (107/191) Updating files: 57% (109/191) Updating files: 58% (111/191) Updating files: 59% (113/191) Updating files: 60% (115/191) Updating files: 61% (117/191) Updating files: 62% (119/191) Updating files: 63% (121/191) Updating files: 64% (123/191) Updating files: 65% (125/191) Updating files: 66% (127/191) Updating files: 67% (128/191) Updating files: 68% (130/191) Updating files: 69% (132/191) Updating files: 70% (134/191) Updating files: 71% (136/191) Updating files: 72% (138/191) Updating files: 73% (140/191) Updating files: 74% (142/191) Updating files: 75% (144/191) Updating files: 76% (146/191) Updating files: 77% (148/191) Updating files: 78% (149/191) Updating files: 79% (151/191) Updating files: 80% (153/191) Updating files: 81% (155/191) Updating files: 82% (157/191) Updating files: 83% (159/191) Updating files: 84% (161/191) Updating files: 85% (163/191) Updating files: 86% (165/191) Updating files: 87% (167/191) Updating files: 88% (169/191) Updating files: 89% (170/191) Updating files: 90% (172/191) Updating files: 91% (174/191) Updating files: 92% (176/191) Updating files: 93% (178/191) Updating files: 94% (180/191) Updating files: 95% (182/191) Updating files: 96% (184/191) Updating files: 97% (186/191) Updating files: 98% (188/191) Updating files: 99% (190/191) Updating files: 100% (191/191) Updating files: 100% (191/191), done. 2024-08-31T04:35:39.085 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 5832e2603c7 v0.72 2024-08-31T04:35:39.093 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.72 2024-08-31T04:35:40.050 INFO:tasks.workunit.client.0.smithi089.stdout:v0.73 2024-08-31T04:35:40.050 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 73 -eq 48 ] 2024-08-31T04:35:40.050 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.73 2024-08-31T04:35:40.051 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.73 2024-08-31T04:35:40.051 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.73 2024-08-31T04:35:44.775 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 38% (57/148) Updating files: 39% (58/148) Updating files: 40% (60/148) Updating files: 41% (61/148) Updating files: 42% (63/148) Updating files: 43% (64/148) Updating files: 44% (66/148) Updating files: 45% (67/148) Updating files: 46% (69/148) Updating files: 47% (70/148) Updating files: 48% (72/148) Updating files: 49% (73/148) Updating files: 50% (74/148) Updating files: 51% (76/148) Updating files: 52% (77/148) Updating files: 53% (79/148) Updating files: 54% (80/148) Updating files: 55% (82/148) Updating files: 56% (83/148) Updating files: 57% (85/148) Updating files: 58% (86/148) Updating files: 59% (88/148) Updating files: 60% (89/148) Updating files: 61% (91/148) Updating files: 62% (92/148) Updating files: 63% (94/148) Updating files: 64% (95/148) Updating files: 65% (97/148) Updating files: 66% (98/148) Updating files: 67% (100/148) Updating files: 68% (101/148) Updating files: 69% (103/148) Updating files: 70% (104/148) Updating files: 71% (106/148) Updating files: 72% (107/148) Updating files: 73% (109/148) Updating files: 74% (110/148) Updating files: 75% (111/148) Updating files: 76% (113/148) Updating files: 77% (114/148) Updating files: 78% (116/148) Updating files: 79% (117/148) Updating files: 80% (119/148) Updating files: 81% (120/148) Updating files: 82% (122/148) Updating files: 83% (123/148) Updating files: 84% (125/148) Updating files: 85% (126/148) Updating files: 86% (128/148) Updating files: 87% (129/148) Updating files: 88% (131/148) Updating files: 89% (132/148) Updating files: 90% (134/148) Updating files: 91% (135/148) Updating files: 92% (137/148) Updating files: 93% (138/148) Updating files: 94% (140/148) Updating files: 95% (141/148) Updating files: 96% (143/148) Updating files: 97% (144/148) Updating files: 98% (146/148) Updating files: 99% (147/148) Updating files: 100% (148/148) Updating files: 100% (148/148), done. 2024-08-31T04:35:44.859 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at d8ad51ee8ab v0.73 2024-08-31T04:35:44.865 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.73 2024-08-31T04:35:44.995 INFO:tasks.workunit.client.0.smithi089.stdout:v0.74 2024-08-31T04:35:44.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 74 -eq 48 ] 2024-08-31T04:35:44.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.74 2024-08-31T04:35:44.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.74 2024-08-31T04:35:44.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.74 2024-08-31T04:35:55.008 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 34% (67/192) Updating files: 35% (68/192) Updating files: 36% (70/192) Updating files: 37% (72/192) Updating files: 38% (73/192) Updating files: 39% (75/192) Updating files: 40% (77/192) Updating files: 41% (79/192) Updating files: 42% (81/192) Updating files: 43% (83/192) Updating files: 44% (85/192) Updating files: 45% (87/192) Updating files: 46% (89/192) Updating files: 47% (91/192) Updating files: 48% (93/192) Updating files: 49% (95/192) Updating files: 50% (96/192) Updating files: 51% (98/192) Updating files: 52% (100/192) Updating files: 53% (102/192) Updating files: 54% (104/192) Updating files: 55% (106/192) Updating files: 56% (108/192) Updating files: 57% (110/192) Updating files: 58% (112/192) Updating files: 59% (114/192) Updating files: 60% (116/192) Updating files: 61% (118/192) Updating files: 61% (119/192) Updating files: 62% (120/192) Updating files: 63% (121/192) Updating files: 64% (123/192) Updating files: 65% (125/192) Updating files: 66% (127/192) Updating files: 67% (129/192) Updating files: 68% (131/192) Updating files: 69% (133/192) Updating files: 70% (135/192) Updating files: 71% (137/192) Updating files: 72% (139/192) Updating files: 73% (141/192) Updating files: 74% (143/192) Updating files: 75% (144/192) Updating files: 76% (146/192) Updating files: 77% (148/192) Updating files: 78% (150/192) Updating files: 79% (152/192) Updating files: 80% (154/192) Updating files: 81% (156/192) Updating files: 82% (158/192) Updating files: 83% (160/192) Updating files: 83% (161/192) Updating files: 84% (162/192) Updating files: 85% (164/192) Updating files: 86% (166/192) Updating files: 87% (168/192) Updating files: 88% (169/192) Updating files: 89% (171/192) Updating files: 90% (173/192) Updating files: 91% (175/192) Updating files: 92% (177/192) Updating files: 93% (179/192) Updating files: 94% (181/192) Updating files: 95% (183/192) Updating files: 96% (185/192) Updating files: 97% (187/192) Updating files: 98% (189/192) Updating files: 99% (191/192) Updating files: 100% (192/192) Updating files: 100% (192/192), done. 2024-08-31T04:35:55.089 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at c165483bc72 v0.74 2024-08-31T04:35:55.097 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.74 2024-08-31T04:35:55.238 INFO:tasks.workunit.client.0.smithi089.stdout:v0.75 2024-08-31T04:35:55.239 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 75 -eq 48 ] 2024-08-31T04:35:55.239 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.75 2024-08-31T04:35:55.239 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.75 2024-08-31T04:35:55.239 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.75 2024-08-31T04:35:56.001 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:35:56.005 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:35:57.457 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:35:57.458 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.95 2024-08-31T04:35:57.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:35:57.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.611+0000 7fa961600640 1 -- 172.21.15.89:0/3527433956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c0ca690 msgr2=0x7fa95c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:57.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.611+0000 7fa961600640 1 --2- 172.21.15.89:0/3527433956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c0ca690 0x7fa95c0caaa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa954009840 tx=0x7fa95401c820 comp rx=0 tx=0).stop 2024-08-31T04:35:57.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.611+0000 7fa961600640 1 -- 172.21.15.89:0/3527433956 shutdown_connections 2024-08-31T04:35:57.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.611+0000 7fa961600640 1 --2- 172.21.15.89:0/3527433956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c0ca690 0x7fa95c0caaa0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.611+0000 7fa961600640 1 --2- 172.21.15.89:0/3527433956 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa95c0c5120 0x7fa95c0c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.611+0000 7fa961600640 1 -- 172.21.15.89:0/3527433956 >> 172.21.15.89:0/3527433956 conn(0x7fa95c071f20 msgr2=0x7fa95c072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:57.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.611+0000 7fa961600640 1 -- 172.21.15.89:0/3527433956 shutdown_connections 2024-08-31T04:35:57.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.611+0000 7fa961600640 1 -- 172.21.15.89:0/3527433956 wait complete. 2024-08-31T04:35:57.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 Processor -- start 2024-08-31T04:35:57.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 -- start start 2024-08-31T04:35:57.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa95c0c5120 0x7fa95c1f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:57.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95c0ca690 0x7fa95c13fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:57.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c152430 0x7fa95c141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:57.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c070df0 con 0x7fa95c152430 2024-08-31T04:35:57.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c0c65e0 con 0x7fa95c0ca690 2024-08-31T04:35:57.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa95c0c58c0 con 0x7fa95c0c5120 2024-08-31T04:35:57.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa960c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c152430 0x7fa95c141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:57.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa960c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c152430 0x7fa95c141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58740/0 (socket says 172.21.15.89:58740) 2024-08-31T04:35:57.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa960c00640 1 -- 172.21.15.89:0/3817832499 learned_addr learned my addr 172.21.15.89:0/3817832499 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:35:57.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa95be00640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa95c0c5120 0x7fa95c1f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:57.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa953400640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95c0ca690 0x7fa95c13fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa960c00640 1 -- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa95c0c5120 msgr2=0x7fa95c1f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa960c00640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa95c0c5120 0x7fa95c1f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa960c00640 1 -- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95c0ca690 msgr2=0x7fa95c13fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa960c00640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95c0ca690 0x7fa95c13fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa960c00640 1 -- 172.21.15.89:0/3817832499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95c144dd0 con 0x7fa95c152430 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa953400640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95c0ca690 0x7fa95c13fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa960c00640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c152430 0x7fa95c141de0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa9540b0040 tx=0x7fa954005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa958c00640 1 -- 172.21.15.89:0/3817832499 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9540b2040 con 0x7fa95c152430 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95c1f7ef0 con 0x7fa95c152430 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa958c00640 1 -- 172.21.15.89:0/3817832499 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9540041f0 con 0x7fa95c152430 2024-08-31T04:35:57.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa958c00640 1 -- 172.21.15.89:0/3817832499 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa954003600 con 0x7fa95c152430 2024-08-31T04:35:57.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.615+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95c1f48e0 con 0x7fa95c152430 2024-08-31T04:35:57.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.619+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa95c13a850 con 0x7fa95c152430 2024-08-31T04:35:57.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.619+0000 7fa958c00640 1 -- 172.21.15.89:0/3817832499 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa9540bd030 con 0x7fa95c152430 2024-08-31T04:35:57.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.619+0000 7fa958c00640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa9380720c0 0x7fa9380745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:57.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.619+0000 7fa958c00640 1 -- 172.21.15.89:0/3817832499 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa95412d3b0 con 0x7fa95c152430 2024-08-31T04:35:57.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.619+0000 7fa95be00640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa9380720c0 0x7fa9380745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:57.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.623+0000 7fa95be00640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa9380720c0 0x7fa9380745d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009e60 tx=0x7fa94c0095b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:57.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.623+0000 7fa958c00640 1 -- 172.21.15.89:0/3817832499 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa9540c4060 con 0x7fa95c152430 2024-08-31T04:35:57.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.823+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa95c158470 con 0x7fa95c152430 2024-08-31T04:35:57.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.823+0000 7fa958c00640 1 -- 172.21.15.89:0/3817832499 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fa954016410 con 0x7fa95c152430 2024-08-31T04:35:57.824 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:35:57.824 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:35:57.824 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:35:57.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.823+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa9380720c0 msgr2=0x7fa9380745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:57.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.823+0000 7fa961600640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa9380720c0 0x7fa9380745d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009e60 tx=0x7fa94c0095b0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.823+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c152430 msgr2=0x7fa95c141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.823+0000 7fa961600640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c152430 0x7fa95c141de0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa9540b0040 tx=0x7fa954005db0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.827+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 shutdown_connections 2024-08-31T04:35:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.827+0000 7fa961600640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa9380720c0 0x7fa9380745d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.827+0000 7fa961600640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa95c152430 0x7fa95c141de0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.827+0000 7fa961600640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa95c0ca690 0x7fa95c13fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.827+0000 7fa961600640 1 --2- 172.21.15.89:0/3817832499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa95c0c5120 0x7fa95c1f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.827+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 >> 172.21.15.89:0/3817832499 conn(0x7fa95c071f20 msgr2=0x7fa95c158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.827+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 shutdown_connections 2024-08-31T04:35:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:57.827+0000 7fa961600640 1 -- 172.21.15.89:0/3817832499 wait complete. 2024-08-31T04:35:57.846 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 147.95 --await-for 45.0' 2024-08-31T04:35:57.846 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 147.95 --await-for 45.0 2024-08-31T04:35:58.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.011+0000 7f1713400640 1 -- 172.21.15.89:0/550456572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 msgr2=0x7f170c15a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:58.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.011+0000 7f1713400640 1 --2- 172.21.15.89:0/550456572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 0x7f170c15a120 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f170c0734a0 tx=0x7f16fc01cd80 comp rx=0 tx=0).stop 2024-08-31T04:35:58.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.011+0000 7f1713400640 1 -- 172.21.15.89:0/550456572 shutdown_connections 2024-08-31T04:35:58.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.011+0000 7f1713400640 1 --2- 172.21.15.89:0/550456572 >> v2:172.21.15.170:3300/0 conn(0x7f170c153800 0x7f170c074390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.011+0000 7f1713400640 1 --2- 172.21.15.89:0/550456572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 0x7f170c15a120 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.011+0000 7f1713400640 1 -- 172.21.15.89:0/550456572 >> 172.21.15.89:0/550456572 conn(0x7f170c0c99b0 msgr2=0x7f170c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:58.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.011+0000 7f1713400640 1 -- 172.21.15.89:0/550456572 shutdown_connections 2024-08-31T04:35:58.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.011+0000 7f1713400640 1 -- 172.21.15.89:0/550456572 wait complete. 2024-08-31T04:35:58.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 Processor -- start 2024-08-31T04:35:58.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 -- start start 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f170c06f3f0 0x7f170c0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 0x7f170c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f170c153800 0x7f170c156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f170c06fc10 con 0x7f170c074d50 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f170c073c10 con 0x7f170c153800 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f170c069fc0 con 0x7f170c06f3f0 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f170be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 0x7f170c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f170be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 0x7f170c158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58756/0 (socket says 172.21.15.89:58756) 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f170be00640 1 -- 172.21.15.89:0/1995490905 learned_addr learned my addr 172.21.15.89:0/1995490905 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1710a00640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f170c06f3f0 0x7f170c0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1711400640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f170c153800 0x7f170c156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f170be00640 1 -- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f170c06f3f0 msgr2=0x7f170c0c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f170be00640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f170c06f3f0 0x7f170c0c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f170be00640 1 -- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f170c153800 msgr2=0x7f170c156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f170be00640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f170c153800 0x7f170c156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f170be00640 1 -- 172.21.15.89:0/1995490905 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c1f65a0 con 0x7f170c074d50 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f170be00640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 0x7f170c158c40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f16f800d750 tx=0x7f16f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1708c00640 1 -- 172.21.15.89:0/1995490905 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8017070 con 0x7f170c074d50 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1708c00640 1 -- 172.21.15.89:0/1995490905 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16f8009d20 con 0x7f170c074d50 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1708c00640 1 -- 172.21.15.89:0/1995490905 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8005280 con 0x7f170c074d50 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 -- 172.21.15.89:0/1995490905 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c1f6880 con 0x7f170c074d50 2024-08-31T04:35:58.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.015+0000 7f1713400640 1 -- 172.21.15.89:0/1995490905 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c151570 con 0x7f170c074d50 2024-08-31T04:35:58.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.019+0000 7f1708c00640 1 -- 172.21.15.89:0/1995490905 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f16f8005420 con 0x7f170c074d50 2024-08-31T04:35:58.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.019+0000 7f1708c00640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16ec0720f0 0x7f16ec074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.019+0000 7f1708c00640 1 -- 172.21.15.89:0/1995490905 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f16f8092ff0 con 0x7f170c074d50 2024-08-31T04:35:58.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.019+0000 7f1710a00640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16ec0720f0 0x7f16ec074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.019+0000 7f171a998000 1 Processor -- start 2024-08-31T04:35:58.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.019+0000 7f171a998000 1 -- start start 2024-08-31T04:35:58.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.019+0000 7f1710a00640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16ec0720f0 0x7f16ec074600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0af000 tx=0x7f16fc01b5c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:58.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227fa840 0x55d4229424b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227e4800 0x55d4229429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d42275d8c0 con 0x55d4227e4800 2024-08-31T04:35:58.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d42274ce50 con 0x55d42240bab0 2024-08-31T04:35:58.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d422750e00 con 0x55d4227fa840 2024-08-31T04:35:58.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1711400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227e4800 0x55d4229429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1711400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227e4800 0x55d4229429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58762/0 (socket says 172.21.15.89:58762) 2024-08-31T04:35:58.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1711400640 1 -- 172.21.15.89:0/3271407779 learned_addr learned my addr 172.21.15.89:0/3271407779 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f170be00640 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227fa840 0x55d4229424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1710a00640 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1711400640 1 -- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227fa840 msgr2=0x55d4229424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1711400640 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227fa840 0x55d4229424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1711400640 1 -- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 msgr2=0x55d42293e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1711400640 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1711400640 1 -- 172.21.15.89:0/3271407779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4226ec850 con 0x55d4227e4800 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f170be00640 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227fa840 0x55d4229424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1710a00640 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1711400640 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227e4800 0x55d4229429f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f170c0c58c0 tx=0x7f1704009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e4ee6b9a2e97be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1701200640 1 -- 172.21.15.89:0/3271407779 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704017070 con 0x55d4227e4800 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1701200640 1 -- 172.21.15.89:0/3271407779 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1704004130 con 0x55d4227e4800 2024-08-31T04:35:58.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f1701200640 1 -- 172.21.15.89:0/3271407779 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170400e9c0 con 0x55d4227e4800 2024-08-31T04:35:58.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 -- 172.21.15.89:0/3271407779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227e4800 msgr2=0x55d4229429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:58.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227e4800 0x55d4229429f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f170c0c58c0 tx=0x7f1704009d00 comp rx=0 tx=0).stop 2024-08-31T04:35:58.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 -- 172.21.15.89:0/3271407779 shutdown_connections 2024-08-31T04:35:58.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227e4800 0x55d4229429f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227fa840 0x55d4229424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 --2- 172.21.15.89:0/3271407779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 -- 172.21.15.89:0/3271407779 >> 172.21.15.89:0/3271407779 conn(0x55d4228d1290 msgr2=0x55d422941280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:58.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 -- 172.21.15.89:0/3271407779 shutdown_connections 2024-08-31T04:35:58.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 -- 172.21.15.89:0/3271407779 wait complete. 2024-08-31T04:35:58.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 -- start start 2024-08-31T04:35:58.027 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.023+0000 7f171a998000 1 Processor -- start 2024-08-31T04:35:58.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d42293dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227fa840 0x55d422904b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d4226f26f0 con 0x55d4227fa840 2024-08-31T04:35:58.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d42275c690 con 0x55d42240bab0 2024-08-31T04:35:58.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d4226cedf0 con 0x55d4227e4800 2024-08-31T04:35:58.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 10 client.0 _ll_register_callbacks cb 0x55d4228eda20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:58.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1711400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227fa840 0x55d422904b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1711400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227fa840 0x55d422904b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58768/0 (socket says 172.21.15.89:58768) 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1711400640 1 -- 172.21.15.89:0/1226158430 learned_addr learned my addr 172.21.15.89:0/1226158430 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1710a00640 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f170be00640 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d42293dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1711400640 1 -- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 msgr2=0x55d42293dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1711400640 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d42293dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1711400640 1 -- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 msgr2=0x55d42293d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1711400640 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1711400640 1 -- 172.21.15.89:0/1226158430 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4226f7340 con 0x55d4227fa840 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f170be00640 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d42293dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1710a00640 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1711400640 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227fa840 0x55d422904b90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f170400e5a0 tx=0x7f1704009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab9c565a9b96046 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:58.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f16f5600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f16f5600640 1 -- 172.21.15.89:0/1226158430 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704017070 con 0x55d4227fa840 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f16f5600640 1 -- 172.21.15.89:0/1226158430 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f1704003800 con 0x55d4227fa840 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 -- 172.21.15.89:0/1226158430 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4226e6960 con 0x55d4227fa840 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f16f5600640 1 -- 172.21.15.89:0/1226158430 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f170402b050 con 0x55d4227fa840 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 10 client.6171 fetch_fsmap learned FSMap version 9 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 -- 172.21.15.89:0/1226158430 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d4226e7bd0 con 0x55d4227fa840 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f16f5600640 1 -- 172.21.15.89:0/1226158430 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d4226e6960 con 0x55d4227fa840 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f16f5600640 1 -- 172.21.15.89:0/1226158430 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f170402e020 con 0x55d4227fa840 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 10 client.6171 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 10 client.6171 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 20 client.6171 populate_metadata read hostname 'smithi089' 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55d4223f0e20 0x55d4229055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 4 client.6171 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:58.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f171a998000 1 -- 172.21.15.89:0/1226158430 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d42275f810 con 0x55d4223f0e20 2024-08-31T04:35:58.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.027+0000 7f1710a00640 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55d4223f0e20 0x55d4229055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f16f5600640 10 client.6171 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:35:58.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f1710a00640 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55d4223f0e20 0x55d4229055a0 crc :-1 s=READY pgs=1416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6bbe428781375d6 server_cookie=adeb29cf9c620411 in_seq=0 out_seq=0 2024-08-31T04:35:58.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f16f5600640 1 -- 172.21.15.89:0/1226158430 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d42275f810 con 0x55d4223f0e20 2024-08-31T04:35:58.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f16f5600640 10 client.6171 handle_command_reply: tid=0 2024-08-31T04:35:58.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 client.6171 shutdown 2024-08-31T04:35:58.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 -- 172.21.15.89:0/1226158430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227fa840 msgr2=0x55d422904b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:58.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227fa840 0x55d422904b90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f170400e5a0 tx=0x7f1704009300 comp rx=0 tx=0).stop 2024-08-31T04:35:58.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 -- 172.21.15.89:0/1226158430 shutdown_connections 2024-08-31T04:35:58.034 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55d4223f0e20 0x55d4229055a0 crc :-1 s=READY pgs=1416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4227fa840 0x55d422904b90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d42293dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f16f5600640 0 client.6171 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:35:58.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 --2- 172.21.15.89:0/1226158430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d42240bab0 0x55d42293d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 -- 172.21.15.89:0/1226158430 >> 172.21.15.89:0/1226158430 conn(0x55d4228d1290 msgr2=0x55d4229403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:58.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 -- 172.21.15.89:0/1226158430 shutdown_connections 2024-08-31T04:35:58.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 1 -- 172.21.15.89:0/1226158430 wait complete. 2024-08-31T04:35:58.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.031+0000 7f171a998000 20 client.6171 trim_cache size 0 max 16384 2024-08-31T04:35:58.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f171a998000 1 Processor -- start 2024-08-31T04:35:58.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f171a998000 1 -- start start 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f171a998000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229bec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f171a998000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d4229bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f171a998000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d4229bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f171a998000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1fe5f0 con 0x55d42240bab0 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f171a998000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1fd8b0 con 0x55d4227fa840 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f171a998000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f170c1fdf20 con 0x55d4227e4800 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1710a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1710a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229bec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58780/0 (socket says 172.21.15.89:58780) 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1710a00640 1 -- 172.21.15.89:0/2209060949 learned_addr learned my addr 172.21.15.89:0/2209060949 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:35:58.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f170be00640 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d4229bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1711400640 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d4229bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1710a00640 1 -- 172.21.15.89:0/2209060949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 msgr2=0x55d4229bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1710a00640 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d4229bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1710a00640 1 -- 172.21.15.89:0/2209060949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 msgr2=0x55d4229bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1710a00640 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d4229bf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1710a00640 1 -- 172.21.15.89:0/2209060949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4227d1b30 con 0x55d42240bab0 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1711400640 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d4229bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f1710a00640 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229bec00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f16fc01d620 tx=0x7f16fc0ba000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44dac585da8e7d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f16f7e00640 1 -- 172.21.15.89:0/2209060949 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0b2040 con 0x55d42240bab0 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f16f7e00640 1 -- 172.21.15.89:0/2209060949 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16fc0041f0 con 0x55d42240bab0 2024-08-31T04:35:58.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.051+0000 7f16f7e00640 1 -- 172.21.15.89:0/2209060949 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc004420 con 0x55d42240bab0 2024-08-31T04:35:58.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 -- 172.21.15.89:0/2209060949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 msgr2=0x55d4229bec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:58.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229bec00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f16fc01d620 tx=0x7f16fc0ba000 comp rx=0 tx=0).stop 2024-08-31T04:35:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 -- 172.21.15.89:0/2209060949 shutdown_connections 2024-08-31T04:35:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d4229bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d4229bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 --2- 172.21.15.89:0/2209060949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229bec00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 -- 172.21.15.89:0/2209060949 >> 172.21.15.89:0/2209060949 conn(0x55d4228d1290 msgr2=0x55d422962920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 -- 172.21.15.89:0/2209060949 shutdown_connections 2024-08-31T04:35:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 -- 172.21.15.89:0/2209060949 wait complete. 2024-08-31T04:35:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 -- start start 2024-08-31T04:35:58.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 Processor -- start 2024-08-31T04:35:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d422957ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d422958530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d422750110 con 0x55d42240bab0 2024-08-31T04:35:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d4226f4f60 con 0x55d4227fa840 2024-08-31T04:35:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d422755430 con 0x55d4227e4800 2024-08-31T04:35:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f171a998000 10 client.0 _ll_register_callbacks cb 0x7f17040096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f1710a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f1710a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58786/0 (socket says 172.21.15.89:58786) 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f1710a00640 1 -- 172.21.15.89:0/3926402436 learned_addr learned my addr 172.21.15.89:0/3926402436 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f170be00640 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d422957ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f1711400640 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d422958530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f1710a00640 1 -- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 msgr2=0x55d422957ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f1710a00640 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d422957ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f1710a00640 1 -- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 msgr2=0x55d422958530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f1710a00640 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d422958530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.055+0000 7f1710a00640 1 -- 172.21.15.89:0/3926402436 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4226d6ea0 con 0x55d42240bab0 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f1711400640 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d422958530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f1710a00640 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229c3af0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f16fc01d620 tx=0x7f16fc0a59a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4928c858845084b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f16f5600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f16f5600640 1 -- 172.21.15.89:0/3926402436 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0d9060 con 0x55d42240bab0 2024-08-31T04:35:58.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f16f5600640 1 -- 172.21.15.89:0/3926402436 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f16fc004560 con 0x55d42240bab0 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f171a998000 1 -- 172.21.15.89:0/3926402436 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16fc0041f0 con 0x55d42240bab0 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f16f5600640 1 -- 172.21.15.89:0/3926402436 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f16fc0b2040 con 0x55d42240bab0 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f171a998000 10 client.6177 fetch_fsmap learned FSMap version 9 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f171a998000 1 -- 172.21.15.89:0/3926402436 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d4226f2c10 con 0x55d42240bab0 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f16f5600640 1 -- 172.21.15.89:0/3926402436 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16fc0041f0 con 0x55d42240bab0 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f16f5600640 1 -- 172.21.15.89:0/3926402436 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f16fc0da260 con 0x55d42240bab0 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f171a998000 10 client.6177 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f171a998000 10 client.6177 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f171a998000 20 client.6177 populate_metadata read hostname 'smithi089' 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f171a998000 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55d4223dee80 0x55d4229c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f171a998000 4 client.6177 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.95, "await_for": 45.0}] 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f171a998000 1 -- 172.21.15.89:0/3926402436 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.95, "await_for": 45.0}) -- 0x55d42275b2b0 con 0x55d4223dee80 2024-08-31T04:35:58.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f170be00640 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55d4223dee80 0x55d4229c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:58.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f170be00640 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55d4223dee80 0x55d4229c1880 crc :-1 s=READY pgs=1417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c935a1489b0c1756 server_cookie=260afeb69f85ae93 in_seq=0 out_seq=0 2024-08-31T04:35:58.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:35:58.059+0000 7f16f5600640 10 client.6177 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f16f5600640 1 -- 172.21.15.89:0/3926402436 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d42275b2b0 con 0x55d4223dee80 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f16f5600640 10 client.6177 handle_command_reply: tid=0 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 client.6177 shutdown 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 -- 172.21.15.89:0/3926402436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 msgr2=0x55d4229c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229c3af0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f16fc01d620 tx=0x7f16fc0a59a0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 -- 172.21.15.89:0/3926402436 shutdown_connections 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55d4223dee80 0x55d4229c1880 crc :-1 s=READY pgs=1417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d4227fa840 0x55d422958530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d4227e4800 0x55d422957ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f16f5600640 0 client.6177 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:01.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 --2- 172.21.15.89:0/3926402436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d42240bab0 0x55d4229c3af0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 -- 172.21.15.89:0/3926402436 >> 172.21.15.89:0/3926402436 conn(0x55d4228d1290 msgr2=0x55d422961d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:01.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 -- 172.21.15.89:0/3926402436 shutdown_connections 2024-08-31T04:36:01.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 1 -- 172.21.15.89:0/3926402436 wait complete. 2024-08-31T04:36:01.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.723+0000 7f171a998000 20 client.6177 trim_cache size 0 max 16384 2024-08-31T04:36:01.727 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:36:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 110, 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "7e8bad7b": { 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 110, 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 147.9, 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:36:01.728 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:01.729 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 -- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16ec0720f0 msgr2=0x7f16ec074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16ec0720f0 0x7f16ec074600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0af000 tx=0x7f16fc01b5c0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 -- 172.21.15.89:0/1995490905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 msgr2=0x7f170c158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 0x7f170c158c40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f16f800d750 tx=0x7f16f800dc10 comp rx=0 tx=0).stop 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 -- 172.21.15.89:0/1995490905 shutdown_connections 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16ec0720f0 0x7f16ec074600 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c074d50 0x7f170c158c40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f170c153800 0x7f170c156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 --2- 172.21.15.89:0/1995490905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f170c06f3f0 0x7f170c0c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 -- 172.21.15.89:0/1995490905 >> 172.21.15.89:0/1995490905 conn(0x7f170c0c99b0 msgr2=0x7f170c0765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:01.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 -- 172.21.15.89:0/1995490905 shutdown_connections 2024-08-31T04:36:01.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:01.727+0000 7f1713400640 1 -- 172.21.15.89:0/1995490905 wait complete. 2024-08-31T04:36:01.747 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7e8bad7b', quiesce took 4.3 seconds. Will release after: 23.65 2024-08-31T04:36:25.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:36:25.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.562+0000 7f5227800640 1 -- 172.21.15.89:0/2256728326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 msgr2=0x7f52200c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.562+0000 7f5227800640 1 --2- 172.21.15.89:0/2256728326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 0x7f52200c7920 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f52200709e0 tx=0x7f521801dc70 comp rx=0 tx=0).stop 2024-08-31T04:36:25.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.562+0000 7f5227800640 1 -- 172.21.15.89:0/2256728326 shutdown_connections 2024-08-31T04:36:25.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.562+0000 7f5227800640 1 --2- 172.21.15.89:0/2256728326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 0x7f52200c7920 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.562+0000 7f5227800640 1 --2- 172.21.15.89:0/2256728326 >> v2:172.21.15.170:3300/0 conn(0x7f52200c8b00 0x7f52200c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.562+0000 7f5227800640 1 -- 172.21.15.89:0/2256728326 >> 172.21.15.89:0/2256728326 conn(0x7f52200ccf20 msgr2=0x7f52200cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:25.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.562+0000 7f5227800640 1 -- 172.21.15.89:0/2256728326 shutdown_connections 2024-08-31T04:36:25.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.562+0000 7f5227800640 1 -- 172.21.15.89:0/2256728326 wait complete. 2024-08-31T04:36:25.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5227800640 1 Processor -- start 2024-08-31T04:36:25.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5227800640 1 -- start start 2024-08-31T04:36:25.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5227800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52200b2fd0 0x7f52201f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5227800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52200c8b00 0x7f52200c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5227800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 0x7f522014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5227800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f52201646d0 con 0x7f5220158470 2024-08-31T04:36:25.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5227800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5220164550 con 0x7f52200c8b00 2024-08-31T04:36:25.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5227800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5220164850 con 0x7f52200b2fd0 2024-08-31T04:36:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5225800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 0x7f522014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5225800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 0x7f522014a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36366/0 (socket says 172.21.15.89:36366) 2024-08-31T04:36:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5225800640 1 -- 172.21.15.89:0/2830028603 learned_addr learned my addr 172.21.15.89:0/2830028603 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5217e00640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52200c8b00 0x7f52200c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.566+0000 7f5224e00640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52200b2fd0 0x7f52201f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5225800640 1 -- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52200b2fd0 msgr2=0x7f52201f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5225800640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52200b2fd0 0x7f52201f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5225800640 1 -- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52200c8b00 msgr2=0x7f52200c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5225800640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52200c8b00 0x7f52200c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5225800640 1 -- 172.21.15.89:0/2830028603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522014ca80 con 0x7f5220158470 2024-08-31T04:36:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5217e00640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52200c8b00 0x7f52200c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5225800640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 0x7f522014a720 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f521801c320 tx=0x7f5218005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f521d600640 1 -- 172.21.15.89:0/2830028603 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52180b3040 con 0x7f5220158470 2024-08-31T04:36:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f521d600640 1 -- 172.21.15.89:0/2830028603 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5218004d40 con 0x7f5220158470 2024-08-31T04:36:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f521d600640 1 -- 172.21.15.89:0/2830028603 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218004240 con 0x7f5220158470 2024-08-31T04:36:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522014cd60 con 0x7f5220158470 2024-08-31T04:36:25.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522014d320 con 0x7f5220158470 2024-08-31T04:36:25.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52200c22b0 con 0x7f5220158470 2024-08-31T04:36:25.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.570+0000 7f521d600640 1 -- 172.21.15.89:0/2830028603 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f52180bf060 con 0x7f5220158470 2024-08-31T04:36:25.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.574+0000 7f521d600640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f51fc0720c0 0x7f51fc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.574+0000 7f521d600640 1 -- 172.21.15.89:0/2830028603 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f521812c8a0 con 0x7f5220158470 2024-08-31T04:36:25.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.574+0000 7f5224e00640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f51fc0720c0 0x7f51fc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.574+0000 7f5224e00640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f51fc0720c0 0x7f51fc0745d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5210004630 tx=0x7f521000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:25.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.578+0000 7f521d600640 1 -- 172.21.15.89:0/2830028603 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5218017860 con 0x7f5220158470 2024-08-31T04:36:25.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.778+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5220151430 con 0x7f5220158470 2024-08-31T04:36:25.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.778+0000 7f521d600640 1 -- 172.21.15.89:0/2830028603 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f52180f7e10 con 0x7f5220158470 2024-08-31T04:36:25.781 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:36:25.781 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:36:25.781 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:36:25.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f51fc0720c0 msgr2=0x7f51fc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f51fc0720c0 0x7f51fc0745d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5210004630 tx=0x7f521000b2e0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 msgr2=0x7f522014a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 0x7f522014a720 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f521801c320 tx=0x7f5218005b00 comp rx=0 tx=0).stop 2024-08-31T04:36:25.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 shutdown_connections 2024-08-31T04:36:25.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f51fc0720c0 0x7f51fc0745d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5220158470 0x7f522014a720 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52200c8b00 0x7f52200c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 --2- 172.21.15.89:0/2830028603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52200b2fd0 0x7f52201f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 >> 172.21.15.89:0/2830028603 conn(0x7f52200ccf20 msgr2=0x7f5220156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:25.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 shutdown_connections 2024-08-31T04:36:25.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.782+0000 7f5227800640 1 -- 172.21.15.89:0/2830028603 wait complete. 2024-08-31T04:36:25.803 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 7e8bad7b --release --await' 2024-08-31T04:36:25.803 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 7e8bad7b --release --await 2024-08-31T04:36:25.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.962+0000 7fe9f1e00640 1 -- 172.21.15.89:0/3197694319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0b2860 msgr2=0x7fe9ec0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.962+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/3197694319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0b2860 0x7fe9ec0b2d20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0725d0 tx=0x7fe9dc01ccc0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.962+0000 7fe9f1e00640 1 -- 172.21.15.89:0/3197694319 shutdown_connections 2024-08-31T04:36:25.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.962+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/3197694319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9ec0c90e0 0x7fe9ec0747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.962+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/3197694319 >> v2:172.21.15.170:3300/0 conn(0x7fe9ec0c1ed0 0x7fe9ec152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.962+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/3197694319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0b2860 0x7fe9ec0b2d20 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.962+0000 7fe9f1e00640 1 -- 172.21.15.89:0/3197694319 >> 172.21.15.89:0/3197694319 conn(0x7fe9ec0c99b0 msgr2=0x7fe9ec0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:25.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.962+0000 7fe9f1e00640 1 -- 172.21.15.89:0/3197694319 shutdown_connections 2024-08-31T04:36:25.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.962+0000 7fe9f1e00640 1 -- 172.21.15.89:0/3197694319 wait complete. 2024-08-31T04:36:25.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 Processor -- start 2024-08-31T04:36:25.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 -- start start 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9ec0b2860 0x7fe9ec15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9ec0c1ed0 0x7fe9ec15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0c90e0 0x7fe9ec14b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0c32e0 con 0x7fe9ec0c90e0 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0c3160 con 0x7fe9ec0b2860 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec1585d0 con 0x7fe9ec0c1ed0 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0c90e0 0x7fe9ec14b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0c90e0 0x7fe9ec14b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36378/0 (socket says 172.21.15.89:36378) 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eb400640 1 -- 172.21.15.89:0/1836404600 learned_addr learned my addr 172.21.15.89:0/1836404600 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9e2000640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9ec0c1ed0 0x7fe9ec15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9ec0b2860 0x7fe9ec15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eb400640 1 -- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9ec0c1ed0 msgr2=0x7fe9ec15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eb400640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9ec0c1ed0 0x7fe9ec15b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eb400640 1 -- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9ec0b2860 msgr2=0x7fe9ec15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eb400640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9ec0b2860 0x7fe9ec15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eb400640 1 -- 172.21.15.89:0/1836404600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec1f5960 con 0x7fe9ec0c90e0 2024-08-31T04:36:25.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9e2000640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9ec0c1ed0 0x7fe9ec15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:25.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9ec0b2860 0x7fe9ec15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:25.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9eb400640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0c90e0 0x7fe9ec14b510 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400e770 tx=0x7fe9e400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:25.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9e3e00640 1 -- 172.21.15.89:0/1836404600 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400ccc0 con 0x7fe9ec0c90e0 2024-08-31T04:36:25.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9e3e00640 1 -- 172.21.15.89:0/1836404600 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9e400ee80 con 0x7fe9ec0c90e0 2024-08-31T04:36:25.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9e3e00640 1 -- 172.21.15.89:0/1836404600 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4005280 con 0x7fe9ec0c90e0 2024-08-31T04:36:25.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 -- 172.21.15.89:0/1836404600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec1487b0 con 0x7fe9ec0c90e0 2024-08-31T04:36:25.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.966+0000 7fe9f1e00640 1 -- 172.21.15.89:0/1836404600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec0c5d60 con 0x7fe9ec0c90e0 2024-08-31T04:36:25.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.970+0000 7fe9e3e00640 1 -- 172.21.15.89:0/1836404600 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe9e4005420 con 0x7fe9ec0c90e0 2024-08-31T04:36:25.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.970+0000 7fe9e3e00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe9c80720c0 0x7fe9c80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.970+0000 7fe9e3e00640 1 -- 172.21.15.89:0/1836404600 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fe9e40937e0 con 0x7fe9ec0c90e0 2024-08-31T04:36:25.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.970+0000 7fe9f937f000 1 Processor -- start 2024-08-31T04:36:25.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.970+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe9c80720c0 0x7fe9c80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.970+0000 7fe9f937f000 1 -- start start 2024-08-31T04:36:25.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.970+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe9c80720c0 0x7fe9c80745d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0af000 tx=0x7fe9dc01b500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:25.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e55a9950 0x5645e56c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5593930 0x5645e56ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e5584890 0x5645e56cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5645e5572f30 con 0x5645e5593930 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5645e54e8690 con 0x5645e55a9950 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5645e54d7c20 con 0x5645e5584890 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9e2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5593930 0x5645e56ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9e2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5593930 0x5645e56ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36384/0 (socket says 172.21.15.89:36384) 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9e2000640 1 -- 172.21.15.89:0/304641379 learned_addr learned my addr 172.21.15.89:0/304641379 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9eb400640 1 --2- 172.21.15.89:0/304641379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e5584890 0x5645e56cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/304641379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e55a9950 0x5645e56c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9e2000640 1 -- 172.21.15.89:0/304641379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e5584890 msgr2=0x5645e56cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:25.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9e2000640 1 --2- 172.21.15.89:0/304641379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e5584890 0x5645e56cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9e2000640 1 -- 172.21.15.89:0/304641379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e55a9950 msgr2=0x5645e56c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:25.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9e2000640 1 --2- 172.21.15.89:0/304641379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e55a9950 0x5645e56c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9e2000640 1 -- 172.21.15.89:0/304641379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e548c8f0 con 0x5645e5593930 2024-08-31T04:36:25.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9e2000640 1 --2- 172.21.15.89:0/304641379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5593930 0x5645e56ccad0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400dc60 tx=0x7fe9d400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a087fe4bfe7317e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:25.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9db400640 1 -- 172.21.15.89:0/304641379 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4005020 con 0x5645e5593930 2024-08-31T04:36:25.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9db400640 1 -- 172.21.15.89:0/304641379 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9d40051c0 con 0x5645e5593930 2024-08-31T04:36:25.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9db400640 1 -- 172.21.15.89:0/304641379 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40055b0 con 0x5645e5593930 2024-08-31T04:36:25.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 -- 172.21.15.89:0/304641379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5593930 msgr2=0x5645e56ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 --2- 172.21.15.89:0/304641379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5593930 0x5645e56ccad0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400dc60 tx=0x7fe9d400f730 comp rx=0 tx=0).stop 2024-08-31T04:36:25.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 -- 172.21.15.89:0/304641379 shutdown_connections 2024-08-31T04:36:25.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 --2- 172.21.15.89:0/304641379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5593930 0x5645e56ccad0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 --2- 172.21.15.89:0/304641379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e5584890 0x5645e56cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 --2- 172.21.15.89:0/304641379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e55a9950 0x5645e56c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 -- 172.21.15.89:0/304641379 >> 172.21.15.89:0/304641379 conn(0x5645e55a9540 msgr2=0x5645e56ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:25.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 -- 172.21.15.89:0/304641379 shutdown_connections 2024-08-31T04:36:25.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 -- 172.21.15.89:0/304641379 wait complete. 2024-08-31T04:36:25.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 -- start start 2024-08-31T04:36:25.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.974+0000 7fe9f937f000 1 Processor -- start 2024-08-31T04:36:25.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e56c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5645e545e500 con 0x5645e5584890 2024-08-31T04:36:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5645e54dbbd0 con 0x5645e5593930 2024-08-31T04:36:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5645e547fa30 con 0x5645e55a9950 2024-08-31T04:36:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 10 client.0 _ll_register_callbacks cb 0x5645e558db00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36396/0 (socket says 172.21.15.89:36396) 2024-08-31T04:36:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eaa00640 1 -- 172.21.15.89:0/46333441 learned_addr learned my addr 172.21.15.89:0/46333441 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eb400640 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e56c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9e2000640 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eaa00640 1 -- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 msgr2=0x5645e56c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:25.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e56c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eaa00640 1 -- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 msgr2=0x5645e56c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:25.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eaa00640 1 -- 172.21.15.89:0/46333441 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645e54776a0 con 0x5645e5584890 2024-08-31T04:36:25.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9e2000640 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:25.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56c6c10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc000f90 tx=0x7fe9dc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5809aeca6778b69 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:25.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:36:25.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9cfe00640 1 -- 172.21.15.89:0/46333441 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0c7020 con 0x5645e5584890 2024-08-31T04:36:25.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 -- 172.21.15.89:0/46333441 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5645e54717e0 con 0x5645e5584890 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9cfe00640 1 -- 172.21.15.89:0/46333441 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fe9dc004240 con 0x5645e5584890 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9cfe00640 1 -- 172.21.15.89:0/46333441 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe9dc0d1050 con 0x5645e5584890 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 10 client.6195 fetch_fsmap learned FSMap version 9 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 -- 172.21.15.89:0/46333441 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5645e54961c0 con 0x5645e5584890 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9cfe00640 1 -- 172.21.15.89:0/46333441 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5645e54717e0 con 0x5645e5584890 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9cfe00640 1 -- 172.21.15.89:0/46333441 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fe9dc0d4020 con 0x5645e5584890 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 10 client.6195 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 10 client.6195 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 20 client.6195 populate_metadata read hostname 'smithi089' 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5645e556dfc0 0x5645e56e1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:25.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 4 client.6195 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:25.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9f937f000 1 -- 172.21.15.89:0/46333441 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645e54ea5e0 con 0x5645e556dfc0 2024-08-31T04:36:25.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.978+0000 7fe9e2000640 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5645e556dfc0 0x5645e56e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:25.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9e2000640 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5645e556dfc0 0x5645e56e1630 crc :-1 s=READY pgs=1443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b6a0ab790255a17 server_cookie=faf05e9f89eacc24 in_seq=0 out_seq=0 2024-08-31T04:36:25.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9cfe00640 10 client.6195 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:25.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9cfe00640 1 -- 172.21.15.89:0/46333441 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645e54ea5e0 con 0x5645e556dfc0 2024-08-31T04:36:25.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9cfe00640 10 client.6195 handle_command_reply: tid=0 2024-08-31T04:36:25.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 client.6195 shutdown 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 -- 172.21.15.89:0/46333441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 msgr2=0x5645e56c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56c6c10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc000f90 tx=0x7fe9dc0095c0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 -- 172.21.15.89:0/46333441 shutdown_connections 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5645e556dfc0 0x5645e56e1630 crc :-1 s=READY pgs=1443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e56c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9cfe00640 0 client.6195 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 --2- 172.21.15.89:0/46333441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56c6c10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 -- 172.21.15.89:0/46333441 >> 172.21.15.89:0/46333441 conn(0x5645e55a9540 msgr2=0x5645e56c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:25.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 -- 172.21.15.89:0/46333441 shutdown_connections 2024-08-31T04:36:25.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 1 -- 172.21.15.89:0/46333441 wait complete. 2024-08-31T04:36:25.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:25.982+0000 7fe9f937f000 20 client.6195 trim_cache size 0 max 16384 2024-08-31T04:36:26.003 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9f937f000 1 Processor -- start 2024-08-31T04:36:26.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9f937f000 1 -- start start 2024-08-31T04:36:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e5687d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56882d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e56e2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9f937f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec204420 con 0x5645e5584890 2024-08-31T04:36:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9f937f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec203300 con 0x5645e5593930 2024-08-31T04:36:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9f937f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec1f90f0 con 0x5645e55a9950 2024-08-31T04:36:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e5687d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e5687d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36412/0 (socket says 172.21.15.89:36412) 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eaa00640 1 -- 172.21.15.89:0/127037283 learned_addr learned my addr 172.21.15.89:0/127037283 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9e2000640 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56882d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eb400640 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e56e2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eaa00640 1 -- 172.21.15.89:0/127037283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 msgr2=0x5645e56e2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e56e2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eaa00640 1 -- 172.21.15.89:0/127037283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 msgr2=0x5645e56882d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56882d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eaa00640 1 -- 172.21.15.89:0/127037283 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e56c8660 con 0x5645e5584890 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eb400640 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e56e2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e5687d90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc005de0 tx=0x7fe9dc0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a6074e2fbec024 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9daa00640 1 -- 172.21.15.89:0/127037283 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0db070 con 0x5645e5584890 2024-08-31T04:36:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9daa00640 1 -- 172.21.15.89:0/127037283 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9dc0bf040 con 0x5645e5584890 2024-08-31T04:36:26.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.002+0000 7fe9daa00640 1 -- 172.21.15.89:0/127037283 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0c7070 con 0x5645e5584890 2024-08-31T04:36:26.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 -- 172.21.15.89:0/127037283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 msgr2=0x5645e5687d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e5687d90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc005de0 tx=0x7fe9dc0092c0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 -- 172.21.15.89:0/127037283 shutdown_connections 2024-08-31T04:36:26.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e56e2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56882d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 --2- 172.21.15.89:0/127037283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e5687d90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 -- 172.21.15.89:0/127037283 >> 172.21.15.89:0/127037283 conn(0x5645e55a9540 msgr2=0x5645e5687680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 -- 172.21.15.89:0/127037283 shutdown_connections 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 -- 172.21.15.89:0/127037283 wait complete. 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 -- start start 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 Processor -- start 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56e5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e5707b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec201e90 con 0x5645e5584890 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec202c30 con 0x5645e5593930 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec202560 con 0x5645e55a9950 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9f937f000 10 client.0 _ll_register_callbacks cb 0x7fe9dc0bb040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56e5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36424/0 (socket says 172.21.15.89:36424) 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9eaa00640 1 -- 172.21.15.89:0/754945128 learned_addr learned my addr 172.21.15.89:0/754945128 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9e2000640 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9eb400640 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e5707b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9eaa00640 1 -- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 msgr2=0x5645e5707b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e5707b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9eaa00640 1 -- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 msgr2=0x5645e56e5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56e5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9eaa00640 1 -- 172.21.15.89:0/754945128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645e555c2f0 con 0x5645e5584890 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.006+0000 7fe9e2000640 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56e5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9eaa00640 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56e5640 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc003fd0 tx=0x7fe9dc004450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b503b4b138a3b00 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9cfe00640 1 -- 172.21.15.89:0/754945128 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0e4060 con 0x5645e5584890 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9cfe00640 1 -- 172.21.15.89:0/754945128 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fe9dc0cc800 con 0x5645e5584890 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9f937f000 1 -- 172.21.15.89:0/754945128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9dc0bf040 con 0x5645e5584890 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9cfe00640 1 -- 172.21.15.89:0/754945128 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe9dc0ea050 con 0x5645e5584890 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9f937f000 10 client.6201 fetch_fsmap learned FSMap version 9 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9f937f000 1 -- 172.21.15.89:0/754945128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5645e5461b30 con 0x5645e5584890 2024-08-31T04:36:26.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9cfe00640 1 -- 172.21.15.89:0/754945128 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9dc0bf040 con 0x5645e5584890 2024-08-31T04:36:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9cfe00640 1 -- 172.21.15.89:0/754945128 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fe9dc0ed020 con 0x5645e5584890 2024-08-31T04:36:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9f937f000 10 client.6201 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:36:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9f937f000 10 client.6201 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:36:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9f937f000 20 client.6201 populate_metadata read hostname 'smithi089' 2024-08-31T04:36:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9f937f000 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5645e5169e80 0x5645e57080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9f937f000 4 client.6201 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7e8bad7b", "release": true, "await": true}] 2024-08-31T04:36:26.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9f937f000 1 -- 172.21.15.89:0/754945128 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7e8bad7b", "release": true, "await": true}) -- 0x5645e54e6080 con 0x5645e5169e80 2024-08-31T04:36:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9e2000640 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5645e5169e80 0x5645e57080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9e2000640 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5645e5169e80 0x5645e57080c0 crc :-1 s=READY pgs=1444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d969c201f6e22e6 server_cookie=3ae6735c73a66df4 in_seq=0 out_seq=0 2024-08-31T04:36:26.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.010+0000 7fe9cfe00640 10 client.6201 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:26.057 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:36:26.060 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:36:26.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9cfe00640 1 -- 172.21.15.89:0/754945128 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5645e54e6080 con 0x5645e5169e80 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9cfe00640 10 client.6201 handle_command_reply: tid=0 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 client.6201 shutdown 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 -- 172.21.15.89:0/754945128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 msgr2=0x5645e56e5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56e5640 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc003fd0 tx=0x7fe9dc004450 comp rx=0 tx=0).stop 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 -- 172.21.15.89:0/754945128 shutdown_connections 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5645e5169e80 0x5645e57080c0 crc :-1 s=READY pgs=1444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5645e55a9950 0x5645e5707b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645e5593930 0x5645e56e5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9cfe00640 0 client.6201 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 --2- 172.21.15.89:0/754945128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5645e5584890 0x5645e56e5640 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 -- 172.21.15.89:0/754945128 >> 172.21.15.89:0/754945128 conn(0x5645e55a9540 msgr2=0x5645e5688320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:26.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 -- 172.21.15.89:0/754945128 shutdown_connections 2024-08-31T04:36:26.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 1 -- 172.21.15.89:0/754945128 wait complete. 2024-08-31T04:36:26.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f937f000 20 client.6201 trim_cache size 0 max 16384 2024-08-31T04:36:26.267 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:36:26.267 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:36:26.267 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 112, 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "7e8bad7b": { 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 112, 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 147.9, 2024-08-31T04:36:26.268 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:36:26.269 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:36:26.269 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:36:26.269 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:36:26.269 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:36:26.269 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:36:26.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:26.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:26.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:26.269 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:26.270 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:26.270 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:36:26.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f1e00640 1 -- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe9c80720c0 msgr2=0x7fe9c80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.262+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe9c80720c0 0x7fe9c80745d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0af000 tx=0x7fe9dc01b500 comp rx=0 tx=0).stop 2024-08-31T04:36:26.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 -- 172.21.15.89:0/1836404600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0c90e0 msgr2=0x7fe9ec14b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0c90e0 0x7fe9ec14b510 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400e770 tx=0x7fe9e400ec30 comp rx=0 tx=0).stop 2024-08-31T04:36:26.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 -- 172.21.15.89:0/1836404600 shutdown_connections 2024-08-31T04:36:26.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe9c80720c0 0x7fe9c80745d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9ec0c90e0 0x7fe9ec14b510 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9ec0c1ed0 0x7fe9ec15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 --2- 172.21.15.89:0/1836404600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9ec0b2860 0x7fe9ec15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 -- 172.21.15.89:0/1836404600 >> 172.21.15.89:0/1836404600 conn(0x7fe9ec0c99b0 msgr2=0x7fe9ec1504e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:26.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 -- 172.21.15.89:0/1836404600 shutdown_connections 2024-08-31T04:36:26.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.266+0000 7fe9f1e00640 1 -- 172.21.15.89:0/1836404600 wait complete. 2024-08-31T04:36:26.287 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7e8bad7b', total seconds elapsed: 28.8 2024-08-31T04:36:26.287 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.95 2024-08-31T04:36:26.288 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:36:26.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.446+0000 7f7821e00640 1 -- 172.21.15.89:0/3466637913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c0c1f40 msgr2=0x7f781c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.446+0000 7f7821e00640 1 --2- 172.21.15.89:0/3466637913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c0c1f40 0x7f781c152a10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f781c073280 tx=0x7f780401f0b0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.446+0000 7f7821e00640 1 -- 172.21.15.89:0/3466637913 shutdown_connections 2024-08-31T04:36:26.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.446+0000 7f7821e00640 1 --2- 172.21.15.89:0/3466637913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c0c1f40 0x7f781c152a10 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.446+0000 7f7821e00640 1 --2- 172.21.15.89:0/3466637913 >> v2:172.21.15.170:3300/0 conn(0x7f781c0c9330 0x7f781c074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.446+0000 7f7821e00640 1 -- 172.21.15.89:0/3466637913 >> 172.21.15.89:0/3466637913 conn(0x7f781c0ccf20 msgr2=0x7f781c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:26.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.446+0000 7f7821e00640 1 -- 172.21.15.89:0/3466637913 shutdown_connections 2024-08-31T04:36:26.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.446+0000 7f7821e00640 1 -- 172.21.15.89:0/3466637913 wait complete. 2024-08-31T04:36:26.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 Processor -- start 2024-08-31T04:36:26.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 -- start start 2024-08-31T04:36:26.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781c0c1f40 0x7f781c1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c0c9330 0x7f781c1f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c15bc70 0x7f781c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f781c0c8030 con 0x7f781c15bc70 2024-08-31T04:36:26.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f781c0c3150 con 0x7f781c0c9330 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f781c074c60 con 0x7f781c0c1f40 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c15bc70 0x7f781c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c15bc70 0x7f781c153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36440/0 (socket says 172.21.15.89:36440) 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781b400640 1 -- 172.21.15.89:0/1829232442 learned_addr learned my addr 172.21.15.89:0/1829232442 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7813e00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c0c9330 0x7f781c1f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781aa00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781c0c1f40 0x7f781c1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781b400640 1 -- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781c0c1f40 msgr2=0x7f781c1556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781b400640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781c0c1f40 0x7f781c1556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781b400640 1 -- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c0c9330 msgr2=0x7f781c1f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781b400640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c0c9330 0x7f781c1f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781b400640 1 -- 172.21.15.89:0/1829232442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781c1539a0 con 0x7f781c15bc70 2024-08-31T04:36:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f781b400640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c15bc70 0x7f781c153460 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f781400e910 tx=0x7f781400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7813400640 1 -- 172.21.15.89:0/1829232442 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814004d30 con 0x7f781c15bc70 2024-08-31T04:36:26.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7813400640 1 -- 172.21.15.89:0/1829232442 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f781400cac0 con 0x7f781c15bc70 2024-08-31T04:36:26.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781c159a50 con 0x7f781c15bc70 2024-08-31T04:36:26.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7813400640 1 -- 172.21.15.89:0/1829232442 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814005020 con 0x7f781c15bc70 2024-08-31T04:36:26.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.450+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f781c154090 con 0x7f781c15bc70 2024-08-31T04:36:26.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.454+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f781c152a10 con 0x7f781c15bc70 2024-08-31T04:36:26.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.454+0000 7f7813400640 1 -- 172.21.15.89:0/1829232442 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f78140051c0 con 0x7f781c15bc70 2024-08-31T04:36:26.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.454+0000 7f7813400640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77f80720c0 0x7f77f80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.454+0000 7f7813400640 1 -- 172.21.15.89:0/1829232442 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f7814093720 con 0x7f781c15bc70 2024-08-31T04:36:26.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.454+0000 7f781aa00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77f80720c0 0x7f77f80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.458+0000 7f781aa00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77f80720c0 0x7f77f80745d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f780c007fd0 tx=0x7f780c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.458+0000 7f7813400640 1 -- 172.21.15.89:0/1829232442 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7814016030 con 0x7f781c15bc70 2024-08-31T04:36:26.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f781c0715f0 con 0x7f781c15bc70 2024-08-31T04:36:26.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7813400640 1 -- 172.21.15.89:0/1829232442 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f78140670b0 con 0x7f781c15bc70 2024-08-31T04:36:26.675 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:36:26.675 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:36:26.676 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:36:26.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77f80720c0 msgr2=0x7f77f80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77f80720c0 0x7f77f80745d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f780c007fd0 tx=0x7f780c009040 comp rx=0 tx=0).stop 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c15bc70 msgr2=0x7f781c153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c15bc70 0x7f781c153460 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f781400e910 tx=0x7f781400edd0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 shutdown_connections 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77f80720c0 0x7f77f80745d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f781c15bc70 0x7f781c153460 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f781c0c9330 0x7f781c1f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 --2- 172.21.15.89:0/1829232442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781c0c1f40 0x7f781c1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 >> 172.21.15.89:0/1829232442 conn(0x7f781c0ccf20 msgr2=0x7f781c150900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:26.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 shutdown_connections 2024-08-31T04:36:26.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.674+0000 7f7821e00640 1 -- 172.21.15.89:0/1829232442 wait complete. 2024-08-31T04:36:26.698 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 147.95 --await-for 45.0' 2024-08-31T04:36:26.698 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 147.95 --await-for 45.0 2024-08-31T04:36:26.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.902+0000 7f038a800640 1 -- 172.21.15.89:0/2373496884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0368004d50 msgr2=0x7f0368005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.902+0000 7f038a800640 1 --2- 172.21.15.89:0/2373496884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0368004d50 0x7f0368005200 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f037c00c2e0 tx=0x7f037c01cf60 comp rx=0 tx=0).stop 2024-08-31T04:36:26.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.902+0000 7f0383e00640 1 -- 172.21.15.89:0/2373496884 reap_dead start 2024-08-31T04:36:26.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.902+0000 7f038a800640 1 -- 172.21.15.89:0/2373496884 shutdown_connections 2024-08-31T04:36:26.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.902+0000 7f038a800640 1 -- 172.21.15.89:0/2373496884 >> 172.21.15.89:0/2373496884 conn(0x7f0384073630 msgr2=0x7f0384073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:26.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.902+0000 7f038a800640 1 -- 172.21.15.89:0/2373496884 shutdown_connections 2024-08-31T04:36:26.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.902+0000 7f038a800640 1 -- 172.21.15.89:0/2373496884 wait complete. 2024-08-31T04:36:26.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f038a800640 1 Processor -- start 2024-08-31T04:36:26.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f038a800640 1 -- start start 2024-08-31T04:36:26.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f038a800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0368004d50 0x7f0384157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f038a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03840b49a0 0x7f03841494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f038a800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0384140800 0x7f0384140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f038a800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f03840c3fe0 con 0x7f0368004d50 2024-08-31T04:36:26.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f038a800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03840c99c0 con 0x7f03840b49a0 2024-08-31T04:36:26.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f038a800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0384157ea0 con 0x7f0384140800 2024-08-31T04:36:26.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0383400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0368004d50 0x7f0384157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0383400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0368004d50 0x7f0384157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36460/0 (socket says 172.21.15.89:36460) 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0383400640 1 -- 172.21.15.89:0/3788167425 learned_addr learned my addr 172.21.15.89:0/3788167425 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0382a00640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03840b49a0 0x7f03841494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0383400640 1 -- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0384140800 msgr2=0x7f0384140c10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0383400640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0384140800 0x7f0384140c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0383400640 1 -- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03840b49a0 msgr2=0x7f03841494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0383400640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03840b49a0 0x7f03841494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0383400640 1 -- 172.21.15.89:0/3788167425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038414f9d0 con 0x7f0368004d50 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.906+0000 7f0383400640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0368004d50 0x7f0384157490 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f03740018d0 tx=0x7f0374001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.910+0000 7f037b400640 1 -- 172.21.15.89:0/3788167425 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374015070 con 0x7f0368004d50 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.910+0000 7f037b400640 1 -- 172.21.15.89:0/3788167425 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f037400ead0 con 0x7f0368004d50 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.910+0000 7f037b400640 1 -- 172.21.15.89:0/3788167425 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374011460 con 0x7f0368004d50 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.910+0000 7f038a800640 1 -- 172.21.15.89:0/3788167425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03841579d0 con 0x7f0368004d50 2024-08-31T04:36:26.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.910+0000 7f038a800640 1 -- 172.21.15.89:0/3788167425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0384146290 con 0x7f0368004d50 2024-08-31T04:36:26.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.910+0000 7f037b400640 1 -- 172.21.15.89:0/3788167425 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f0374018070 con 0x7f0368004d50 2024-08-31T04:36:26.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.910+0000 7f037b400640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f03640720f0 0x7f0364074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.910+0000 7f037b400640 1 -- 172.21.15.89:0/3788167425 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f0374093860 con 0x7f0368004d50 2024-08-31T04:36:26.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.910+0000 7f0382a00640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f03640720f0 0x7f0364074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 Processor -- start 2024-08-31T04:36:26.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 -- start start 2024-08-31T04:36:26.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0382a00640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f03640720f0 0x7f0364074600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f038414d810 tx=0x7f03700091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af756820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af75a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af75a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5606af5758c0 con 0x5606af5fc800 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5606af564e50 con 0x5606af612840 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5606af568e00 con 0x5606af223ab0 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af75a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af75a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36476/0 (socket says 172.21.15.89:36476) 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383e00640 1 -- 172.21.15.89:0/810474427 learned_addr learned my addr 172.21.15.89:0/810474427 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0382a00640 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af75a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383400640 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af756820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383e00640 1 -- 172.21.15.89:0/810474427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 msgr2=0x5606af756820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383e00640 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af756820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383e00640 1 -- 172.21.15.89:0/810474427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 msgr2=0x5606af75a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383e00640 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af75a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383e00640 1 -- 172.21.15.89:0/810474427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606af504850 con 0x5606af5fc800 2024-08-31T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0382a00640 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af75a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0383e00640 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af75a9f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f037c01ca20 tx=0x7f0368005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50433b301aba04cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f036fe00640 1 -- 172.21.15.89:0/810474427 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c001d10 con 0x5606af5fc800 2024-08-31T04:36:26.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f036fe00640 1 -- 172.21.15.89:0/810474427 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f037c006090 con 0x5606af5fc800 2024-08-31T04:36:26.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f036fe00640 1 -- 172.21.15.89:0/810474427 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c0064a0 con 0x5606af5fc800 2024-08-31T04:36:26.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 -- 172.21.15.89:0/810474427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 msgr2=0x5606af75a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af75a9f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f037c01ca20 tx=0x7f0368005840 comp rx=0 tx=0).stop 2024-08-31T04:36:26.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 -- 172.21.15.89:0/810474427 shutdown_connections 2024-08-31T04:36:26.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af75a9f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af75a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 --2- 172.21.15.89:0/810474427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af756820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.914+0000 7f0391d73000 1 -- 172.21.15.89:0/810474427 >> 172.21.15.89:0/810474427 conn(0x5606af6e9290 msgr2=0x5606af759280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:26.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 -- 172.21.15.89:0/810474427 shutdown_connections 2024-08-31T04:36:26.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 -- 172.21.15.89:0/810474427 wait complete. 2024-08-31T04:36:26.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 -- start start 2024-08-31T04:36:26.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 Processor -- start 2024-08-31T04:36:26.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af765040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af765580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af71bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5606af50a6f0 con 0x5606af5fc800 2024-08-31T04:36:26.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5606af574690 con 0x5606af612840 2024-08-31T04:36:26.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5606af4e6df0 con 0x5606af223ab0 2024-08-31T04:36:26.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 10 client.0 _ll_register_callbacks cb 0x5606af705a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:26.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0382a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af765580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0382a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af765580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36484/0 (socket says 172.21.15.89:36484) 2024-08-31T04:36:26.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0382a00640 1 -- 172.21.15.89:0/595613117 learned_addr learned my addr 172.21.15.89:0/595613117 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:26.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0383e00640 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af71bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0383400640 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af765040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0382a00640 1 -- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 msgr2=0x5606af765040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0382a00640 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af765040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0382a00640 1 -- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 msgr2=0x5606af71bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0382a00640 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af71bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0382a00640 1 -- 172.21.15.89:0/595613117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606af50f340 con 0x5606af5fc800 2024-08-31T04:36:26.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0383e00640 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af71bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:26.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0382a00640 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af765580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0370011740 tx=0x7f03700046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edd106e8b50f4fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f036cc00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:36:26.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f036cc00640 1 -- 172.21.15.89:0/595613117 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037002c060 con 0x5606af5fc800 2024-08-31T04:36:26.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f036cc00640 1 -- 172.21.15.89:0/595613117 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f037001e910 con 0x5606af5fc800 2024-08-31T04:36:26.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.918+0000 7f0391d73000 1 -- 172.21.15.89:0/595613117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5606af4fe960 con 0x5606af5fc800 2024-08-31T04:36:26.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f036cc00640 1 -- 172.21.15.89:0/595613117 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f0370032050 con 0x5606af5fc800 2024-08-31T04:36:26.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 10 client.6222 fetch_fsmap learned FSMap version 9 2024-08-31T04:36:26.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 -- 172.21.15.89:0/595613117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5606af4ffbd0 con 0x5606af5fc800 2024-08-31T04:36:26.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f036cc00640 1 -- 172.21.15.89:0/595613117 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5606af4fe960 con 0x5606af5fc800 2024-08-31T04:36:26.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f036cc00640 1 -- 172.21.15.89:0/595613117 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f0370035020 con 0x5606af5fc800 2024-08-31T04:36:26.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 10 client.6222 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:36:26.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 10 client.6222 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:36:26.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 20 client.6222 populate_metadata read hostname 'smithi089' 2024-08-31T04:36:26.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5606af208e20 0x5606af71c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 4 client.6222 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:26.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 -- 172.21.15.89:0/595613117 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606af577810 con 0x5606af208e20 2024-08-31T04:36:26.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0383400640 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5606af208e20 0x5606af71c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f036cc00640 10 client.6222 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0383400640 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5606af208e20 0x5606af71c4f0 crc :-1 s=READY pgs=1445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a2bcf4b1bbf01d4 server_cookie=6fc539eb3ba7b9d2 in_seq=0 out_seq=0 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f036cc00640 1 -- 172.21.15.89:0/595613117 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606af577810 con 0x5606af208e20 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f036cc00640 10 client.6222 handle_command_reply: tid=0 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 client.6222 shutdown 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 -- 172.21.15.89:0/595613117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 msgr2=0x5606af765580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af765580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0370011740 tx=0x7f03700046d0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 -- 172.21.15.89:0/595613117 shutdown_connections 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5606af208e20 0x5606af71c4f0 crc :-1 s=READY pgs=1445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af765580 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af71bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 --2- 172.21.15.89:0/595613117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af765040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f036cc00640 0 client.6222 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:26.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.922+0000 7f0391d73000 1 -- 172.21.15.89:0/595613117 >> 172.21.15.89:0/595613117 conn(0x5606af6e9290 msgr2=0x5606af7583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:26.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.926+0000 7f0391d73000 1 -- 172.21.15.89:0/595613117 shutdown_connections 2024-08-31T04:36:26.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.926+0000 7f0391d73000 1 -- 172.21.15.89:0/595613117 wait complete. 2024-08-31T04:36:26.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.926+0000 7f0391d73000 20 client.6222 trim_cache size 0 max 16384 2024-08-31T04:36:26.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0391d73000 1 Processor -- start 2024-08-31T04:36:26.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0391d73000 1 -- start start 2024-08-31T04:36:26.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0391d73000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af71ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0391d73000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af71b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0391d73000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af7753f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0391d73000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f03841fd900 con 0x5606af5fc800 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0391d73000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03841fcb90 con 0x5606af612840 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0391d73000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f03841fd230 con 0x5606af223ab0 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0382a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af71b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0382a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af71b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36486/0 (socket says 172.21.15.89:36486) 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0382a00640 1 -- 172.21.15.89:0/899296794 learned_addr learned my addr 172.21.15.89:0/899296794 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0383400640 1 --2- 172.21.15.89:0/899296794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af71ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0383e00640 1 --2- 172.21.15.89:0/899296794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af7753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0382a00640 1 -- 172.21.15.89:0/899296794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 msgr2=0x5606af71ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0382a00640 1 --2- 172.21.15.89:0/899296794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af71ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0382a00640 1 -- 172.21.15.89:0/899296794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 msgr2=0x5606af7753f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0382a00640 1 --2- 172.21.15.89:0/899296794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af7753f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.942+0000 7f0382a00640 1 -- 172.21.15.89:0/899296794 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606af5e9b30 con 0x5606af5fc800 2024-08-31T04:36:26.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0382a00640 1 --2- 172.21.15.89:0/899296794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af71b220 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0370011680 tx=0x7f037001e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90658f0d3591606a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f036f400640 1 -- 172.21.15.89:0/899296794 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037003a020 con 0x5606af5fc800 2024-08-31T04:36:26.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f036f400640 1 -- 172.21.15.89:0/899296794 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f037001e040 con 0x5606af5fc800 2024-08-31T04:36:26.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f036f400640 1 -- 172.21.15.89:0/899296794 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037002c050 con 0x5606af5fc800 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 -- 172.21.15.89:0/899296794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 msgr2=0x5606af71b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 --2- 172.21.15.89:0/899296794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af71b220 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0370011680 tx=0x7f037001e910 comp rx=0 tx=0).stop 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 -- 172.21.15.89:0/899296794 shutdown_connections 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 --2- 172.21.15.89:0/899296794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af5fc800 0x5606af71b220 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 --2- 172.21.15.89:0/899296794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af612840 0x5606af7753f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 --2- 172.21.15.89:0/899296794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af71ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 -- 172.21.15.89:0/899296794 >> 172.21.15.89:0/899296794 conn(0x5606af6e9290 msgr2=0x5606af71a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 -- 172.21.15.89:0/899296794 shutdown_connections 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 -- 172.21.15.89:0/899296794 wait complete. 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 -- start start 2024-08-31T04:36:26.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 Processor -- start 2024-08-31T04:36:26.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af775610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af5fc800 0x5606af79a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af612840 0x5606af79a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5606af568110 con 0x5606af612840 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5606af50cf60 con 0x5606af5fc800 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5606af56d430 con 0x5606af223ab0 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.946+0000 7f0391d73000 10 client.0 _ll_register_callbacks cb 0x7f0370009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af612840 0x5606af79a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af612840 0x5606af79a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36492/0 (socket says 172.21.15.89:36492) 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383e00640 1 -- 172.21.15.89:0/527633496 learned_addr learned my addr 172.21.15.89:0/527633496 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0382a00640 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af5fc800 0x5606af79a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383400640 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af775610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383e00640 1 -- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 msgr2=0x5606af775610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383e00640 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af775610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383e00640 1 -- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af5fc800 msgr2=0x5606af79a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383e00640 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af5fc800 0x5606af79a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:26.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383e00640 1 -- 172.21.15.89:0/527633496 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606af4eeea0 con 0x5606af612840 2024-08-31T04:36:26.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0382a00640 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af5fc800 0x5606af79a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:26.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383e00640 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af612840 0x5606af79a930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f037c006fd0 tx=0x7f037c000f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61add456afe950f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:26.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f036cc00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:36:26.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f036cc00640 1 -- 172.21.15.89:0/527633496 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c001d10 con 0x5606af612840 2024-08-31T04:36:26.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f036cc00640 1 -- 172.21.15.89:0/527633496 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f037c0bfac0 con 0x5606af612840 2024-08-31T04:36:26.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0391d73000 1 -- 172.21.15.89:0/527633496 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f037001e040 con 0x5606af612840 2024-08-31T04:36:26.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f036cc00640 1 -- 172.21.15.89:0/527633496 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f037c0cf050 con 0x5606af612840 2024-08-31T04:36:26.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0391d73000 10 client.6228 fetch_fsmap learned FSMap version 9 2024-08-31T04:36:26.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0391d73000 1 -- 172.21.15.89:0/527633496 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5606af50ac10 con 0x5606af612840 2024-08-31T04:36:26.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f036cc00640 1 -- 172.21.15.89:0/527633496 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f037001e040 con 0x5606af612840 2024-08-31T04:36:26.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f036cc00640 1 -- 172.21.15.89:0/527633496 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f037c0bfcc0 con 0x5606af612840 2024-08-31T04:36:26.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0391d73000 10 client.6228 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:36:26.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0391d73000 10 client.6228 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:36:26.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0391d73000 20 client.6228 populate_metadata read hostname 'smithi089' 2024-08-31T04:36:26.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0391d73000 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5606af1f6e80 0x5606af79ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:26.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0391d73000 4 client.6228 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.95, "await_for": 45.0}] 2024-08-31T04:36:26.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0391d73000 1 -- 172.21.15.89:0/527633496 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.95, "await_for": 45.0}) -- 0x5606af5732b0 con 0x5606af1f6e80 2024-08-31T04:36:26.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383400640 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5606af1f6e80 0x5606af79ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:26.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f0383400640 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5606af1f6e80 0x5606af79ae70 crc :-1 s=READY pgs=1446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f0a802998a054b3 server_cookie=2691e19e4c9fbc88 in_seq=0 out_seq=0 2024-08-31T04:36:26.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:26.950+0000 7f036cc00640 10 client.6228 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:28.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.518+0000 7f036cc00640 1 -- 172.21.15.89:0/527633496 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5606af5732b0 con 0x5606af1f6e80 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.518+0000 7f036cc00640 10 client.6228 handle_command_reply: tid=0 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.518+0000 7f0391d73000 1 client.6228 shutdown 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.518+0000 7f0391d73000 1 -- 172.21.15.89:0/527633496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af612840 msgr2=0x5606af79a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.518+0000 7f0391d73000 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af612840 0x5606af79a930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f037c006fd0 tx=0x7f037c000f70 comp rx=0 tx=0).stop 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f0391d73000 1 -- 172.21.15.89:0/527633496 shutdown_connections 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f0391d73000 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5606af1f6e80 0x5606af79ae70 crc :-1 s=READY pgs=1446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f0391d73000 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5606af612840 0x5606af79a930 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f0391d73000 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5606af5fc800 0x5606af79a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f036cc00640 0 client.6228 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f0391d73000 1 --2- 172.21.15.89:0/527633496 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5606af223ab0 0x5606af775610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f0391d73000 1 -- 172.21.15.89:0/527633496 >> 172.21.15.89:0/527633496 conn(0x5606af6e9290 msgr2=0x5606af71b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:28.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f0391d73000 1 -- 172.21.15.89:0/527633496 shutdown_connections 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f0391d73000 1 -- 172.21.15.89:0/527633496 wait complete. 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f0391d73000 20 client.6228 trim_cache size 0 max 16384 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 114, 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stdout: "b210bf7a": { 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 114, 2024-08-31T04:36:28.524 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 147.9, 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:28.525 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:28.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:28.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:28.526 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:28.526 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:36:28.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 -- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f03640720f0 msgr2=0x7f0364074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:28.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f03640720f0 0x7f0364074600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f038414d810 tx=0x7f03700091e0 comp rx=0 tx=0).stop 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 -- 172.21.15.89:0/3788167425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0368004d50 msgr2=0x7f0384157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0368004d50 0x7f0384157490 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f03740018d0 tx=0x7f0374001d90 comp rx=0 tx=0).stop 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 -- 172.21.15.89:0/3788167425 shutdown_connections 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f03640720f0 0x7f0364074600 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0384140800 0x7f0384140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03840b49a0 0x7f03841494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 --2- 172.21.15.89:0/3788167425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0368004d50 0x7f0384157490 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 -- 172.21.15.89:0/3788167425 >> 172.21.15.89:0/3788167425 conn(0x7f0384073630 msgr2=0x7f03840cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 -- 172.21.15.89:0/3788167425 shutdown_connections 2024-08-31T04:36:28.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:28.522+0000 7f038a800640 1 -- 172.21.15.89:0/3788167425 wait complete. 2024-08-31T04:36:28.544 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b210bf7a', quiesce took 2.3 seconds. Will release after: 25.65 2024-08-31T04:36:54.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:36:54.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 -- 172.21.15.89:0/3134215770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c1f40 msgr2=0x7f79d8152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 --2- 172.21.15.89:0/3134215770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c1f40 0x7f79d8152a10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f79d8073280 tx=0x7f79c001f0b0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 -- 172.21.15.89:0/3134215770 shutdown_connections 2024-08-31T04:36:54.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 --2- 172.21.15.89:0/3134215770 >> v2:172.21.15.170:3300/0 conn(0x7f79d80c9330 0x7f79d8074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 --2- 172.21.15.89:0/3134215770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c1f40 0x7f79d8152a10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 -- 172.21.15.89:0/3134215770 >> 172.21.15.89:0/3134215770 conn(0x7f79d80ccf20 msgr2=0x7f79d80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:54.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 -- 172.21.15.89:0/3134215770 shutdown_connections 2024-08-31T04:36:54.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 -- 172.21.15.89:0/3134215770 wait complete. 2024-08-31T04:36:54.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 Processor -- start 2024-08-31T04:36:54.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.362+0000 7f79dfc00640 1 -- start start 2024-08-31T04:36:54.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dfc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79d80c1f40 0x7f79d81f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dfc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c9330 0x7f79d8153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dfc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d815bc70 0x7f79d814b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dfc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f79d80c8030 con 0x7f79d80c9330 2024-08-31T04:36:54.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dfc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f79d80c3150 con 0x7f79d815bc70 2024-08-31T04:36:54.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dfc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f79d8074c60 con 0x7f79d80c1f40 2024-08-31T04:36:54.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79cfe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c9330 0x7f79d8153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79cfe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c9330 0x7f79d8153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44598/0 (socket says 172.21.15.89:44598) 2024-08-31T04:36:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79cfe00640 1 -- 172.21.15.89:0/1449039463 learned_addr learned my addr 172.21.15.89:0/1449039463 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79ddc00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d815bc70 0x7f79d814b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dd200640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79d80c1f40 0x7f79d81f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79cfe00640 1 -- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79d80c1f40 msgr2=0x7f79d81f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79cfe00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79d80c1f40 0x7f79d81f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79cfe00640 1 -- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d815bc70 msgr2=0x7f79d814b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79cfe00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d815bc70 0x7f79d814b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79cfe00640 1 -- 172.21.15.89:0/1449039463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d81f2510 con 0x7f79d80c9330 2024-08-31T04:36:54.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79cfe00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c9330 0x7f79d8153bf0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f79c00b3040 tx=0x7f79c0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:54.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79d5600640 1 -- 172.21.15.89:0/1449039463 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c00be070 con 0x7f79d80c9330 2024-08-31T04:36:54.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79d5600640 1 -- 172.21.15.89:0/1449039463 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79c00053e0 con 0x7f79d80c9330 2024-08-31T04:36:54.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d81587b0 con 0x7f79d80c9330 2024-08-31T04:36:54.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79d5600640 1 -- 172.21.15.89:0/1449039463 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c00b5040 con 0x7f79d80c9330 2024-08-31T04:36:54.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d8158a70 con 0x7f79d80c9330 2024-08-31T04:36:54.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d8152a10 con 0x7f79d80c9330 2024-08-31T04:36:54.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.366+0000 7f79d5600640 1 -- 172.21.15.89:0/1449039463 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f79c00c1070 con 0x7f79d80c9330 2024-08-31T04:36:54.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.370+0000 7f79d5600640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79b40720c0 0x7f79b40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.370+0000 7f79d5600640 1 -- 172.21.15.89:0/1449039463 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f79c012fe40 con 0x7f79d80c9330 2024-08-31T04:36:54.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.370+0000 7f79dd200640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79b40720c0 0x7f79b40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.370+0000 7f79dd200640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79b40720c0 0x7f79b40745d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f79c8001650 tx=0x7f79c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:54.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.374+0000 7f79d5600640 1 -- 172.21.15.89:0/1449039463 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f79c0018c10 con 0x7f79d80c9330 2024-08-31T04:36:54.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79d81560a0 con 0x7f79d80c9330 2024-08-31T04:36:54.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79d5600640 1 -- 172.21.15.89:0/1449039463 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f79c00fb320 con 0x7f79d80c9330 2024-08-31T04:36:54.576 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:36:54.576 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:36:54.576 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79b40720c0 msgr2=0x7f79b40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79b40720c0 0x7f79b40745d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f79c8001650 tx=0x7f79c8009040 comp rx=0 tx=0).stop 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c9330 msgr2=0x7f79d8153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c9330 0x7f79d8153bf0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f79c00b3040 tx=0x7f79c0004600 comp rx=0 tx=0).stop 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 shutdown_connections 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f79b40720c0 0x7f79b40745d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79d80c9330 0x7f79d8153bf0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d815bc70 0x7f79d814b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 --2- 172.21.15.89:0/1449039463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79d80c1f40 0x7f79d81f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 >> 172.21.15.89:0/1449039463 conn(0x7f79d80ccf20 msgr2=0x7f79d8156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 shutdown_connections 2024-08-31T04:36:54.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.574+0000 7f79dfc00640 1 -- 172.21.15.89:0/1449039463 wait complete. 2024-08-31T04:36:54.598 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id b210bf7a --release --await' 2024-08-31T04:36:54.598 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id b210bf7a --release --await 2024-08-31T04:36:54.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.758+0000 7f47ed400640 1 -- 172.21.15.89:0/3799186704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47cc003a10 msgr2=0x7f47cc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.758+0000 7f47ed400640 1 --2- 172.21.15.89:0/3799186704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47cc003a10 0x7f47cc003e80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009b40 tx=0x7f47d801d270 comp rx=0 tx=0).stop 2024-08-31T04:36:54.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.758+0000 7f47e7200640 1 -- 172.21.15.89:0/3799186704 reap_dead start 2024-08-31T04:36:54.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.758+0000 7f47ed400640 1 -- 172.21.15.89:0/3799186704 shutdown_connections 2024-08-31T04:36:54.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.758+0000 7f47ed400640 1 -- 172.21.15.89:0/3799186704 >> 172.21.15.89:0/3799186704 conn(0x7f47e80c99b0 msgr2=0x7f47e80c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:54.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.758+0000 7f47ed400640 1 -- 172.21.15.89:0/3799186704 shutdown_connections 2024-08-31T04:36:54.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.758+0000 7f47ed400640 1 -- 172.21.15.89:0/3799186704 wait complete. 2024-08-31T04:36:54.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.758+0000 7f47ed400640 1 Processor -- start 2024-08-31T04:36:54.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.758+0000 7f47ed400640 1 -- start start 2024-08-31T04:36:54.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47ed400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47cc003a10 0x7f47e80c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47ed400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e80c3590 0x7f47e814ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47ed400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47e8147930 0x7f47e8147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47ed400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47e806fc10 con 0x7f47e80c3590 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47ed400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f47e8073e70 con 0x7f47cc003a10 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47ed400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f47e8069fc0 con 0x7f47e8147930 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e80c3590 0x7f47e814ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e6800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47cc003a10 0x7f47e80c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e80c3590 0x7f47e814ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44628/0 (socket says 172.21.15.89:44628) 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e5e00640 1 -- 172.21.15.89:0/1047418974 learned_addr learned my addr 172.21.15.89:0/1047418974 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e6800640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47cc003a10 0x7f47e80c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.89:56000/0 (socket says 172.21.15.89:56000) 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e7200640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47e8147930 0x7f47e8147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e5e00640 1 -- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47e8147930 msgr2=0x7f47e8147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e5e00640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47e8147930 0x7f47e8147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e5e00640 1 -- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47cc003a10 msgr2=0x7f47e80c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e5e00640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47cc003a10 0x7f47e80c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e5e00640 1 -- 172.21.15.89:0/1047418974 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e8148280 con 0x7f47e80c3590 2024-08-31T04:36:54.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47e5e00640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e80c3590 0x7f47e814ff30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f47d4011a80 tx=0x7f47d4011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:54.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47dea00640 1 -- 172.21.15.89:0/1047418974 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d400fe10 con 0x7f47e80c3590 2024-08-31T04:36:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47dea00640 1 -- 172.21.15.89:0/1047418974 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47d4016070 con 0x7f47e80c3590 2024-08-31T04:36:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47dea00640 1 -- 172.21.15.89:0/1047418974 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40126b0 con 0x7f47e80c3590 2024-08-31T04:36:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47ed400640 1 -- 172.21.15.89:0/1047418974 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e80c85e0 con 0x7f47e80c3590 2024-08-31T04:36:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.762+0000 7f47ed400640 1 -- 172.21.15.89:0/1047418974 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e80c28f0 con 0x7f47e80c3590 2024-08-31T04:36:54.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.766+0000 7f47dea00640 1 -- 172.21.15.89:0/1047418974 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f47d4018030 con 0x7f47e80c3590 2024-08-31T04:36:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.766+0000 7f47dea00640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f47c80720c0 0x7f47c80745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.766+0000 7f47dea00640 1 -- 172.21.15.89:0/1047418974 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f47d40936f0 con 0x7f47e80c3590 2024-08-31T04:36:54.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.766+0000 7f47f4b2f000 1 Processor -- start 2024-08-31T04:36:54.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.766+0000 7f47e6800640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f47c80720c0 0x7f47c80745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.766+0000 7f47f4b2f000 1 -- start start 2024-08-31T04:36:54.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.766+0000 7f47e6800640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f47c80720c0 0x7f47c80745d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009b40 tx=0x7f47d801a010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:54.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 0x56291a1b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a07d930 0x56291a1b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a06e890 0x56291a1b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56291a05cf30 con 0x56291a07d930 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562919fd2690 con 0x56291a093950 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562919fc1c20 con 0x56291a06e890 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a07d930 0x56291a1b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a07d930 0x56291a1b6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44632/0 (socket says 172.21.15.89:44632) 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e5e00640 1 -- 172.21.15.89:0/3307977391 learned_addr learned my addr 172.21.15.89:0/3307977391 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e6800640 1 --2- 172.21.15.89:0/3307977391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 0x56291a1b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e7200640 1 --2- 172.21.15.89:0/3307977391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a06e890 0x56291a1b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e5e00640 1 -- 172.21.15.89:0/3307977391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a06e890 msgr2=0x56291a1b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e5e00640 1 --2- 172.21.15.89:0/3307977391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a06e890 0x56291a1b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e5e00640 1 -- 172.21.15.89:0/3307977391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 msgr2=0x56291a1b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:54.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e5e00640 1 --2- 172.21.15.89:0/3307977391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 0x56291a1b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e5e00640 1 -- 172.21.15.89:0/3307977391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562919f768f0 con 0x56291a07d930 2024-08-31T04:36:54.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47e5e00640 1 --2- 172.21.15.89:0/3307977391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a07d930 0x56291a1b6ad0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f47d405ab70 tx=0x7f47d405dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8f8c6cf45cbd4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:54.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47d3000640 1 -- 172.21.15.89:0/3307977391 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40670b0 con 0x56291a07d930 2024-08-31T04:36:54.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47d3000640 1 -- 172.21.15.89:0/3307977391 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47d4067760 con 0x56291a07d930 2024-08-31T04:36:54.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47d3000640 1 -- 172.21.15.89:0/3307977391 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4065270 con 0x56291a07d930 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 -- 172.21.15.89:0/3307977391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a07d930 msgr2=0x56291a1b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/3307977391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a07d930 0x56291a1b6ad0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f47d405ab70 tx=0x7f47d405dde0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 -- 172.21.15.89:0/3307977391 shutdown_connections 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/3307977391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a07d930 0x56291a1b6ad0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/3307977391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a06e890 0x56291a1b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/3307977391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 0x56291a1b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 -- 172.21.15.89:0/3307977391 >> 172.21.15.89:0/3307977391 conn(0x56291a093540 msgr2=0x56291a1b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 -- 172.21.15.89:0/3307977391 shutdown_connections 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 -- 172.21.15.89:0/3307977391 wait complete. 2024-08-31T04:36:54.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 -- start start 2024-08-31T04:36:54.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.770+0000 7f47f4b2f000 1 Processor -- start 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a1b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a07d930 0x56291a1b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 0x56291a1b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562919f48500 con 0x56291a06e890 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562919fc5bd0 con 0x56291a093950 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562919f69a30 con 0x56291a07d930 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 10 client.0 _ll_register_callbacks cb 0x56291a077b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a1b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a1b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44634/0 (socket says 172.21.15.89:44634) 2024-08-31T04:36:54.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e6800640 1 -- 172.21.15.89:0/2305590945 learned_addr learned my addr 172.21.15.89:0/2305590945 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e7200640 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 0x56291a1b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e5e00640 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a07d930 0x56291a1b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e6800640 1 -- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a07d930 msgr2=0x56291a1b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e6800640 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a07d930 0x56291a1b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e6800640 1 -- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 msgr2=0x56291a1b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e6800640 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 0x56291a1b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e6800640 1 -- 172.21.15.89:0/2305590945 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562919f616a0 con 0x56291a06e890 2024-08-31T04:36:54.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e5e00640 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a07d930 0x56291a1b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e6800640 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a1b0c10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009a60 tx=0x7f47d80091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7c10db1680a7ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47c7400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47c7400640 1 -- 172.21.15.89:0/2305590945 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8004c20 con 0x56291a06e890 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47c7400640 1 -- 172.21.15.89:0/2305590945 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f47d8004dc0 con 0x56291a06e890 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2305590945 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562919f5b7e0 con 0x56291a06e890 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47c7400640 1 -- 172.21.15.89:0/2305590945 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f47d80d6050 con 0x56291a06e890 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 10 client.6246 fetch_fsmap learned FSMap version 9 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2305590945 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562919f801c0 con 0x56291a06e890 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47c7400640 1 -- 172.21.15.89:0/2305590945 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562919f5b7e0 con 0x56291a06e890 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47c7400640 1 -- 172.21.15.89:0/2305590945 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f47d80d9020 con 0x56291a06e890 2024-08-31T04:36:54.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 10 client.6246 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:36:54.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 10 client.6246 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:36:54.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 20 client.6246 populate_metadata read hostname 'smithi089' 2024-08-31T04:36:54.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56291a057fc0 0x56291a1cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 4 client.6246 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:54.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2305590945 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562919fd45e0 con 0x56291a057fc0 2024-08-31T04:36:54.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.774+0000 7f47e5e00640 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56291a057fc0 0x56291a1cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47e5e00640 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56291a057fc0 0x56291a1cc010 crc :-1 s=READY pgs=1449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3eecbc1954ea65f server_cookie=fb0cd59ca308ea09 in_seq=0 out_seq=0 2024-08-31T04:36:54.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47c7400640 10 client.6246 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:54.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47c7400640 1 -- 172.21.15.89:0/2305590945 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562919fd45e0 con 0x56291a057fc0 2024-08-31T04:36:54.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47c7400640 10 client.6246 handle_command_reply: tid=0 2024-08-31T04:36:54.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 client.6246 shutdown 2024-08-31T04:36:54.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2305590945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 msgr2=0x56291a1b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a1b0c10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009a60 tx=0x7f47d80091e0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2305590945 shutdown_connections 2024-08-31T04:36:54.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56291a057fc0 0x56291a1cc010 crc :-1 s=READY pgs=1449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a093950 0x56291a1b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a07d930 0x56291a1b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47c7400640 0 client.6246 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:54.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2305590945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a1b0c10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2305590945 >> 172.21.15.89:0/2305590945 conn(0x56291a093540 msgr2=0x56291a1b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:54.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2305590945 shutdown_connections 2024-08-31T04:36:54.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2305590945 wait complete. 2024-08-31T04:36:54.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.778+0000 7f47f4b2f000 20 client.6246 trim_cache size 0 max 16384 2024-08-31T04:36:54.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 Processor -- start 2024-08-31T04:36:54.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 -- start start 2024-08-31T04:36:54.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 0x56291a22ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 0x56291a22d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56291a173e20 con 0x56291a06e890 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f47e8204a80 con 0x56291a07d930 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f47e8203960 con 0x56291a093950 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44650/0 (socket says 172.21.15.89:44650) 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e6800640 1 -- 172.21.15.89:0/2723442259 learned_addr learned my addr 172.21.15.89:0/2723442259 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e7200640 1 --2- 172.21.15.89:0/2723442259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 0x56291a22d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e5e00640 1 --2- 172.21.15.89:0/2723442259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 0x56291a22ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e6800640 1 -- 172.21.15.89:0/2723442259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 msgr2=0x56291a22d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e6800640 1 --2- 172.21.15.89:0/2723442259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 0x56291a22d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e6800640 1 -- 172.21.15.89:0/2723442259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 msgr2=0x56291a22ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e6800640 1 --2- 172.21.15.89:0/2723442259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 0x56291a22ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e6800640 1 -- 172.21.15.89:0/2723442259 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56291a0462f0 con 0x56291a06e890 2024-08-31T04:36:54.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47e6800640 1 --2- 172.21.15.89:0/2723442259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22c900 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009a10 tx=0x7f47d80057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237e77e179e7b364 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:54.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47d2600640 1 -- 172.21.15.89:0/2723442259 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d80d18c0 con 0x56291a06e890 2024-08-31T04:36:54.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47d2600640 1 -- 172.21.15.89:0/2723442259 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47d80e1070 con 0x56291a06e890 2024-08-31T04:36:54.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47d2600640 1 -- 172.21.15.89:0/2723442259 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8004aa0 con 0x56291a06e890 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2723442259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 msgr2=0x56291a22c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2723442259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22c900 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009a10 tx=0x7f47d80057a0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2723442259 shutdown_connections 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2723442259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 0x56291a22d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2723442259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 0x56291a22ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/2723442259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22c900 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2723442259 >> 172.21.15.89:0/2723442259 conn(0x56291a093540 msgr2=0x56291a175280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2723442259 shutdown_connections 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.798+0000 7f47f4b2f000 1 -- 172.21.15.89:0/2723442259 wait complete. 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 -- start start 2024-08-31T04:36:54.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 Processor -- start 2024-08-31T04:36:54.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 0x56291a22de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 0x56291a22e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47e8203290 con 0x56291a06e890 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f47e8201ee0 con 0x56291a07d930 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f47e8202530 con 0x56291a093950 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 10 client.0 _ll_register_callbacks cb 0x7f47cc00b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e6800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44666/0 (socket says 172.21.15.89:44666) 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e6800640 1 -- 172.21.15.89:0/552299075 learned_addr learned my addr 172.21.15.89:0/552299075 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e7200640 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 0x56291a22e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e5e00640 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 0x56291a22de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e6800640 1 -- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 msgr2=0x56291a22e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e6800640 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 0x56291a22e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e6800640 1 -- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 msgr2=0x56291a22de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e6800640 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 0x56291a22de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e6800640 1 -- 172.21.15.89:0/552299075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562919f4bb30 con 0x56291a06e890 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47e6800640 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22d910 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f47d801d750 tx=0x7f47d8004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1666e4cea0d427d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47c7400640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47c7400640 1 -- 172.21.15.89:0/552299075 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d80ea060 con 0x56291a06e890 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47c7400640 1 -- 172.21.15.89:0/552299075 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f47d80cbac0 con 0x56291a06e890 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 -- 172.21.15.89:0/552299075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47d80e1070 con 0x56291a06e890 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47c7400640 1 -- 172.21.15.89:0/552299075 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f47d80cbcc0 con 0x56291a06e890 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 10 client.6252 fetch_fsmap learned FSMap version 9 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47f4b2f000 1 -- 172.21.15.89:0/552299075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562919f58c70 con 0x56291a06e890 2024-08-31T04:36:54.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47c7400640 1 -- 172.21.15.89:0/552299075 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47d80e1070 con 0x56291a06e890 2024-08-31T04:36:54.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.802+0000 7f47c7400640 1 -- 172.21.15.89:0/552299075 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f47d80d9040 con 0x56291a06e890 2024-08-31T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.806+0000 7f47f4b2f000 10 client.6252 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.806+0000 7f47f4b2f000 10 client.6252 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.806+0000 7f47f4b2f000 20 client.6252 populate_metadata read hostname 'smithi089' 2024-08-31T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.806+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562919c53e80 0x56291a1ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.806+0000 7f47f4b2f000 4 client.6252 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b210bf7a", "release": true, "await": true}] 2024-08-31T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.806+0000 7f47f4b2f000 1 -- 172.21.15.89:0/552299075 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b210bf7a", "release": true, "await": true}) -- 0x562919fd0080 con 0x562919c53e80 2024-08-31T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.806+0000 7f47e5e00640 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562919c53e80 0x56291a1ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.806+0000 7f47e5e00640 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562919c53e80 0x56291a1ce6f0 crc :-1 s=READY pgs=1450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dcf9bb55ab249ca server_cookie=9245a4516b3995a4 in_seq=0 out_seq=0 2024-08-31T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.806+0000 7f47c7400640 10 client.6252 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:54.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47c7400640 1 -- 172.21.15.89:0/552299075 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562919fd0080 con 0x562919c53e80 2024-08-31T04:36:54.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47c7400640 10 client.6252 handle_command_reply: tid=0 2024-08-31T04:36:54.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 client.6252 shutdown 2024-08-31T04:36:54.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 -- 172.21.15.89:0/552299075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 msgr2=0x56291a22d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22d910 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f47d801d750 tx=0x7f47d8004f30 comp rx=0 tx=0).stop 2024-08-31T04:36:54.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 -- 172.21.15.89:0/552299075 shutdown_connections 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x562919c53e80 0x56291a1ce6f0 crc :-1 s=READY pgs=1450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56291a093950 0x56291a22e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56291a07d930 0x56291a22de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47c7400640 0 client.6252 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 --2- 172.21.15.89:0/552299075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56291a06e890 0x56291a22d910 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 -- 172.21.15.89:0/552299075 >> 172.21.15.89:0/552299075 conn(0x56291a093540 msgr2=0x56291a172040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 -- 172.21.15.89:0/552299075 shutdown_connections 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 1 -- 172.21.15.89:0/552299075 wait complete. 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.934+0000 7f47f4b2f000 20 client.6252 trim_cache size 0 max 16384 2024-08-31T04:36:54.939 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 116, 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "b210bf7a": { 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 116, 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:36:54.940 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 147.9, 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:36:54.941 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:36:54.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 -- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f47c80720c0 msgr2=0x7f47c80745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f47c80720c0 0x7f47c80745d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009b40 tx=0x7f47d801a010 comp rx=0 tx=0).stop 2024-08-31T04:36:54.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 -- 172.21.15.89:0/1047418974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e80c3590 msgr2=0x7f47e814ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:54.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e80c3590 0x7f47e814ff30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f47d4011a80 tx=0x7f47d4011f40 comp rx=0 tx=0).stop 2024-08-31T04:36:54.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 -- 172.21.15.89:0/1047418974 shutdown_connections 2024-08-31T04:36:54.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f47c80720c0 0x7f47c80745d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47e80c3590 0x7f47e814ff30 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47e8147930 0x7f47e8147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 --2- 172.21.15.89:0/1047418974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47cc003a10 0x7f47e80c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:54.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 -- 172.21.15.89:0/1047418974 >> 172.21.15.89:0/1047418974 conn(0x7f47e80c99b0 msgr2=0x7f47e80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:54.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 -- 172.21.15.89:0/1047418974 shutdown_connections 2024-08-31T04:36:54.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:36:54.938+0000 7f47ed400640 1 -- 172.21.15.89:0/1047418974 wait complete. 2024-08-31T04:36:54.958 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b210bf7a', total seconds elapsed: 28.7 2024-08-31T04:36:56.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:36:56.314 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:36:59.003 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 8% (24/291) Updating files: 8% (25/291) Updating files: 9% (27/291) Updating files: 10% (30/291) Updating files: 11% (33/291) Updating files: 12% (35/291) Updating files: 13% (38/291) Updating files: 14% (41/291) Updating files: 15% (44/291) Updating files: 16% (47/291) Updating files: 17% (50/291) Updating files: 18% (53/291) Updating files: 19% (56/291) Updating files: 20% (59/291) Updating files: 21% (62/291) Updating files: 22% (65/291) Updating files: 23% (67/291) Updating files: 24% (70/291) Updating files: 25% (73/291) Updating files: 25% (74/291) Updating files: 26% (76/291) Updating files: 27% (79/291) Updating files: 28% (82/291) Updating files: 29% (85/291) Updating files: 30% (88/291) Updating files: 31% (91/291) Updating files: 32% (94/291) Updating files: 33% (97/291) Updating files: 34% (99/291) Updating files: 35% (102/291) Updating files: 36% (105/291) Updating files: 37% (108/291) Updating files: 38% (111/291) Updating files: 39% (114/291) Updating files: 40% (117/291) Updating files: 41% (120/291) Updating files: 42% (123/291) Updating files: 43% (126/291) Updating files: 44% (129/291) Updating files: 45% (131/291) Updating files: 46% (134/291) Updating files: 47% (137/291) Updating files: 48% (140/291) Updating files: 49% (143/291) Updating files: 50% (146/291) Updating files: 51% (149/291) Updating files: 52% (152/291) Updating files: 52% (153/291) Updating files: 53% (155/291) Updating files: 54% (158/291) Updating files: 55% (161/291) Updating files: 56% (163/291) Updating files: 57% (166/291) Updating files: 58% (169/291) Updating files: 59% (172/291) Updating files: 60% (175/291) Updating files: 61% (178/291) Updating files: 62% (181/291) Updating files: 63% (184/291) Updating files: 64% (187/291) Updating files: 65% (190/291) Updating files: 66% (193/291) Updating files: 67% (195/291) Updating files: 68% (198/291) Updating files: 69% (201/291) Updating files: 70% (204/291) Updating files: 71% (207/291) Updating files: 72% (210/291) Updating files: 73% (213/291) Updating files: 74% (216/291) Updating files: 75% (219/291) Updating files: 76% (222/291) Updating files: 77% (225/291) Updating files: 78% (227/291) Updating files: 79% (230/291) Updating files: 80% (233/291) Updating files: 81% (236/291) Updating files: 82% (239/291) Updating files: 83% (242/291) Updating files: 84% (245/291) Updating files: 85% (248/291) Updating files: 86% (251/291) Updating files: 87% (254/291) Updating files: 88% (257/291) Updating files: 89% (259/291) Updating files: 90% (262/291) Updating files: 91% (265/291) Updating files: 92% (268/291) Updating files: 93% (271/291) Updating files: 94% (274/291) Updating files: 95% (277/291) Updating files: 96% (280/291) Updating files: 97% (283/291) Updating files: 98% (286/291) Updating files: 99% (289/291) Updating files: 100% (291/291) Updating files: 100% (291/291), done. 2024-08-31T04:36:59.619 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 946d6036958 v0.75 2024-08-31T04:36:59.712 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.75 2024-08-31T04:36:59.733 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 76 -eq 48 ] 2024-08-31T04:36:59.734 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.76 2024-08-31T04:36:59.734 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.76 2024-08-31T04:36:59.734 INFO:tasks.workunit.client.0.smithi089.stdout:v0.76 2024-08-31T04:36:59.734 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.76 2024-08-31T04:37:14.768 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 31% (53/168) Updating files: 32% (54/168) Updating files: 33% (56/168) Updating files: 34% (58/168) Updating files: 35% (59/168) Updating files: 36% (61/168) Updating files: 37% (63/168) Updating files: 38% (64/168) Updating files: 39% (66/168) Updating files: 40% (68/168) Updating files: 41% (69/168) Updating files: 42% (71/168) Updating files: 43% (73/168) Updating files: 44% (74/168) Updating files: 45% (76/168) Updating files: 46% (78/168) Updating files: 47% (79/168) Updating files: 48% (81/168) Updating files: 49% (83/168) Updating files: 50% (84/168) Updating files: 51% (86/168) Updating files: 52% (88/168) Updating files: 53% (90/168) Updating files: 54% (91/168) Updating files: 55% (93/168) Updating files: 56% (95/168) Updating files: 57% (96/168) Updating files: 58% (98/168) Updating files: 59% (100/168) Updating files: 60% (101/168) Updating files: 61% (103/168) Updating files: 62% (105/168) Updating files: 63% (106/168) Updating files: 64% (108/168) Updating files: 65% (110/168) Updating files: 66% (111/168) Updating files: 67% (113/168) Updating files: 68% (115/168) Updating files: 69% (116/168) Updating files: 70% (118/168) Updating files: 71% (120/168) Updating files: 72% (121/168) Updating files: 73% (123/168) Updating files: 74% (125/168) Updating files: 75% (126/168) Updating files: 76% (128/168) Updating files: 77% (130/168) Updating files: 78% (132/168) Updating files: 79% (133/168) Updating files: 80% (135/168) Updating files: 81% (137/168) Updating files: 82% (138/168) Updating files: 83% (140/168) Updating files: 84% (142/168) Updating files: 85% (143/168) Updating files: 86% (145/168) Updating files: 87% (147/168) Updating files: 88% (148/168) Updating files: 89% (150/168) Updating files: 90% (152/168) Updating files: 91% (153/168) Updating files: 92% (155/168) Updating files: 93% (157/168) Updating files: 94% (158/168) Updating files: 95% (160/168) Updating files: 96% (162/168) Updating files: 97% (163/168) Updating files: 98% (165/168) Updating files: 99% (167/168) Updating files: 100% (168/168) Updating files: 100% (168/168), done. 2024-08-31T04:37:14.883 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 3b990136bfa v0.76 2024-08-31T04:37:14.889 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.76 2024-08-31T04:37:15.026 INFO:tasks.workunit.client.0.smithi089.stdout:v0.77 2024-08-31T04:37:15.027 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 77 -eq 48 ] 2024-08-31T04:37:15.027 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.77 2024-08-31T04:37:15.027 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.77 2024-08-31T04:37:15.027 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.77 2024-08-31T04:37:21.221 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 17% (52/298) Updating files: 18% (54/298) Updating files: 19% (57/298) Updating files: 20% (60/298) Updating files: 21% (63/298) Updating files: 22% (66/298) Updating files: 23% (69/298) Updating files: 24% (72/298) Updating files: 25% (75/298) Updating files: 26% (78/298) Updating files: 27% (81/298) Updating files: 28% (84/298) Updating files: 29% (87/298) Updating files: 30% (90/298) Updating files: 31% (93/298) Updating files: 32% (96/298) Updating files: 33% (99/298) Updating files: 34% (102/298) Updating files: 35% (105/298) Updating files: 36% (108/298) Updating files: 36% (109/298) Updating files: 37% (111/298) Updating files: 38% (114/298) Updating files: 39% (117/298) Updating files: 40% (120/298) Updating files: 41% (123/298) Updating files: 42% (126/298) Updating files: 43% (129/298) Updating files: 44% (132/298) Updating files: 45% (135/298) Updating files: 46% (138/298) Updating files: 47% (141/298) Updating files: 48% (144/298) Updating files: 49% (147/298) Updating files: 50% (149/298) Updating files: 51% (152/298) Updating files: 52% (155/298) Updating files: 53% (158/298) Updating files: 54% (161/298) Updating files: 55% (164/298) Updating files: 56% (167/298) Updating files: 57% (170/298) Updating files: 58% (173/298) Updating files: 59% (176/298) Updating files: 60% (179/298) Updating files: 61% (182/298) Updating files: 62% (185/298) Updating files: 63% (188/298) Updating files: 63% (189/298) Updating files: 64% (191/298) Updating files: 65% (194/298) Updating files: 66% (197/298) Updating files: 66% (199/298) Updating files: 67% (200/298) Updating files: 68% (203/298) Updating files: 69% (206/298) Updating files: 70% (209/298) Updating files: 71% (212/298) Updating files: 72% (215/298) Updating files: 73% (218/298) Updating files: 74% (221/298) Updating files: 75% (224/298) Updating files: 76% (227/298) Updating files: 77% (230/298) Updating files: 78% (233/298) Updating files: 79% (236/298) Updating files: 80% (239/298) Updating files: 81% (242/298) Updating files: 82% (245/298) Updating files: 83% (248/298) Updating files: 84% (251/298) Updating files: 85% (254/298) Updating files: 86% (257/298) Updating files: 87% (260/298) Updating files: 88% (263/298) Updating files: 89% (266/298) Updating files: 90% (269/298) Updating files: 91% (272/298) Updating files: 92% (275/298) Updating files: 93% (278/298) Updating files: 94% (281/298) Updating files: 95% (284/298) Updating files: 96% (287/298) Updating files: 97% (290/298) Updating files: 98% (293/298) Updating files: 99% (296/298) Updating files: 100% (298/298) Updating files: 100% (298/298), done. 2024-08-31T04:37:21.413 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 1bca9c5c412 v0.77 2024-08-31T04:37:21.422 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.77 2024-08-31T04:37:22.943 INFO:tasks.workunit.client.0.smithi089.stdout:v0.78 2024-08-31T04:37:22.943 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 78 -eq 48 ] 2024-08-31T04:37:22.943 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.78 2024-08-31T04:37:22.943 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.78 2024-08-31T04:37:22.943 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.78 2024-08-31T04:37:26.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:37:26.421 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:37:33.510 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 10% (52/496) Updating files: 11% (55/496) Updating files: 12% (60/496) Updating files: 13% (65/496) Updating files: 14% (70/496) Updating files: 15% (75/496) Updating files: 16% (80/496) Updating files: 17% (85/496) Updating files: 18% (90/496) Updating files: 19% (95/496) Updating files: 20% (100/496) Updating files: 21% (105/496) Updating files: 22% (110/496) Updating files: 23% (115/496) Updating files: 24% (120/496) Updating files: 25% (124/496) Updating files: 26% (129/496) Updating files: 27% (134/496) Updating files: 28% (139/496) Updating files: 29% (144/496) Updating files: 30% (149/496) Updating files: 31% (154/496) Updating files: 32% (159/496) Updating files: 32% (160/496) Updating files: 33% (164/496) Updating files: 34% (169/496) Updating files: 35% (174/496) Updating files: 36% (179/496) Updating files: 37% (184/496) Updating files: 38% (189/496) Updating files: 38% (193/496) Updating files: 39% (194/496) Updating files: 40% (199/496) Updating files: 41% (204/496) Updating files: 42% (209/496) Updating files: 43% (214/496) Updating files: 44% (219/496) Updating files: 45% (224/496) Updating files: 46% (229/496) Updating files: 47% (234/496) Updating files: 48% (239/496) Updating files: 48% (241/496) Updating files: 49% (244/496) Updating files: 50% (248/496) Updating files: 51% (253/496) Updating files: 52% (258/496) Updating files: 53% (263/496) Updating files: 54% (268/496) Updating files: 55% (273/496) Updating files: 56% (278/496) Updating files: 57% (283/496) Updating files: 58% (288/496) Updating files: 59% (293/496) Updating files: 60% (298/496) Updating files: 61% (303/496) Updating files: 62% (308/496) Updating files: 63% (313/496) Updating files: 63% (316/496) Updating files: 64% (318/496) Updating files: 65% (323/496) Updating files: 66% (328/496) Updating files: 67% (333/496) Updating files: 68% (338/496) Updating files: 69% (343/496) Updating files: 70% (348/496) Updating files: 71% (353/496) Updating files: 72% (358/496) Updating files: 73% (363/496) Updating files: 74% (368/496) Updating files: 75% (372/496) Updating files: 76% (377/496) Updating files: 77% (382/496) Updating files: 78% (387/496) Updating files: 79% (392/496) Updating files: 80% (397/496) Updating files: 81% (402/496) Updating files: 82% (407/496) Updating files: 82% (408/496) Updating files: 83% (412/496) Updating files: 84% (417/496) Updating files: 85% (422/496) Updating files: 86% (427/496) Updating files: 87% (432/496) Updating files: 88% (437/496) Updating files: 89% (442/496) Updating files: 90% (447/496) Updating files: 91% (452/496) Updating files: 92% (457/496) Updating files: 93% (462/496) Updating files: 94% (467/496) Updating files: 95% (472/496) Updating files: 96% (477/496) Updating files: 97% (482/496) Updating files: 98% (487/496) Updating files: 99% (492/496) Updating files: 100% (496/496) Updating files: 100% (496/496), done. 2024-08-31T04:37:33.569 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at f6c746c314d 0.78 2024-08-31T04:37:33.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.78 2024-08-31T04:37:34.611 INFO:tasks.workunit.client.0.smithi089.stdout:v0.79 2024-08-31T04:37:34.611 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 79 -eq 48 ] 2024-08-31T04:37:34.612 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.79 2024-08-31T04:37:34.612 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.79 2024-08-31T04:37:34.612 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.79 2024-08-31T04:37:41.738 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 7% (25/329) Updating files: 8% (27/329) Updating files: 9% (30/329) Updating files: 10% (33/329) Updating files: 11% (37/329) Updating files: 12% (40/329) Updating files: 13% (43/329) Updating files: 14% (47/329) Updating files: 15% (50/329) Updating files: 16% (53/329) Updating files: 17% (56/329) Updating files: 18% (60/329) Updating files: 19% (63/329) Updating files: 19% (64/329) Updating files: 20% (66/329) Updating files: 21% (70/329) Updating files: 22% (73/329) Updating files: 23% (76/329) Updating files: 24% (79/329) Updating files: 25% (83/329) Updating files: 26% (86/329) Updating files: 26% (87/329) Updating files: 27% (89/329) Updating files: 28% (93/329) Updating files: 29% (96/329) Updating files: 30% (99/329) Updating files: 31% (102/329) Updating files: 32% (106/329) Updating files: 33% (109/329) Updating files: 34% (112/329) Updating files: 35% (116/329) Updating files: 36% (119/329) Updating files: 37% (122/329) Updating files: 38% (126/329) Updating files: 39% (129/329) Updating files: 40% (132/329) Updating files: 41% (135/329) Updating files: 42% (139/329) Updating files: 43% (142/329) Updating files: 44% (145/329) Updating files: 45% (149/329) Updating files: 46% (152/329) Updating files: 47% (155/329) Updating files: 48% (158/329) Updating files: 48% (159/329) Updating files: 49% (162/329) Updating files: 50% (165/329) Updating files: 51% (168/329) Updating files: 52% (172/329) Updating files: 53% (175/329) Updating files: 54% (178/329) Updating files: 55% (181/329) Updating files: 56% (185/329) Updating files: 57% (188/329) Updating files: 58% (191/329) Updating files: 59% (195/329) Updating files: 60% (198/329) Updating files: 61% (201/329) Updating files: 62% (204/329) Updating files: 63% (208/329) Updating files: 64% (211/329) Updating files: 65% (214/329) Updating files: 65% (216/329) Updating files: 66% (218/329) Updating files: 67% (221/329) Updating files: 68% (224/329) Updating files: 69% (228/329) Updating files: 69% (229/329) Updating files: 70% (231/329) Updating files: 71% (234/329) Updating files: 72% (237/329) Updating files: 73% (241/329) Updating files: 74% (244/329) Updating files: 75% (247/329) Updating files: 76% (251/329) Updating files: 77% (254/329) Updating files: 78% (257/329) Updating files: 79% (260/329) Updating files: 80% (264/329) Updating files: 81% (267/329) Updating files: 82% (270/329) Updating files: 83% (274/329) Updating files: 84% (277/329) Updating files: 85% (280/329) Updating files: 86% (283/329) Updating files: 87% (287/329) Updating files: 88% (290/329) Updating files: 89% (293/329) Updating files: 90% (297/329) Updating files: 91% (300/329) Updating files: 92% (303/329) Updating files: 93% (306/329) Updating files: 94% (310/329) Updating files: 95% (313/329) Updating files: 96% (316/329) Updating files: 96% (319/329) Updating files: 97% (320/329) Updating files: 98% (323/329) Updating files: 99% (326/329) Updating files: 100% (329/329) Updating files: 100% (329/329), done. 2024-08-31T04:37:41.813 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 4c2d73a5095 0.79 2024-08-31T04:37:41.820 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.79 2024-08-31T04:37:42.157 INFO:tasks.workunit.client.0.smithi089.stdout:v0.80 2024-08-31T04:37:42.157 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 80 -eq 48 ] 2024-08-31T04:37:42.158 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.80 2024-08-31T04:37:42.158 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.80 2024-08-31T04:37:42.158 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.80 2024-08-31T04:37:54.909 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 48% (86/176) Updating files: 49% (87/176) Updating files: 50% (88/176) Updating files: 51% (90/176) Updating files: 52% (92/176) Updating files: 53% (94/176) Updating files: 54% (96/176) Updating files: 55% (97/176) Updating files: 56% (99/176) Updating files: 57% (101/176) Updating files: 58% (103/176) Updating files: 59% (104/176) Updating files: 60% (106/176) Updating files: 61% (108/176) Updating files: 62% (110/176) Updating files: 63% (111/176) Updating files: 64% (113/176) Updating files: 65% (115/176) Updating files: 66% (117/176) Updating files: 67% (118/176) Updating files: 68% (120/176) Updating files: 69% (122/176) Updating files: 70% (124/176) Updating files: 71% (125/176) Updating files: 72% (127/176) Updating files: 73% (129/176) Updating files: 74% (131/176) Updating files: 75% (132/176) Updating files: 76% (134/176) Updating files: 77% (136/176) Updating files: 78% (138/176) Updating files: 79% (140/176) Updating files: 80% (141/176) Updating files: 81% (143/176) Updating files: 82% (145/176) Updating files: 83% (147/176) Updating files: 84% (148/176) Updating files: 85% (150/176) Updating files: 86% (152/176) Updating files: 87% (154/176) Updating files: 88% (155/176) Updating files: 89% (157/176) Updating files: 90% (159/176) Updating files: 91% (161/176) Updating files: 92% (162/176) Updating files: 93% (164/176) Updating files: 94% (166/176) Updating files: 95% (168/176) Updating files: 96% (169/176) Updating files: 97% (171/176) Updating files: 98% (173/176) Updating files: 99% (175/176) Updating files: 100% (176/176) Updating files: 100% (176/176), done. 2024-08-31T04:37:55.122 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at b78644e7dee 0.80 2024-08-31T04:37:55.136 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.80 2024-08-31T04:37:55.219 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 81 -eq 48 ] 2024-08-31T04:37:55.220 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.81 2024-08-31T04:37:55.220 INFO:tasks.workunit.client.0.smithi089.stdout:v0.81 2024-08-31T04:37:55.220 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.81 2024-08-31T04:37:55.220 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.81 2024-08-31T04:37:56.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:37:56.489 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:38:01.669 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 3% (12/309) Updating files: 4% (13/309) Updating files: 5% (16/309) Updating files: 6% (19/309) Updating files: 7% (22/309) Updating files: 8% (25/309) Updating files: 9% (28/309) Updating files: 10% (31/309) Updating files: 11% (34/309) Updating files: 12% (38/309) Updating files: 13% (41/309) Updating files: 14% (44/309) Updating files: 15% (47/309) Updating files: 16% (50/309) Updating files: 17% (53/309) Updating files: 18% (56/309) Updating files: 19% (59/309) Updating files: 20% (62/309) Updating files: 21% (65/309) Updating files: 22% (68/309) Updating files: 23% (72/309) Updating files: 24% (75/309) Updating files: 25% (78/309) Updating files: 26% (81/309) Updating files: 27% (84/309) Updating files: 28% (87/309) Updating files: 29% (90/309) Updating files: 30% (93/309) Updating files: 31% (96/309) Updating files: 32% (99/309) Updating files: 33% (102/309) Updating files: 34% (106/309) Updating files: 35% (109/309) Updating files: 36% (112/309) Updating files: 37% (115/309) Updating files: 38% (118/309) Updating files: 38% (119/309) Updating files: 39% (121/309) Updating files: 40% (124/309) Updating files: 41% (127/309) Updating files: 42% (130/309) Updating files: 43% (133/309) Updating files: 44% (136/309) Updating files: 45% (140/309) Updating files: 46% (143/309) Updating files: 47% (146/309) Updating files: 48% (149/309) Updating files: 49% (152/309) Updating files: 50% (155/309) Updating files: 51% (158/309) Updating files: 52% (161/309) Updating files: 53% (164/309) Updating files: 54% (167/309) Updating files: 55% (170/309) Updating files: 56% (174/309) Updating files: 57% (177/309) Updating files: 58% (180/309) Updating files: 59% (183/309) Updating files: 60% (186/309) Updating files: 61% (189/309) Updating files: 62% (192/309) Updating files: 63% (195/309) Updating files: 64% (198/309) Updating files: 65% (201/309) Updating files: 66% (204/309) Updating files: 67% (208/309) Updating files: 68% (211/309) Updating files: 69% (214/309) Updating files: 70% (217/309) Updating files: 71% (220/309) Updating files: 72% (223/309) Updating files: 73% (226/309) Updating files: 74% (229/309) Updating files: 75% (232/309) Updating files: 76% (235/309) Updating files: 77% (238/309) Updating files: 78% (242/309) Updating files: 79% (245/309) Updating files: 80% (248/309) Updating files: 81% (251/309) Updating files: 82% (254/309) Updating files: 83% (257/309) Updating files: 84% (260/309) Updating files: 85% (263/309) Updating files: 86% (266/309) Updating files: 87% (269/309) Updating files: 88% (272/309) Updating files: 89% (276/309) Updating files: 90% (279/309) Updating files: 91% (282/309) Updating files: 92% (285/309) Updating files: 93% (288/309) Updating files: 94% (291/309) Updating files: 95% (294/309) Updating files: 95% (296/309) Updating files: 96% (297/309) Updating files: 97% (300/309) Updating files: 98% (303/309) Updating files: 99% (306/309) Updating files: 100% (309/309) Updating files: 100% (309/309), done. 2024-08-31T04:38:01.881 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 8de9501df27 0.81 2024-08-31T04:38:01.896 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.81 2024-08-31T04:38:02.071 INFO:tasks.workunit.client.0.smithi089.stdout:v0.82 2024-08-31T04:38:02.071 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 82 -eq 48 ] 2024-08-31T04:38:02.072 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.82 2024-08-31T04:38:02.072 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.82 2024-08-31T04:38:02.072 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.82 2024-08-31T04:38:18.534 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 5% (11/204) Updating files: 6% (13/204) Updating files: 7% (15/204) Updating files: 8% (17/204) Updating files: 9% (19/204) Updating files: 10% (21/204) Updating files: 11% (23/204) Updating files: 12% (25/204) Updating files: 13% (27/204) Updating files: 14% (29/204) Updating files: 15% (31/204) Updating files: 16% (33/204) Updating files: 17% (35/204) Updating files: 18% (37/204) Updating files: 19% (39/204) Updating files: 20% (41/204) Updating files: 21% (43/204) Updating files: 22% (45/204) Updating files: 23% (47/204) Updating files: 24% (49/204) Updating files: 25% (51/204) Updating files: 26% (54/204) Updating files: 27% (56/204) Updating files: 28% (58/204) Updating files: 28% (59/204) Updating files: 29% (60/204) Updating files: 30% (62/204) Updating files: 31% (64/204) Updating files: 32% (66/204) Updating files: 32% (67/204) Updating files: 33% (68/204) Updating files: 34% (70/204) Updating files: 35% (72/204) Updating files: 36% (74/204) Updating files: 37% (76/204) Updating files: 38% (78/204) Updating files: 39% (80/204) Updating files: 40% (82/204) Updating files: 41% (84/204) Updating files: 42% (86/204) Updating files: 43% (88/204) Updating files: 44% (90/204) Updating files: 45% (92/204) Updating files: 46% (94/204) Updating files: 47% (96/204) Updating files: 48% (98/204) Updating files: 49% (100/204) Updating files: 50% (102/204) Updating files: 51% (105/204) Updating files: 52% (107/204) Updating files: 53% (109/204) Updating files: 54% (111/204) Updating files: 55% (113/204) Updating files: 56% (115/204) Updating files: 56% (116/204) Updating files: 57% (117/204) Updating files: 58% (119/204) Updating files: 59% (121/204) Updating files: 60% (123/204) Updating files: 61% (125/204) Updating files: 62% (127/204) Updating files: 63% (129/204) Updating files: 64% (131/204) Updating files: 65% (133/204) Updating files: 66% (135/204) Updating files: 67% (137/204) Updating files: 68% (139/204) Updating files: 69% (141/204) Updating files: 70% (143/204) Updating files: 71% (145/204) Updating files: 72% (147/204) Updating files: 73% (149/204) Updating files: 74% (151/204) Updating files: 75% (153/204) Updating files: 76% (156/204) Updating files: 77% (158/204) Updating files: 78% (160/204) Updating files: 79% (162/204) Updating files: 80% (164/204) Updating files: 81% (166/204) Updating files: 82% (168/204) Updating files: 83% (170/204) Updating files: 84% (172/204) Updating files: 85% (174/204) Updating files: 86% (176/204) Updating files: 87% (178/204) Updating files: 88% (180/204) Updating files: 89% (182/204) Updating files: 89% (183/204) Updating files: 90% (184/204) Updating files: 91% (186/204) Updating files: 92% (188/204) Updating files: 93% (190/204) Updating files: 94% (192/204) Updating files: 95% (194/204) Updating files: 96% (196/204) Updating files: 97% (198/204) Updating files: 98% (200/204) Updating files: 99% (202/204) Updating files: 100% (204/204) Updating files: 100% (204/204), done. 2024-08-31T04:38:18.577 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 14085f42ddd 0.82 2024-08-31T04:38:18.584 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.82 2024-08-31T04:38:18.644 INFO:tasks.workunit.client.0.smithi089.stdout:v0.83 2024-08-31T04:38:18.644 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 83 -eq 48 ] 2024-08-31T04:38:18.644 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.83 2024-08-31T04:38:18.644 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.83 2024-08-31T04:38:18.644 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.83 2024-08-31T04:38:26.278 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 13% (30/218) Updating files: 14% (31/218) Updating files: 15% (33/218) Updating files: 16% (35/218) Updating files: 17% (38/218) Updating files: 18% (40/218) Updating files: 19% (42/218) Updating files: 20% (44/218) Updating files: 21% (46/218) Updating files: 22% (48/218) Updating files: 23% (51/218) Updating files: 24% (53/218) Updating files: 25% (55/218) Updating files: 26% (57/218) Updating files: 27% (59/218) Updating files: 28% (62/218) Updating files: 29% (64/218) Updating files: 30% (66/218) Updating files: 31% (68/218) Updating files: 32% (70/218) Updating files: 33% (72/218) Updating files: 34% (75/218) Updating files: 35% (77/218) Updating files: 36% (79/218) Updating files: 37% (81/218) Updating files: 38% (83/218) Updating files: 38% (84/218) Updating files: 39% (86/218) Updating files: 40% (88/218) Updating files: 41% (90/218) Updating files: 42% (92/218) Updating files: 43% (94/218) Updating files: 44% (96/218) Updating files: 45% (99/218) Updating files: 46% (101/218) Updating files: 47% (103/218) Updating files: 48% (105/218) Updating files: 49% (107/218) Updating files: 49% (108/218) Updating files: 50% (109/218) Updating files: 51% (112/218) Updating files: 52% (114/218) Updating files: 53% (116/218) Updating files: 54% (118/218) Updating files: 55% (120/218) Updating files: 56% (123/218) Updating files: 57% (125/218) Updating files: 58% (127/218) Updating files: 59% (129/218) Updating files: 60% (131/218) Updating files: 61% (133/218) Updating files: 62% (136/218) Updating files: 63% (138/218) Updating files: 64% (140/218) Updating files: 65% (142/218) Updating files: 66% (144/218) Updating files: 67% (147/218) Updating files: 68% (149/218) Updating files: 69% (151/218) Updating files: 70% (153/218) Updating files: 71% (155/218) Updating files: 72% (157/218) Updating files: 73% (160/218) Updating files: 74% (162/218) Updating files: 75% (164/218) Updating files: 76% (166/218) Updating files: 77% (168/218) Updating files: 78% (171/218) Updating files: 79% (173/218) Updating files: 80% (175/218) Updating files: 81% (177/218) Updating files: 82% (179/218) Updating files: 83% (181/218) Updating files: 84% (184/218) Updating files: 85% (186/218) Updating files: 86% (188/218) Updating files: 87% (190/218) Updating files: 88% (192/218) Updating files: 88% (193/218) Updating files: 89% (195/218) Updating files: 90% (197/218) Updating files: 91% (199/218) Updating files: 92% (201/218) Updating files: 93% (203/218) Updating files: 94% (205/218) Updating files: 95% (208/218) Updating files: 96% (210/218) Updating files: 97% (212/218) Updating files: 98% (214/218) Updating files: 99% (216/218) Updating files: 100% (218/218) Updating files: 100% (218/218), done. 2024-08-31T04:38:26.823 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 78ff1f0a5df 0.83 2024-08-31T04:38:26.829 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.83 2024-08-31T04:38:26.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:38:26.899 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:38:27.172 INFO:tasks.workunit.client.0.smithi089.stdout:v0.84 2024-08-31T04:38:27.172 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 84 -eq 48 ] 2024-08-31T04:38:27.173 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.84 2024-08-31T04:38:27.173 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.84 2024-08-31T04:38:27.173 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.84 2024-08-31T04:38:37.996 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 6% (22/356) Updating files: 7% (25/356) Updating files: 8% (29/356) Updating files: 8% (32/356) Updating files: 9% (33/356) Updating files: 10% (36/356) Updating files: 11% (40/356) Updating files: 12% (43/356) Updating files: 13% (47/356) Updating files: 14% (50/356) Updating files: 15% (54/356) Updating files: 16% (57/356) Updating files: 17% (61/356) Updating files: 18% (65/356) Updating files: 19% (68/356) Updating files: 20% (72/356) Updating files: 21% (75/356) Updating files: 22% (79/356) Updating files: 23% (82/356) Updating files: 24% (86/356) Updating files: 25% (89/356) Updating files: 26% (93/356) Updating files: 26% (94/356) Updating files: 27% (97/356) Updating files: 28% (100/356) Updating files: 28% (103/356) Updating files: 29% (104/356) Updating files: 30% (107/356) Updating files: 31% (111/356) Updating files: 32% (114/356) Updating files: 33% (118/356) Updating files: 34% (122/356) Updating files: 35% (125/356) Updating files: 36% (129/356) Updating files: 37% (132/356) Updating files: 38% (136/356) Updating files: 39% (139/356) Updating files: 40% (143/356) Updating files: 41% (146/356) Updating files: 42% (150/356) Updating files: 43% (154/356) Updating files: 44% (157/356) Updating files: 45% (161/356) Updating files: 45% (163/356) Updating files: 46% (164/356) Updating files: 47% (168/356) Updating files: 48% (171/356) Updating files: 49% (175/356) Updating files: 50% (178/356) Updating files: 51% (182/356) Updating files: 52% (186/356) Updating files: 53% (189/356) Updating files: 54% (193/356) Updating files: 55% (196/356) Updating files: 56% (200/356) Updating files: 57% (203/356) Updating files: 58% (207/356) Updating files: 59% (211/356) Updating files: 59% (213/356) Updating files: 60% (214/356) Updating files: 61% (218/356) Updating files: 62% (221/356) Updating files: 63% (225/356) Updating files: 64% (228/356) Updating files: 65% (232/356) Updating files: 66% (235/356) Updating files: 67% (239/356) Updating files: 68% (243/356) Updating files: 69% (246/356) Updating files: 70% (250/356) Updating files: 71% (253/356) Updating files: 72% (257/356) Updating files: 73% (260/356) Updating files: 74% (264/356) Updating files: 75% (267/356) Updating files: 76% (271/356) Updating files: 77% (275/356) Updating files: 78% (278/356) Updating files: 78% (279/356) Updating files: 79% (282/356) Updating files: 80% (285/356) Updating files: 80% (288/356) Updating files: 81% (289/356) Updating files: 82% (292/356) Updating files: 83% (296/356) Updating files: 84% (300/356) Updating files: 85% (303/356) Updating files: 86% (307/356) Updating files: 87% (310/356) Updating files: 88% (314/356) Updating files: 89% (317/356) Updating files: 90% (321/356) Updating files: 91% (324/356) Updating files: 92% (328/356) Updating files: 93% (332/356) Updating files: 94% (335/356) Updating files: 95% (339/356) Updating files: 96% (342/356) Updating files: 97% (346/356) Updating files: 98% (349/356) Updating files: 99% (353/356) Updating files: 100% (356/356) Updating files: 100% (356/356), done. 2024-08-31T04:38:38.467 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 8336f81c5c7 0.84 2024-08-31T04:38:38.476 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.84 2024-08-31T04:38:38.628 INFO:tasks.workunit.client.0.smithi089.stdout:v0.85 2024-08-31T04:38:38.629 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 85 -eq 48 ] 2024-08-31T04:38:38.629 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.85 2024-08-31T04:38:38.629 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.85 2024-08-31T04:38:38.629 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.85 2024-08-31T04:38:38.773 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10.7 2024-08-31T04:38:38.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 -- 172.21.15.89:0/1197925392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 msgr2=0x7fcf740c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 --2- 172.21.15.89:0/1197925392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 0x7fcf740c7d30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcf740c3a70 tx=0x7fcf6c01f580 comp rx=0 tx=0).stop 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 -- 172.21.15.89:0/1197925392 shutdown_connections 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 --2- 172.21.15.89:0/1197925392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 0x7fcf740c7d30 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 --2- 172.21.15.89:0/1197925392 >> v2:172.21.15.170:3300/0 conn(0x7fcf740c1f40 0x7fcf740c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 --2- 172.21.15.89:0/1197925392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf7415bc70 0x7fcf74152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 -- 172.21.15.89:0/1197925392 >> 172.21.15.89:0/1197925392 conn(0x7fcf740ccf20 msgr2=0x7fcf740cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 -- 172.21.15.89:0/1197925392 shutdown_connections 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 -- 172.21.15.89:0/1197925392 wait complete. 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 Processor -- start 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.927+0000 7fcf79600640 1 -- start start 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf79600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf740c1f40 0x7fcf7415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf79600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 0x7fcf74147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf79600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7415bc70 0x7fcf74143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf79600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcf740710c0 con 0x7fcf740c7920 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf79600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74070f40 con 0x7fcf7415bc70 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf79600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcf74071240 con 0x7fcf740c1f40 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 0x7fcf74147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 0x7fcf74147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46768/0 (socket says 172.21.15.89:46768) 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72000640 1 -- 172.21.15.89:0/497611182 learned_addr learned my addr 172.21.15.89:0/497611182 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72a00640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf740c1f40 0x7fcf7415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf73400640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7415bc70 0x7fcf74143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72000640 1 -- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf740c1f40 msgr2=0x7fcf7415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72000640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf740c1f40 0x7fcf7415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72000640 1 -- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7415bc70 msgr2=0x7fcf74143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72000640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7415bc70 0x7fcf74143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72000640 1 -- 172.21.15.89:0/497611182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf74148370 con 0x7fcf740c7920 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72a00640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf740c1f40 0x7fcf7415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf73400640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7415bc70 0x7fcf74143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf72000640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 0x7fcf74147e30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000d5f0 tx=0x7fcf6000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf6aa00640 1 -- 172.21.15.89:0/497611182 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60017070 con 0x7fcf740c7920 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf6aa00640 1 -- 172.21.15.89:0/497611182 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf60009a40 con 0x7fcf740c7920 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf741f6320 con 0x7fcf740c7920 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf6aa00640 1 -- 172.21.15.89:0/497611182 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60010460 con 0x7fcf740c7920 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf7415a740 con 0x7fcf740c7920 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.931+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf740c7d30 con 0x7fcf740c7920 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.935+0000 7fcf6aa00640 1 -- 172.21.15.89:0/497611182 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fcf6001a070 con 0x7fcf740c7920 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.935+0000 7fcf6aa00640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf540720c0 0x7fcf540745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.935+0000 7fcf6aa00640 1 -- 172.21.15.89:0/497611182 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fcf600930d0 con 0x7fcf740c7920 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.935+0000 7fcf72a00640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf540720c0 0x7fcf540745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.935+0000 7fcf72a00640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf540720c0 0x7fcf540745d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400bbd0 tx=0x7fcf6400b5b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:38.939+0000 7fcf6aa00640 1 -- 172.21.15.89:0/497611182 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcf6005e520 con 0x7fcf740c7920 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf740c82f0 con 0x7fcf740c7920 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf6aa00640 1 -- 172.21.15.89:0/497611182 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fcf6005de20 con 0x7fcf740c7920 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf540720c0 msgr2=0x7fcf540745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf540720c0 0x7fcf540745d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400bbd0 tx=0x7fcf6400b5b0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 msgr2=0x7fcf74147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 0x7fcf74147e30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000d5f0 tx=0x7fcf6000dab0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 shutdown_connections 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf540720c0 0x7fcf540745d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf740c7920 0x7fcf74147e30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7415bc70 0x7fcf74143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 --2- 172.21.15.89:0/497611182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf740c1f40 0x7fcf7415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 >> 172.21.15.89:0/497611182 conn(0x7fcf740ccf20 msgr2=0x7fcf7415c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 shutdown_connections 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.155+0000 7fcf79600640 1 -- 172.21.15.89:0/497611182 wait complete. 2024-08-31T04:38:39.178 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 130.7 --await-for 45.0' 2024-08-31T04:38:39.178 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 130.7 --await-for 45.0 2024-08-31T04:38:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.347+0000 7f2e92a00640 1 -- 172.21.15.89:0/1767316815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0c90e0 msgr2=0x7f2e8c0747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.347+0000 7f2e92a00640 1 --2- 172.21.15.89:0/1767316815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0c90e0 0x7f2e8c0747b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0725d0 tx=0x7f2e8401c830 comp rx=0 tx=0).stop 2024-08-31T04:38:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.347+0000 7f2e92a00640 1 -- 172.21.15.89:0/1767316815 shutdown_connections 2024-08-31T04:38:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.347+0000 7f2e92a00640 1 --2- 172.21.15.89:0/1767316815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0c90e0 0x7f2e8c0747b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.347+0000 7f2e92a00640 1 --2- 172.21.15.89:0/1767316815 >> v2:172.21.15.170:3300/0 conn(0x7f2e8c0b2d20 0x7f2e8c0c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.347+0000 7f2e92a00640 1 -- 172.21.15.89:0/1767316815 >> 172.21.15.89:0/1767316815 conn(0x7f2e8c0c99b0 msgr2=0x7f2e8c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.347+0000 7f2e92a00640 1 -- 172.21.15.89:0/1767316815 shutdown_connections 2024-08-31T04:38:39.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.347+0000 7f2e92a00640 1 -- 172.21.15.89:0/1767316815 wait complete. 2024-08-31T04:38:39.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 Processor -- start 2024-08-31T04:38:39.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 -- start start 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0b2860 0x7f2e8c147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0b2d20 0x7f2e8c1f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0c90e0 0x7f2e8c0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c165770 con 0x7f2e8c0b2d20 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c1658f0 con 0x7f2e8c0c90e0 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c165a70 con 0x7f2e8c0b2860 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e83400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0b2d20 0x7f2e8c1f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e83400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0b2d20 0x7f2e8c1f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46792/0 (socket says 172.21.15.89:46792) 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e83400640 1 -- 172.21.15.89:0/1900830129 learned_addr learned my addr 172.21.15.89:0/1900830129 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e8be00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0b2860 0x7f2e8c147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e90a00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0c90e0 0x7f2e8c0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e83400640 1 -- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0b2860 msgr2=0x7f2e8c147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e83400640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0b2860 0x7f2e8c147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e83400640 1 -- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0c90e0 msgr2=0x7f2e8c0c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e83400640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0c90e0 0x7f2e8c0c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e83400640 1 -- 172.21.15.89:0/1900830129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c151fb0 con 0x7f2e8c0b2d20 2024-08-31T04:38:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e83400640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0b2d20 0x7f2e8c1f52a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400d750 tx=0x7f2e7400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e88c00640 1 -- 172.21.15.89:0/1900830129 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74017070 con 0x7f2e8c0b2d20 2024-08-31T04:38:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e88c00640 1 -- 172.21.15.89:0/1900830129 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e74004310 con 0x7f2e8c0b2d20 2024-08-31T04:38:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 -- 172.21.15.89:0/1900830129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c1480c0 con 0x7f2e8c0b2d20 2024-08-31T04:38:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e88c00640 1 -- 172.21.15.89:0/1900830129 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400de60 con 0x7f2e8c0b2d20 2024-08-31T04:38:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.351+0000 7f2e92a00640 1 -- 172.21.15.89:0/1900830129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c1f57e0 con 0x7f2e8c0b2d20 2024-08-31T04:38:39.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.355+0000 7f2e88c00640 1 -- 172.21.15.89:0/1900830129 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2e74009c30 con 0x7f2e8c0b2d20 2024-08-31T04:38:39.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.355+0000 7f2e88c00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2e680720c0 0x7f2e680745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 Processor -- start 2024-08-31T04:38:39.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.355+0000 7f2e88c00640 1 -- 172.21.15.89:0/1900830129 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2e74092f90 con 0x7f2e8c0b2d20 2024-08-31T04:38:39.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 -- start start 2024-08-31T04:38:39.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e8be00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2e680720c0 0x7f2e680745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e8be00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2e680720c0 0x7f2e680745d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c001e40 tx=0x7f2e7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a270453f0 0x558a2717ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a27147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a27148220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558a26f9d820 con 0x558a2703ae90 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a26f8cdb0 con 0x558a27024960 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a26f90d60 con 0x558a270453f0 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e83400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a27147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e8be00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a270453f0 0x558a2717ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e83400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a27147ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46800/0 (socket says 172.21.15.89:46800) 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e83400640 1 -- 172.21.15.89:0/3047778402 learned_addr learned my addr 172.21.15.89:0/3047778402 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e90a00640 1 --2- 172.21.15.89:0/3047778402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a27148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e83400640 1 -- 172.21.15.89:0/3047778402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a270453f0 msgr2=0x558a2717ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e83400640 1 --2- 172.21.15.89:0/3047778402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a270453f0 0x558a2717ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e83400640 1 -- 172.21.15.89:0/3047778402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 msgr2=0x558a27148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:39.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e83400640 1 --2- 172.21.15.89:0/3047778402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a27148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e83400640 1 -- 172.21.15.89:0/3047778402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a26f27b70 con 0x558a2703ae90 2024-08-31T04:38:39.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e83400640 1 --2- 172.21.15.89:0/3047778402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a27147ce0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f2e74091090 tx=0x7f2e7405deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cbdf505835c736 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e7be00640 1 -- 172.21.15.89:0/3047778402 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74020040 con 0x558a2703ae90 2024-08-31T04:38:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e7be00640 1 -- 172.21.15.89:0/3047778402 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e7405d820 con 0x558a2703ae90 2024-08-31T04:38:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e7be00640 1 -- 172.21.15.89:0/3047778402 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e740623d0 con 0x558a2703ae90 2024-08-31T04:38:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/3047778402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 msgr2=0x558a27147ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/3047778402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a27147ce0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f2e74091090 tx=0x7f2e7405deb0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/3047778402 shutdown_connections 2024-08-31T04:38:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/3047778402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a27147ce0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/3047778402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a27148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/3047778402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a270453f0 0x558a2717ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/3047778402 >> 172.21.15.89:0/3047778402 conn(0x558a26c4c210 msgr2=0x558a27181990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:39.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/3047778402 shutdown_connections 2024-08-31T04:38:39.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.359+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/3047778402 wait complete. 2024-08-31T04:38:39.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 -- start start 2024-08-31T04:38:39.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 Processor -- start 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a2717d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 0x558a2717de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558a26c53b10 con 0x558a270453f0 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a26f136f0 con 0x558a27024960 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a26f95390 con 0x558a2703ae90 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 10 client.0 _ll_register_callbacks cb 0x558a26f34b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e90a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e90a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46802/0 (socket says 172.21.15.89:46802) 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e90a00640 1 -- 172.21.15.89:0/41391466 learned_addr learned my addr 172.21.15.89:0/41391466 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:39.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e8be00640 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a2717d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e83400640 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 0x558a2717de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e90a00640 1 -- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 msgr2=0x558a2717de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e90a00640 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 0x558a2717de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e90a00640 1 -- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 msgr2=0x558a2717d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e90a00640 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a2717d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e90a00640 1 -- 172.21.15.89:0/41391466 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a26f4b380 con 0x558a270453f0 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e90a00640 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717e370 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2e84005f80 tx=0x7f2e840a65c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f9f4d7ee8f9e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e78c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e78c00640 1 -- 172.21.15.89:0/41391466 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e840c1060 con 0x558a270453f0 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e78c00640 1 -- 172.21.15.89:0/41391466 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2e840a6b90 con 0x558a270453f0 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/41391466 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a26f9bd20 con 0x558a270453f0 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e78c00640 1 -- 172.21.15.89:0/41391466 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2e840c7050 con 0x558a270453f0 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 10 client.6270 fetch_fsmap learned FSMap version 9 2024-08-31T04:38:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.363+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/41391466 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558a27011e40 con 0x558a270453f0 2024-08-31T04:38:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e78c00640 1 -- 172.21.15.89:0/41391466 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558a26f9bd20 con 0x558a270453f0 2024-08-31T04:38:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e78c00640 1 -- 172.21.15.89:0/41391466 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2e84005030 con 0x558a270453f0 2024-08-31T04:38:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 10 client.6270 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:38:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 10 client.6270 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:38:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 20 client.6270 populate_metadata read hostname 'smithi089' 2024-08-31T04:38:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a26c30dc0 0x558a27198f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 4 client.6270 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:38:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/41391466 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a26f9f770 con 0x558a26c30dc0 2024-08-31T04:38:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e8be00640 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a26c30dc0 0x558a27198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e78c00640 10 client.6270 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:38:39.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e8be00640 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a26c30dc0 0x558a27198f90 crc :-1 s=READY pgs=1541 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a44ce348568a4088 server_cookie=86746b5bf099720e in_seq=0 out_seq=0 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e78c00640 1 -- 172.21.15.89:0/41391466 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a26f9f770 con 0x558a26c30dc0 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e78c00640 10 client.6270 handle_command_reply: tid=0 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 client.6270 shutdown 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/41391466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 msgr2=0x558a2717e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717e370 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2e84005f80 tx=0x7f2e840a65c0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/41391466 shutdown_connections 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a26c30dc0 0x558a27198f90 crc :-1 s=READY pgs=1541 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717e370 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 0x558a2717de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/41391466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a2717d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e78c00640 0 client.6270 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/41391466 >> 172.21.15.89:0/41391466 conn(0x558a26c4c210 msgr2=0x558a27180340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/41391466 shutdown_connections 2024-08-31T04:38:39.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/41391466 wait complete. 2024-08-31T04:38:39.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.367+0000 7f2e9a0d0000 20 client.6270 trim_cache size 0 max 16384 2024-08-31T04:38:39.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e9a0d0000 1 Processor -- start 2024-08-31T04:38:39.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e9a0d0000 1 -- start start 2024-08-31T04:38:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a2717d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 0x558a2717d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c2019c0 con 0x558a270453f0 2024-08-31T04:38:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c202d60 con 0x558a27024960 2024-08-31T04:38:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c202010 con 0x558a2703ae90 2024-08-31T04:38:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e90a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e90a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46810/0 (socket says 172.21.15.89:46810) 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e90a00640 1 -- 172.21.15.89:0/959928515 learned_addr learned my addr 172.21.15.89:0/959928515 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e83400640 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 0x558a2717d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e8be00640 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a2717d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e90a00640 1 -- 172.21.15.89:0/959928515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 msgr2=0x558a2717d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e90a00640 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 0x558a2717d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e90a00640 1 -- 172.21.15.89:0/959928515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 msgr2=0x558a2717d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e90a00640 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a2717d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e90a00640 1 -- 172.21.15.89:0/959928515 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a26fe95b0 con 0x558a270453f0 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e8be00640 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a2717d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e90a00640 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717dff0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2e840c5040 tx=0x7f2e8401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be6f84e81d5b987 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e7b400640 1 -- 172.21.15.89:0/959928515 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e840054e0 con 0x558a270453f0 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.387+0000 7f2e7b400640 1 -- 172.21.15.89:0/959928515 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e84000e50 con 0x558a270453f0 2024-08-31T04:38:39.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e7b400640 1 -- 172.21.15.89:0/959928515 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e840a6b90 con 0x558a270453f0 2024-08-31T04:38:39.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/959928515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 msgr2=0x558a2717dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717dff0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2e840c5040 tx=0x7f2e8401c830 comp rx=0 tx=0).stop 2024-08-31T04:38:39.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/959928515 shutdown_connections 2024-08-31T04:38:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a270453f0 0x558a2717dff0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a2703ae90 0x558a2717d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/959928515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a27024960 0x558a2717d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/959928515 >> 172.21.15.89:0/959928515 conn(0x558a26c4c210 msgr2=0x558a271416d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/959928515 shutdown_connections 2024-08-31T04:38:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/959928515 wait complete. 2024-08-31T04:38:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 -- start start 2024-08-31T04:38:39.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 Processor -- start 2024-08-31T04:38:39.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a27024960 0x558a2719ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a2719ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a270453f0 0x558a2719bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558a26f0eeb0 con 0x558a2703ae90 2024-08-31T04:38:39.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c202690 con 0x558a270453f0 2024-08-31T04:38:39.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a26f34f20 con 0x558a27024960 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e9a0d0000 10 client.0 _ll_register_callbacks cb 0x7f2e840044d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e83400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a2719ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e83400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a2719ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46816/0 (socket says 172.21.15.89:46816) 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e83400640 1 -- 172.21.15.89:0/1131068805 learned_addr learned my addr 172.21.15.89:0/1131068805 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e8be00640 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a27024960 0x558a2719ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.391+0000 7f2e90a00640 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a270453f0 0x558a2719bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e83400640 1 -- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a27024960 msgr2=0x558a2719ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e83400640 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a27024960 0x558a2719ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e83400640 1 -- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a270453f0 msgr2=0x558a2719bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e83400640 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a270453f0 0x558a2719bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e83400640 1 -- 172.21.15.89:0/1131068805 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a26f1dfc0 con 0x558a2703ae90 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e83400640 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a2719ba80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2e7405a690 tx=0x7f2e7405a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ecf1a33e26ed32 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:39.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e78c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e78c00640 1 -- 172.21.15.89:0/1131068805 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74020040 con 0x558a2703ae90 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e78c00640 1 -- 172.21.15.89:0/1131068805 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2e74062370 con 0x558a2703ae90 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/1131068805 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e84000e50 con 0x558a2703ae90 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e78c00640 1 -- 172.21.15.89:0/1131068805 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2e7405d130 con 0x558a2703ae90 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e9a0d0000 10 client.6276 fetch_fsmap learned FSMap version 9 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/1131068805 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558a26f16e00 con 0x558a2703ae90 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e78c00640 1 -- 172.21.15.89:0/1131068805 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e84000e50 con 0x558a2703ae90 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e78c00640 1 -- 172.21.15.89:0/1131068805 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f2e7405d2d0 con 0x558a2703ae90 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e9a0d0000 10 client.6276 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e9a0d0000 10 client.6276 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e9a0d0000 20 client.6276 populate_metadata read hostname 'smithi089' 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a26c1ee20 0x558a2719c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e9a0d0000 4 client.6276 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.7, "await_for": 45.0}] 2024-08-31T04:38:39.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/1131068805 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.7, "await_for": 45.0}) -- 0x558a26f9b210 con 0x558a26c1ee20 2024-08-31T04:38:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e8be00640 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a26c1ee20 0x558a2719c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e8be00640 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a26c1ee20 0x558a2719c890 crc :-1 s=READY pgs=1542 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd61e98018cdb438 server_cookie=72c95d5ab8fc4b4b in_seq=0 out_seq=0 2024-08-31T04:38:39.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:39.395+0000 7f2e78c00640 10 client.6276 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:38:43.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e78c00640 1 -- 172.21.15.89:0/1131068805 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558a26f9b210 con 0x558a26c1ee20 2024-08-31T04:38:43.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e78c00640 10 client.6276 handle_command_reply: tid=0 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 client.6276 shutdown 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/1131068805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 msgr2=0x558a2719ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a2719ba80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2e7405a690 tx=0x7f2e7405a390 comp rx=0 tx=0).stop 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/1131068805 shutdown_connections 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x558a26c1ee20 0x558a2719c890 crc :-1 s=READY pgs=1542 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a2703ae90 0x558a2719ba80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a270453f0 0x558a2719bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 --2- 172.21.15.89:0/1131068805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a27024960 0x558a2719ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/1131068805 >> 172.21.15.89:0/1131068805 conn(0x558a26c4c210 msgr2=0x558a271414c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e78c00640 0 client.6276 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/1131068805 shutdown_connections 2024-08-31T04:38:43.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 1 -- 172.21.15.89:0/1131068805 wait complete. 2024-08-31T04:38:43.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e9a0d0000 20 client.6276 trim_cache size 0 max 16384 2024-08-31T04:38:43.590 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:38:43.590 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:38:43.590 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:38:43.590 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 118, 2024-08-31T04:38:43.590 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:38:43.590 INFO:teuthology.orchestra.run.smithi089.stdout: "aead6f67": { 2024-08-31T04:38:43.590 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 118, 2024-08-31T04:38:43.590 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.7, 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:43.591 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:43.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:43.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:43.592 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:38:43.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 -- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2e680720c0 msgr2=0x7f2e680745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2e680720c0 0x7f2e680745d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c001e40 tx=0x7f2e7c009040 comp rx=0 tx=0).stop 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 -- 172.21.15.89:0/1900830129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0b2d20 msgr2=0x7f2e8c1f52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0b2d20 0x7f2e8c1f52a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400d750 tx=0x7f2e7400dc10 comp rx=0 tx=0).stop 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 -- 172.21.15.89:0/1900830129 shutdown_connections 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2e680720c0 0x7f2e680745d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e8c0b2d20 0x7f2e8c1f52a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0c90e0 0x7f2e8c0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 --2- 172.21.15.89:0/1900830129 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0b2860 0x7f2e8c147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 -- 172.21.15.89:0/1900830129 >> 172.21.15.89:0/1900830129 conn(0x7f2e8c0c99b0 msgr2=0x7f2e8c157320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 -- 172.21.15.89:0/1900830129 shutdown_connections 2024-08-31T04:38:43.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:43.587+0000 7f2e92a00640 1 -- 172.21.15.89:0/1900830129 wait complete. 2024-08-31T04:38:43.609 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'aead6f67', quiesce took 4.8 seconds. Will release after: 5.8999999999999995 2024-08-31T04:38:49.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:38:49.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.675+0000 7fb0fcc00640 1 -- 172.21.15.89:0/380940835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc004d50 msgr2=0x7fb0dc005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:49.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.675+0000 7fb0fcc00640 1 --2- 172.21.15.89:0/380940835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc004d50 0x7fb0dc005160 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80735c0 tx=0x7fb0f001f730 comp rx=0 tx=0).stop 2024-08-31T04:38:49.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.675+0000 7fb0f6800640 1 -- 172.21.15.89:0/380940835 reap_dead start 2024-08-31T04:38:49.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.675+0000 7fb0fcc00640 1 -- 172.21.15.89:0/380940835 shutdown_connections 2024-08-31T04:38:49.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.675+0000 7fb0fcc00640 1 -- 172.21.15.89:0/380940835 >> 172.21.15.89:0/380940835 conn(0x7fb0f80ccf20 msgr2=0x7fb0f80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:49.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.675+0000 7fb0fcc00640 1 -- 172.21.15.89:0/380940835 shutdown_connections 2024-08-31T04:38:49.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.675+0000 7fb0fcc00640 1 -- 172.21.15.89:0/380940835 wait complete. 2024-08-31T04:38:49.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0fcc00640 1 Processor -- start 2024-08-31T04:38:49.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0fcc00640 1 -- start start 2024-08-31T04:38:49.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0fcc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc004d50 0x7fb0f81570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:49.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0fcc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0f8155830 0x7fb0f8156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:49.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0fcc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0f814d860 0x7fb0f814dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:49.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0fcc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f8074fb0 con 0x7fb0dc004d50 2024-08-31T04:38:49.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0fcc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f8074e30 con 0x7fb0f814d860 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0fcc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f8152a10 con 0x7fb0f8155830 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc004d50 0x7fb0f81570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f5e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc004d50 0x7fb0f81570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50032/0 (socket says 172.21.15.89:50032) 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f5e00640 1 -- 172.21.15.89:0/1407494912 learned_addr learned my addr 172.21.15.89:0/1407494912 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0ed400640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0f8155830 0x7fb0f8156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f6800640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0f814d860 0x7fb0f814dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f5e00640 1 -- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0f8155830 msgr2=0x7fb0f8156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f5e00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0f8155830 0x7fb0f8156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f5e00640 1 -- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0f814d860 msgr2=0x7fb0f814dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f5e00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0f814d860 0x7fb0f814dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f5e00640 1 -- 172.21.15.89:0/1407494912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f8153fc0 con 0x7fb0dc004d50 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f6800640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0f814d860 0x7fb0f814dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:38:49.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0ed400640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0f8155830 0x7fb0f8156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:38:49.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0f5e00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc004d50 0x7fb0f81570e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8011d30 tx=0x7fb0e800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:49.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.679+0000 7fb0eea00640 1 -- 172.21.15.89:0/1407494912 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8003d90 con 0x7fb0dc004d50 2024-08-31T04:38:49.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.683+0000 7fb0eea00640 1 -- 172.21.15.89:0/1407494912 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0e8004050 con 0x7fb0dc004d50 2024-08-31T04:38:49.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.683+0000 7fb0eea00640 1 -- 172.21.15.89:0/1407494912 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8004460 con 0x7fb0dc004d50 2024-08-31T04:38:49.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.683+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f81f28e0 con 0x7fb0dc004d50 2024-08-31T04:38:49.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.683+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f8153660 con 0x7fb0dc004d50 2024-08-31T04:38:49.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.683+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f80c26e0 con 0x7fb0dc004d50 2024-08-31T04:38:49.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.683+0000 7fb0eea00640 1 -- 172.21.15.89:0/1407494912 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fb0e8004600 con 0x7fb0dc004d50 2024-08-31T04:38:49.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.683+0000 7fb0eea00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb0d40720c0 0x7fb0d40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:49.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.683+0000 7fb0eea00640 1 -- 172.21.15.89:0/1407494912 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fb0e80945a0 con 0x7fb0dc004d50 2024-08-31T04:38:49.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.683+0000 7fb0ed400640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb0d40720c0 0x7fb0d40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:49.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.687+0000 7fb0ed400640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb0d40720c0 0x7fb0d40745d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb0f81e1f40 tx=0x7fb0e00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.687+0000 7fb0eea00640 1 -- 172.21.15.89:0/1407494912 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb0e8011e20 con 0x7fb0dc004d50 2024-08-31T04:38:49.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0f81560a0 con 0x7fb0dc004d50 2024-08-31T04:38:49.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0eea00640 1 -- 172.21.15.89:0/1407494912 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fb0e805fb10 con 0x7fb0dc004d50 2024-08-31T04:38:49.895 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:38:49.895 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:38:49.896 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:38:49.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb0d40720c0 msgr2=0x7fb0d40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:49.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb0d40720c0 0x7fb0d40745d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb0f81e1f40 tx=0x7fb0e00091e0 comp rx=0 tx=0).stop 2024-08-31T04:38:49.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc004d50 msgr2=0x7fb0f81570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:49.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc004d50 0x7fb0f81570e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8011d30 tx=0x7fb0e800f790 comp rx=0 tx=0).stop 2024-08-31T04:38:49.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 shutdown_connections 2024-08-31T04:38:49.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fb0d40720c0 0x7fb0d40745d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:49.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0f814d860 0x7fb0f814dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:49.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0f8155830 0x7fb0f8156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:49.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 --2- 172.21.15.89:0/1407494912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0dc004d50 0x7fb0f81570e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:49.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 >> 172.21.15.89:0/1407494912 conn(0x7fb0f80ccf20 msgr2=0x7fb0f80765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:49.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 shutdown_connections 2024-08-31T04:38:49.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:49.895+0000 7fb0fcc00640 1 -- 172.21.15.89:0/1407494912 wait complete. 2024-08-31T04:38:49.917 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id aead6f67 --release --await' 2024-08-31T04:38:49.917 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id aead6f67 --release --await 2024-08-31T04:38:50.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.079+0000 7f3fb5800640 1 -- 172.21.15.89:0/740655773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f940039f0 msgr2=0x7f3f94003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:50.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.079+0000 7f3fb5800640 1 --2- 172.21.15.89:0/740655773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f940039f0 0x7f3f94003e20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009b40 tx=0x7f3fa001d270 comp rx=0 tx=0).stop 2024-08-31T04:38:50.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.079+0000 7f3faf400640 1 -- 172.21.15.89:0/740655773 reap_dead start 2024-08-31T04:38:50.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.079+0000 7f3fb5800640 1 -- 172.21.15.89:0/740655773 shutdown_connections 2024-08-31T04:38:50.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.079+0000 7f3fb5800640 1 -- 172.21.15.89:0/740655773 >> 172.21.15.89:0/740655773 conn(0x7f3fb006ce00 msgr2=0x7f3fb006d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:50.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.079+0000 7f3fb5800640 1 -- 172.21.15.89:0/740655773 shutdown_connections 2024-08-31T04:38:50.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.079+0000 7f3fb5800640 1 -- 172.21.15.89:0/740655773 wait complete. 2024-08-31T04:38:50.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.079+0000 7f3fb5800640 1 Processor -- start 2024-08-31T04:38:50.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.079+0000 7f3fb5800640 1 -- start start 2024-08-31T04:38:50.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fb5800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f940039f0 0x7f3fb015c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fb5800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fb006fac0 0x7f3fb0150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fb5800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fb00c4d00 0x7f3fb01f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fb5800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb00cad90 con 0x7f3fb006fac0 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fb5800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb00caab0 con 0x7f3fb00c4d00 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fb5800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb015ce20 con 0x7f3f940039f0 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fae000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fb006fac0 0x7f3fb0150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fae000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fb006fac0 0x7f3fb0150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50040/0 (socket says 172.21.15.89:50040) 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fae000640 1 -- 172.21.15.89:0/3086413266 learned_addr learned my addr 172.21.15.89:0/3086413266 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3faea00640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f940039f0 0x7f3fb015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3faf400640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fb00c4d00 0x7f3fb01f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fae000640 1 -- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f940039f0 msgr2=0x7f3fb015c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fae000640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f940039f0 0x7f3fb015c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fae000640 1 -- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fb00c4d00 msgr2=0x7f3fb01f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:50.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fae000640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fb00c4d00 0x7f3fb01f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fae000640 1 -- 172.21.15.89:0/3086413266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb015c590 con 0x7f3fb006fac0 2024-08-31T04:38:50.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fae000640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fb006fac0 0x7f3fb0150890 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c004fd0 tx=0x7f3f9c00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:50.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fa6a00640 1 -- 172.21.15.89:0/3086413266 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c015070 con 0x7f3fb006fac0 2024-08-31T04:38:50.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fa6a00640 1 -- 172.21.15.89:0/3086413266 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f9c010980 con 0x7f3fb006fac0 2024-08-31T04:38:50.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fa6a00640 1 -- 172.21.15.89:0/3086413266 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c010d90 con 0x7f3fb006fac0 2024-08-31T04:38:50.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fb5800640 1 -- 172.21.15.89:0/3086413266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb01f1a10 con 0x7f3fb006fac0 2024-08-31T04:38:50.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.083+0000 7f3fb5800640 1 -- 172.21.15.89:0/3086413266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb015c7a0 con 0x7f3fb006fac0 2024-08-31T04:38:50.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fa6a00640 1 -- 172.21.15.89:0/3086413266 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3f9c018070 con 0x7f3fb006fac0 2024-08-31T04:38:50.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fa6a00640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3f900720c0 0x7f3f900745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fa6a00640 1 -- 172.21.15.89:0/3086413266 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3f9c0933f0 con 0x7f3fb006fac0 2024-08-31T04:38:50.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fbcddc000 1 Processor -- start 2024-08-31T04:38:50.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faea00640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3f900720c0 0x7f3f900745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fbcddc000 1 -- start start 2024-08-31T04:38:50.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faea00640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3f900720c0 0x7f3f900745d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00ad000 tx=0x7f3fa001a010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:50.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 0x5573040a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040a9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557303f4ef30 con 0x557303f60890 2024-08-31T04:38:50.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557303ec4690 con 0x557303f6f930 2024-08-31T04:38:50.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x557303eb3c20 con 0x557303f85950 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faf400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faf400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50044/0 (socket says 172.21.15.89:50044) 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faf400640 1 -- 172.21.15.89:0/3546651425 learned_addr learned my addr 172.21.15.89:0/3546651425 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faea00640 1 --2- 172.21.15.89:0/3546651425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3fae000640 1 --2- 172.21.15.89:0/3546651425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 0x5573040a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faf400640 1 -- 172.21.15.89:0/3546651425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 msgr2=0x5573040a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faf400640 1 --2- 172.21.15.89:0/3546651425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faf400640 1 -- 172.21.15.89:0/3546651425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 msgr2=0x5573040a8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faf400640 1 --2- 172.21.15.89:0/3546651425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 0x5573040a8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.087+0000 7f3faf400640 1 -- 172.21.15.89:0/3546651425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557303e688f0 con 0x557303f60890 2024-08-31T04:38:50.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3faf400640 1 --2- 172.21.15.89:0/3546651425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040a9010 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8001530 tx=0x7f3fa8013930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c529595928d482 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:50.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3f9b400640 1 -- 172.21.15.89:0/3546651425 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80116f0 con 0x557303f60890 2024-08-31T04:38:50.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3f9b400640 1 -- 172.21.15.89:0/3546651425 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fa8011980 con 0x557303f60890 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3f9b400640 1 -- 172.21.15.89:0/3546651425 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8011d70 con 0x557303f60890 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 -- 172.21.15.89:0/3546651425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 msgr2=0x5573040a9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/3546651425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040a9010 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8001530 tx=0x7f3fa8013930 comp rx=0 tx=0).stop 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 -- 172.21.15.89:0/3546651425 shutdown_connections 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/3546651425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040a9010 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/3546651425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 0x5573040a8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/3546651425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 -- 172.21.15.89:0/3546651425 >> 172.21.15.89:0/3546651425 conn(0x557303f85540 msgr2=0x5573040a6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 -- 172.21.15.89:0/3546651425 shutdown_connections 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 -- 172.21.15.89:0/3546651425 wait complete. 2024-08-31T04:38:50.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 -- start start 2024-08-31T04:38:50.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.091+0000 7f3fbcddc000 1 Processor -- start 2024-08-31T04:38:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f60890 0x5573040a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040a3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557303e3a500 con 0x557303f6f930 2024-08-31T04:38:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557303eb7bd0 con 0x557303f60890 2024-08-31T04:38:50.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x557303e5ba30 con 0x557303f85950 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 10 client.0 _ll_register_callbacks cb 0x557303f69b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fae000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fae000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040a3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50046/0 (socket says 172.21.15.89:50046) 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fae000640 1 -- 172.21.15.89:0/835242676 learned_addr learned my addr 172.21.15.89:0/835242676 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3faea00640 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f60890 0x5573040a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3faf400640 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fae000640 1 -- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 msgr2=0x5573040adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fae000640 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fae000640 1 -- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f60890 msgr2=0x5573040a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fae000640 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f60890 0x5573040a3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fae000640 1 -- 172.21.15.89:0/835242676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557303e536a0 con 0x557303f6f930 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3faea00640 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f60890 0x5573040a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:38:50.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fae000640 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040a3570 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00ef20 tx=0x7f3f9c05d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a03549d1975dec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3f8fe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3f8fe00640 1 -- 172.21.15.89:0/835242676 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c01f040 con 0x557303f6f930 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 -- 172.21.15.89:0/835242676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557303e4d7e0 con 0x557303f6f930 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3f8fe00640 1 -- 172.21.15.89:0/835242676 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3f9c047b80 con 0x557303f6f930 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3f8fe00640 1 -- 172.21.15.89:0/835242676 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3f9c0629c0 con 0x557303f6f930 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 10 client.6294 fetch_fsmap learned FSMap version 9 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 -- 172.21.15.89:0/835242676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557303e721c0 con 0x557303f6f930 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3f8fe00640 1 -- 172.21.15.89:0/835242676 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557303e4d7e0 con 0x557303f6f930 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3f8fe00640 1 -- 172.21.15.89:0/835242676 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f3f9c063b50 con 0x557303f6f930 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 10 client.6294 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 10 client.6294 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 20 client.6294 populate_metadata read hostname 'smithi089' 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x557303f49fc0 0x5573040ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 4 client.6294 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:38:50.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3fbcddc000 1 -- 172.21.15.89:0/835242676 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557303ec65e0 con 0x557303f49fc0 2024-08-31T04:38:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3faea00640 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x557303f49fc0 0x5573040ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3faea00640 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x557303f49fc0 0x5573040ae970 crc :-1 s=READY pgs=1560 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=289f24c22dd0930b server_cookie=951530f1702e1ec6 in_seq=0 out_seq=0 2024-08-31T04:38:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.095+0000 7f3f8fe00640 10 client.6294 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:38:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3f8fe00640 1 -- 172.21.15.89:0/835242676 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557303ec65e0 con 0x557303f49fc0 2024-08-31T04:38:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3f8fe00640 10 client.6294 handle_command_reply: tid=0 2024-08-31T04:38:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 client.6294 shutdown 2024-08-31T04:38:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 -- 172.21.15.89:0/835242676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 msgr2=0x5573040a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040a3570 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00ef20 tx=0x7f3f9c05d9b0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 -- 172.21.15.89:0/835242676 shutdown_connections 2024-08-31T04:38:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x557303f49fc0 0x5573040ae970 crc :-1 s=READY pgs=1560 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040a3570 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/835242676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f60890 0x5573040a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3f8fe00640 0 client.6294 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:38:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 -- 172.21.15.89:0/835242676 >> 172.21.15.89:0/835242676 conn(0x557303f85540 msgr2=0x5573040a4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 -- 172.21.15.89:0/835242676 shutdown_connections 2024-08-31T04:38:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 1 -- 172.21.15.89:0/835242676 wait complete. 2024-08-31T04:38:50.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.099+0000 7f3fbcddc000 20 client.6294 trim_cache size 0 max 16384 2024-08-31T04:38:50.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.115+0000 7f3fbcddc000 1 Processor -- start 2024-08-31T04:38:50.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.115+0000 7f3fbcddc000 1 -- start start 2024-08-31T04:38:50.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040bc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 0x5573040bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040bce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb0201110 con 0x557303f60890 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01ffff0 con 0x557303f6f930 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb01f5da0 con 0x557303f85950 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faea00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040bc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50062/0 (socket says 172.21.15.89:50062) 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faea00640 1 -- 172.21.15.89:0/1715433785 learned_addr learned my addr 172.21.15.89:0/1715433785 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faf400640 1 --2- 172.21.15.89:0/1715433785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fae000640 1 --2- 172.21.15.89:0/1715433785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 0x5573040bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faea00640 1 -- 172.21.15.89:0/1715433785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 msgr2=0x5573040bce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faea00640 1 --2- 172.21.15.89:0/1715433785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040bce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faea00640 1 -- 172.21.15.89:0/1715433785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 msgr2=0x5573040bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faea00640 1 --2- 172.21.15.89:0/1715433785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 0x5573040bc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faea00640 1 -- 172.21.15.89:0/1715433785 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573040adf40 con 0x557303f60890 2024-08-31T04:38:50.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3faea00640 1 --2- 172.21.15.89:0/1715433785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040bc380 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009b40 tx=0x7f3fa00b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6633f10d9f5f477b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:50.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3f9aa00640 1 -- 172.21.15.89:0/1715433785 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00048d0 con 0x557303f60890 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3f9aa00640 1 -- 172.21.15.89:0/1715433785 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fa0004b60 con 0x557303f60890 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3f9aa00640 1 -- 172.21.15.89:0/1715433785 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00d6440 con 0x557303f60890 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 -- 172.21.15.89:0/1715433785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 msgr2=0x5573040bc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/1715433785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040bc380 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009b40 tx=0x7f3fa00b8000 comp rx=0 tx=0).stop 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 -- 172.21.15.89:0/1715433785 shutdown_connections 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/1715433785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f85950 0x5573040bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/1715433785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f6f930 0x5573040bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/1715433785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f60890 0x5573040bc380 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 -- 172.21.15.89:0/1715433785 >> 172.21.15.89:0/1715433785 conn(0x557303f85540 msgr2=0x557304064040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 -- 172.21.15.89:0/1715433785 shutdown_connections 2024-08-31T04:38:50.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 -- 172.21.15.89:0/1715433785 wait complete. 2024-08-31T04:38:50.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 -- start start 2024-08-31T04:38:50.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.119+0000 7f3fbcddc000 1 Processor -- start 2024-08-31T04:38:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f60890 0x5573040bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040c0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f85950 0x5573040c0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01feba0 con 0x557303f6f930 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01ff920 con 0x557303f85950 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb01ff250 con 0x557303f60890 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 10 client.0 _ll_register_callbacks cb 0x7f3f9c05db90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fae000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fae000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040c0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50070/0 (socket says 172.21.15.89:50070) 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fae000640 1 -- 172.21.15.89:0/613189109 learned_addr learned my addr 172.21.15.89:0/613189109 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3faea00640 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f60890 0x5573040bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3faf400640 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f85950 0x5573040c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fae000640 1 -- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f60890 msgr2=0x5573040bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fae000640 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f60890 0x5573040bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fae000640 1 -- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f85950 msgr2=0x5573040c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fae000640 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f85950 0x5573040c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fae000640 1 -- 172.21.15.89:0/613189109 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557303f382f0 con 0x557303f6f930 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3faf400640 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f85950 0x5573040c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fae000640 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040c0410 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00efd0 tx=0x7f3f9c05e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc88a0270975a290 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3f8fe00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3f8fe00640 1 -- 172.21.15.89:0/613189109 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c01f040 con 0x557303f6f930 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3f8fe00640 1 -- 172.21.15.89:0/613189109 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3f9c05d3b0 con 0x557303f6f930 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 -- 172.21.15.89:0/613189109 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fa0004b60 con 0x557303f6f930 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3f8fe00640 1 -- 172.21.15.89:0/613189109 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3f9c05d5b0 con 0x557303f6f930 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 10 client.6300 fetch_fsmap learned FSMap version 9 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 -- 172.21.15.89:0/613189109 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557303e3db30 con 0x557303f6f930 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3f8fe00640 1 -- 172.21.15.89:0/613189109 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fa0004b60 con 0x557303f6f930 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3f8fe00640 1 -- 172.21.15.89:0/613189109 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f3f9c059ac0 con 0x557303f6f930 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 10 client.6300 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:38:50.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 10 client.6300 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:38:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 20 client.6300 populate_metadata read hostname 'smithi089' 2024-08-31T04:38:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x557303b45e80 0x5573040c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 4 client.6300 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "aead6f67", "release": true, "await": true}] 2024-08-31T04:38:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3fbcddc000 1 -- 172.21.15.89:0/613189109 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "aead6f67", "release": true, "await": true}) -- 0x557303ec2080 con 0x557303b45e80 2024-08-31T04:38:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.123+0000 7f3faea00640 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x557303b45e80 0x5573040c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.127+0000 7f3f8fe00640 10 client.6300 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:38:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.127+0000 7f3faea00640 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x557303b45e80 0x5573040c13d0 crc :-1 s=READY pgs=1561 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a7b3a14765fb83 server_cookie=5d14294238f25acc in_seq=0 out_seq=0 2024-08-31T04:38:50.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3f8fe00640 1 -- 172.21.15.89:0/613189109 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557303ec2080 con 0x557303b45e80 2024-08-31T04:38:50.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3f8fe00640 10 client.6300 handle_command_reply: tid=0 2024-08-31T04:38:50.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 client.6300 shutdown 2024-08-31T04:38:50.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 -- 172.21.15.89:0/613189109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 msgr2=0x5573040c0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:50.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040c0410 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00efd0 tx=0x7f3f9c05e8c0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 -- 172.21.15.89:0/613189109 shutdown_connections 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x557303b45e80 0x5573040c13d0 crc :-1 s=READY pgs=1561 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557303f6f930 0x5573040c0410 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557303f85950 0x5573040c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 --2- 172.21.15.89:0/613189109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557303f60890 0x5573040bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3f8fe00640 0 client.6300 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 -- 172.21.15.89:0/613189109 >> 172.21.15.89:0/613189109 conn(0x557303f85540 msgr2=0x557304064040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 -- 172.21.15.89:0/613189109 shutdown_connections 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 1 -- 172.21.15.89:0/613189109 wait complete. 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fbcddc000 20 client.6300 trim_cache size 0 max 16384 2024-08-31T04:38:50.288 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 120, 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "aead6f67": { 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 120, 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:38:50.289 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.7, 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:38:50.290 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:38:50.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 -- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3f900720c0 msgr2=0x7f3f900745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:50.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3f900720c0 0x7f3f900745d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00ad000 tx=0x7f3fa001a010 comp rx=0 tx=0).stop 2024-08-31T04:38:50.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 -- 172.21.15.89:0/3086413266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fb006fac0 msgr2=0x7f3fb0150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:50.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fb006fac0 0x7f3fb0150890 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c004fd0 tx=0x7f3f9c00ea20 comp rx=0 tx=0).stop 2024-08-31T04:38:50.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 -- 172.21.15.89:0/3086413266 shutdown_connections 2024-08-31T04:38:50.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3f900720c0 0x7f3f900745d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fb006fac0 0x7f3fb0150890 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fb00c4d00 0x7f3fb01f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 --2- 172.21.15.89:0/3086413266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f940039f0 0x7f3fb015c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:50.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 -- 172.21.15.89:0/3086413266 >> 172.21.15.89:0/3086413266 conn(0x7f3fb006ce00 msgr2=0x7f3fb014b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:50.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 -- 172.21.15.89:0/3086413266 shutdown_connections 2024-08-31T04:38:50.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:38:50.287+0000 7f3fb5800640 1 -- 172.21.15.89:0/3086413266 wait complete. 2024-08-31T04:38:50.309 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'aead6f67', total seconds elapsed: 11.5 2024-08-31T04:38:56.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:38:56.959 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:39:09.173 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 11% (28/243) Updating files: 12% (30/243) Updating files: 13% (32/243) Updating files: 14% (35/243) Updating files: 15% (37/243) Updating files: 16% (39/243) Updating files: 17% (42/243) Updating files: 18% (44/243) Updating files: 19% (47/243) Updating files: 20% (49/243) Updating files: 21% (52/243) Updating files: 22% (54/243) Updating files: 23% (56/243) Updating files: 24% (59/243) Updating files: 25% (61/243) Updating files: 26% (64/243) Updating files: 27% (66/243) Updating files: 28% (69/243) Updating files: 29% (71/243) Updating files: 30% (73/243) Updating files: 31% (76/243) Updating files: 32% (78/243) Updating files: 33% (81/243) Updating files: 34% (83/243) Updating files: 35% (86/243) Updating files: 36% (88/243) Updating files: 37% (90/243) Updating files: 38% (93/243) Updating files: 39% (95/243) Updating files: 40% (98/243) Updating files: 41% (100/243) Updating files: 42% (103/243) Updating files: 43% (105/243) Updating files: 44% (107/243) Updating files: 45% (110/243) Updating files: 46% (112/243) Updating files: 47% (115/243) Updating files: 48% (117/243) Updating files: 49% (120/243) Updating files: 50% (122/243) Updating files: 51% (124/243) Updating files: 52% (127/243) Updating files: 53% (129/243) Updating files: 54% (132/243) Updating files: 55% (134/243) Updating files: 56% (137/243) Updating files: 57% (139/243) Updating files: 58% (141/243) Updating files: 59% (144/243) Updating files: 60% (146/243) Updating files: 61% (149/243) Updating files: 62% (151/243) Updating files: 63% (154/243) Updating files: 64% (156/243) Updating files: 65% (158/243) Updating files: 66% (161/243) Updating files: 67% (163/243) Updating files: 68% (166/243) Updating files: 69% (168/243) Updating files: 70% (171/243) Updating files: 71% (173/243) Updating files: 72% (175/243) Updating files: 73% (178/243) Updating files: 74% (180/243) Updating files: 75% (183/243) Updating files: 76% (185/243) Updating files: 77% (188/243) Updating files: 78% (190/243) Updating files: 79% (192/243) Updating files: 80% (195/243) Updating files: 81% (197/243) Updating files: 82% (200/243) Updating files: 83% (202/243) Updating files: 84% (205/243) Updating files: 84% (206/243) Updating files: 85% (207/243) Updating files: 86% (209/243) Updating files: 87% (212/243) Updating files: 88% (214/243) Updating files: 89% (217/243) Updating files: 90% (219/243) Updating files: 91% (222/243) Updating files: 92% (224/243) Updating files: 93% (226/243) Updating files: 94% (229/243) Updating files: 95% (231/243) Updating files: 96% (234/243) Updating files: 97% (236/243) Updating files: 98% (239/243) Updating files: 99% (241/243) Updating files: 100% (243/243) Updating files: 100% (243/243), done. 2024-08-31T04:39:09.427 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at a0c22842db9 0.85 2024-08-31T04:39:09.435 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.85 2024-08-31T04:39:09.464 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 86 -eq 48 ] 2024-08-31T04:39:09.464 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.86 2024-08-31T04:39:09.464 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.86 2024-08-31T04:39:09.464 INFO:tasks.workunit.client.0.smithi089.stdout:v0.86 2024-08-31T04:39:09.465 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.86 2024-08-31T04:39:10.182 INFO:tasks.quiescer.fs.[cephfs]:Total duration (41.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:39:10.182 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-08-31T04:39:10.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:39:10.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.338+0000 7fd67b000640 1 -- 172.21.15.89:0/2771962323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6740c9330 msgr2=0x7fd674074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.338+0000 7fd67b000640 1 --2- 172.21.15.89:0/2771962323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6740c9330 0x7fd674074720 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd674072540 tx=0x7fd66c01f0b0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.338+0000 7fd67b000640 1 -- 172.21.15.89:0/2771962323 shutdown_connections 2024-08-31T04:39:10.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.338+0000 7fd67b000640 1 --2- 172.21.15.89:0/2771962323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6740c9330 0x7fd674074720 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.338+0000 7fd67b000640 1 --2- 172.21.15.89:0/2771962323 >> v2:172.21.15.170:3300/0 conn(0x7fd67415bc70 0x7fd674152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.338+0000 7fd67b000640 1 -- 172.21.15.89:0/2771962323 >> 172.21.15.89:0/2771962323 conn(0x7fd6740ccf20 msgr2=0x7fd6740cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:10.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.338+0000 7fd67b000640 1 -- 172.21.15.89:0/2771962323 shutdown_connections 2024-08-31T04:39:10.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.338+0000 7fd67b000640 1 -- 172.21.15.89:0/2771962323 wait complete. 2024-08-31T04:39:10.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.338+0000 7fd67b000640 1 Processor -- start 2024-08-31T04:39:10.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 -- start start 2024-08-31T04:39:10.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6740c1f40 0x7fd6740c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6740c9330 0x7fd674155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd67415bc70 0x7fd674157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740c8030 con 0x7fd6740c9330 2024-08-31T04:39:10.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740c3150 con 0x7fd67415bc70 2024-08-31T04:39:10.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd674074c60 con 0x7fd6740c1f40 2024-08-31T04:39:10.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6740c1f40 0x7fd6740c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6740c9330 0x7fd674155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6740c1f40 0x7fd6740c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.89:53236/0 (socket says 172.21.15.89:53236) 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673e00640 1 -- 172.21.15.89:0/1442458589 learned_addr learned my addr 172.21.15.89:0/1442458589 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd679000640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd67415bc70 0x7fd674157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673e00640 1 -- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd67415bc70 msgr2=0x7fd674157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673e00640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd67415bc70 0x7fd674157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673e00640 1 -- 172.21.15.89:0/1442458589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6740c9330 msgr2=0x7fd674155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673e00640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6740c9330 0x7fd674155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673e00640 1 -- 172.21.15.89:0/1442458589 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6740c6760 con 0x7fd6740c1f40 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673400640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6740c9330 0x7fd674155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd673e00640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6740c1f40 0x7fd6740c6220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd66400e7c0 tx=0x7fd66400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd66be00640 1 -- 172.21.15.89:0/1442458589 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66400cc60 con 0x7fd6740c1f40 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd66be00640 1 -- 172.21.15.89:0/1442458589 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd66400ce20 con 0x7fd6740c1f40 2024-08-31T04:39:10.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd674154250 con 0x7fd6740c1f40 2024-08-31T04:39:10.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd66be00640 1 -- 172.21.15.89:0/1442458589 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664005280 con 0x7fd6740c1f40 2024-08-31T04:39:10.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd674074170 con 0x7fd6740c1f40 2024-08-31T04:39:10.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.342+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6740c5eb0 con 0x7fd6740c1f40 2024-08-31T04:39:10.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.346+0000 7fd66be00640 1 -- 172.21.15.89:0/1442458589 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd664005420 con 0x7fd6740c1f40 2024-08-31T04:39:10.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.346+0000 7fd66be00640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6540720c0 0x7fd6540745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.346+0000 7fd66be00640 1 -- 172.21.15.89:0/1442458589 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fd664093c80 con 0x7fd6740c1f40 2024-08-31T04:39:10.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.346+0000 7fd673400640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6540720c0 0x7fd6540745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.350 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.346+0000 7fd673400640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6540720c0 0x7fd6540745d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6600012f0 tx=0x7fd660009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.350+0000 7fd66be00640 1 -- 172.21.15.89:0/1442458589 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd6740c5eb0 con 0x7fd6740c1f40 2024-08-31T04:39:10.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.550+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd674074720 con 0x7fd6740c1f40 2024-08-31T04:39:10.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.550+0000 7fd66be00640 1 -- 172.21.15.89:0/1442458589 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fd66405eb10 con 0x7fd6740c1f40 2024-08-31T04:39:10.553 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:39:10.553 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:39:10.553 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:39:10.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6540720c0 msgr2=0x7fd6540745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6540720c0 0x7fd6540745d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6600012f0 tx=0x7fd660009040 comp rx=0 tx=0).stop 2024-08-31T04:39:10.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6740c1f40 msgr2=0x7fd6740c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6740c1f40 0x7fd6740c6220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd66400e7c0 tx=0x7fd66400ec80 comp rx=0 tx=0).stop 2024-08-31T04:39:10.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 shutdown_connections 2024-08-31T04:39:10.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd6540720c0 0x7fd6540745d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6740c9330 0x7fd674155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd67415bc70 0x7fd674157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 --2- 172.21.15.89:0/1442458589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6740c1f40 0x7fd6740c6220 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 >> 172.21.15.89:0/1442458589 conn(0x7fd6740ccf20 msgr2=0x7fd674158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:10.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 shutdown_connections 2024-08-31T04:39:10.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.554+0000 7fd67b000640 1 -- 172.21.15.89:0/1442458589 wait complete. 2024-08-31T04:39:10.574 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-08-31T04:39:10.575 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-08-31T04:39:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.746+0000 7f8ca3e00640 1 -- 172.21.15.89:0/1556839455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca415bde0 msgr2=0x7f8ca415c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.746+0000 7f8ca3e00640 1 --2- 172.21.15.89:0/1556839455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca415bde0 0x7f8ca415c1f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40c6650 tx=0x7f8c9c01f0b0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.746+0000 7f8ca3e00640 1 -- 172.21.15.89:0/1556839455 shutdown_connections 2024-08-31T04:39:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.746+0000 7f8ca3e00640 1 --2- 172.21.15.89:0/1556839455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca415bde0 0x7f8ca415c1f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.746+0000 7f8ca3e00640 1 --2- 172.21.15.89:0/1556839455 >> v2:172.21.15.170:3300/0 conn(0x7f8ca40c7cc0 0x7f8ca40c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.746+0000 7f8ca3e00640 1 -- 172.21.15.89:0/1556839455 >> 172.21.15.89:0/1556839455 conn(0x7f8ca40cd3c0 msgr2=0x7f8ca40cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:10.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.746+0000 7f8ca3e00640 1 -- 172.21.15.89:0/1556839455 shutdown_connections 2024-08-31T04:39:10.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.746+0000 7f8ca3e00640 1 -- 172.21.15.89:0/1556839455 wait complete. 2024-08-31T04:39:10.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 Processor -- start 2024-08-31T04:39:10.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 -- start start 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40c7cc0 0x7f8ca4147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca414f110 0x7f8ca414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415bde0 0x7f8ca40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca415c730 con 0x7f8ca414f110 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4159070 con 0x7f8ca40c7cc0 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca4152b20 con 0x7f8ca415bde0 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca414f110 0x7f8ca414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca414f110 0x7f8ca414cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59202/0 (socket says 172.21.15.89:59202) 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2000640 1 -- 172.21.15.89:0/3313800446 learned_addr learned my addr 172.21.15.89:0/3313800446 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3400640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415bde0 0x7f8ca40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40c7cc0 0x7f8ca4147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2000640 1 -- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415bde0 msgr2=0x7f8ca40cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2000640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415bde0 0x7f8ca40cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2000640 1 -- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40c7cc0 msgr2=0x7f8ca4147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2000640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40c7cc0 0x7f8ca4147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2000640 1 -- 172.21.15.89:0/3313800446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca41e45d0 con 0x7f8ca414f110 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3400640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415bde0 0x7f8ca40cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40c7cc0 0x7f8ca4147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca2000640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca414f110 0x7f8ca414cd40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000d750 tx=0x7f8c9000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8c9aa00640 1 -- 172.21.15.89:0/3313800446 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90017070 con 0x7f8ca414f110 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8c9aa00640 1 -- 172.21.15.89:0/3313800446 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c90009d20 con 0x7f8ca414f110 2024-08-31T04:39:10.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8c9aa00640 1 -- 172.21.15.89:0/3313800446 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90005280 con 0x7f8ca414f110 2024-08-31T04:39:10.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 -- 172.21.15.89:0/3313800446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca41e48b0 con 0x7f8ca414f110 2024-08-31T04:39:10.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.750+0000 7f8ca3e00640 1 -- 172.21.15.89:0/3313800446 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca4146f40 con 0x7f8ca414f110 2024-08-31T04:39:10.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.754+0000 7f8c9aa00640 1 -- 172.21.15.89:0/3313800446 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8c90005420 con 0x7f8ca414f110 2024-08-31T04:39:10.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.754+0000 7f8cb0d7f000 1 Processor -- start 2024-08-31T04:39:10.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8c9aa00640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8c840720c0 0x7f8c840745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 -- start start 2024-08-31T04:39:10.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8c9aa00640 1 -- 172.21.15.89:0/3313800446 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8c90093060 con 0x7f8ca414f110 2024-08-31T04:39:10.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca3400640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8c840720c0 0x7f8c840745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 0x56414d3b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 0x56414d37d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56414d1d2820 con 0x56414d26fe90 2024-08-31T04:39:10.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56414d1c1db0 con 0x56414d259960 2024-08-31T04:39:10.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56414d1c5d60 con 0x56414d27a3f0 2024-08-31T04:39:10.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca3400640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8c840720c0 0x7f8c840745d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0b2000 tx=0x7f8c9c01d8f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59206/0 (socket says 172.21.15.89:59206) 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2000640 1 -- 172.21.15.89:0/2882693198 learned_addr learned my addr 172.21.15.89:0/2882693198 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca3400640 1 --2- 172.21.15.89:0/2882693198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 0x56414d37d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/2882693198 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 0x56414d3b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2000640 1 -- 172.21.15.89:0/2882693198 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 msgr2=0x56414d3b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2000640 1 --2- 172.21.15.89:0/2882693198 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 0x56414d3b70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2000640 1 -- 172.21.15.89:0/2882693198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 msgr2=0x56414d37d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2000640 1 --2- 172.21.15.89:0/2882693198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 0x56414d37d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2000640 1 -- 172.21.15.89:0/2882693198 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414d15cb70 con 0x56414d26fe90 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8ca2000640 1 --2- 172.21.15.89:0/2882693198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37cce0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8c9005de70 tx=0x7f8c9005d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e49bacadbe73695 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8c8f400640 1 -- 172.21.15.89:0/2882693198 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90020040 con 0x56414d26fe90 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8c8f400640 1 -- 172.21.15.89:0/2882693198 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c9005dee0 con 0x56414d26fe90 2024-08-31T04:39:10.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8c8f400640 1 -- 172.21.15.89:0/2882693198 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90062750 con 0x56414d26fe90 2024-08-31T04:39:10.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2882693198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 msgr2=0x56414d37cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2882693198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37cce0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8c9005de70 tx=0x7f8c9005d9f0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2882693198 shutdown_connections 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2882693198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37cce0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2882693198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 0x56414d37d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2882693198 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 0x56414d3b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2882693198 >> 172.21.15.89:0/2882693198 conn(0x56414ce81210 msgr2=0x56414d3b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2882693198 shutdown_connections 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.758+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2882693198 wait complete. 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 -- start start 2024-08-31T04:39:10.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 Processor -- start 2024-08-31T04:39:10.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 0x56414d37ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 0x56414d37b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56414ce88b10 con 0x56414d26fe90 2024-08-31T04:39:10.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56414d1486f0 con 0x56414d259960 2024-08-31T04:39:10.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56414d1ca390 con 0x56414d27a3f0 2024-08-31T04:39:10.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 10 client.0 _ll_register_callbacks cb 0x56414d169b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:39:10.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59212/0 (socket says 172.21.15.89:59212) 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2000640 1 -- 172.21.15.89:0/2427920919 learned_addr learned my addr 172.21.15.89:0/2427920919 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 0x56414d37ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca3400640 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 0x56414d37b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2000640 1 -- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 msgr2=0x56414d37b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2000640 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 0x56414d37b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2000640 1 -- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 msgr2=0x56414d37ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2000640 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 0x56414d37ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2000640 1 -- 172.21.15.89:0/2427920919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414d180380 con 0x56414d26fe90 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8ca2000640 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37b3a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009610 tx=0x7f8c9005a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509ed447148b0ad1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8c83e00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8c83e00640 1 -- 172.21.15.89:0/2427920919 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90077020 con 0x56414d26fe90 2024-08-31T04:39:10.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2427920919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56414d1d0d20 con 0x56414d26fe90 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8c83e00640 1 -- 172.21.15.89:0/2427920919 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8c900624b0 con 0x56414d26fe90 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8c83e00640 1 -- 172.21.15.89:0/2427920919 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8c90020070 con 0x56414d26fe90 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 10 client.6321 fetch_fsmap learned FSMap version 9 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.762+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2427920919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56414d246e40 con 0x56414d26fe90 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8c83e00640 1 -- 172.21.15.89:0/2427920919 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56414d1d0d20 con 0x56414d26fe90 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8c83e00640 1 -- 172.21.15.89:0/2427920919 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8c9005d140 con 0x56414d26fe90 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8cb0d7f000 10 client.6321 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8cb0d7f000 10 client.6321 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8cb0d7f000 20 client.6321 populate_metadata read hostname 'smithi089' 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56414ce65dc0 0x56414d37c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8cb0d7f000 4 client.6321 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2427920919 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56414d1d4770 con 0x56414ce65dc0 2024-08-31T04:39:10.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56414ce65dc0 0x56414d37c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56414ce65dc0 0x56414d37c2f0 crc :-1 s=READY pgs=1577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef7f213748eb4cd server_cookie=bbfd33276860cdf0 in_seq=0 out_seq=0 2024-08-31T04:39:10.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.766+0000 7f8c83e00640 10 client.6321 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:10.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8c83e00640 1 -- 172.21.15.89:0/2427920919 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56414d1d4770 con 0x56414ce65dc0 2024-08-31T04:39:10.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8c83e00640 10 client.6321 handle_command_reply: tid=0 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 client.6321 shutdown 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2427920919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 msgr2=0x56414d37b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37b3a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009610 tx=0x7f8c9005a420 comp rx=0 tx=0).stop 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2427920919 shutdown_connections 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56414ce65dc0 0x56414d37c2f0 crc :-1 s=READY pgs=1577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d37b3a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d27a3f0 0x56414d37b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/2427920919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d259960 0x56414d37ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8c83e00640 0 client.6321 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2427920919 >> 172.21.15.89:0/2427920919 conn(0x56414ce81210 msgr2=0x56414d3b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2427920919 shutdown_connections 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/2427920919 wait complete. 2024-08-31T04:39:10.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.774+0000 7f8cb0d7f000 20 client.6321 trim_cache size 0 max 16384 2024-08-31T04:39:10.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8cb0d7f000 1 Processor -- start 2024-08-31T04:39:10.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8cb0d7f000 1 -- start start 2024-08-31T04:39:10.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d26fe90 0x56414d3d73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d27a3f0 0x56414d42e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca415aaf0 con 0x56414d27a3f0 2024-08-31T04:39:10.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca41fb100 con 0x56414d26fe90 2024-08-31T04:39:10.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca415b140 con 0x56414d259960 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d27a3f0 0x56414d42e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d27a3f0 0x56414d42e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59226/0 (socket says 172.21.15.89:59226) 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca3400640 1 -- 172.21.15.89:0/3766354601 learned_addr learned my addr 172.21.15.89:0/3766354601 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca2000640 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d26fe90 0x56414d3d73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca3400640 1 -- 172.21.15.89:0/3766354601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 msgr2=0x56414d3d6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca3400640 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca3400640 1 -- 172.21.15.89:0/3766354601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d26fe90 msgr2=0x56414d3d73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca3400640 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d26fe90 0x56414d3d73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca3400640 1 -- 172.21.15.89:0/3766354601 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414d21e5b0 con 0x56414d27a3f0 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:39:10.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8ca3400640 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d27a3f0 0x56414d42e090 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009230 tx=0x7f8c9c0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f439f11e3f2f565 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8c8ea00640 1 -- 172.21.15.89:0/3766354601 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0c1040 con 0x56414d27a3f0 2024-08-31T04:39:10.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8c8ea00640 1 -- 172.21.15.89:0/3766354601 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c9c0055b0 con 0x56414d27a3f0 2024-08-31T04:39:10.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.794+0000 7f8c8ea00640 1 -- 172.21.15.89:0/3766354601 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0b5040 con 0x56414d27a3f0 2024-08-31T04:39:10.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/3766354601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d27a3f0 msgr2=0x56414d42e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d27a3f0 0x56414d42e090 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009230 tx=0x7f8c9c0b7000 comp rx=0 tx=0).stop 2024-08-31T04:39:10.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/3766354601 shutdown_connections 2024-08-31T04:39:10.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d27a3f0 0x56414d42e090 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d26fe90 0x56414d3d73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/3766354601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/3766354601 >> 172.21.15.89:0/3766354601 conn(0x56414ce81210 msgr2=0x56414d3d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:10.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/3766354601 shutdown_connections 2024-08-31T04:39:10.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/3766354601 wait complete. 2024-08-31T04:39:10.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 -- start start 2024-08-31T04:39:10.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 Processor -- start 2024-08-31T04:39:10.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d3d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d27a3f0 0x56414d3f8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56414d143eb0 con 0x56414d26fe90 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca415b7f0 con 0x56414d27a3f0 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56414d169f20 con 0x56414d259960 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8cb0d7f000 10 client.0 _ll_register_callbacks cb 0x7f8c9004a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8ca2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d3d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8ca2000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d3d6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59236/0 (socket says 172.21.15.89:59236) 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8ca2000640 1 -- 172.21.15.89:0/977686994 learned_addr learned my addr 172.21.15.89:0/977686994 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.798+0000 7f8ca3400640 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d27a3f0 0x56414d3f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca2000640 1 -- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 msgr2=0x56414d3d62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca2000640 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca2000640 1 -- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d27a3f0 msgr2=0x56414d3f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:10.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca2000640 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d27a3f0 0x56414d3f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca2000640 1 -- 172.21.15.89:0/977686994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414d152fc0 con 0x56414d26fe90 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca3400640 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d27a3f0 0x56414d3f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca2000640 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d3d6810 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000df30 tx=0x7f8c9005e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43912b06d12d0a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8c83e00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8c83e00640 1 -- 172.21.15.89:0/977686994 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90077040 con 0x56414d26fe90 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8c83e00640 1 -- 172.21.15.89:0/977686994 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8c90059850 con 0x56414d26fe90 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/977686994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c0055b0 con 0x56414d26fe90 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8c83e00640 1 -- 172.21.15.89:0/977686994 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8c9005dee0 con 0x56414d26fe90 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8cb0d7f000 10 client.6327 fetch_fsmap learned FSMap version 9 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/977686994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56414d14be00 con 0x56414d26fe90 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8c83e00640 1 -- 172.21.15.89:0/977686994 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c9c0055b0 con 0x56414d26fe90 2024-08-31T04:39:10.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8c83e00640 1 -- 172.21.15.89:0/977686994 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f8c90077b00 con 0x56414d26fe90 2024-08-31T04:39:10.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8cb0d7f000 10 client.6327 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:39:10.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8cb0d7f000 10 client.6327 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:39:10.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8cb0d7f000 20 client.6327 populate_metadata read hostname 'smithi089' 2024-08-31T04:39:10.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56414ce53e20 0x56414d3f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8cb0d7f000 4 client.6327 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-08-31T04:39:10.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/977686994 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x56414d1d0210 con 0x56414ce53e20 2024-08-31T04:39:10.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56414ce53e20 0x56414d3f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8c83e00640 10 client.6327 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:10.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:10.802+0000 7f8ca2a00640 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56414ce53e20 0x56414d3f90d0 crc :-1 s=READY pgs=1578 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49d5883d9c722c9c server_cookie=ea25c214013e1818 in_seq=0 out_seq=0 2024-08-31T04:39:17.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8c83e00640 1 -- 172.21.15.89:0/977686994 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56414d1d0210 con 0x56414ce53e20 2024-08-31T04:39:17.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8c83e00640 10 client.6327 handle_command_reply: tid=0 2024-08-31T04:39:17.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 client.6327 shutdown 2024-08-31T04:39:17.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/977686994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 msgr2=0x56414d3d6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:17.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d3d6810 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000df30 tx=0x7f8c9005e650 comp rx=0 tx=0).stop 2024-08-31T04:39:17.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/977686994 shutdown_connections 2024-08-31T04:39:17.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56414ce53e20 0x56414d3f90d0 crc :-1 s=READY pgs=1578 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56414d26fe90 0x56414d3d6810 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56414d27a3f0 0x56414d3f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 --2- 172.21.15.89:0/977686994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56414d259960 0x56414d3d62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8c83e00640 0 client.6327 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/977686994 >> 172.21.15.89:0/977686994 conn(0x56414ce81210 msgr2=0x56414d379e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/977686994 shutdown_connections 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 1 -- 172.21.15.89:0/977686994 wait complete. 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8cb0d7f000 20 client.6327 trim_cache size 0 max 16384 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:39:17.442 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 122, 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "8dd3e564": { 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 122, 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 140.5, 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:39:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:39:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:39:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:39:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:17.444 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:39:17.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 -- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8c840720c0 msgr2=0x7f8c840745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:17.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8c840720c0 0x7f8c840745d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0b2000 tx=0x7f8c9c01d8f0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 -- 172.21.15.89:0/3313800446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca414f110 msgr2=0x7f8ca414cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:17.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca414f110 0x7f8ca414cd40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000d750 tx=0x7f8c9000dc10 comp rx=0 tx=0).stop 2024-08-31T04:39:17.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 -- 172.21.15.89:0/3313800446 shutdown_connections 2024-08-31T04:39:17.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8c840720c0 0x7f8c840745d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ca414f110 0x7f8ca414cd40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ca415bde0 0x7f8ca40cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 --2- 172.21.15.89:0/3313800446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ca40c7cc0 0x7f8ca4147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 -- 172.21.15.89:0/3313800446 >> 172.21.15.89:0/3313800446 conn(0x7f8ca40cd3c0 msgr2=0x7f8ca4157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:17.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 -- 172.21.15.89:0/3313800446 shutdown_connections 2024-08-31T04:39:17.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:17.438+0000 7f8ca3e00640 1 -- 172.21.15.89:0/3313800446 wait complete. 2024-08-31T04:39:17.461 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8dd3e564', quiesce took 7.3 seconds. Will release after: 13.2 2024-08-31T04:39:27.098 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:39:27.102 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:39:30.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:39:30.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 -- 172.21.15.89:0/3327540657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 msgr2=0x7f5550152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:30.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 --2- 172.21.15.89:0/3327540657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 0x7f5550152a10 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f55500c9020 tx=0x7f554001f5a0 comp rx=0 tx=0).stop 2024-08-31T04:39:30.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 -- 172.21.15.89:0/3327540657 shutdown_connections 2024-08-31T04:39:30.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 --2- 172.21.15.89:0/3327540657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55500c1f40 0x7f55500c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:30.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 --2- 172.21.15.89:0/3327540657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 0x7f5550152a10 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:30.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 -- 172.21.15.89:0/3327540657 >> 172.21.15.89:0/3327540657 conn(0x7f55500ccf20 msgr2=0x7f55500cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:30.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 -- 172.21.15.89:0/3327540657 shutdown_connections 2024-08-31T04:39:30.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 -- 172.21.15.89:0/3327540657 wait complete. 2024-08-31T04:39:30.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 Processor -- start 2024-08-31T04:39:30.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.826+0000 7f5555e00640 1 -- start start 2024-08-31T04:39:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5555e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55500c1f40 0x7f5550153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5555e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55500c7920 0x7f55501f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5555e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 0x7f55500c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5555e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5550074fb0 con 0x7f555015bc70 2024-08-31T04:39:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5555e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5550074e30 con 0x7f55500c1f40 2024-08-31T04:39:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5555e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f55500c7d30 con 0x7f55500c7920 2024-08-31T04:39:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 0x7f55500c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554f400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 0x7f55500c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58720/0 (socket says 172.21.15.89:58720) 2024-08-31T04:39:30.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554f400640 1 -- 172.21.15.89:0/487771405 learned_addr learned my addr 172.21.15.89:0/487771405 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:30.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554e000640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55500c7920 0x7f55501f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:30.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554ea00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55500c1f40 0x7f5550153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:30.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554f400640 1 -- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55500c7920 msgr2=0x7f55501f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:30.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554f400640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55500c7920 0x7f55501f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:30.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554f400640 1 -- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55500c1f40 msgr2=0x7f5550153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:30.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554f400640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55500c1f40 0x7f5550153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:30.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554f400640 1 -- 172.21.15.89:0/487771405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5550074150 con 0x7f555015bc70 2024-08-31T04:39:30.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554ea00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55500c1f40 0x7f5550153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:30.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f554f400640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 0x7f55500c5bc0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f554800c370 tx=0x7f554800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:30.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5547400640 1 -- 172.21.15.89:0/487771405 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548017070 con 0x7f555015bc70 2024-08-31T04:39:30.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5547400640 1 -- 172.21.15.89:0/487771405 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55480053c0 con 0x7f555015bc70 2024-08-31T04:39:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55501f2bc0 con 0x7f555015bc70 2024-08-31T04:39:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5547400640 1 -- 172.21.15.89:0/487771405 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548003860 con 0x7f555015bc70 2024-08-31T04:39:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55500746d0 con 0x7f555015bc70 2024-08-31T04:39:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.830+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55500c9330 con 0x7f555015bc70 2024-08-31T04:39:30.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.834+0000 7f5547400640 1 -- 172.21.15.89:0/487771405 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f554801a070 con 0x7f555015bc70 2024-08-31T04:39:30.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.834+0000 7f5547400640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55300720c0 0x7f55300745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:30.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.834+0000 7f5547400640 1 -- 172.21.15.89:0/487771405 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f55480921c0 con 0x7f555015bc70 2024-08-31T04:39:30.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.834+0000 7f554ea00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55300720c0 0x7f55300745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:30.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.834+0000 7f554ea00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55300720c0 0x7f55300745d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f55400b3000 tx=0x7f554001dde0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:30.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:30.838+0000 7f5547400640 1 -- 172.21.15.89:0/487771405 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5550074150 con 0x7f555015bc70 2024-08-31T04:39:31.039 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.038+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55500c82f0 con 0x7f555015bc70 2024-08-31T04:39:31.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.038+0000 7f5547400640 1 -- 172.21.15.89:0/487771405 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f554805d0e0 con 0x7f555015bc70 2024-08-31T04:39:31.040 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:39:31.041 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:39:31.041 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55300720c0 msgr2=0x7f55300745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55300720c0 0x7f55300745d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f55400b3000 tx=0x7f554001dde0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 msgr2=0x7f55500c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 0x7f55500c5bc0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f554800c370 tx=0x7f554800c830 comp rx=0 tx=0).stop 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 shutdown_connections 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55300720c0 0x7f55300745d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f555015bc70 0x7f55500c5bc0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55500c7920 0x7f55501f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 --2- 172.21.15.89:0/487771405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55500c1f40 0x7f5550153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 >> 172.21.15.89:0/487771405 conn(0x7f55500ccf20 msgr2=0x7f55500765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 shutdown_connections 2024-08-31T04:39:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.042+0000 7f5555e00640 1 -- 172.21.15.89:0/487771405 wait complete. 2024-08-31T04:39:31.062 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 8dd3e564 --release --await' 2024-08-31T04:39:31.062 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 8dd3e564 --release --await 2024-08-31T04:39:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.222+0000 7ffb90000640 1 -- 172.21.15.89:0/2049129720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 msgr2=0x7ffb70003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.222+0000 7ffb90000640 1 --2- 172.21.15.89:0/2049129720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 0x7ffb70003ed0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009b40 tx=0x7ffb7c01d250 comp rx=0 tx=0).stop 2024-08-31T04:39:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.222+0000 7ffb90000640 1 -- 172.21.15.89:0/2049129720 shutdown_connections 2024-08-31T04:39:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.222+0000 7ffb90000640 1 --2- 172.21.15.89:0/2049129720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 0x7ffb70003ed0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.222+0000 7ffb90000640 1 -- 172.21.15.89:0/2049129720 >> 172.21.15.89:0/2049129720 conn(0x7ffb880c99b0 msgr2=0x7ffb880c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.222+0000 7ffb90000640 1 -- 172.21.15.89:0/2049129720 shutdown_connections 2024-08-31T04:39:31.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.222+0000 7ffb90000640 1 -- 172.21.15.89:0/2049129720 wait complete. 2024-08-31T04:39:31.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.222+0000 7ffb90000640 1 Processor -- start 2024-08-31T04:39:31.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.222+0000 7ffb90000640 1 -- start start 2024-08-31T04:39:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb90000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 0x7ffb8814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb90000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb88155900 0x7ffb881543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb90000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb880c5ee0 0x7ffb880c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb90000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88158750 con 0x7ffb70003a60 2024-08-31T04:39:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb90000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881585d0 con 0x7ffb88155900 2024-08-31T04:39:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb90000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffb88152780 con 0x7ffb880c5ee0 2024-08-31T04:39:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8d600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 0x7ffb8814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8d600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 0x7ffb8814dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58730/0 (socket says 172.21.15.89:58730) 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8d600640 1 -- 172.21.15.89:0/3268452099 learned_addr learned my addr 172.21.15.89:0/3268452099 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb88155900 0x7ffb881543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8e000640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb880c5ee0 0x7ffb880c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8d600640 1 -- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb880c5ee0 msgr2=0x7ffb880c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8d600640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb880c5ee0 0x7ffb880c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8d600640 1 -- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb88155900 msgr2=0x7ffb881543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8d600640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb88155900 0x7ffb881543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8d600640 1 -- 172.21.15.89:0/3268452099 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb881e72e0 con 0x7ffb70003a60 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb88155900 0x7ffb881543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8e000640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb880c5ee0 0x7ffb880c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb8d600640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 0x7ffb8814dbb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0ae040 tx=0x7ffb7c0050a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb85600640 1 -- 172.21.15.89:0/3268452099 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0bb030 con 0x7ffb70003a60 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb85600640 1 -- 172.21.15.89:0/3268452099 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb7c004900 con 0x7ffb70003a60 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb85600640 1 -- 172.21.15.89:0/3268452099 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c004d50 con 0x7ffb70003a60 2024-08-31T04:39:31.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb90000640 1 -- 172.21.15.89:0/3268452099 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb88154930 con 0x7ffb70003a60 2024-08-31T04:39:31.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.226+0000 7ffb90000640 1 -- 172.21.15.89:0/3268452099 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb88153630 con 0x7ffb70003a60 2024-08-31T04:39:31.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.230+0000 7ffb85600640 1 -- 172.21.15.89:0/3268452099 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ffb7c0be030 con 0x7ffb70003a60 2024-08-31T04:39:31.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.230+0000 7ffb85600640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffb680720c0 0x7ffb680745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.230+0000 7ffb85600640 1 -- 172.21.15.89:0/3268452099 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ffb7c12e600 con 0x7ffb70003a60 2024-08-31T04:39:31.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.230+0000 7ffb977ed000 1 Processor -- start 2024-08-31T04:39:31.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.230+0000 7ffb977ed000 1 -- start start 2024-08-31T04:39:31.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.230+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffb680720c0 0x7ffb680745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.230+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffb680720c0 0x7ffb680745d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb881e82d0 tx=0x7ffb74006b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19db010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5586a1880f30 con 0x5586a1892890 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5586a17f6690 con 0x5586a18a1930 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5586a17e5c20 con 0x5586a18b7950 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8e000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19db010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8d600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8e000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19db010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58736/0 (socket says 172.21.15.89:58736) 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8e000640 1 -- 172.21.15.89:0/463136737 learned_addr learned my addr 172.21.15.89:0/463136737 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/463136737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8e000640 1 -- 172.21.15.89:0/463136737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 msgr2=0x5586a19d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8e000640 1 --2- 172.21.15.89:0/463136737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8e000640 1 -- 172.21.15.89:0/463136737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 msgr2=0x5586a19daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8e000640 1 --2- 172.21.15.89:0/463136737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8e000640 1 -- 172.21.15.89:0/463136737 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586a179a8f0 con 0x5586a1892890 2024-08-31T04:39:31.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb8e000640 1 --2- 172.21.15.89:0/463136737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19db010 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ffb880c3c70 tx=0x7ffb80006e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2196d937e6eeb03 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:31.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb79c00640 1 -- 172.21.15.89:0/463136737 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80003b90 con 0x5586a1892890 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb79c00640 1 -- 172.21.15.89:0/463136737 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb80003e20 con 0x5586a1892890 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb79c00640 1 -- 172.21.15.89:0/463136737 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000ebb0 con 0x5586a1892890 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 -- 172.21.15.89:0/463136737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 msgr2=0x5586a19db010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 --2- 172.21.15.89:0/463136737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19db010 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ffb880c3c70 tx=0x7ffb80006e00 comp rx=0 tx=0).stop 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 -- 172.21.15.89:0/463136737 shutdown_connections 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 --2- 172.21.15.89:0/463136737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19db010 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 --2- 172.21.15.89:0/463136737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 --2- 172.21.15.89:0/463136737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 -- 172.21.15.89:0/463136737 >> 172.21.15.89:0/463136737 conn(0x5586a18b7540 msgr2=0x5586a19d8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 -- 172.21.15.89:0/463136737 shutdown_connections 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 -- 172.21.15.89:0/463136737 wait complete. 2024-08-31T04:39:31.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 -- start start 2024-08-31T04:39:31.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.234+0000 7ffb977ed000 1 Processor -- start 2024-08-31T04:39:31.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19d5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19d5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5586a176c500 con 0x5586a1892890 2024-08-31T04:39:31.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5586a17e9bd0 con 0x5586a18a1930 2024-08-31T04:39:31.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5586a178da30 con 0x5586a18b7950 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 10 client.0 _ll_register_callbacks cb 0x5586a189bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8d600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19d5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8d600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19d5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58744/0 (socket says 172.21.15.89:58744) 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8d600640 1 -- 172.21.15.89:0/1868376759 learned_addr learned my addr 172.21.15.89:0/1868376759 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8e000640 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19d5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8d600640 1 -- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 msgr2=0x5586a19dfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8d600640 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19dfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8d600640 1 -- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 msgr2=0x5586a19d5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8d600640 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19d5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8d600640 1 -- 172.21.15.89:0/1868376759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586a17856a0 con 0x5586a1892890 2024-08-31T04:39:31.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19d5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8d600640 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19d5030 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c01d080 tx=0x7ffb7c0f8e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87067d3d5a249a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb6e000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:39:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb6e000640 1 -- 172.21.15.89:0/1868376759 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0c5040 con 0x5586a1892890 2024-08-31T04:39:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb6e000640 1 -- 172.21.15.89:0/1868376759 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ffb7c11e1d0 con 0x5586a1892890 2024-08-31T04:39:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 -- 172.21.15.89:0/1868376759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5586a177f7e0 con 0x5586a1892890 2024-08-31T04:39:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb6e000640 1 -- 172.21.15.89:0/1868376759 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ffb7c0f93f0 con 0x5586a1892890 2024-08-31T04:39:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 10 client.6345 fetch_fsmap learned FSMap version 9 2024-08-31T04:39:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 -- 172.21.15.89:0/1868376759 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5586a17a41c0 con 0x5586a1892890 2024-08-31T04:39:31.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb6e000640 1 -- 172.21.15.89:0/1868376759 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb7c117070 con 0x5586a1892890 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb6e000640 1 -- 172.21.15.89:0/1868376759 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ffb7c0f9650 con 0x5586a1892890 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 10 client.6345 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 10 client.6345 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 20 client.6345 populate_metadata read hostname 'smithi089' 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5586a187bfc0 0x5586a19e0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 4 client.6345 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb977ed000 1 -- 172.21.15.89:0/1868376759 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586a17f85e0 con 0x5586a187bfc0 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.238+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5586a187bfc0 0x5586a19e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5586a187bfc0 0x5586a19e0970 crc :-1 s=READY pgs=1594 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b03e643adf66d8e server_cookie=8e8d4cb103191bee in_seq=0 out_seq=0 2024-08-31T04:39:31.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb6e000640 10 client.6345 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:31.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb6e000640 1 -- 172.21.15.89:0/1868376759 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586a17f85e0 con 0x5586a187bfc0 2024-08-31T04:39:31.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb6e000640 10 client.6345 handle_command_reply: tid=0 2024-08-31T04:39:31.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 client.6345 shutdown 2024-08-31T04:39:31.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 -- 172.21.15.89:0/1868376759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 msgr2=0x5586a19d5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19d5030 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c01d080 tx=0x7ffb7c0f8e00 comp rx=0 tx=0).stop 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 -- 172.21.15.89:0/1868376759 shutdown_connections 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5586a187bfc0 0x5586a19e0970 crc :-1 s=READY pgs=1594 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19dfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19d5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb6e000640 0 client.6345 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1868376759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a1892890 0x5586a19d5030 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 -- 172.21.15.89:0/1868376759 >> 172.21.15.89:0/1868376759 conn(0x5586a18b7540 msgr2=0x5586a19d6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 -- 172.21.15.89:0/1868376759 shutdown_connections 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 1 -- 172.21.15.89:0/1868376759 wait complete. 2024-08-31T04:39:31.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.242+0000 7ffb977ed000 20 client.6345 trim_cache size 0 max 16384 2024-08-31T04:39:31.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb977ed000 1 Processor -- start 2024-08-31T04:39:31.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb977ed000 1 -- start start 2024-08-31T04:39:31.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a1892890 0x5586a19ded10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19df250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18b7950 0x5586a19ee380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb977ed000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88204b00 con 0x5586a18b7950 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb977ed000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffb882039e0 con 0x5586a18a1930 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb977ed000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffb88201f60 con 0x5586a1892890 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8e000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18b7950 0x5586a19ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8e000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18b7950 0x5586a19ee380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58746/0 (socket says 172.21.15.89:58746) 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8e000640 1 -- 172.21.15.89:0/1404987760 learned_addr learned my addr 172.21.15.89:0/1404987760 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19df250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8d600640 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a1892890 0x5586a19ded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8e000640 1 -- 172.21.15.89:0/1404987760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a1892890 msgr2=0x5586a19ded10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8e000640 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a1892890 0x5586a19ded10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8e000640 1 -- 172.21.15.89:0/1404987760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 msgr2=0x5586a19df250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:31.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8e000640 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19df250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8e000640 1 -- 172.21.15.89:0/1404987760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586a19dff40 con 0x5586a18b7950 2024-08-31T04:39:31.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19df250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:31.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb8e000640 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18b7950 0x5586a19ee380 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ffb800013e0 tx=0x7ffb880c2a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea4a4e1fbf8a698 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:31.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb79200640 1 -- 172.21.15.89:0/1404987760 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80022070 con 0x5586a18b7950 2024-08-31T04:39:31.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb79200640 1 -- 172.21.15.89:0/1404987760 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb8000e9b0 con 0x5586a18b7950 2024-08-31T04:39:31.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.262+0000 7ffb79200640 1 -- 172.21.15.89:0/1404987760 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000ee00 con 0x5586a18b7950 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 -- 172.21.15.89:0/1404987760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18b7950 msgr2=0x5586a19ee380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18b7950 0x5586a19ee380 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ffb800013e0 tx=0x7ffb880c2a90 comp rx=0 tx=0).stop 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 -- 172.21.15.89:0/1404987760 shutdown_connections 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18b7950 0x5586a19ee380 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a18a1930 0x5586a19df250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1404987760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a1892890 0x5586a19ded10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 -- 172.21.15.89:0/1404987760 >> 172.21.15.89:0/1404987760 conn(0x5586a18b7540 msgr2=0x5586a19964c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 -- 172.21.15.89:0/1404987760 shutdown_connections 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 -- 172.21.15.89:0/1404987760 wait complete. 2024-08-31T04:39:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 -- start start 2024-08-31T04:39:31.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 Processor -- start 2024-08-31T04:39:31.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a1892890 0x5586a19f1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18a1930 0x5586a19f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffb882025b0 con 0x5586a18a1930 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88203310 con 0x5586a1892890 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffb88202c40 con 0x5586a18b7950 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb977ed000 10 client.0 _ll_register_callbacks cb 0x7ffb7c0f52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18a1930 0x5586a19f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18a1930 0x5586a19f1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58748/0 (socket says 172.21.15.89:58748) 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8cc00640 1 -- 172.21.15.89:0/1066018417 learned_addr learned my addr 172.21.15.89:0/1066018417 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8d600640 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a1892890 0x5586a19f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8e000640 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8cc00640 1 -- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 msgr2=0x5586a19f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8cc00640 1 -- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a1892890 msgr2=0x5586a19f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a1892890 0x5586a19f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8cc00640 1 -- 172.21.15.89:0/1066018417 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586a186a2f0 con 0x5586a18a1930 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8e000640 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8d600640 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a1892890 0x5586a19f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb8cc00640 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18a1930 0x5586a19f1e60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ffb880b2400 tx=0x7ffb740011a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d30f40e3d0bc05a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.266+0000 7ffb6e000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb6e000640 1 -- 172.21.15.89:0/1066018417 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74016040 con 0x5586a18a1930 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb977ed000 1 -- 172.21.15.89:0/1066018417 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb8000e9b0 con 0x5586a18a1930 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb6e000640 1 -- 172.21.15.89:0/1066018417 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ffb74012bd0 con 0x5586a18a1930 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb6e000640 1 -- 172.21.15.89:0/1066018417 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ffb74012dd0 con 0x5586a18a1930 2024-08-31T04:39:31.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb977ed000 10 client.6351 fetch_fsmap learned FSMap version 9 2024-08-31T04:39:31.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb977ed000 1 -- 172.21.15.89:0/1066018417 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5586a176fb30 con 0x5586a18a1930 2024-08-31T04:39:31.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb6e000640 1 -- 172.21.15.89:0/1066018417 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb8000e9b0 con 0x5586a18a1930 2024-08-31T04:39:31.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb6e000640 1 -- 172.21.15.89:0/1066018417 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7ffb7403b080 con 0x5586a18a1930 2024-08-31T04:39:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb977ed000 10 client.6351 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:39:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb977ed000 10 client.6351 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:39:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb977ed000 20 client.6351 populate_metadata read hostname 'smithi089' 2024-08-31T04:39:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5586a1477e80 0x5586a1a5c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb977ed000 4 client.6351 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8dd3e564", "release": true, "await": true}] 2024-08-31T04:39:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb977ed000 1 -- 172.21.15.89:0/1066018417 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8dd3e564", "release": true, "await": true}) -- 0x5586a17f4080 con 0x5586a1477e80 2024-08-31T04:39:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb8d600640 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5586a1477e80 0x5586a1a5c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb8d600640 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5586a1477e80 0x5586a1a5c7b0 crc :-1 s=READY pgs=1595 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87b187f791e74ac6 server_cookie=f60d530471591b53 in_seq=0 out_seq=0 2024-08-31T04:39:31.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.270+0000 7ffb6e000640 10 client.6351 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb6e000640 1 -- 172.21.15.89:0/1066018417 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5586a17f4080 con 0x5586a1477e80 2024-08-31T04:39:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb6e000640 10 client.6351 handle_command_reply: tid=0 2024-08-31T04:39:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 client.6351 shutdown 2024-08-31T04:39:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 -- 172.21.15.89:0/1066018417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18a1930 msgr2=0x5586a19f1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18a1930 0x5586a19f1e60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ffb880b2400 tx=0x7ffb740011a0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 -- 172.21.15.89:0/1066018417 shutdown_connections 2024-08-31T04:39:31.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5586a1477e80 0x5586a1a5c7b0 crc :-1 s=READY pgs=1595 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586a18a1930 0x5586a19f1e60 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5586a18b7950 0x5586a19f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb6e000640 0 client.6351 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 --2- 172.21.15.89:0/1066018417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586a1892890 0x5586a19f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 -- 172.21.15.89:0/1066018417 >> 172.21.15.89:0/1066018417 conn(0x5586a18b7540 msgr2=0x5586a19eb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 -- 172.21.15.89:0/1066018417 shutdown_connections 2024-08-31T04:39:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 1 -- 172.21.15.89:0/1066018417 wait complete. 2024-08-31T04:39:31.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb977ed000 20 client.6351 trim_cache size 0 max 16384 2024-08-31T04:39:31.453 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 124, 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "8dd3e564": { 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 124, 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 140.5, 2024-08-31T04:39:31.454 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:31.455 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:39:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 -- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffb680720c0 msgr2=0x7ffb680745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffb680720c0 0x7ffb680745d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb881e82d0 tx=0x7ffb74006b20 comp rx=0 tx=0).stop 2024-08-31T04:39:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 -- 172.21.15.89:0/3268452099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 msgr2=0x7ffb8814dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 0x7ffb8814dbb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0ae040 tx=0x7ffb7c0050a0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 -- 172.21.15.89:0/3268452099 shutdown_connections 2024-08-31T04:39:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffb680720c0 0x7ffb680745d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb880c5ee0 0x7ffb880c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb88155900 0x7ffb881543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 --2- 172.21.15.89:0/3268452099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb70003a60 0x7ffb8814dbb0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 -- 172.21.15.89:0/3268452099 >> 172.21.15.89:0/3268452099 conn(0x7ffb880c99b0 msgr2=0x7ffb880c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:31.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 -- 172.21.15.89:0/3268452099 shutdown_connections 2024-08-31T04:39:31.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.450+0000 7ffb90000640 1 -- 172.21.15.89:0/3268452099 wait complete. 2024-08-31T04:39:31.474 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8dd3e564', total seconds elapsed: 21.3 2024-08-31T04:39:31.474 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-08-31T04:39:31.474 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:39:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 -- 172.21.15.89:0/3576483571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40c1f40 msgr2=0x7ffad40c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 --2- 172.21.15.89:0/3576483571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40c1f40 0x7ffad40c9330 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ffad40c9020 tx=0x7ffabc01f0d0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 -- 172.21.15.89:0/3576483571 shutdown_connections 2024-08-31T04:39:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 --2- 172.21.15.89:0/3576483571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40c1f40 0x7ffad40c9330 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 --2- 172.21.15.89:0/3576483571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffad415bc70 0x7ffad4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 -- 172.21.15.89:0/3576483571 >> 172.21.15.89:0/3576483571 conn(0x7ffad40ccf20 msgr2=0x7ffad40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 -- 172.21.15.89:0/3576483571 shutdown_connections 2024-08-31T04:39:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 -- 172.21.15.89:0/3576483571 wait complete. 2024-08-31T04:39:31.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 Processor -- start 2024-08-31T04:39:31.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.634+0000 7ffad9a00640 1 -- start start 2024-08-31T04:39:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad9a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffad40c1f40 0x7ffad415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad9a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffad40c7920 0x7ffad414f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad9a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad415bc70 0x7ffad414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad9a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4074fb0 con 0x7ffad415bc70 2024-08-31T04:39:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad9a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4074e30 con 0x7ffad40c1f40 2024-08-31T04:39:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad9a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffad40c7d30 con 0x7ffad40c7920 2024-08-31T04:39:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad415bc70 0x7ffad414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad415bc70 0x7ffad414b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40394/0 (socket says 172.21.15.89:40394) 2024-08-31T04:39:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad3400640 1 -- 172.21.15.89:0/812764417 learned_addr learned my addr 172.21.15.89:0/812764417 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffaca000640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffad40c7920 0x7ffad414f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad2a00640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffad40c1f40 0x7ffad415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad3400640 1 -- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffad40c7920 msgr2=0x7ffad414f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad3400640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffad40c7920 0x7ffad414f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad3400640 1 -- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffad40c1f40 msgr2=0x7ffad415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad3400640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffad40c1f40 0x7ffad415a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad3400640 1 -- 172.21.15.89:0/812764417 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad415ba30 con 0x7ffad415bc70 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad3400640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad415bc70 0x7ffad414b900 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00c6e0 tx=0x7ffacc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffacb400640 1 -- 172.21.15.89:0/812764417 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc003b80 con 0x7ffad415bc70 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffacb400640 1 -- 172.21.15.89:0/812764417 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffacc003d20 con 0x7ffad415bc70 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad40b1f10 con 0x7ffad415bc70 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffacb400640 1 -- 172.21.15.89:0/812764417 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc005330 con 0x7ffad415bc70 2024-08-31T04:39:31.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad415b510 con 0x7ffad415bc70 2024-08-31T04:39:31.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.638+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad40ccb50 con 0x7ffad415bc70 2024-08-31T04:39:31.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.642+0000 7ffacb400640 1 -- 172.21.15.89:0/812764417 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ffacc0054d0 con 0x7ffad415bc70 2024-08-31T04:39:31.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.642+0000 7ffacb400640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffab00720c0 0x7ffab00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:31.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.642+0000 7ffacb400640 1 -- 172.21.15.89:0/812764417 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ffacc092c20 con 0x7ffad415bc70 2024-08-31T04:39:31.644 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.642+0000 7ffad2a00640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffab00720c0 0x7ffab00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:31.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.642+0000 7ffad2a00640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffab00720c0 0x7ffab00745d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffac400bb50 tx=0x7ffac400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:31.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.646+0000 7ffacb400640 1 -- 172.21.15.89:0/812764417 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ffad40ccb50 con 0x7ffad415bc70 2024-08-31T04:39:31.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffad40c9330 con 0x7ffad415bc70 2024-08-31T04:39:31.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffacb400640 1 -- 172.21.15.89:0/812764417 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7ffacc05dab0 con 0x7ffad415bc70 2024-08-31T04:39:31.855 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:39:31.855 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:39:31.856 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffab00720c0 msgr2=0x7ffab00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffab00720c0 0x7ffab00745d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffac400bb50 tx=0x7ffac400b2e0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad415bc70 msgr2=0x7ffad414b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad415bc70 0x7ffad414b900 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00c6e0 tx=0x7ffacc00cba0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 shutdown_connections 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ffab00720c0 0x7ffab00745d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad415bc70 0x7ffad414b900 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffad40c7920 0x7ffad414f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 --2- 172.21.15.89:0/812764417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffad40c1f40 0x7ffad415a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:31.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 >> 172.21.15.89:0/812764417 conn(0x7ffad40ccf20 msgr2=0x7ffad4150200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 shutdown_connections 2024-08-31T04:39:31.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:31.854+0000 7ffad9a00640 1 -- 172.21.15.89:0/812764417 wait complete. 2024-08-31T04:39:31.878 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-08-31T04:39:31.878 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-08-31T04:39:32.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.054+0000 7fdc52000640 1 -- 172.21.15.89:0/2193638957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c074d50 msgr2=0x7fdc4c15a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:32.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.054+0000 7fdc52000640 1 --2- 172.21.15.89:0/2193638957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c074d50 0x7fdc4c15a120 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0734a0 tx=0x7fdc3c01c8c0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.054+0000 7fdc52000640 1 -- 172.21.15.89:0/2193638957 shutdown_connections 2024-08-31T04:39:32.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.054+0000 7fdc52000640 1 --2- 172.21.15.89:0/2193638957 >> v2:172.21.15.170:3300/0 conn(0x7fdc4c153800 0x7fdc4c074390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.054+0000 7fdc52000640 1 --2- 172.21.15.89:0/2193638957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c074d50 0x7fdc4c15a120 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.054+0000 7fdc52000640 1 -- 172.21.15.89:0/2193638957 >> 172.21.15.89:0/2193638957 conn(0x7fdc4c0c99b0 msgr2=0x7fdc4c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:32.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.054+0000 7fdc52000640 1 -- 172.21.15.89:0/2193638957 shutdown_connections 2024-08-31T04:39:32.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.054+0000 7fdc52000640 1 -- 172.21.15.89:0/2193638957 wait complete. 2024-08-31T04:39:32.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc52000640 1 Processor -- start 2024-08-31T04:39:32.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc52000640 1 -- start start 2024-08-31T04:39:32.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc52000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc4c06f3f0 0x7fdc4c14f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc52000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc4c074d50 0x7fdc4c0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc52000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c153800 0x7fdc4c0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc52000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c06fc10 con 0x7fdc4c153800 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc52000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c073e70 con 0x7fdc4c06f3f0 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc52000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4c069fc0 con 0x7fdc4c074d50 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c153800 0x7fdc4c0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c153800 0x7fdc4c0c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40422/0 (socket says 172.21.15.89:40422) 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4be00640 1 -- 172.21.15.89:0/3760504577 learned_addr learned my addr 172.21.15.89:0/3760504577 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4aa00640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc4c074d50 0x7fdc4c0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4b400640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc4c06f3f0 0x7fdc4c14f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4be00640 1 -- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc4c074d50 msgr2=0x7fdc4c0c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4be00640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc4c074d50 0x7fdc4c0c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4be00640 1 -- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc4c06f3f0 msgr2=0x7fdc4c14f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:32.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4be00640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc4c06f3f0 0x7fdc4c14f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4be00640 1 -- 172.21.15.89:0/3760504577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c1641e0 con 0x7fdc4c153800 2024-08-31T04:39:32.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc4be00640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c153800 0x7fdc4c0c75a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c6b0 tx=0x7fdc4400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:32.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc43400640 1 -- 172.21.15.89:0/3760504577 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44017070 con 0x7fdc4c153800 2024-08-31T04:39:32.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc43400640 1 -- 172.21.15.89:0/3760504577 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc44003c70 con 0x7fdc4c153800 2024-08-31T04:39:32.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc43400640 1 -- 172.21.15.89:0/3760504577 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44005350 con 0x7fdc4c153800 2024-08-31T04:39:32.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.058+0000 7fdc52000640 1 -- 172.21.15.89:0/3760504577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4c15ca00 con 0x7fdc4c153800 2024-08-31T04:39:32.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.062+0000 7fdc52000640 1 -- 172.21.15.89:0/3760504577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4c159fb0 con 0x7fdc4c153800 2024-08-31T04:39:32.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.062+0000 7fdc43400640 1 -- 172.21.15.89:0/3760504577 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdc4401a070 con 0x7fdc4c153800 2024-08-31T04:39:32.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.062+0000 7fdc43400640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc2c0720c0 0x7fdc2c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.062+0000 7fdc43400640 1 -- 172.21.15.89:0/3760504577 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdc44092510 con 0x7fdc4c153800 2024-08-31T04:39:32.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.062+0000 7fdc59721000 1 Processor -- start 2024-08-31T04:39:32.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.062+0000 7fdc4b400640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc2c0720c0 0x7fdc2c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.062+0000 7fdc59721000 1 -- start start 2024-08-31T04:39:32.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4b400640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc2c0720c0 0x7fdc2c0745d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0af000 tx=0x7fdc3c01b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af18d3f0 0x5631af2c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af182e90 0x5631af28fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af290220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5631af0e5820 con 0x5631af16c960 2024-08-31T04:39:32.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5631af0d4db0 con 0x5631af182e90 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5631af0d8d60 con 0x5631af18d3f0 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af290220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af290220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40428/0 (socket says 172.21.15.89:40428) 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4be00640 1 -- 172.21.15.89:0/1815175887 learned_addr learned my addr 172.21.15.89:0/1815175887 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4b400640 1 --2- 172.21.15.89:0/1815175887 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af18d3f0 0x5631af2c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4aa00640 1 --2- 172.21.15.89:0/1815175887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af182e90 0x5631af28fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4be00640 1 -- 172.21.15.89:0/1815175887 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af18d3f0 msgr2=0x5631af2c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4be00640 1 --2- 172.21.15.89:0/1815175887 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af18d3f0 0x5631af2c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4be00640 1 -- 172.21.15.89:0/1815175887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af182e90 msgr2=0x5631af28fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4be00640 1 --2- 172.21.15.89:0/1815175887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af182e90 0x5631af28fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4be00640 1 -- 172.21.15.89:0/1815175887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631af06fb70 con 0x5631af16c960 2024-08-31T04:39:32.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc4be00640 1 --2- 172.21.15.89:0/1815175887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af290220 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fdc440594b0 tx=0x7fdc4405cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f126f550a4e67bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc37400640 1 -- 172.21.15.89:0/1815175887 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44066610 con 0x5631af16c960 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc37400640 1 -- 172.21.15.89:0/1815175887 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc440596c0 con 0x5631af16c960 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc37400640 1 -- 172.21.15.89:0/1815175887 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44066180 con 0x5631af16c960 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 -- 172.21.15.89:0/1815175887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 msgr2=0x5631af290220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 --2- 172.21.15.89:0/1815175887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af290220 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fdc440594b0 tx=0x7fdc4405cc60 comp rx=0 tx=0).stop 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 -- 172.21.15.89:0/1815175887 shutdown_connections 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 --2- 172.21.15.89:0/1815175887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af290220 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 --2- 172.21.15.89:0/1815175887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af182e90 0x5631af28fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 --2- 172.21.15.89:0/1815175887 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af18d3f0 0x5631af2c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 -- 172.21.15.89:0/1815175887 >> 172.21.15.89:0/1815175887 conn(0x5631aed94210 msgr2=0x5631af2c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 -- 172.21.15.89:0/1815175887 shutdown_connections 2024-08-31T04:39:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.066+0000 7fdc59721000 1 -- 172.21.15.89:0/1815175887 wait complete. 2024-08-31T04:39:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc59721000 1 -- start start 2024-08-31T04:39:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc59721000 1 Processor -- start 2024-08-31T04:39:32.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc59721000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc59721000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af2c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc59721000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 0x5631af2c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc59721000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5631aed9bb10 con 0x5631af16c960 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc59721000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5631af05b6f0 con 0x5631af18d3f0 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc59721000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5631af0dd390 con 0x5631af182e90 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc59721000 10 client.0 _ll_register_callbacks cb 0x5631af07cb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40438/0 (socket says 172.21.15.89:40438) 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4b400640 1 -- 172.21.15.89:0/293866658 learned_addr learned my addr 172.21.15.89:0/293866658 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4be00640 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 0x5631af2c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4aa00640 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af2c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4b400640 1 -- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 msgr2=0x5631af2c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4b400640 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af2c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4b400640 1 -- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 msgr2=0x5631af2c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:32.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4b400640 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 0x5631af2c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4b400640 1 -- 172.21.15.89:0/293866658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631af093380 con 0x5631af16c960 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc4b400640 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2c58f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0b0040 tx=0x7fdc3c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a81a0c07ee72fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc2be00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.070+0000 7fdc2be00640 1 -- 172.21.15.89:0/293866658 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0bf040 con 0x5631af16c960 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc59721000 1 -- 172.21.15.89:0/293866658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5631af0e3d20 con 0x5631af16c960 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc2be00640 1 -- 172.21.15.89:0/293866658 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdc3c004990 con 0x5631af16c960 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc2be00640 1 -- 172.21.15.89:0/293866658 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdc3c0b2040 con 0x5631af16c960 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc59721000 10 client.6372 fetch_fsmap learned FSMap version 9 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc59721000 1 -- 172.21.15.89:0/293866658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5631af159e40 con 0x5631af16c960 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc2be00640 1 -- 172.21.15.89:0/293866658 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5631af0e3d20 con 0x5631af16c960 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc2be00640 1 -- 172.21.15.89:0/293866658 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdc3c004bd0 con 0x5631af16c960 2024-08-31T04:39:32.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc59721000 10 client.6372 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:39:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc59721000 10 client.6372 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:39:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc59721000 20 client.6372 populate_metadata read hostname 'smithi089' 2024-08-31T04:39:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc59721000 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5631aed78dc0 0x5631af2e0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc59721000 4 client.6372 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:39:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc59721000 1 -- 172.21.15.89:0/293866658 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631af0e7770 con 0x5631aed78dc0 2024-08-31T04:39:32.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc4aa00640 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5631aed78dc0 0x5631af2e0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc4aa00640 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5631aed78dc0 0x5631af2e0f90 crc :-1 s=READY pgs=1597 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f716b9700d79b9f6 server_cookie=6f52c36687eba990 in_seq=0 out_seq=0 2024-08-31T04:39:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.074+0000 7fdc2be00640 10 client.6372 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc2be00640 1 -- 172.21.15.89:0/293866658 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631af0e7770 con 0x5631aed78dc0 2024-08-31T04:39:32.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc2be00640 10 client.6372 handle_command_reply: tid=0 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 client.6372 shutdown 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 -- 172.21.15.89:0/293866658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 msgr2=0x5631af2c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2c58f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0b0040 tx=0x7fdc3c009260 comp rx=0 tx=0).stop 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 -- 172.21.15.89:0/293866658 shutdown_connections 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5631aed78dc0 0x5631af2e0f90 crc :-1 s=READY pgs=1597 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 0x5631af2c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af2c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc2be00640 0 client.6372 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 --2- 172.21.15.89:0/293866658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2c58f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 -- 172.21.15.89:0/293866658 >> 172.21.15.89:0/293866658 conn(0x5631aed94210 msgr2=0x5631af2c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 -- 172.21.15.89:0/293866658 shutdown_connections 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 1 -- 172.21.15.89:0/293866658 wait complete. 2024-08-31T04:39:32.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.078+0000 7fdc59721000 20 client.6372 trim_cache size 0 max 16384 2024-08-31T04:39:32.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.094+0000 7fdc59721000 1 Processor -- start 2024-08-31T04:39:32.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.094+0000 7fdc59721000 1 -- start start 2024-08-31T04:39:32.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af16c960 0x5631af288fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af28f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af18d3f0 0x5631af28fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c1f9540 con 0x5631af18d3f0 2024-08-31T04:39:32.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c202790 con 0x5631af16c960 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4c201a60 con 0x5631af182e90 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af18d3f0 0x5631af28fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af18d3f0 0x5631af28fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40454/0 (socket says 172.21.15.89:40454) 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4be00640 1 -- 172.21.15.89:0/2768658314 learned_addr learned my addr 172.21.15.89:0/2768658314 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4aa00640 1 --2- 172.21.15.89:0/2768658314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af28f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4b400640 1 --2- 172.21.15.89:0/2768658314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af16c960 0x5631af288fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4be00640 1 -- 172.21.15.89:0/2768658314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 msgr2=0x5631af28f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4be00640 1 --2- 172.21.15.89:0/2768658314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af28f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4be00640 1 -- 172.21.15.89:0/2768658314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af16c960 msgr2=0x5631af288fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4be00640 1 --2- 172.21.15.89:0/2768658314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af16c960 0x5631af288fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4be00640 1 -- 172.21.15.89:0/2768658314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631af1315b0 con 0x5631af18d3f0 2024-08-31T04:39:32.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc4be00640 1 --2- 172.21.15.89:0/2768658314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af18d3f0 0x5631af28fd00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fdc4405a6a0 tx=0x7fdc44064040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c61d3362382f89 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:32.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc36a00640 1 -- 172.21.15.89:0/2768658314 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44082220 con 0x5631af18d3f0 2024-08-31T04:39:32.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc36a00640 1 -- 172.21.15.89:0/2768658314 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc44082070 con 0x5631af18d3f0 2024-08-31T04:39:32.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc36a00640 1 -- 172.21.15.89:0/2768658314 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44092110 con 0x5631af18d3f0 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 -- 172.21.15.89:0/2768658314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af18d3f0 msgr2=0x5631af28fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 --2- 172.21.15.89:0/2768658314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af18d3f0 0x5631af28fd00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fdc4405a6a0 tx=0x7fdc44064040 comp rx=0 tx=0).stop 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 -- 172.21.15.89:0/2768658314 shutdown_connections 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 --2- 172.21.15.89:0/2768658314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af18d3f0 0x5631af28fd00 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 --2- 172.21.15.89:0/2768658314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af28f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 --2- 172.21.15.89:0/2768658314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af16c960 0x5631af288fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 -- 172.21.15.89:0/2768658314 >> 172.21.15.89:0/2768658314 conn(0x5631aed94210 msgr2=0x5631af2882a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 -- 172.21.15.89:0/2768658314 shutdown_connections 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 -- 172.21.15.89:0/2768658314 wait complete. 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 -- start start 2024-08-31T04:39:32.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.098+0000 7fdc59721000 1 Processor -- start 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2e4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af2e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 0x5631af2e4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5631af056eb0 con 0x5631af16c960 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c2020c0 con 0x5631af18d3f0 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5631af07cf20 con 0x5631af182e90 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 10 client.0 _ll_register_callbacks cb 0x7fdc3c0041a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2e4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2e4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40456/0 (socket says 172.21.15.89:40456) 2024-08-31T04:39:32.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4b400640 1 -- 172.21.15.89:0/1904209896 learned_addr learned my addr 172.21.15.89:0/1904209896 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4aa00640 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af2e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4be00640 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 0x5631af2e4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4b400640 1 -- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 msgr2=0x5631af2e4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4b400640 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af2e4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4b400640 1 -- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 msgr2=0x5631af2e4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4b400640 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 0x5631af2e4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4b400640 1 -- 172.21.15.89:0/1904209896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631af065fc0 con 0x5631af16c960 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4be00640 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 0x5631af2e4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4b400640 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2e4530 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000c10 tx=0x7fdc3c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1566a49bb61fe9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc2be00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc2be00640 1 -- 172.21.15.89:0/1904209896 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0da060 con 0x5631af16c960 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc2be00640 1 -- 172.21.15.89:0/1904209896 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdc3c0a5c60 con 0x5631af16c960 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 -- 172.21.15.89:0/1904209896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc44082070 con 0x5631af16c960 2024-08-31T04:39:32.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc2be00640 1 -- 172.21.15.89:0/1904209896 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdc3c0e0050 con 0x5631af16c960 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 10 client.6378 fetch_fsmap learned FSMap version 9 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 -- 172.21.15.89:0/1904209896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5631af05ee00 con 0x5631af16c960 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc2be00640 1 -- 172.21.15.89:0/1904209896 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc44082070 con 0x5631af16c960 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc2be00640 1 -- 172.21.15.89:0/1904209896 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdc3c0e3020 con 0x5631af16c960 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 10 client.6378 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 10 client.6378 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 20 client.6378 populate_metadata read hostname 'smithi089' 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5631aed66e20 0x5631af2e54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 4 client.6378 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc59721000 1 -- 172.21.15.89:0/1904209896 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x5631af0e3210 con 0x5631aed66e20 2024-08-31T04:39:32.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.102+0000 7fdc4aa00640 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5631aed66e20 0x5631af2e54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:32.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.106+0000 7fdc4aa00640 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5631aed66e20 0x5631af2e54f0 crc :-1 s=READY pgs=1598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=149041d8c3656a79 server_cookie=1c9f0136a395dde9 in_seq=0 out_seq=0 2024-08-31T04:39:32.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:32.106+0000 7fdc2be00640 10 client.6378 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:33.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc2be00640 1 -- 172.21.15.89:0/1904209896 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5631af0e3210 con 0x5631aed66e20 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc2be00640 10 client.6378 handle_command_reply: tid=0 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 client.6378 shutdown 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 -- 172.21.15.89:0/1904209896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 msgr2=0x5631af2e4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2e4530 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000c10 tx=0x7fdc3c0045e0 comp rx=0 tx=0).stop 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 -- 172.21.15.89:0/1904209896 shutdown_connections 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5631aed66e20 0x5631af2e54f0 crc :-1 s=READY pgs=1598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631af18d3f0 0x5631af2e4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631af182e90 0x5631af2e4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 --2- 172.21.15.89:0/1904209896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5631af16c960 0x5631af2e4530 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 -- 172.21.15.89:0/1904209896 >> 172.21.15.89:0/1904209896 conn(0x5631aed94210 msgr2=0x5631af2882a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc2be00640 0 client.6378 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:33.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 -- 172.21.15.89:0/1904209896 shutdown_connections 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.622+0000 7fdc59721000 1 -- 172.21.15.89:0/1904209896 wait complete. 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc59721000 20 client.6378 trim_cache size 0 max 16384 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 126, 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "2e438c9e": { 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 126, 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:39:33.628 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 140.5, 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:33.629 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:33.630 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:39:33.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 -- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc2c0720c0 msgr2=0x7fdc2c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:33.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc2c0720c0 0x7fdc2c0745d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0af000 tx=0x7fdc3c01b100 comp rx=0 tx=0).stop 2024-08-31T04:39:33.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 -- 172.21.15.89:0/3760504577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c153800 msgr2=0x7fdc4c0c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:33.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c153800 0x7fdc4c0c75a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400c6b0 tx=0x7fdc4400cb70 comp rx=0 tx=0).stop 2024-08-31T04:39:33.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 -- 172.21.15.89:0/3760504577 shutdown_connections 2024-08-31T04:39:33.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc2c0720c0 0x7fdc2c0745d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:33.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc4c153800 0x7fdc4c0c75a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:33.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc4c074d50 0x7fdc4c0c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:33.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 --2- 172.21.15.89:0/3760504577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc4c06f3f0 0x7fdc4c14f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:33.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 -- 172.21.15.89:0/3760504577 >> 172.21.15.89:0/3760504577 conn(0x7fdc4c0c99b0 msgr2=0x7fdc4c0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:33.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 -- 172.21.15.89:0/3760504577 shutdown_connections 2024-08-31T04:39:33.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:33.626+0000 7fdc52000640 1 -- 172.21.15.89:0/3760504577 wait complete. 2024-08-31T04:39:33.647 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2e438c9e', quiesce took 2.2 seconds. Will release after: 18.3 2024-08-31T04:39:51.948 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:39:52.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.101+0000 7fd531c00640 1 -- 172.21.15.89:0/3471726648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c15bc70 msgr2=0x7fd52c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.101+0000 7fd531c00640 1 --2- 172.21.15.89:0/3471726648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c15bc70 0x7fd52c152a10 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd52c070b70 tx=0x7fd51c01eff0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.101+0000 7fd531c00640 1 -- 172.21.15.89:0/3471726648 shutdown_connections 2024-08-31T04:39:52.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.101+0000 7fd531c00640 1 --2- 172.21.15.89:0/3471726648 >> v2:172.21.15.170:3300/0 conn(0x7fd52c0c1f40 0x7fd52c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.101+0000 7fd531c00640 1 --2- 172.21.15.89:0/3471726648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c15bc70 0x7fd52c152a10 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.101+0000 7fd531c00640 1 -- 172.21.15.89:0/3471726648 >> 172.21.15.89:0/3471726648 conn(0x7fd52c0ccf20 msgr2=0x7fd52c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:52.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.101+0000 7fd531c00640 1 -- 172.21.15.89:0/3471726648 shutdown_connections 2024-08-31T04:39:52.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.101+0000 7fd531c00640 1 -- 172.21.15.89:0/3471726648 wait complete. 2024-08-31T04:39:52.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 Processor -- start 2024-08-31T04:39:52.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 -- start start 2024-08-31T04:39:52.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0c1f40 0x7fd52c14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c0c7920 0x7fd52c074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd52c15bc70 0x7fd52c14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c074fb0 con 0x7fd52c0c1f40 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c074e30 con 0x7fd52c0c7920 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd52c0c7d30 con 0x7fd52c15bc70 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0c1f40 0x7fd52c14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0c1f40 0x7fd52c14f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49506/0 (socket says 172.21.15.89:49506) 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52aa00640 1 -- 172.21.15.89:0/3033753202 learned_addr learned my addr 172.21.15.89:0/3033753202 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd522000640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c0c7920 0x7fd52c074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52b400640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd52c15bc70 0x7fd52c14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52aa00640 1 -- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd52c15bc70 msgr2=0x7fd52c14b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52aa00640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd52c15bc70 0x7fd52c14b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52aa00640 1 -- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c0c7920 msgr2=0x7fd52c074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52aa00640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c0c7920 0x7fd52c074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52aa00640 1 -- 172.21.15.89:0/3033753202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52c155e10 con 0x7fd52c0c1f40 2024-08-31T04:39:52.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52b400640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd52c15bc70 0x7fd52c14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:39:52.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd52aa00640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0c1f40 0x7fd52c14f0b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009790 tx=0x7fd51c0a8c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:52.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd523400640 1 -- 172.21.15.89:0/3033753202 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0bf070 con 0x7fd52c0c1f40 2024-08-31T04:39:52.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd523400640 1 -- 172.21.15.89:0/3033753202 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd51c0053e0 con 0x7fd52c0c1f40 2024-08-31T04:39:52.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd523400640 1 -- 172.21.15.89:0/3033753202 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0b5040 con 0x7fd52c0c1f40 2024-08-31T04:39:52.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd52c154220 con 0x7fd52c0c1f40 2024-08-31T04:39:52.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.105+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd52c14eb90 con 0x7fd52c0c1f40 2024-08-31T04:39:52.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.109+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd52c14e980 con 0x7fd52c0c1f40 2024-08-31T04:39:52.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.109+0000 7fd523400640 1 -- 172.21.15.89:0/3033753202 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd51c0046d0 con 0x7fd52c0c1f40 2024-08-31T04:39:52.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.109+0000 7fd523400640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5080720f0 0x7fd508074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.109+0000 7fd523400640 1 -- 172.21.15.89:0/3033753202 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fd51c12ff00 con 0x7fd52c0c1f40 2024-08-31T04:39:52.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.109+0000 7fd522000640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5080720f0 0x7fd508074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.109+0000 7fd522000640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5080720f0 0x7fd508074600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd514005fd0 tx=0x7fd514005ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:52.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.113+0000 7fd523400640 1 -- 172.21.15.89:0/3033753202 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd51c018b50 con 0x7fd52c0c1f40 2024-08-31T04:39:52.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd52c0c9330 con 0x7fd52c0c1f40 2024-08-31T04:39:52.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd523400640 1 -- 172.21.15.89:0/3033753202 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fd51c0fb620 con 0x7fd52c0c1f40 2024-08-31T04:39:52.316 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:39:52.316 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:39:52.316 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:39:52.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5080720f0 msgr2=0x7fd508074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5080720f0 0x7fd508074600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd514005fd0 tx=0x7fd514005ea0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0c1f40 msgr2=0x7fd52c14f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0c1f40 0x7fd52c14f0b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009790 tx=0x7fd51c0a8c00 comp rx=0 tx=0).stop 2024-08-31T04:39:52.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 shutdown_connections 2024-08-31T04:39:52.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd5080720f0 0x7fd508074600 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd52c15bc70 0x7fd52c14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c0c7920 0x7fd52c074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 --2- 172.21.15.89:0/3033753202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd52c0c1f40 0x7fd52c14f0b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 >> 172.21.15.89:0/3033753202 conn(0x7fd52c0ccf20 msgr2=0x7fd52c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:52.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 shutdown_connections 2024-08-31T04:39:52.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.313+0000 7fd531c00640 1 -- 172.21.15.89:0/3033753202 wait complete. 2024-08-31T04:39:52.338 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id 2e438c9e --release --await' 2024-08-31T04:39:52.338 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id 2e438c9e --release --await 2024-08-31T04:39:52.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.497+0000 7f11b8400640 1 -- 172.21.15.89:0/3941954454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2d20 msgr2=0x7f11b00c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.497+0000 7f11b8400640 1 --2- 172.21.15.89:0/3941954454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2d20 0x7f11b00c1ed0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f119c009900 tx=0x7f119c01c850 comp rx=0 tx=0).stop 2024-08-31T04:39:52.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.497+0000 7f11b8400640 1 -- 172.21.15.89:0/3941954454 shutdown_connections 2024-08-31T04:39:52.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.497+0000 7f11b8400640 1 --2- 172.21.15.89:0/3941954454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2d20 0x7f11b00c1ed0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.497+0000 7f11b8400640 1 -- 172.21.15.89:0/3941954454 >> 172.21.15.89:0/3941954454 conn(0x7f11b00c99b0 msgr2=0x7f11b00c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:52.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.497+0000 7f11b8400640 1 -- 172.21.15.89:0/3941954454 shutdown_connections 2024-08-31T04:39:52.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.497+0000 7f11b8400640 1 -- 172.21.15.89:0/3941954454 wait complete. 2024-08-31T04:39:52.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.497+0000 7f11b8400640 1 Processor -- start 2024-08-31T04:39:52.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.497+0000 7f11b8400640 1 -- start start 2024-08-31T04:39:52.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b8400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2860 0x7f11b0161340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b8400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b00b2d20 0x7f11b0147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b8400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11b00c90e0 0x7f11b0147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b8400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f11b00c2670 con 0x7f11b00b2860 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b8400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f11b00c8c50 con 0x7f11b00b2d20 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b8400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f11b0166780 con 0x7f11b00c90e0 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2860 0x7f11b0161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2860 0x7f11b0161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49520/0 (socket says 172.21.15.89:49520) 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5a00640 1 -- 172.21.15.89:0/4254503870 learned_addr learned my addr 172.21.15.89:0/4254503870 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5000640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b00b2d20 0x7f11b0147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b6400640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11b00c90e0 0x7f11b0147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5a00640 1 -- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11b00c90e0 msgr2=0x7f11b0147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.505 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5a00640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11b00c90e0 0x7f11b0147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5a00640 1 -- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b00b2d20 msgr2=0x7f11b0147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5a00640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b00b2d20 0x7f11b0147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5a00640 1 -- 172.21.15.89:0/4254503870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b0161880 con 0x7f11b00b2860 2024-08-31T04:39:52.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b6400640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11b00c90e0 0x7f11b0147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:39:52.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b5a00640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2860 0x7f11b0161340 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c3c0 tx=0x7f11a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:52.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11ad600640 1 -- 172.21.15.89:0/4254503870 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4017070 con 0x7f11b00b2860 2024-08-31T04:39:52.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11ad600640 1 -- 172.21.15.89:0/4254503870 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a40053c0 con 0x7f11b00b2860 2024-08-31T04:39:52.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b8400640 1 -- 172.21.15.89:0/4254503870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b014d630 con 0x7f11b00b2860 2024-08-31T04:39:52.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11ad600640 1 -- 172.21.15.89:0/4254503870 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4003860 con 0x7f11b00b2860 2024-08-31T04:39:52.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.501+0000 7f11b8400640 1 -- 172.21.15.89:0/4254503870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b014c720 con 0x7f11b00b2860 2024-08-31T04:39:52.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11ad600640 1 -- 172.21.15.89:0/4254503870 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f11a401a070 con 0x7f11b00b2860 2024-08-31T04:39:52.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11ad600640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11900720c0 0x7f11900745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.507 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11ad600640 1 -- 172.21.15.89:0/4254503870 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f11a4092220 con 0x7f11b00b2860 2024-08-31T04:39:52.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5000640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11900720c0 0x7f11900745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11bf9b3000 1 Processor -- start 2024-08-31T04:39:52.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11bf9b3000 1 -- start start 2024-08-31T04:39:52.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5000640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11900720c0 0x7f11900745d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f119c0af000 tx=0x7f119c01b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:52.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1f5950 0x55e2ed313e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1df930 0x55e2ed318ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 0x55e2ed319010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e2ed1bef30 con 0x55e2ed1f5950 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e2ed134690 con 0x55e2ed1d0890 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e2ed123c20 con 0x55e2ed1df930 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1f5950 0x55e2ed313e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1f5950 0x55e2ed313e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49530/0 (socket says 172.21.15.89:49530) 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5a00640 1 -- 172.21.15.89:0/1800202908 learned_addr learned my addr 172.21.15.89:0/1800202908 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5000640 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1df930 0x55e2ed318ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b6400640 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 0x55e2ed319010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5a00640 1 -- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1df930 msgr2=0x55e2ed318ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:52.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5a00640 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1df930 0x55e2ed318ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5a00640 1 -- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 msgr2=0x55e2ed319010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:52.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5a00640 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 0x55e2ed319010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5a00640 1 -- 172.21.15.89:0/1800202908 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2ed0d88f0 con 0x55e2ed1f5950 2024-08-31T04:39:52.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b6400640 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 0x55e2ed319010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:39:52.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.505+0000 7f11b5000640 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1df930 0x55e2ed318ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:39:52.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11b5a00640 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1f5950 0x55e2ed313e30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f11a4090310 tx=0x7f11a405cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289f4d55c29fc82e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:52.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11a2000640 1 -- 172.21.15.89:0/1800202908 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4061990 con 0x55e2ed1f5950 2024-08-31T04:39:52.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11a2000640 1 -- 172.21.15.89:0/1800202908 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a40663b0 con 0x55e2ed1f5950 2024-08-31T04:39:52.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11a2000640 1 -- 172.21.15.89:0/1800202908 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a405c630 con 0x55e2ed1f5950 2024-08-31T04:39:52.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 -- 172.21.15.89:0/1800202908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1f5950 msgr2=0x55e2ed313e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1f5950 0x55e2ed313e30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f11a4090310 tx=0x7f11a405cce0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 -- 172.21.15.89:0/1800202908 shutdown_connections 2024-08-31T04:39:52.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 0x55e2ed319010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1df930 0x55e2ed318ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/1800202908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1f5950 0x55e2ed313e30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 -- 172.21.15.89:0/1800202908 >> 172.21.15.89:0/1800202908 conn(0x55e2ed1f5540 msgr2=0x55e2ed316890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 -- 172.21.15.89:0/1800202908 shutdown_connections 2024-08-31T04:39:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 -- 172.21.15.89:0/1800202908 wait complete. 2024-08-31T04:39:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 -- start start 2024-08-31T04:39:52.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 Processor -- start 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 0x55e2ed312c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed313150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1f5950 0x55e2ed313690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e2ed0aa500 con 0x55e2ed1df930 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e2ed127bd0 con 0x55e2ed1d0890 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e2ed0cba30 con 0x55e2ed1f5950 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.509+0000 7f11bf9b3000 10 client.0 _ll_register_callbacks cb 0x55e2ed1d9b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed313150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed313150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49544/0 (socket says 172.21.15.89:49544) 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5000640 1 -- 172.21.15.89:0/3778975374 learned_addr learned my addr 172.21.15.89:0/3778975374 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b6400640 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1f5950 0x55e2ed313690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5a00640 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 0x55e2ed312c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5000640 1 -- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1f5950 msgr2=0x55e2ed313690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5000640 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1f5950 0x55e2ed313690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5000640 1 -- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 msgr2=0x55e2ed312c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5000640 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 0x55e2ed312c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5000640 1 -- 172.21.15.89:0/3778975374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2ed0c36a0 con 0x55e2ed1df930 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5000640 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed313150 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f119c01a480 tx=0x7f119c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2352e515a131a54 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f1196a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f1196a00640 1 -- 172.21.15.89:0/3778975374 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0c8060 con 0x55e2ed1df930 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f1196a00640 1 -- 172.21.15.89:0/3778975374 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f119c005540 con 0x55e2ed1df930 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3778975374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e2ed0bd7e0 con 0x55e2ed1df930 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f1196a00640 1 -- 172.21.15.89:0/3778975374 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f119c0ce050 con 0x55e2ed1df930 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11bf9b3000 10 client.6402 fetch_fsmap learned FSMap version 9 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3778975374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e2ed0e21c0 con 0x55e2ed1df930 2024-08-31T04:39:52.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f1196a00640 1 -- 172.21.15.89:0/3778975374 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e2ed0bd7e0 con 0x55e2ed1df930 2024-08-31T04:39:52.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f1196a00640 1 -- 172.21.15.89:0/3778975374 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f119c0d1020 con 0x55e2ed1df930 2024-08-31T04:39:52.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11bf9b3000 10 client.6402 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:39:52.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11bf9b3000 10 client.6402 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:39:52.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11bf9b3000 20 client.6402 populate_metadata read hostname 'smithi089' 2024-08-31T04:39:52.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e2ed1b9fc0 0x55e2ed32e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11bf9b3000 4 client.6402 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:39:52.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3778975374 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2ed1365e0 con 0x55e2ed1b9fc0 2024-08-31T04:39:52.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5a00640 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e2ed1b9fc0 0x55e2ed32e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f11b5a00640 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e2ed1b9fc0 0x55e2ed32e010 crc :-1 s=READY pgs=1601 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce85f0e8bd020109 server_cookie=bb7c6135d7b5891d in_seq=0 out_seq=0 2024-08-31T04:39:52.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.513+0000 7f1196a00640 10 client.6402 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:52.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f1196a00640 1 -- 172.21.15.89:0/3778975374 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2ed1365e0 con 0x55e2ed1b9fc0 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f1196a00640 10 client.6402 handle_command_reply: tid=0 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 client.6402 shutdown 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3778975374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 msgr2=0x55e2ed313150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed313150 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f119c01a480 tx=0x7f119c009260 comp rx=0 tx=0).stop 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3778975374 shutdown_connections 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e2ed1b9fc0 0x55e2ed32e010 crc :-1 s=READY pgs=1601 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed313150 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1f5950 0x55e2ed313690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f1196a00640 0 client.6402 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3778975374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1d0890 0x55e2ed312c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3778975374 >> 172.21.15.89:0/3778975374 conn(0x55e2ed1f5540 msgr2=0x55e2ed314040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3778975374 shutdown_connections 2024-08-31T04:39:52.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3778975374 wait complete. 2024-08-31T04:39:52.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.517+0000 7f11bf9b3000 20 client.6402 trim_cache size 0 max 16384 2024-08-31T04:39:52.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.533+0000 7f11bf9b3000 1 Processor -- start 2024-08-31T04:39:52.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.533+0000 7f11bf9b3000 1 -- start start 2024-08-31T04:39:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 0x55e2ed331890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed2d7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 0x55e2ed2d7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0204190 con 0x55e2ed1df930 2024-08-31T04:39:52.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0203070 con 0x55e2ed1f5950 2024-08-31T04:39:52.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f11b02015d0 con 0x55e2ed1d0890 2024-08-31T04:39:52.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed2d7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed2d7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49556/0 (socket says 172.21.15.89:49556) 2024-08-31T04:39:52.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5000640 1 -- 172.21.15.89:0/3804375143 learned_addr learned my addr 172.21.15.89:0/3804375143 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:52.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b6400640 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 0x55e2ed2d7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5a00640 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 0x55e2ed331890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5000640 1 -- 172.21.15.89:0/3804375143 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 msgr2=0x55e2ed331890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:52.541 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5000640 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 0x55e2ed331890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5000640 1 -- 172.21.15.89:0/3804375143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 msgr2=0x55e2ed2d7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:52.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5000640 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 0x55e2ed2d7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5000640 1 -- 172.21.15.89:0/3804375143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2ed1a82f0 con 0x55e2ed1df930 2024-08-31T04:39:52.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5a00640 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 0x55e2ed331890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:39:52.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11b5000640 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed2d7230 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f119c0a5560 tx=0x7f119c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c362570bccfb64ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:52.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11a1600640 1 -- 172.21.15.89:0/3804375143 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0d7070 con 0x55e2ed1df930 2024-08-31T04:39:52.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11a1600640 1 -- 172.21.15.89:0/3804375143 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f119c0c9250 con 0x55e2ed1df930 2024-08-31T04:39:52.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11a1600640 1 -- 172.21.15.89:0/3804375143 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0b2040 con 0x55e2ed1df930 2024-08-31T04:39:52.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3804375143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 msgr2=0x55e2ed2d7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed2d7230 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f119c0a5560 tx=0x7f119c0195f0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3804375143 shutdown_connections 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed2d7230 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 0x55e2ed2d7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/3804375143 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 0x55e2ed331890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3804375143 >> 172.21.15.89:0/3804375143 conn(0x55e2ed1f5540 msgr2=0x55e2ed313100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3804375143 shutdown_connections 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 -- 172.21.15.89:0/3804375143 wait complete. 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 -- start start 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.537+0000 7f11bf9b3000 1 Processor -- start 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 0x55e2ed330dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed32eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 0x55e2ed32f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0201c20 con 0x55e2ed1df930 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f11b02029a0 con 0x55e2ed1f5950 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f11b02022d0 con 0x55e2ed1d0890 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 10 client.0 _ll_register_callbacks cb 0x7f119c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed32eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed32eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49560/0 (socket says 172.21.15.89:49560) 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5000640 1 -- 172.21.15.89:0/833338230 learned_addr learned my addr 172.21.15.89:0/833338230 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5000640 1 -- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 msgr2=0x55e2ed330dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5000640 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 0x55e2ed330dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b6400640 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 0x55e2ed32f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5000640 1 -- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 msgr2=0x55e2ed32f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5000640 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 0x55e2ed32f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5000640 1 -- 172.21.15.89:0/833338230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2ed0adb30 con 0x55e2ed1df930 2024-08-31T04:39:52.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5000640 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed32eaf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f119c009900 tx=0x7f119c01cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208268f42169612 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f1196a00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f1196a00640 1 -- 172.21.15.89:0/833338230 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0d7070 con 0x55e2ed1df930 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f1196a00640 1 -- 172.21.15.89:0/833338230 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f119c0c9600 con 0x55e2ed1df930 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 -- 172.21.15.89:0/833338230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f119c0c9250 con 0x55e2ed1df930 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f1196a00640 1 -- 172.21.15.89:0/833338230 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f119c0b2050 con 0x55e2ed1df930 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 10 client.6408 fetch_fsmap learned FSMap version 9 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 -- 172.21.15.89:0/833338230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e2ed0bac70 con 0x55e2ed1df930 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f1196a00640 1 -- 172.21.15.89:0/833338230 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f119c0c9250 con 0x55e2ed1df930 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f1196a00640 1 -- 172.21.15.89:0/833338230 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f119c0d1030 con 0x55e2ed1df930 2024-08-31T04:39:52.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 10 client.6408 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:39:52.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 10 client.6408 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:39:52.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 20 client.6408 populate_metadata read hostname 'smithi089' 2024-08-31T04:39:52.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e2ecdb5e80 0x55e2ed32fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:52.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 4 client.6408 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2e438c9e", "release": true, "await": true}] 2024-08-31T04:39:52.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11bf9b3000 1 -- 172.21.15.89:0/833338230 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2e438c9e", "release": true, "await": true}) -- 0x55e2ed132080 con 0x55e2ecdb5e80 2024-08-31T04:39:52.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.541+0000 7f11b5a00640 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e2ecdb5e80 0x55e2ed32fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:52.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.545+0000 7f11b5a00640 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e2ecdb5e80 0x55e2ed32fa20 crc :-1 s=READY pgs=1602 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b33c1a6010e184ca server_cookie=cbe1b40fee659e3f in_seq=0 out_seq=0 2024-08-31T04:39:52.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.545+0000 7f1196a00640 10 client.6408 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:52.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f1196a00640 1 -- 172.21.15.89:0/833338230 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e2ed132080 con 0x55e2ecdb5e80 2024-08-31T04:39:52.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f1196a00640 10 client.6408 handle_command_reply: tid=0 2024-08-31T04:39:52.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 client.6408 shutdown 2024-08-31T04:39:52.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 -- 172.21.15.89:0/833338230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 msgr2=0x55e2ed32eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed32eaf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f119c009900 tx=0x7f119c01cac0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 -- 172.21.15.89:0/833338230 shutdown_connections 2024-08-31T04:39:52.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55e2ecdb5e80 0x55e2ed32fa20 crc :-1 s=READY pgs=1602 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e2ed1df930 0x55e2ed32eaf0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2ed1f5950 0x55e2ed32f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f1196a00640 0 client.6408 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:39:52.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 --2- 172.21.15.89:0/833338230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2ed1d0890 0x55e2ed330dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 -- 172.21.15.89:0/833338230 >> 172.21.15.89:0/833338230 conn(0x55e2ed1f5540 msgr2=0x55e2ed331470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:52.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 -- 172.21.15.89:0/833338230 shutdown_connections 2024-08-31T04:39:52.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.713+0000 7f11bf9b3000 1 -- 172.21.15.89:0/833338230 wait complete. 2024-08-31T04:39:52.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11bf9b3000 20 client.6408 trim_cache size 0 max 16384 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 128, 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "2e438c9e": { 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 128, 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:39:52.721 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 140.5, 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:52.722 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:39:52.723 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:39:52.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 -- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11900720c0 msgr2=0x7f11900745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11900720c0 0x7f11900745d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f119c0af000 tx=0x7f119c01b090 comp rx=0 tx=0).stop 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 -- 172.21.15.89:0/4254503870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2860 msgr2=0x7f11b0161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2860 0x7f11b0161340 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c3c0 tx=0x7f11a400c880 comp rx=0 tx=0).stop 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 -- 172.21.15.89:0/4254503870 shutdown_connections 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f11900720c0 0x7f11900745d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11b00c90e0 0x7f11b0147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b00b2d20 0x7f11b0147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 --2- 172.21.15.89:0/4254503870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11b00b2860 0x7f11b0161340 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 -- 172.21.15.89:0/4254503870 >> 172.21.15.89:0/4254503870 conn(0x7f11b00c99b0 msgr2=0x7f11b01633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 -- 172.21.15.89:0/4254503870 shutdown_connections 2024-08-31T04:39:52.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:39:52.717+0000 7f11b8400640 1 -- 172.21.15.89:0/4254503870 wait complete. 2024-08-31T04:39:52.738 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2e438c9e', total seconds elapsed: 21.3 2024-08-31T04:39:57.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:39:57.215 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:39:57.235 INFO:tasks.ceph.mds.d.smithi170.stderr:2024-08-31T04:39:57.232+0000 7f6c3a512640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34176) UID: 0 2024-08-31T04:39:57.235 INFO:tasks.ceph.mds.f.smithi170.stderr:2024-08-31T04:39:57.232+0000 7f76ae22c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34176) UID: 0 2024-08-31T04:39:57.236 INFO:tasks.ceph.mds.b.smithi170.stderr:2024-08-31T04:39:57.232+0000 7f1b7db9c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 34176) UID: 0 2024-08-31T04:40:00.296 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 22% (102/447) Updating files: 23% (103/447) Updating files: 24% (108/447) Updating files: 25% (112/447) Updating files: 26% (117/447) Updating files: 26% (118/447) Updating files: 27% (121/447) Updating files: 27% (122/447) Updating files: 28% (126/447) Updating files: 29% (130/447) Updating files: 30% (135/447) Updating files: 31% (139/447) Updating files: 32% (144/447) Updating files: 33% (148/447) Updating files: 34% (152/447) Updating files: 35% (157/447) Updating files: 35% (160/447) Updating files: 36% (161/447) Updating files: 37% (166/447) Updating files: 38% (170/447) Updating files: 39% (175/447) Updating files: 40% (179/447) Updating files: 41% (184/447) Updating files: 42% (188/447) Updating files: 43% (193/447) Updating files: 44% (197/447) Updating files: 45% (202/447) Updating files: 46% (206/447) Updating files: 47% (211/447) Updating files: 48% (215/447) Updating files: 49% (220/447) Updating files: 50% (224/447) Updating files: 51% (228/447) Updating files: 52% (233/447) Updating files: 53% (237/447) Updating files: 53% (241/447) Updating files: 54% (242/447) Updating files: 55% (246/447) Updating files: 56% (251/447) Updating files: 57% (255/447) Updating files: 58% (260/447) Updating files: 58% (262/447) Updating files: 59% (264/447) Updating files: 60% (269/447) Updating files: 61% (273/447) Updating files: 62% (278/447) Updating files: 63% (282/447) Updating files: 64% (287/447) Updating files: 65% (291/447) Updating files: 66% (296/447) Updating files: 67% (300/447) Updating files: 68% (304/447) Updating files: 69% (309/447) Updating files: 70% (313/447) Updating files: 71% (318/447) Updating files: 72% (322/447) Updating files: 73% (327/447) Updating files: 73% (328/447) Updating files: 74% (331/447) Updating files: 75% (336/447) Updating files: 76% (340/447) Updating files: 77% (345/447) Updating files: 78% (349/447) Updating files: 79% (354/447) Updating files: 80% (358/447) Updating files: 81% (363/447) Updating files: 82% (367/447) Updating files: 83% (372/447) Updating files: 83% (373/447) Updating files: 84% (376/447) Updating files: 85% (380/447) Updating files: 86% (385/447) Updating files: 87% (389/447) Updating files: 88% (394/447) Updating files: 89% (398/447) Updating files: 90% (403/447) Updating files: 91% (407/447) Updating files: 92% (412/447) Updating files: 93% (416/447) Updating files: 94% (421/447) Updating files: 94% (424/447) Updating files: 95% (425/447) Updating files: 96% (430/447) Updating files: 97% (434/447) Updating files: 98% (439/447) Updating files: 99% (443/447) Updating files: 100% (447/447) Updating files: 100% (447/447), done. 2024-08-31T04:40:01.191 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 97dcc0539df 0.86 2024-08-31T04:40:01.291 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.86 2024-08-31T04:40:01.316 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 87 -eq 48 ] 2024-08-31T04:40:01.316 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.87 2024-08-31T04:40:01.316 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.87 2024-08-31T04:40:01.316 INFO:tasks.workunit.client.0.smithi089.stdout:v0.87 2024-08-31T04:40:01.317 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.87 2024-08-31T04:40:12.127 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 45% (27/59) Updating files: 47% (28/59) Updating files: 49% (29/59) Updating files: 50% (30/59) Updating files: 52% (31/59) Updating files: 54% (32/59) Updating files: 55% (33/59) Updating files: 57% (34/59) Updating files: 59% (35/59) Updating files: 61% (36/59) Updating files: 62% (37/59) Updating files: 64% (38/59) Updating files: 66% (39/59) Updating files: 67% (40/59) Updating files: 69% (41/59) Updating files: 71% (42/59) Updating files: 72% (43/59) Updating files: 74% (44/59) Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-08-31T04:40:12.278 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at c51c8f9d80f 0.87 2024-08-31T04:40:12.282 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.87 2024-08-31T04:40:12.322 INFO:tasks.workunit.client.0.smithi089.stdout:v0.88 2024-08-31T04:40:12.322 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 88 -eq 48 ] 2024-08-31T04:40:12.322 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.88 2024-08-31T04:40:12.322 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.88 2024-08-31T04:40:12.322 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.88 2024-08-31T04:40:16.720 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 37% (127/335) Updating files: 38% (128/335) Updating files: 39% (131/335) Updating files: 40% (134/335) Updating files: 41% (138/335) Updating files: 42% (141/335) Updating files: 43% (145/335) Updating files: 44% (148/335) Updating files: 45% (151/335) Updating files: 46% (155/335) Updating files: 47% (158/335) Updating files: 48% (161/335) Updating files: 49% (165/335) Updating files: 50% (168/335) Updating files: 51% (171/335) Updating files: 52% (175/335) Updating files: 53% (178/335) Updating files: 54% (181/335) Updating files: 55% (185/335) Updating files: 56% (188/335) Updating files: 57% (191/335) Updating files: 58% (195/335) Updating files: 59% (198/335) Updating files: 60% (201/335) Updating files: 61% (205/335) Updating files: 62% (208/335) Updating files: 63% (212/335) Updating files: 64% (215/335) Updating files: 65% (218/335) Updating files: 66% (222/335) Updating files: 67% (225/335) Updating files: 68% (228/335) Updating files: 69% (232/335) Updating files: 70% (235/335) Updating files: 71% (238/335) Updating files: 72% (242/335) Updating files: 73% (245/335) Updating files: 74% (248/335) Updating files: 75% (252/335) Updating files: 76% (255/335) Updating files: 77% (258/335) Updating files: 78% (262/335) Updating files: 79% (265/335) Updating files: 80% (268/335) Updating files: 81% (272/335) Updating files: 82% (275/335) Updating files: 83% (279/335) Updating files: 84% (282/335) Updating files: 85% (285/335) Updating files: 86% (289/335) Updating files: 87% (292/335) Updating files: 88% (295/335) Updating files: 89% (299/335) Updating files: 90% (302/335) Updating files: 91% (305/335) Updating files: 92% (309/335) Updating files: 93% (312/335) Updating files: 94% (315/335) Updating files: 95% (319/335) Updating files: 96% (322/335) Updating files: 97% (325/335) Updating files: 97% (327/335) Updating files: 98% (329/335) Updating files: 99% (332/335) Updating files: 100% (335/335) Updating files: 100% (335/335), done. 2024-08-31T04:40:16.779 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 4be687bf448 0.88 2024-08-31T04:40:16.790 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.88 2024-08-31T04:40:16.825 INFO:tasks.workunit.client.0.smithi089.stdout:v0.89 2024-08-31T04:40:16.826 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 89 -eq 48 ] 2024-08-31T04:40:16.826 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.89 2024-08-31T04:40:16.826 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.89 2024-08-31T04:40:16.826 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.89 2024-08-31T04:40:23.664 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 25% (51/197) Updating files: 26% (52/197) Updating files: 27% (54/197) Updating files: 28% (56/197) Updating files: 29% (58/197) Updating files: 30% (60/197) Updating files: 30% (61/197) Updating files: 31% (62/197) Updating files: 32% (64/197) Updating files: 33% (66/197) Updating files: 34% (67/197) Updating files: 35% (69/197) Updating files: 36% (71/197) Updating files: 37% (73/197) Updating files: 38% (75/197) Updating files: 39% (77/197) Updating files: 40% (79/197) Updating files: 41% (81/197) Updating files: 42% (83/197) Updating files: 43% (85/197) Updating files: 44% (87/197) Updating files: 44% (88/197) Updating files: 45% (89/197) Updating files: 46% (91/197) Updating files: 47% (93/197) Updating files: 48% (95/197) Updating files: 49% (97/197) Updating files: 50% (99/197) Updating files: 51% (101/197) Updating files: 52% (103/197) Updating files: 53% (105/197) Updating files: 54% (107/197) Updating files: 55% (109/197) Updating files: 56% (111/197) Updating files: 57% (113/197) Updating files: 58% (115/197) Updating files: 59% (117/197) Updating files: 60% (119/197) Updating files: 61% (121/197) Updating files: 62% (123/197) Updating files: 63% (125/197) Updating files: 64% (127/197) Updating files: 65% (129/197) Updating files: 66% (131/197) Updating files: 67% (132/197) Updating files: 68% (134/197) Updating files: 69% (136/197) Updating files: 70% (138/197) Updating files: 71% (140/197) Updating files: 72% (142/197) Updating files: 73% (144/197) Updating files: 74% (146/197) Updating files: 75% (148/197) Updating files: 76% (150/197) Updating files: 77% (152/197) Updating files: 78% (154/197) Updating files: 79% (156/197) Updating files: 80% (158/197) Updating files: 81% (160/197) Updating files: 82% (162/197) Updating files: 83% (164/197) Updating files: 84% (166/197) Updating files: 85% (168/197) Updating files: 86% (170/197) Updating files: 86% (171/197) Updating files: 87% (172/197) Updating files: 88% (174/197) Updating files: 89% (176/197) Updating files: 90% (178/197) Updating files: 91% (180/197) Updating files: 92% (182/197) Updating files: 93% (184/197) Updating files: 94% (186/197) Updating files: 95% (188/197) Updating files: 96% (190/197) Updating files: 97% (192/197) Updating files: 98% (194/197) Updating files: 99% (196/197) Updating files: 100% (197/197) Updating files: 100% (197/197), done. 2024-08-31T04:40:23.737 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 68fdc0f68e6 0.89 2024-08-31T04:40:23.746 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.89 2024-08-31T04:40:23.856 INFO:tasks.workunit.client.0.smithi089.stdout:v0.90 2024-08-31T04:40:23.856 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 90 -eq 48 ] 2024-08-31T04:40:23.856 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.90 2024-08-31T04:40:23.856 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo v0.90 2024-08-31T04:40:23.856 INFO:tasks.workunit.client.0.smithi089.stderr:+ git reset --hard v0.90 2024-08-31T04:40:37.951 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 6% (17/265) Updating files: 7% (19/265) Updating files: 8% (22/265) Updating files: 9% (24/265) Updating files: 10% (27/265) Updating files: 11% (30/265) Updating files: 12% (32/265) Updating files: 13% (35/265) Updating files: 14% (38/265) Updating files: 15% (40/265) Updating files: 16% (43/265) Updating files: 17% (46/265) Updating files: 18% (48/265) Updating files: 19% (51/265) Updating files: 20% (53/265) Updating files: 21% (56/265) Updating files: 22% (59/265) Updating files: 23% (61/265) Updating files: 24% (64/265) Updating files: 25% (67/265) Updating files: 26% (69/265) Updating files: 27% (72/265) Updating files: 28% (75/265) Updating files: 29% (77/265) Updating files: 30% (80/265) Updating files: 31% (83/265) Updating files: 32% (85/265) Updating files: 33% (88/265) Updating files: 34% (91/265) Updating files: 35% (93/265) Updating files: 36% (96/265) Updating files: 37% (99/265) Updating files: 38% (101/265) Updating files: 39% (104/265) Updating files: 39% (105/265) Updating files: 40% (106/265) Updating files: 41% (109/265) Updating files: 42% (112/265) Updating files: 43% (114/265) Updating files: 44% (117/265) Updating files: 45% (120/265) Updating files: 46% (122/265) Updating files: 47% (125/265) Updating files: 48% (128/265) Updating files: 49% (130/265) Updating files: 50% (133/265) Updating files: 51% (136/265) Updating files: 52% (138/265) Updating files: 53% (141/265) Updating files: 54% (144/265) Updating files: 55% (146/265) Updating files: 55% (147/265) Updating files: 56% (149/265) Updating files: 57% (152/265) Updating files: 58% (154/265) Updating files: 59% (157/265) Updating files: 60% (159/265) Updating files: 61% (162/265) Updating files: 62% (165/265) Updating files: 63% (167/265) Updating files: 64% (170/265) Updating files: 64% (171/265) Updating files: 65% (173/265) Updating files: 66% (175/265) Updating files: 67% (178/265) Updating files: 68% (181/265) Updating files: 69% (183/265) Updating files: 70% (186/265) Updating files: 71% (189/265) Updating files: 72% (191/265) Updating files: 73% (194/265) Updating files: 74% (197/265) Updating files: 75% (199/265) Updating files: 76% (202/265) Updating files: 77% (205/265) Updating files: 78% (207/265) Updating files: 79% (210/265) Updating files: 80% (212/265) Updating files: 81% (215/265) Updating files: 82% (218/265) Updating files: 83% (220/265) Updating files: 84% (223/265) Updating files: 85% (226/265) Updating files: 86% (228/265) Updating files: 87% (231/265) Updating files: 88% (234/265) Updating files: 89% (236/265) Updating files: 90% (239/265) Updating files: 91% (242/265) Updating files: 92% (244/265) Updating files: 93% (247/265) Updating files: 94% (250/265) Updating files: 95% (252/265) Updating files: 96% (255/265) Updating files: 97% (258/265) Updating files: 98% (260/265) Updating files: 99% (263/265) Updating files: 100% (265/265) Updating files: 100% (265/265), done. 2024-08-31T04:40:38.235 INFO:tasks.workunit.client.0.smithi089.stdout:HEAD is now at 08bd1e1eee3 0.90 2024-08-31T04:40:38.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir .snap/v0.90 2024-08-31T04:40:38.272 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.1 2024-08-31T04:40:38.272 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 1 -eq 48 ] 2024-08-31T04:40:38.272 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.1 2024-08-31T04:40:38.272 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.1 2024-08-31T04:40:38.272 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.1 2024-08-31T04:40:38.272 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:40:46.989 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:40:46.990 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 2 -eq 48 ] 2024-08-31T04:40:46.990 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.2 2024-08-31T04:40:46.990 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.2 2024-08-31T04:40:46.990 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.2 2024-08-31T04:40:46.990 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.2 2024-08-31T04:40:46.990 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:40:50.994 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:40:50.995 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.3 2024-08-31T04:40:50.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 3 -eq 48 ] 2024-08-31T04:40:50.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.3 2024-08-31T04:40:50.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.3 2024-08-31T04:40:50.995 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.3 2024-08-31T04:40:50.996 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:40:57.215 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:40:57.216 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 4 -eq 48 ] 2024-08-31T04:40:57.216 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.4 2024-08-31T04:40:57.216 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.4 2024-08-31T04:40:57.216 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.4 2024-08-31T04:40:57.217 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.4 2024-08-31T04:40:57.217 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:00.563 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:00.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 5 -eq 48 ] 2024-08-31T04:41:00.564 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.5 2024-08-31T04:41:00.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.5 2024-08-31T04:41:00.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.5 2024-08-31T04:41:00.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.5 2024-08-31T04:41:00.564 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:02.695 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:02.695 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.6 2024-08-31T04:41:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 6 -eq 48 ] 2024-08-31T04:41:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.6 2024-08-31T04:41:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.6 2024-08-31T04:41:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.6 2024-08-31T04:41:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:06.816 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:06.816 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 7 -eq 48 ] 2024-08-31T04:41:06.816 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.7 2024-08-31T04:41:06.817 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.7 2024-08-31T04:41:06.817 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.7 2024-08-31T04:41:06.817 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.7 2024-08-31T04:41:06.817 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:08.882 INFO:tasks.quiescer.fs.[cephfs]:Total duration (46.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:41:08.883 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.3 2024-08-31T04:41:08.883 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:41:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.043+0000 7f7776800640 1 -- 172.21.15.89:0/2209634123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700c5120 msgr2=0x7f77700c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.043+0000 7f7776800640 1 --2- 172.21.15.89:0/2209634123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700c5120 0x7f77700c7b00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f77700c9300 tx=0x7f776401c8c0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.043+0000 7f7776800640 1 -- 172.21.15.89:0/2209634123 shutdown_connections 2024-08-31T04:41:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.043+0000 7f7776800640 1 --2- 172.21.15.89:0/2209634123 >> v2:172.21.15.170:3300/0 conn(0x7f77700ca690 0x7f77700caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.043+0000 7f7776800640 1 --2- 172.21.15.89:0/2209634123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700c5120 0x7f77700c7b00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.043+0000 7f7776800640 1 -- 172.21.15.89:0/2209634123 >> 172.21.15.89:0/2209634123 conn(0x7f7770071f20 msgr2=0x7f7770072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.043+0000 7f7776800640 1 -- 172.21.15.89:0/2209634123 shutdown_connections 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.043+0000 7f7776800640 1 -- 172.21.15.89:0/2209634123 wait complete. 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7776800640 1 Processor -- start 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7776800640 1 -- start start 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7776800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700c5120 0x7f7770144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7776800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700ca690 0x7f7770145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7776800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7770152430 0x7f7770145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7776800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7770070df0 con 0x7f77700ca690 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7776800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f77700c58c0 con 0x7f7770152430 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7776800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7770152840 con 0x7f77700c5120 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7774a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700ca690 0x7f7770145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7774a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700ca690 0x7f7770145960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34244/0 (socket says 172.21.15.89:34244) 2024-08-31T04:41:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7774a00640 1 -- 172.21.15.89:0/2000046088 learned_addr learned my addr 172.21.15.89:0/2000046088 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7775e00640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7770152430 0x7f7770145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7775400640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700c5120 0x7f7770144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7774a00640 1 -- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700c5120 msgr2=0x7f7770144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7774a00640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700c5120 0x7f7770144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7774a00640 1 -- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7770152430 msgr2=0x7f7770145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7774a00640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7770152430 0x7f7770145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7774a00640 1 -- 172.21.15.89:0/2000046088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777014e560 con 0x7f77700ca690 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.047+0000 7f7774a00640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700ca690 0x7f7770145960 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f775c00c420 tx=0x7f775c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.051+0000 7f776d600640 1 -- 172.21.15.89:0/2000046088 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c017070 con 0x7f77700ca690 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.051+0000 7f776d600640 1 -- 172.21.15.89:0/2000046088 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f775c0053c0 con 0x7f77700ca690 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.051+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7770142c90 con 0x7f77700ca690 2024-08-31T04:41:09.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.051+0000 7f776d600640 1 -- 172.21.15.89:0/2000046088 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c003860 con 0x7f77700ca690 2024-08-31T04:41:09.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.051+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7770142f30 con 0x7f77700ca690 2024-08-31T04:41:09.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.051+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77701585c0 con 0x7f77700ca690 2024-08-31T04:41:09.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.051+0000 7f776d600640 1 -- 172.21.15.89:0/2000046088 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f775c01a070 con 0x7f77700ca690 2024-08-31T04:41:09.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.051+0000 7f776d600640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77500720c0 0x7f77500745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.055+0000 7f776d600640 1 -- 172.21.15.89:0/2000046088 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f775c092160 con 0x7f77700ca690 2024-08-31T04:41:09.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.055+0000 7f7775400640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77500720c0 0x7f77500745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.055+0000 7f7775400640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77500720c0 0x7f77500745d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f77640af000 tx=0x7f77640a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:09.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.059+0000 7f776d600640 1 -- 172.21.15.89:0/2000046088 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f775c001090 con 0x7f77700ca690 2024-08-31T04:41:09.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.263+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77700c7320 con 0x7f77700ca690 2024-08-31T04:41:09.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.263+0000 7f776d600640 1 -- 172.21.15.89:0/2000046088 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f775c05d080 con 0x7f77700ca690 2024-08-31T04:41:09.266 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:41:09.266 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:41:09.266 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:41:09.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77500720c0 msgr2=0x7f77500745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77500720c0 0x7f77500745d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f77640af000 tx=0x7f77640a7040 comp rx=0 tx=0).stop 2024-08-31T04:41:09.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700ca690 msgr2=0x7f7770145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700ca690 0x7f7770145960 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f775c00c420 tx=0x7f775c00c8e0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 shutdown_connections 2024-08-31T04:41:09.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f77500720c0 0x7f77500745d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77700ca690 0x7f7770145960 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7770152430 0x7f7770145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 --2- 172.21.15.89:0/2000046088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700c5120 0x7f7770144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 >> 172.21.15.89:0/2000046088 conn(0x7f7770071f20 msgr2=0x7f77701556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:09.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 shutdown_connections 2024-08-31T04:41:09.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.267+0000 7f7776800640 1 -- 172.21.15.89:0/2000046088 wait complete. 2024-08-31T04:41:09.287 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 143.3 --await-for 45.0' 2024-08-31T04:41:09.288 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 143.3 --await-for 45.0 2024-08-31T04:41:09.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.451+0000 7f7f04600640 1 -- 172.21.15.89:0/1954372563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee4004d50 msgr2=0x7f7ee4005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.451+0000 7f7f04600640 1 --2- 172.21.15.89:0/1954372563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ee4004d50 0x7f7ee4005160 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009e90 tx=0x7f7ef401d5d0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.451+0000 7f7f02600640 1 -- 172.21.15.89:0/1954372563 reap_dead start 2024-08-31T04:41:09.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.451+0000 7f7f04600640 1 -- 172.21.15.89:0/1954372563 shutdown_connections 2024-08-31T04:41:09.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.451+0000 7f7f04600640 1 -- 172.21.15.89:0/1954372563 >> 172.21.15.89:0/1954372563 conn(0x7f7efc0c99b0 msgr2=0x7f7efc0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:09.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 -- 172.21.15.89:0/1954372563 shutdown_connections 2024-08-31T04:41:09.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 -- 172.21.15.89:0/1954372563 wait complete. 2024-08-31T04:41:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 Processor -- start 2024-08-31T04:41:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 -- start start 2024-08-31T04:41:09.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ee4004d50 0x7f7efc0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7efc159c80 0x7f7efc14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7efc15a090 0x7f7efc14caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0c3160 con 0x7f7efc15a090 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0c22e0 con 0x7f7efc159c80 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f04600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7efc0c32e0 con 0x7f7ee4004d50 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.455+0000 7f7f02600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7efc15a090 0x7f7efc14caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f02600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7efc15a090 0x7f7efc14caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34248/0 (socket says 172.21.15.89:34248) 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f02600640 1 -- 172.21.15.89:0/3909854853 learned_addr learned my addr 172.21.15.89:0/3909854853 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f01200640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7efc159c80 0x7f7efc14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f01c00640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ee4004d50 0x7f7efc0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f02600640 1 -- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ee4004d50 msgr2=0x7f7efc0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f02600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ee4004d50 0x7f7efc0cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f02600640 1 -- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7efc159c80 msgr2=0x7f7efc14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f02600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7efc159c80 0x7f7efc14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f02600640 1 -- 172.21.15.89:0/3909854853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc0cacb0 con 0x7f7efc15a090 2024-08-31T04:41:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f01200640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7efc159c80 0x7f7efc14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:41:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f02600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7efc15a090 0x7f7efc14caa0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009e90 tx=0x7f7ef4009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7ef9600640 1 -- 172.21.15.89:0/3909854853 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4009a90 con 0x7f7efc15a090 2024-08-31T04:41:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7ef9600640 1 -- 172.21.15.89:0/3909854853 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ef40a9510 con 0x7f7efc15a090 2024-08-31T04:41:09.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7ef9600640 1 -- 172.21.15.89:0/3909854853 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40a9ac0 con 0x7f7efc15a090 2024-08-31T04:41:09.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f04600640 1 -- 172.21.15.89:0/3909854853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc0c6140 con 0x7f7efc15a090 2024-08-31T04:41:09.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7f04600640 1 -- 172.21.15.89:0/3909854853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc151690 con 0x7f7efc15a090 2024-08-31T04:41:09.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.459+0000 7f7ef9600640 1 -- 172.21.15.89:0/3909854853 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f7ef40a7040 con 0x7f7efc15a090 2024-08-31T04:41:09.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7ef9600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7ee00720c0 0x7f7ee00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7ef9600640 1 -- 172.21.15.89:0/3909854853 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f7ef412dea0 con 0x7f7efc15a090 2024-08-31T04:41:09.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f0bcc9000 1 Processor -- start 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01c00640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7ee00720c0 0x7f7ee00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f0bcc9000 1 -- start start 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01c00640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7ee00720c0 0x7f7ee00745d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000fb50 tx=0x7f7ef00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1814d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede17ddce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede17de220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ede1633820 con 0x55ede16d0e90 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ede1622db0 con 0x55ede16db3f0 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ede1626d60 con 0x55ede16ba960 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede17ddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede17ddce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34252/0 (socket says 172.21.15.89:34252) 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01200640 1 -- 172.21.15.89:0/1850485460 learned_addr learned my addr 172.21.15.89:0/1850485460 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:09.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01c00640 1 --2- 172.21.15.89:0/1850485460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1814d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f02600640 1 --2- 172.21.15.89:0/1850485460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede17de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01200640 1 -- 172.21.15.89:0/1850485460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 msgr2=0x55ede17de220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01200640 1 --2- 172.21.15.89:0/1850485460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede17de220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01200640 1 -- 172.21.15.89:0/1850485460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 msgr2=0x55ede1814d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01200640 1 --2- 172.21.15.89:0/1850485460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1814d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01200640 1 -- 172.21.15.89:0/1850485460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ede15bdb70 con 0x55ede16d0e90 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7f01200640 1 --2- 172.21.15.89:0/1850485460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede17ddce0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7eec001870 tx=0x7f7eec004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c779d7308259629f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7eea000640 1 -- 172.21.15.89:0/1850485460 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec004570 con 0x55ede16d0e90 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7eea000640 1 -- 172.21.15.89:0/1850485460 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7eec014c40 con 0x55ede16d0e90 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.463+0000 7f7eea000640 1 -- 172.21.15.89:0/1850485460 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec012470 con 0x55ede16d0e90 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1850485460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 msgr2=0x55ede17ddce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1850485460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede17ddce0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7eec001870 tx=0x7f7eec004380 comp rx=0 tx=0).stop 2024-08-31T04:41:09.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1850485460 shutdown_connections 2024-08-31T04:41:09.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1850485460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede17ddce0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1850485460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede17de220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1850485460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1814d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1850485460 >> 172.21.15.89:0/1850485460 conn(0x55ede12e2210 msgr2=0x55ede1817990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:09.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1850485460 shutdown_connections 2024-08-31T04:41:09.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1850485460 wait complete. 2024-08-31T04:41:09.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 -- start start 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 Processor -- start 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede18138f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1813e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1814370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ede12e9b10 con 0x55ede16d0e90 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ede15a96f0 con 0x55ede16db3f0 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ede162b390 con 0x55ede16ba960 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f0bcc9000 10 client.0 _ll_register_callbacks cb 0x55ede15cab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f01200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1813e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f01200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1813e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34262/0 (socket says 172.21.15.89:34262) 2024-08-31T04:41:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f01200640 1 -- 172.21.15.89:0/3670723069 learned_addr learned my addr 172.21.15.89:0/3670723069 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f02600640 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1814370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f01c00640 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede18138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f01200640 1 -- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 msgr2=0x55ede18138f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f01200640 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede18138f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f01200640 1 -- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 msgr2=0x55ede1814370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f01200640 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1814370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.467+0000 7f7f01200640 1 -- 172.21.15.89:0/3670723069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ede15e1380 con 0x55ede16d0e90 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f01200640 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1813e30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7eec014830 tx=0x7f7eec021670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bab4b5dc74273c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 1 -- 172.21.15.89:0/3670723069 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec004570 con 0x55ede16d0e90 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 1 -- 172.21.15.89:0/3670723069 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f7eec021ca0 con 0x55ede16d0e90 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/3670723069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ede1631d20 con 0x55ede16d0e90 2024-08-31T04:41:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 1 -- 172.21.15.89:0/3670723069 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7eec01e440 con 0x55ede16d0e90 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 10 client.6426 fetch_fsmap learned FSMap version 9 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/3670723069 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ede16a7e40 con 0x55ede16d0e90 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 1 -- 172.21.15.89:0/3670723069 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ede1631d20 con 0x55ede16d0e90 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 1 -- 172.21.15.89:0/3670723069 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7eec028020 con 0x55ede16d0e90 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 10 client.6426 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 10 client.6426 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 20 client.6426 populate_metadata read hostname 'smithi089' 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ede12c6dc0 0x55ede182ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 4 client.6426 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/3670723069 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ede1635770 con 0x55ede12c6dc0 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f01c00640 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ede12c6dc0 0x55ede182ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f01c00640 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ede12c6dc0 0x55ede182ef90 crc :-1 s=READY pgs=1681 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ec4f4382de9f03c server_cookie=5b272d0fe5639ab9 in_seq=0 out_seq=0 2024-08-31T04:41:09.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 10 client.6426 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 1 -- 172.21.15.89:0/3670723069 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ede1635770 con 0x55ede12c6dc0 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 10 client.6426 handle_command_reply: tid=0 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 client.6426 shutdown 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/3670723069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 msgr2=0x55ede1813e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1813e30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7eec014830 tx=0x7f7eec021670 comp rx=0 tx=0).stop 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/3670723069 shutdown_connections 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ede12c6dc0 0x55ede182ef90 crc :-1 s=READY pgs=1681 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1813e30 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1814370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/3670723069 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede18138f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7edea00640 0 client.6426 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:09.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/3670723069 >> 172.21.15.89:0/3670723069 conn(0x55ede12e2210 msgr2=0x55ede1816340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:09.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.471+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/3670723069 shutdown_connections 2024-08-31T04:41:09.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.475+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/3670723069 wait complete. 2024-08-31T04:41:09.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.475+0000 7f7f0bcc9000 20 client.6426 trim_cache size 0 max 16384 2024-08-31T04:41:09.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f0bcc9000 1 Processor -- start 2024-08-31T04:41:09.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f0bcc9000 1 -- start start 2024-08-31T04:41:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede182ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede18304e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1830a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1f5e20 con 0x55ede16d0e90 2024-08-31T04:41:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1ff940 con 0x55ede16db3f0 2024-08-31T04:41:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7efc1febe0 con 0x55ede16ba960 2024-08-31T04:41:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f01200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede18304e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f01200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede18304e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34276/0 (socket says 172.21.15.89:34276) 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f01200640 1 -- 172.21.15.89:0/2567625096 learned_addr learned my addr 172.21.15.89:0/2567625096 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f01c00640 1 --2- 172.21.15.89:0/2567625096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede182ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f02600640 1 --2- 172.21.15.89:0/2567625096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1830a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.491+0000 7f7f01200640 1 -- 172.21.15.89:0/2567625096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 msgr2=0x55ede182ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f01200640 1 --2- 172.21.15.89:0/2567625096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede182ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f01200640 1 -- 172.21.15.89:0/2567625096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 msgr2=0x55ede1830a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f01200640 1 --2- 172.21.15.89:0/2567625096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1830a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f01200640 1 -- 172.21.15.89:0/2567625096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ede167f5b0 con 0x55ede16d0e90 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f01200640 1 --2- 172.21.15.89:0/2567625096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede18304e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7eec000eb0 tx=0x7f7eec015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2235e7637bd996 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7ee9600640 1 -- 172.21.15.89:0/2567625096 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0216e0 con 0x55ede16d0e90 2024-08-31T04:41:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7ee9600640 1 -- 172.21.15.89:0/2567625096 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7eec021aa0 con 0x55ede16d0e90 2024-08-31T04:41:09.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7ee9600640 1 -- 172.21.15.89:0/2567625096 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec021070 con 0x55ede16d0e90 2024-08-31T04:41:09.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/2567625096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 msgr2=0x55ede18304e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/2567625096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede18304e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7eec000eb0 tx=0x7f7eec015f90 comp rx=0 tx=0).stop 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/2567625096 shutdown_connections 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/2567625096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede18304e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/2567625096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede1830a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/2567625096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede182ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/2567625096 >> 172.21.15.89:0/2567625096 conn(0x55ede12e2210 msgr2=0x55ede17d6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/2567625096 shutdown_connections 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/2567625096 wait complete. 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 -- start start 2024-08-31T04:41:09.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 Processor -- start 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede1833660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.495+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1833ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede18554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ede15a4eb0 con 0x55ede16d0e90 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1ff270 con 0x55ede16db3f0 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ede15caf20 con 0x55ede16ba960 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 10 client.0 _ll_register_callbacks cb 0x7f7ef000f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1833ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1833ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34278/0 (socket says 172.21.15.89:34278) 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01200640 1 -- 172.21.15.89:0/1443790096 learned_addr learned my addr 172.21.15.89:0/1443790096 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:09.501 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f02600640 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede18554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01c00640 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede1833660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01200640 1 -- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 msgr2=0x55ede1833660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01200640 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede1833660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01200640 1 -- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 msgr2=0x55ede18554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01200640 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede18554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01200640 1 -- 172.21.15.89:0/1443790096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ede15b3fc0 con 0x55ede16d0e90 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f02600640 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede18554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01c00640 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede1833660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01200640 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1833ba0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7eec014830 tx=0x7f7eec003670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b39f1f705e341 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7edea00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7edea00640 1 -- 172.21.15.89:0/1443790096 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec041060 con 0x55ede16d0e90 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7edea00640 1 -- 172.21.15.89:0/1443790096 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f7eec014af0 con 0x55ede16d0e90 2024-08-31T04:41:09.502 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1443790096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eec021aa0 con 0x55ede16d0e90 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7edea00640 1 -- 172.21.15.89:0/1443790096 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7eec047050 con 0x55ede16d0e90 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 10 client.6432 fetch_fsmap learned FSMap version 9 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1443790096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ede15ace00 con 0x55ede16d0e90 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7edea00640 1 -- 172.21.15.89:0/1443790096 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7eec021aa0 con 0x55ede16d0e90 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7edea00640 1 -- 172.21.15.89:0/1443790096 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f7eec04a020 con 0x55ede16d0e90 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 10 client.6432 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 10 client.6432 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 20 client.6432 populate_metadata read hostname 'smithi089' 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ede12b4e20 0x55ede1855e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 4 client.6432 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.3, "await_for": 45.0}] 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1443790096 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.3, "await_for": 45.0}) -- 0x55ede1631210 con 0x55ede12b4e20 2024-08-31T04:41:09.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01c00640 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ede12b4e20 0x55ede1855e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:09.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7f01c00640 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ede12b4e20 0x55ede1855e10 crc :-1 s=READY pgs=1682 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77e6e2014e65dc2b server_cookie=133b7b28ff37ea3b in_seq=0 out_seq=0 2024-08-31T04:41:09.504 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:09.499+0000 7f7edea00640 10 client.6432 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:12.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.015+0000 7f7edea00640 1 -- 172.21.15.89:0/1443790096 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ede1631210 con 0x55ede12b4e20 2024-08-31T04:41:12.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.015+0000 7f7edea00640 10 client.6432 handle_command_reply: tid=0 2024-08-31T04:41:12.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.015+0000 7f7f0bcc9000 1 client.6432 shutdown 2024-08-31T04:41:12.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1443790096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 msgr2=0x55ede1833ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:12.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1833ba0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7eec014830 tx=0x7f7eec003670 comp rx=0 tx=0).stop 2024-08-31T04:41:12.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1443790096 shutdown_connections 2024-08-31T04:41:12.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55ede12b4e20 0x55ede1855e10 crc :-1 s=READY pgs=1682 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:12.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7edea00640 0 client.6432 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:12.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ede16d0e90 0x55ede1833ba0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:12.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ede16db3f0 0x55ede18554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:12.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 --2- 172.21.15.89:0/1443790096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ede16ba960 0x55ede1833660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:12.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1443790096 >> 172.21.15.89:0/1443790096 conn(0x55ede12e2210 msgr2=0x55ede1834c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:12.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1443790096 shutdown_connections 2024-08-31T04:41:12.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 1 -- 172.21.15.89:0/1443790096 wait complete. 2024-08-31T04:41:12.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f0bcc9000 20 client.6432 trim_cache size 0 max 16384 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 130, 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "db3750d5": { 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 130, 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:41:12.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 143.3, 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:12.022 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:12.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:12.023 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:41:12.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 -- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7ee00720c0 msgr2=0x7f7ee00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:12.023 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7ee00720c0 0x7f7ee00745d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000fb50 tx=0x7f7ef00091e0 comp rx=0 tx=0).stop 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 -- 172.21.15.89:0/3909854853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7efc15a090 msgr2=0x7f7efc14caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7efc15a090 0x7f7efc14caa0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009e90 tx=0x7f7ef4009760 comp rx=0 tx=0).stop 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 -- 172.21.15.89:0/3909854853 shutdown_connections 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f7ee00720c0 0x7f7ee00745d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7efc15a090 0x7f7efc14caa0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7efc159c80 0x7f7efc14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 --2- 172.21.15.89:0/3909854853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ee4004d50 0x7f7efc0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 -- 172.21.15.89:0/3909854853 >> 172.21.15.89:0/3909854853 conn(0x7f7efc0c99b0 msgr2=0x7f7efc14eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 -- 172.21.15.89:0/3909854853 shutdown_connections 2024-08-31T04:41:12.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:12.019+0000 7f7f04600640 1 -- 172.21.15.89:0/3909854853 wait complete. 2024-08-31T04:41:12.044 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'db3750d5', quiesce took 3.2 seconds. Will release after: 20.1 2024-08-31T04:41:12.054 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:12.057 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 8 -eq 48 ] 2024-08-31T04:41:12.057 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.8 2024-08-31T04:41:12.057 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.8 2024-08-31T04:41:12.057 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.8 2024-08-31T04:41:12.058 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.8 2024-08-31T04:41:12.058 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:16.370 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:16.370 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.9 2024-08-31T04:41:16.370 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 9 -eq 48 ] 2024-08-31T04:41:16.371 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.9 2024-08-31T04:41:16.371 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.9 2024-08-31T04:41:16.371 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.9 2024-08-31T04:41:16.371 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:18.830 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:18.831 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 10 -eq 48 ] 2024-08-31T04:41:18.831 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.10 2024-08-31T04:41:18.831 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.10 2024-08-31T04:41:18.831 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.10 2024-08-31T04:41:18.831 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.10 2024-08-31T04:41:18.831 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:21.592 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:21.592 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 11 -eq 48 ] 2024-08-31T04:41:21.592 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.11 2024-08-31T04:41:21.593 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.11 2024-08-31T04:41:21.593 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.11 2024-08-31T04:41:21.593 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.11 2024-08-31T04:41:21.593 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:23.802 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:23.802 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 12 -eq 48 ] 2024-08-31T04:41:23.803 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.12 2024-08-31T04:41:23.803 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.12 2024-08-31T04:41:23.803 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.12 2024-08-31T04:41:23.804 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.12 2024-08-31T04:41:23.804 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:26.529 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:26.529 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.13 2024-08-31T04:41:26.530 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 13 -eq 48 ] 2024-08-31T04:41:26.530 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.13 2024-08-31T04:41:26.530 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.13 2024-08-31T04:41:26.530 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.13 2024-08-31T04:41:26.530 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:29.783 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:29.783 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.14 2024-08-31T04:41:29.784 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 14 -eq 48 ] 2024-08-31T04:41:29.784 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.14 2024-08-31T04:41:29.784 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.14 2024-08-31T04:41:29.784 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.14 2024-08-31T04:41:29.784 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:32.134 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:32.134 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 15 -eq 48 ] 2024-08-31T04:41:32.135 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.15 2024-08-31T04:41:32.135 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.15 2024-08-31T04:41:32.135 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.15 2024-08-31T04:41:32.135 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.15 2024-08-31T04:41:32.135 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:32.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:41:32.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.315+0000 7fcf77e00640 1 -- 172.21.15.89:0/3034073968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c9330 msgr2=0x7fcf70074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.315+0000 7fcf77e00640 1 --2- 172.21.15.89:0/3034073968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c9330 0x7fcf70074720 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcf70070b70 tx=0x7fcf6801f580 comp rx=0 tx=0).stop 2024-08-31T04:41:32.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.315+0000 7fcf77e00640 1 -- 172.21.15.89:0/3034073968 shutdown_connections 2024-08-31T04:41:32.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.315+0000 7fcf77e00640 1 --2- 172.21.15.89:0/3034073968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c9330 0x7fcf70074720 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.315+0000 7fcf77e00640 1 --2- 172.21.15.89:0/3034073968 >> v2:172.21.15.170:3300/0 conn(0x7fcf700c1f40 0x7fcf70152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.315+0000 7fcf77e00640 1 -- 172.21.15.89:0/3034073968 >> 172.21.15.89:0/3034073968 conn(0x7fcf700ccf20 msgr2=0x7fcf700cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:32.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.315+0000 7fcf77e00640 1 -- 172.21.15.89:0/3034073968 shutdown_connections 2024-08-31T04:41:32.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.315+0000 7fcf77e00640 1 -- 172.21.15.89:0/3034073968 wait complete. 2024-08-31T04:41:32.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 Processor -- start 2024-08-31T04:41:32.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 -- start start 2024-08-31T04:41:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c1f40 0x7fcf701f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf700c9330 0x7fcf701545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7015bc70 0x7fcf700b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700c8030 con 0x7fcf700c1f40 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700c3150 con 0x7fcf7015bc70 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcf70074c60 con 0x7fcf700c9330 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c1f40 0x7fcf701f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c1f40 0x7fcf701f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44740/0 (socket says 172.21.15.89:44740) 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75400640 1 -- 172.21.15.89:0/1097927916 learned_addr learned my addr 172.21.15.89:0/1097927916 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf74a00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf700c9330 0x7fcf701545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75e00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7015bc70 0x7fcf700b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75400640 1 -- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf700c9330 msgr2=0x7fcf701545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75400640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf700c9330 0x7fcf701545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75400640 1 -- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7015bc70 msgr2=0x7fcf700b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75400640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7015bc70 0x7fcf700b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75400640 1 -- 172.21.15.89:0/1097927916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7015b4b0 con 0x7fcf700c1f40 2024-08-31T04:41:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75e00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7015bc70 0x7fcf700b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:41:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf75400640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c1f40 0x7fcf701f57f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c420 tx=0x7fcf6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf6d600640 1 -- 172.21.15.89:0/1097927916 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64017070 con 0x7fcf700c1f40 2024-08-31T04:41:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf6d600640 1 -- 172.21.15.89:0/1097927916 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf640053c0 con 0x7fcf700c1f40 2024-08-31T04:41:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7015ba50 con 0x7fcf700c1f40 2024-08-31T04:41:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf6d600640 1 -- 172.21.15.89:0/1097927916 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64003860 con 0x7fcf700c1f40 2024-08-31T04:41:32.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.319+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf701532f0 con 0x7fcf700c1f40 2024-08-31T04:41:32.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.323+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf70152a10 con 0x7fcf700c1f40 2024-08-31T04:41:32.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.323+0000 7fcf6d600640 1 -- 172.21.15.89:0/1097927916 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fcf6401a070 con 0x7fcf700c1f40 2024-08-31T04:41:32.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.323+0000 7fcf6d600640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf500720c0 0x7fcf500745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.323+0000 7fcf6d600640 1 -- 172.21.15.89:0/1097927916 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fcf64092110 con 0x7fcf700c1f40 2024-08-31T04:41:32.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.323+0000 7fcf74a00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf500720c0 0x7fcf500745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.327+0000 7fcf74a00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf500720c0 0x7fcf500745d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcf700c66e0 tx=0x7fcf5c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:32.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.327+0000 7fcf6d600640 1 -- 172.21.15.89:0/1097927916 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcf6405d030 con 0x7fcf700c1f40 2024-08-31T04:41:32.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.527+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf70150d60 con 0x7fcf700c1f40 2024-08-31T04:41:32.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf6d600640 1 -- 172.21.15.89:0/1097927916 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fcf640617f0 con 0x7fcf700c1f40 2024-08-31T04:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:41:32.531 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:41:32.532 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:41:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf500720c0 msgr2=0x7fcf500745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf500720c0 0x7fcf500745d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcf700c66e0 tx=0x7fcf5c0091e0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c1f40 msgr2=0x7fcf701f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c1f40 0x7fcf701f57f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c420 tx=0x7fcf6400c8e0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 shutdown_connections 2024-08-31T04:41:32.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fcf500720c0 0x7fcf500745d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf7015bc70 0x7fcf700b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf700c9330 0x7fcf701545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 --2- 172.21.15.89:0/1097927916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf700c1f40 0x7fcf701f57f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 >> 172.21.15.89:0/1097927916 conn(0x7fcf700ccf20 msgr2=0x7fcf70150f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 shutdown_connections 2024-08-31T04:41:32.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.531+0000 7fcf77e00640 1 -- 172.21.15.89:0/1097927916 wait complete. 2024-08-31T04:41:32.553 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id db3750d5 --release --await' 2024-08-31T04:41:32.553 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id db3750d5 --release --await 2024-08-31T04:41:32.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 -- 172.21.15.89:0/3947666222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd938152ad0 msgr2=0x7fd938158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 --2- 172.21.15.89:0/3947666222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd938152ad0 0x7fd938158650 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009900 tx=0x7fd92c01f0d0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 -- 172.21.15.89:0/3947666222 shutdown_connections 2024-08-31T04:41:32.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 --2- 172.21.15.89:0/3947666222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9380c88c0 0x7fd9380ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 --2- 172.21.15.89:0/3947666222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd938152ad0 0x7fd938158650 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 -- 172.21.15.89:0/3947666222 >> 172.21.15.89:0/3947666222 conn(0x7fd9380ca9c0 msgr2=0x7fd9380cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:32.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 -- 172.21.15.89:0/3947666222 shutdown_connections 2024-08-31T04:41:32.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 -- 172.21.15.89:0/3947666222 wait complete. 2024-08-31T04:41:32.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 Processor -- start 2024-08-31T04:41:32.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.723+0000 7fd93f000640 1 -- start start 2024-08-31T04:41:32.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93f000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9380c2ee0 0x7fd9381f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93f000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9380c88c0 0x7fd93815bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93f000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd938152ad0 0x7fd9381f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93f000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd9380b3e60 con 0x7fd9380c2ee0 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93f000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd9380b3b80 con 0x7fd9380c88c0 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93f000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd938072f50 con 0x7fd938152ad0 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9380c2ee0 0x7fd9381f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9380c2ee0 0x7fd9381f1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44754/0 (socket says 172.21.15.89:44754) 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93dc00640 1 -- 172.21.15.89:0/30676935 learned_addr learned my addr 172.21.15.89:0/30676935 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93e600640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd938152ad0 0x7fd9381f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93d200640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9380c88c0 0x7fd93815bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93dc00640 1 -- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd938152ad0 msgr2=0x7fd9381f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93dc00640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd938152ad0 0x7fd9381f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93dc00640 1 -- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9380c88c0 msgr2=0x7fd93815bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93dc00640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9380c88c0 0x7fd93815bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93dc00640 1 -- 172.21.15.89:0/30676935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93815ca10 con 0x7fd9380c2ee0 2024-08-31T04:41:32.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93d200640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9380c88c0 0x7fd93815bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:41:32.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93dc00640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9380c2ee0 0x7fd9381f1090 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0099f0 tx=0x7fd92c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:32.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd935600640 1 -- 172.21.15.89:0/30676935 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0b5040 con 0x7fd9380c2ee0 2024-08-31T04:41:32.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd935600640 1 -- 172.21.15.89:0/30676935 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd92c003600 con 0x7fd9380c2ee0 2024-08-31T04:41:32.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93f000640 1 -- 172.21.15.89:0/30676935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93815b210 con 0x7fd9380c2ee0 2024-08-31T04:41:32.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd935600640 1 -- 172.21.15.89:0/30676935 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0039b0 con 0x7fd9380c2ee0 2024-08-31T04:41:32.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.727+0000 7fd93f000640 1 -- 172.21.15.89:0/30676935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd93814c8a0 con 0x7fd9380c2ee0 2024-08-31T04:41:32.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd935600640 1 -- 172.21.15.89:0/30676935 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fd92c0c2020 con 0x7fd9380c2ee0 2024-08-31T04:41:32.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd935600640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9180720c0 0x7fd9180745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd947e52000 1 Processor -- start 2024-08-31T04:41:32.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd935600640 1 -- 172.21.15.89:0/30676935 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fd92c130ae0 con 0x7fd9380c2ee0 2024-08-31T04:41:32.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd947e52000 1 -- start start 2024-08-31T04:41:32.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd93d200640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9180720c0 0x7fd9180745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd93d200640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9180720c0 0x7fd9180745d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd938150310 tx=0x7fd924009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:32.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd947e52000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a5041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd947e52000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 0x55a7a5042010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd947e52000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a5042550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd947e52000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a7a4ee7f30 con 0x55a7a4ef9890 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd947e52000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a7a4e5d690 con 0x55a7a4f08930 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd947e52000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a7a4e4cc20 con 0x55a7a4f1e950 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd93e600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a5042550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd93d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 0x55a7a5042010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd93e600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a5042550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44770/0 (socket says 172.21.15.89:44770) 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd93dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a5041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.731+0000 7fd93e600640 1 -- 172.21.15.89:0/3091042304 learned_addr learned my addr 172.21.15.89:0/3091042304 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd93e600640 1 -- 172.21.15.89:0/3091042304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 msgr2=0x55a7a5041ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd93e600640 1 --2- 172.21.15.89:0/3091042304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a5041ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd93e600640 1 -- 172.21.15.89:0/3091042304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 msgr2=0x55a7a5042010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:32.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd93e600640 1 --2- 172.21.15.89:0/3091042304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 0x55a7a5042010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd93e600640 1 -- 172.21.15.89:0/3091042304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a4e018f0 con 0x55a7a4ef9890 2024-08-31T04:41:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd93e600640 1 --2- 172.21.15.89:0/3091042304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a5042550 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd930009ec0 tx=0x7fd9300107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaa628619aed1a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd92a000640 1 -- 172.21.15.89:0/3091042304 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930003b80 con 0x55a7a4ef9890 2024-08-31T04:41:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd92a000640 1 -- 172.21.15.89:0/3091042304 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd930003e10 con 0x55a7a4ef9890 2024-08-31T04:41:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd92a000640 1 -- 172.21.15.89:0/3091042304 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930004290 con 0x55a7a4ef9890 2024-08-31T04:41:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 -- 172.21.15.89:0/3091042304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 msgr2=0x55a7a5042550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 --2- 172.21.15.89:0/3091042304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a5042550 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd930009ec0 tx=0x7fd9300107a0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 -- 172.21.15.89:0/3091042304 shutdown_connections 2024-08-31T04:41:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 --2- 172.21.15.89:0/3091042304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a5042550 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 --2- 172.21.15.89:0/3091042304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 0x55a7a5042010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 --2- 172.21.15.89:0/3091042304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a5041ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 -- 172.21.15.89:0/3091042304 >> 172.21.15.89:0/3091042304 conn(0x55a7a4f1e540 msgr2=0x55a7a503f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 -- 172.21.15.89:0/3091042304 shutdown_connections 2024-08-31T04:41:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 -- 172.21.15.89:0/3091042304 wait complete. 2024-08-31T04:41:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 -- start start 2024-08-31T04:41:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.735+0000 7fd947e52000 1 Processor -- start 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a503bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 0x55a7a503c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a503c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a7a4dd3500 con 0x55a7a4ef9890 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a7a4e50bd0 con 0x55a7a4f08930 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a7a4df4a30 con 0x55a7a4f1e950 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 10 client.0 _ll_register_callbacks cb 0x55a7a4f02b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a503bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a503bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44776/0 (socket says 172.21.15.89:44776) 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93dc00640 1 -- 172.21.15.89:0/1595925213 learned_addr learned my addr 172.21.15.89:0/1595925213 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93e600640 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a503c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93d200640 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 0x55a7a503c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93dc00640 1 -- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 msgr2=0x55a7a503c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93dc00640 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a503c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93dc00640 1 -- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 msgr2=0x55a7a503c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93dc00640 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 0x55a7a503c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93dc00640 1 -- 172.21.15.89:0/1595925213 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a4dec6a0 con 0x55a7a4ef9890 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93dc00640 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a503bc10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd92c01d780 tx=0x7fd92c0fc100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e0c9924e2357b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd91ea00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd91ea00640 1 -- 172.21.15.89:0/1595925213 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0fbb20 con 0x55a7a4ef9890 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd91ea00640 1 -- 172.21.15.89:0/1595925213 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fd92c0fbcc0 con 0x55a7a4ef9890 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 -- 172.21.15.89:0/1595925213 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a7a4de67e0 con 0x55a7a4ef9890 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd91ea00640 1 -- 172.21.15.89:0/1595925213 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd92c1046c0 con 0x55a7a4ef9890 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 10 client.6453 fetch_fsmap learned FSMap version 9 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 -- 172.21.15.89:0/1595925213 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a7a4e0b1c0 con 0x55a7a4ef9890 2024-08-31T04:41:32.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd91ea00640 1 -- 172.21.15.89:0/1595925213 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a7a4de67e0 con 0x55a7a4ef9890 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd91ea00640 1 -- 172.21.15.89:0/1595925213 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fd92c12e5c0 con 0x55a7a4ef9890 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 10 client.6453 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 10 client.6453 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 20 client.6453 populate_metadata read hostname 'smithi089' 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a7a4ee2fc0 0x55a7a505a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 4 client.6453 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd947e52000 1 -- 172.21.15.89:0/1595925213 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7a4e5f5e0 con 0x55a7a4ee2fc0 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93d200640 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a7a4ee2fc0 0x55a7a505a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd91ea00640 10 client.6453 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:32.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.739+0000 7fd93d200640 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a7a4ee2fc0 0x55a7a505a1a0 crc :-1 s=READY pgs=1717 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c3b66676e94ebce server_cookie=ad5dfd8a35eba6e9 in_seq=0 out_seq=0 2024-08-31T04:41:32.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd91ea00640 1 -- 172.21.15.89:0/1595925213 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7a4e5f5e0 con 0x55a7a4ee2fc0 2024-08-31T04:41:32.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd91ea00640 10 client.6453 handle_command_reply: tid=0 2024-08-31T04:41:32.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 client.6453 shutdown 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 -- 172.21.15.89:0/1595925213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 msgr2=0x55a7a503bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a503bc10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd92c01d780 tx=0x7fd92c0fc100 comp rx=0 tx=0).stop 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 -- 172.21.15.89:0/1595925213 shutdown_connections 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a7a4ee2fc0 0x55a7a505a1a0 crc :-1 s=READY pgs=1717 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a503c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f08930 0x55a7a503c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd91ea00640 0 client.6453 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 --2- 172.21.15.89:0/1595925213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a503bc10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 -- 172.21.15.89:0/1595925213 >> 172.21.15.89:0/1595925213 conn(0x55a7a4f1e540 msgr2=0x55a7a503e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 -- 172.21.15.89:0/1595925213 shutdown_connections 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 1 -- 172.21.15.89:0/1595925213 wait complete. 2024-08-31T04:41:32.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.743+0000 7fd947e52000 20 client.6453 trim_cache size 0 max 16384 2024-08-31T04:41:32.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.759+0000 7fd947e52000 1 Processor -- start 2024-08-31T04:41:32.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.759+0000 7fd947e52000 1 -- start start 2024-08-31T04:41:32.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a50600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f08930 0x55a7a505b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f1e950 0x55a7a505b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381fc9d0 con 0x55a7a4ef9890 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381fb8b0 con 0x55a7a4f1e950 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd9380c72e0 con 0x55a7a4f08930 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a50600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a50600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44778/0 (socket says 172.21.15.89:44778) 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93dc00640 1 -- 172.21.15.89:0/2699024859 learned_addr learned my addr 172.21.15.89:0/2699024859 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93d200640 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f08930 0x55a7a505b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93e600640 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f1e950 0x55a7a505b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93dc00640 1 -- 172.21.15.89:0/2699024859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f08930 msgr2=0x55a7a505b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:32.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93dc00640 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f08930 0x55a7a505b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93dc00640 1 -- 172.21.15.89:0/2699024859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f1e950 msgr2=0x55a7a505b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:32.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93dc00640 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f1e950 0x55a7a505b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93dc00640 1 -- 172.21.15.89:0/2699024859 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a4ed12f0 con 0x55a7a4ef9890 2024-08-31T04:41:32.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93e600640 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f1e950 0x55a7a505b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:41:32.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd93dc00640 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a50600a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0f79d0 tx=0x7fd92c0a8b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c95f43c3f54506f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:32.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd929600640 1 -- 172.21.15.89:0/2699024859 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c125070 con 0x55a7a4ef9890 2024-08-31T04:41:32.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd929600640 1 -- 172.21.15.89:0/2699024859 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd92c12ea70 con 0x55a7a4ef9890 2024-08-31T04:41:32.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd929600640 1 -- 172.21.15.89:0/2699024859 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c104860 con 0x55a7a4ef9890 2024-08-31T04:41:32.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 -- 172.21.15.89:0/2699024859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 msgr2=0x55a7a50600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a50600a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0f79d0 tx=0x7fd92c0a8b60 comp rx=0 tx=0).stop 2024-08-31T04:41:32.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 -- 172.21.15.89:0/2699024859 shutdown_connections 2024-08-31T04:41:32.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4f1e950 0x55a7a505b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f08930 0x55a7a505b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 --2- 172.21.15.89:0/2699024859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4ef9890 0x55a7a50600a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 -- 172.21.15.89:0/2699024859 >> 172.21.15.89:0/2699024859 conn(0x55a7a4f1e540 msgr2=0x55a7a5006310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:32.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 -- 172.21.15.89:0/2699024859 shutdown_connections 2024-08-31T04:41:32.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 -- 172.21.15.89:0/2699024859 wait complete. 2024-08-31T04:41:32.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.763+0000 7fd947e52000 1 -- start start 2024-08-31T04:41:32.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 Processor -- start 2024-08-31T04:41:32.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4ef9890 0x55a7a505ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4f08930 0x55a7a505f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a50806f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381fa6d0 con 0x55a7a4f08930 2024-08-31T04:41:32.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381fb1e0 con 0x55a7a4ef9890 2024-08-31T04:41:32.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd9381fab50 con 0x55a7a4f1e950 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 10 client.0 _ll_register_callbacks cb 0x7fd92c0057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4f08930 0x55a7a505f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4ef9890 0x55a7a505ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93d200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4f08930 0x55a7a505f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44784/0 (socket says 172.21.15.89:44784) 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93d200640 1 -- 172.21.15.89:0/1092053817 learned_addr learned my addr 172.21.15.89:0/1092053817 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93e600640 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a50806f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93d200640 1 -- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 msgr2=0x55a7a50806f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93d200640 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a50806f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93d200640 1 -- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4ef9890 msgr2=0x55a7a505ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93d200640 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4ef9890 0x55a7a505ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93d200640 1 -- 172.21.15.89:0/1092053817 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a4dd6b30 con 0x55a7a4f08930 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd93d200640 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4f08930 0x55a7a505f2c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd9240039a0 tx=0x7fd924007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5766a3e0cc64d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:32.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd91ea00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:41:32.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd91ea00640 1 -- 172.21.15.89:0/1092053817 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92402f060 con 0x55a7a4f08930 2024-08-31T04:41:32.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd91ea00640 1 -- 172.21.15.89:0/1092053817 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fd924007260 con 0x55a7a4f08930 2024-08-31T04:41:32.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 -- 172.21.15.89:0/1092053817 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd92c12ea70 con 0x55a7a4f08930 2024-08-31T04:41:32.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd91ea00640 1 -- 172.21.15.89:0/1092053817 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd9240074a0 con 0x55a7a4f08930 2024-08-31T04:41:32.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 10 client.6459 fetch_fsmap learned FSMap version 9 2024-08-31T04:41:32.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 -- 172.21.15.89:0/1092053817 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a7a4de3c70 con 0x55a7a4f08930 2024-08-31T04:41:32.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd91ea00640 1 -- 172.21.15.89:0/1092053817 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd92c12ea70 con 0x55a7a4f08930 2024-08-31T04:41:32.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd91ea00640 1 -- 172.21.15.89:0/1092053817 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fd9240067c0 con 0x55a7a4f08930 2024-08-31T04:41:32.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 10 client.6459 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:41:32.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 10 client.6459 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:41:32.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 20 client.6459 populate_metadata read hostname 'smithi089' 2024-08-31T04:41:32.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a7a4adee80 0x55a7a5080c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:32.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 4 client.6459 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "db3750d5", "release": true, "await": true}] 2024-08-31T04:41:32.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.767+0000 7fd947e52000 1 -- 172.21.15.89:0/1092053817 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "db3750d5", "release": true, "await": true}) -- 0x55a7a4e5b080 con 0x55a7a4adee80 2024-08-31T04:41:32.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.771+0000 7fd93dc00640 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a7a4adee80 0x55a7a5080c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:32.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.771+0000 7fd93dc00640 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a7a4adee80 0x55a7a5080c30 crc :-1 s=READY pgs=1718 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7d83b086ab9c770 server_cookie=de8899ff3a4db71c in_seq=0 out_seq=0 2024-08-31T04:41:32.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.771+0000 7fd91ea00640 10 client.6459 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:32.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd91ea00640 1 -- 172.21.15.89:0/1092053817 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a7a4e5b080 con 0x55a7a4adee80 2024-08-31T04:41:32.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd91ea00640 10 client.6459 handle_command_reply: tid=0 2024-08-31T04:41:32.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 client.6459 shutdown 2024-08-31T04:41:32.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 -- 172.21.15.89:0/1092053817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4f08930 msgr2=0x55a7a505f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4f08930 0x55a7a505f2c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd9240039a0 tx=0x7fd924007940 comp rx=0 tx=0).stop 2024-08-31T04:41:32.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 -- 172.21.15.89:0/1092053817 shutdown_connections 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55a7a4adee80 0x55a7a5080c30 crc :-1 s=READY pgs=1718 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a7a4f08930 0x55a7a505f2c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a7a4f1e950 0x55a7a50806f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 --2- 172.21.15.89:0/1092053817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a7a4ef9890 0x55a7a505ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd91ea00640 0 client.6459 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 -- 172.21.15.89:0/1092053817 >> 172.21.15.89:0/1092053817 conn(0x55a7a4f1e540 msgr2=0x55a7a5006310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 -- 172.21.15.89:0/1092053817 shutdown_connections 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 1 -- 172.21.15.89:0/1092053817 wait complete. 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.923+0000 7fd947e52000 20 client.6459 trim_cache size 0 max 16384 2024-08-31T04:41:32.928 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 132, 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "db3750d5": { 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 132, 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:41:32.929 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 143.3, 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:32.930 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:41:32.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 -- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9180720c0 msgr2=0x7fd9180745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9180720c0 0x7fd9180745d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd938150310 tx=0x7fd924009040 comp rx=0 tx=0).stop 2024-08-31T04:41:32.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 -- 172.21.15.89:0/30676935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9380c2ee0 msgr2=0x7fd9381f1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:32.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9380c2ee0 0x7fd9381f1090 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0099f0 tx=0x7fd92c0056e0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 -- 172.21.15.89:0/30676935 shutdown_connections 2024-08-31T04:41:32.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fd9180720c0 0x7fd9180745d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd938152ad0 0x7fd9381f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9380c88c0 0x7fd93815bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 --2- 172.21.15.89:0/30676935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9380c2ee0 0x7fd9381f1090 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:32.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 -- 172.21.15.89:0/30676935 >> 172.21.15.89:0/30676935 conn(0x7fd9380ca9c0 msgr2=0x7fd9380765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:32.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 -- 172.21.15.89:0/30676935 shutdown_connections 2024-08-31T04:41:32.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:32.927+0000 7fd93f000640 1 -- 172.21.15.89:0/30676935 wait complete. 2024-08-31T04:41:32.947 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'db3750d5', total seconds elapsed: 24.1 2024-08-31T04:41:32.947 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.3 2024-08-31T04:41:32.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:41:33.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.111+0000 7fa7bb200640 1 -- 172.21.15.89:0/1762017309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 msgr2=0x7fa7bc159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.111+0000 7fa7bb200640 1 --2- 172.21.15.89:0/1762017309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 0x7fa7bc159c50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009bc0 tx=0x7fa7b401f3b0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.111+0000 7fa7bb200640 1 -- 172.21.15.89:0/1762017309 shutdown_connections 2024-08-31T04:41:33.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.111+0000 7fa7bb200640 1 --2- 172.21.15.89:0/1762017309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 0x7fa7bc159c50 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.111+0000 7fa7bb200640 1 --2- 172.21.15.89:0/1762017309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7bc0c70e0 0x7fa7bc06eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.111+0000 7fa7bb200640 1 -- 172.21.15.89:0/1762017309 >> 172.21.15.89:0/1762017309 conn(0x7fa7bc0c9b00 msgr2=0x7fa7bc0c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:33.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.111+0000 7fa7bb200640 1 -- 172.21.15.89:0/1762017309 shutdown_connections 2024-08-31T04:41:33.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.111+0000 7fa7bb200640 1 -- 172.21.15.89:0/1762017309 wait complete. 2024-08-31T04:41:33.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.115+0000 7fa7bb200640 1 Processor -- start 2024-08-31T04:41:33.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.115+0000 7fa7bb200640 1 -- start start 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7bb200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 0x7fa7bc152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7bb200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7bc0c70e0 0x7fa7bc148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7bb200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7bc0c7a00 0x7fa7bc151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7bb200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc15d770 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7bb200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc15d490 con 0x7fa7bc0c7a00 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7bb200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa7bc15da50 con 0x7fa7bc0c70e0 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 0x7fa7bc152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 0x7fa7bc152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44808/0 (socket says 172.21.15.89:44808) 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b9e00640 1 -- 172.21.15.89:0/1681305574 learned_addr learned my addr 172.21.15.89:0/1681305574 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:33.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b1400640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7bc0c70e0 0x7fa7bc148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7ba800640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7bc0c7a00 0x7fa7bc151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b9e00640 1 -- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7bc0c70e0 msgr2=0x7fa7bc148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b9e00640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7bc0c70e0 0x7fa7bc148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b9e00640 1 -- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7bc0c7a00 msgr2=0x7fa7bc151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b9e00640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7bc0c7a00 0x7fa7bc151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b9e00640 1 -- 172.21.15.89:0/1681305574 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc0c5d70 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b9e00640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 0x7fa7bc152ad0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00c410 tx=0x7fa7ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:33.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b2a00640 1 -- 172.21.15.89:0/1681305574 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac011790 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b2a00640 1 -- 172.21.15.89:0/1681305574 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7ac017070 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc1476c0 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b2a00640 1 -- 172.21.15.89:0/1681305574 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac011ce0 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc151190 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7bc0c6430 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.119+0000 7fa7b2a00640 1 -- 172.21.15.89:0/1681305574 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa7ac01c460 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.123+0000 7fa7b2a00640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa7980720c0 0x7fa7980745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.123+0000 7fa7b2a00640 1 -- 172.21.15.89:0/1681305574 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa7ac092bb0 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.123+0000 7fa7b1400640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa7980720c0 0x7fa7980745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.123+0000 7fa7b1400640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa7980720c0 0x7fa7980745d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc14d900 tx=0x7fa7a40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:33.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.127+0000 7fa7b2a00640 1 -- 172.21.15.89:0/1681305574 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa7ac05da40 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.335+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7bc0c8e10 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.335+0000 7fa7b2a00640 1 -- 172.21.15.89:0/1681305574 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fa7ac062200 con 0x7fa7bc06f0b0 2024-08-31T04:41:33.337 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:41:33.337 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:41:33.337 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:41:33.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa7980720c0 msgr2=0x7fa7980745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa7980720c0 0x7fa7980745d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc14d900 tx=0x7fa7a40091e0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 msgr2=0x7fa7bc152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 0x7fa7bc152ad0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00c410 tx=0x7fa7ac00c8d0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 shutdown_connections 2024-08-31T04:41:33.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa7980720c0 0x7fa7980745d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7bc0c7a00 0x7fa7bc151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7bc0c70e0 0x7fa7bc148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 --2- 172.21.15.89:0/1681305574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc06f0b0 0x7fa7bc152ad0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 >> 172.21.15.89:0/1681305574 conn(0x7fa7bc0c9b00 msgr2=0x7fa7bc073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:33.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 shutdown_connections 2024-08-31T04:41:33.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.339+0000 7fa7bb200640 1 -- 172.21.15.89:0/1681305574 wait complete. 2024-08-31T04:41:33.358 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 143.3 --await-for 45.0' 2024-08-31T04:41:33.358 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 143.3 --await-for 45.0 2024-08-31T04:41:33.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.523+0000 7fdcd2a00640 1 -- 172.21.15.89:0/482598682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb0003c20 msgr2=0x7fdcb0004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.523+0000 7fdcd2a00640 1 --2- 172.21.15.89:0/482598682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcb0003c20 0x7fdcb0004070 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc001860 tx=0x7fdcbc01c8e0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.523+0000 7fdcd0a00640 1 -- 172.21.15.89:0/482598682 reap_dead start 2024-08-31T04:41:33.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.523+0000 7fdcd2a00640 1 -- 172.21.15.89:0/482598682 shutdown_connections 2024-08-31T04:41:33.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.523+0000 7fdcd2a00640 1 -- 172.21.15.89:0/482598682 >> 172.21.15.89:0/482598682 conn(0x7fdccc0c99b0 msgr2=0x7fdccc0c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:33.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.523+0000 7fdcd2a00640 1 -- 172.21.15.89:0/482598682 shutdown_connections 2024-08-31T04:41:33.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.523+0000 7fdcd2a00640 1 -- 172.21.15.89:0/482598682 wait complete. 2024-08-31T04:41:33.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd2a00640 1 Processor -- start 2024-08-31T04:41:33.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd2a00640 1 -- start start 2024-08-31T04:41:33.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd2a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcb0003c20 0x7fdccc1f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdccc14a270 0x7fdccc14a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd2a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14dc70 0x7fdccc14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd2a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc0c97f0 con 0x7fdccc14dc70 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd2a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc163f60 con 0x7fdccc14a270 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd2a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc1640e0 con 0x7fdcb0003c20 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd0a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14dc70 0x7fdccc14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd0a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14dc70 0x7fdccc14e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44822/0 (socket says 172.21.15.89:44822) 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd0a00640 1 -- 172.21.15.89:0/3823893554 learned_addr learned my addr 172.21.15.89:0/3823893554 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdccb400640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdccc14a270 0x7fdccc14a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdccbe00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcb0003c20 0x7fdccc1f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd0a00640 1 -- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcb0003c20 msgr2=0x7fdccc1f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd0a00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcb0003c20 0x7fdccc1f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd0a00640 1 -- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdccc14a270 msgr2=0x7fdccc14a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd0a00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdccc14a270 0x7fdccc14a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd0a00640 1 -- 172.21.15.89:0/3823893554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc1f4740 con 0x7fdccc14dc70 2024-08-31T04:41:33.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.527+0000 7fdcd0a00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14dc70 0x7fdccc14e080 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0c3c70 tx=0x7fdcc400fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:33.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcc3e00640 1 -- 172.21.15.89:0/3823893554 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4003e50 con 0x7fdccc14dc70 2024-08-31T04:41:33.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcc3e00640 1 -- 172.21.15.89:0/3823893554 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcc4017070 con 0x7fdccc14dc70 2024-08-31T04:41:33.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcd2a00640 1 -- 172.21.15.89:0/3823893554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc0c5d50 con 0x7fdccc14dc70 2024-08-31T04:41:33.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcc3e00640 1 -- 172.21.15.89:0/3823893554 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400d8d0 con 0x7fdccc14dc70 2024-08-31T04:41:33.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcd2a00640 1 -- 172.21.15.89:0/3823893554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc1f8030 con 0x7fdccc14dc70 2024-08-31T04:41:33.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcc3e00640 1 -- 172.21.15.89:0/3823893554 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdcc400da70 con 0x7fdccc14dc70 2024-08-31T04:41:33.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcc3e00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdcac072260 0x7fdcac074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcc3e00640 1 -- 172.21.15.89:0/3823893554 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdcc4093490 con 0x7fdccc14dc70 2024-08-31T04:41:33.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcd9fca000 1 Processor -- start 2024-08-31T04:41:33.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdccbe00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdcac072260 0x7fdcac074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.531+0000 7fdcd9fca000 1 -- start start 2024-08-31T04:41:33.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccbe00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdcac072260 0x7fdcac074770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc001830 tx=0x7fdcbc019720 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:33.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd47be90 0x55b4fd588ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 0x55b4fd589220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd3de820 con 0x55b4fd47be90 2024-08-31T04:41:33.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd3cddb0 con 0x55b4fd4863f0 2024-08-31T04:41:33.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b4fd3d1d60 con 0x55b4fd465960 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd47be90 0x55b4fd588ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccb400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd47be90 0x55b4fd588ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44824/0 (socket says 172.21.15.89:44824) 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccb400640 1 -- 172.21.15.89:0/115167501 learned_addr learned my addr 172.21.15.89:0/115167501 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccbe00640 1 --2- 172.21.15.89:0/115167501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd0a00640 1 --2- 172.21.15.89:0/115167501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 0x55b4fd589220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccb400640 1 -- 172.21.15.89:0/115167501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 msgr2=0x55b4fd589220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccb400640 1 --2- 172.21.15.89:0/115167501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 0x55b4fd589220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccb400640 1 -- 172.21.15.89:0/115167501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 msgr2=0x55b4fd5bfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccb400640 1 --2- 172.21.15.89:0/115167501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccb400640 1 -- 172.21.15.89:0/115167501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4fd368b70 con 0x55b4fd47be90 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdccb400640 1 --2- 172.21.15.89:0/115167501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd47be90 0x55b4fd588ce0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8004990 tx=0x7fdcb80016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb1fffc3775b6be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcb7e00640 1 -- 172.21.15.89:0/115167501 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8011c70 con 0x55b4fd47be90 2024-08-31T04:41:33.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcb7e00640 1 -- 172.21.15.89:0/115167501 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcb8016030 con 0x55b4fd47be90 2024-08-31T04:41:33.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcb7e00640 1 -- 172.21.15.89:0/115167501 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80126a0 con 0x55b4fd47be90 2024-08-31T04:41:33.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 -- 172.21.15.89:0/115167501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd47be90 msgr2=0x55b4fd588ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/115167501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd47be90 0x55b4fd588ce0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8004990 tx=0x7fdcb80016c0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 -- 172.21.15.89:0/115167501 shutdown_connections 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/115167501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd47be90 0x55b4fd588ce0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/115167501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 0x55b4fd589220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/115167501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 -- 172.21.15.89:0/115167501 >> 172.21.15.89:0/115167501 conn(0x55b4fd08d210 msgr2=0x55b4fd5c2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 -- 172.21.15.89:0/115167501 shutdown_connections 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.535+0000 7fdcd9fca000 1 -- 172.21.15.89:0/115167501 wait complete. 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 -- start start 2024-08-31T04:41:33.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 Processor -- start 2024-08-31T04:41:33.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 0x55b4fd5be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 0x55b4fd5bee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd094b10 con 0x55b4fd4863f0 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd3546f0 con 0x55b4fd47be90 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b4fd3d6390 con 0x55b4fd465960 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 10 client.0 _ll_register_callbacks cb 0x55b4fd375b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd0a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdccb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 0x55b4fd5bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdccbe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 0x55b4fd5be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd0a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44832/0 (socket says 172.21.15.89:44832) 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd0a00640 1 -- 172.21.15.89:0/1468013494 learned_addr learned my addr 172.21.15.89:0/1468013494 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd0a00640 1 -- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 msgr2=0x55b4fd5be8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd0a00640 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 0x55b4fd5be8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd0a00640 1 -- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 msgr2=0x55b4fd5bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd0a00640 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 0x55b4fd5bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd0a00640 1 -- 172.21.15.89:0/1468013494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4fd38c380 con 0x55b4fd4863f0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd0a00640 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bf370 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4091550 tx=0x7fdcc405def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadabd957242212a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcb4c00640 1 -- 172.21.15.89:0/1468013494 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4020040 con 0x55b4fd4863f0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcb4c00640 1 -- 172.21.15.89:0/1468013494 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdcc4067070 con 0x55b4fd4863f0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 -- 172.21.15.89:0/1468013494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4fd3dcd20 con 0x55b4fd4863f0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcb4c00640 1 -- 172.21.15.89:0/1468013494 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdcc40830d0 con 0x55b4fd4863f0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 10 client.6480 fetch_fsmap learned FSMap version 9 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcd9fca000 1 -- 172.21.15.89:0/1468013494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b4fd452e40 con 0x55b4fd4863f0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcb4c00640 1 -- 172.21.15.89:0/1468013494 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b4fd3dcd20 con 0x55b4fd4863f0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.539+0000 7fdcb4c00640 1 -- 172.21.15.89:0/1468013494 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdcc405d580 con 0x55b4fd4863f0 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 10 client.6480 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:41:33.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 10 client.6480 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:41:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 20 client.6480 populate_metadata read hostname 'smithi089' 2024-08-31T04:41:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4fd071dc0 0x55b4fd5d9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 4 client.6480 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:41:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 -- 172.21.15.89:0/1468013494 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4fd3e0770 con 0x55b4fd071dc0 2024-08-31T04:41:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdccbe00640 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4fd071dc0 0x55b4fd5d9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdccbe00640 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4fd071dc0 0x55b4fd5d9f90 crc :-1 s=READY pgs=1719 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e3eb55df5078ff server_cookie=5aa2db1f8935d92c in_seq=0 out_seq=0 2024-08-31T04:41:33.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcb4c00640 10 client.6480 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:33.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcb4c00640 1 -- 172.21.15.89:0/1468013494 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4fd3e0770 con 0x55b4fd071dc0 2024-08-31T04:41:33.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcb4c00640 10 client.6480 handle_command_reply: tid=0 2024-08-31T04:41:33.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 client.6480 shutdown 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 -- 172.21.15.89:0/1468013494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd4863f0 msgr2=0x55b4fd5bf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bf370 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4091550 tx=0x7fdcc405def0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 -- 172.21.15.89:0/1468013494 shutdown_connections 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4fd071dc0 0x55b4fd5d9f90 crc :-1 s=READY pgs=1719 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd4863f0 0x55b4fd5bf370 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 0x55b4fd5bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcb4c00640 0 client.6480 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/1468013494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd465960 0x55b4fd5be8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 -- 172.21.15.89:0/1468013494 >> 172.21.15.89:0/1468013494 conn(0x55b4fd08d210 msgr2=0x55b4fd5c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 -- 172.21.15.89:0/1468013494 shutdown_connections 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 1 -- 172.21.15.89:0/1468013494 wait complete. 2024-08-31T04:41:33.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.543+0000 7fdcd9fca000 20 client.6480 trim_cache size 0 max 16384 2024-08-31T04:41:33.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcd9fca000 1 Processor -- start 2024-08-31T04:41:33.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcd9fca000 1 -- start start 2024-08-31T04:41:33.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd5877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd47be90 0x55b4fd587ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 0x55b4fd5d9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc2016a0 con 0x55b4fd465960 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc202a50 con 0x55b4fd4863f0 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc201cf0 con 0x55b4fd47be90 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccbe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd5877a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccbe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd5877a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44846/0 (socket says 172.21.15.89:44846) 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccbe00640 1 -- 172.21.15.89:0/3359680746 learned_addr learned my addr 172.21.15.89:0/3359680746 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccb400640 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd47be90 0x55b4fd587ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcd0a00640 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 0x55b4fd5d9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccbe00640 1 -- 172.21.15.89:0/3359680746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd47be90 msgr2=0x55b4fd587ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccbe00640 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd47be90 0x55b4fd587ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccbe00640 1 -- 172.21.15.89:0/3359680746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 msgr2=0x55b4fd5d9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccbe00640 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 0x55b4fd5d9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccbe00640 1 -- 172.21.15.89:0/3359680746 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4fd42a5b0 con 0x55b4fd465960 2024-08-31T04:41:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccb400640 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd47be90 0x55b4fd587ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:41:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdccbe00640 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd5877a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0061f0 tx=0x7fdcbc0a7050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73102ac4089066ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcb7400640 1 -- 172.21.15.89:0/3359680746 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc003bd0 con 0x55b4fd465960 2024-08-31T04:41:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcb7400640 1 -- 172.21.15.89:0/3359680746 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcbc003d70 con 0x55b4fd465960 2024-08-31T04:41:33.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.563+0000 7fdcb7400640 1 -- 172.21.15.89:0/3359680746 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0a5560 con 0x55b4fd465960 2024-08-31T04:41:33.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 -- 172.21.15.89:0/3359680746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 msgr2=0x55b4fd5877a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:33.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd5877a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0061f0 tx=0x7fdcbc0a7050 comp rx=0 tx=0).stop 2024-08-31T04:41:33.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 -- 172.21.15.89:0/3359680746 shutdown_connections 2024-08-31T04:41:33.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd4863f0 0x55b4fd5d9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd47be90 0x55b4fd587ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/3359680746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd5877a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 -- 172.21.15.89:0/3359680746 >> 172.21.15.89:0/3359680746 conn(0x55b4fd08d210 msgr2=0x55b4fd588860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:33.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 -- 172.21.15.89:0/3359680746 shutdown_connections 2024-08-31T04:41:33.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 -- 172.21.15.89:0/3359680746 wait complete. 2024-08-31T04:41:33.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 -- start start 2024-08-31T04:41:33.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 Processor -- start 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd63c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 0x55b4fd63cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd4863f0 0x55b4fd63d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd34feb0 con 0x55b4fd465960 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc202380 con 0x55b4fd47be90 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b4fd375f20 con 0x55b4fd4863f0 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd9fca000 10 client.0 _ll_register_callbacks cb 0x7fdcb0003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccbe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd63c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccbe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd63c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44858/0 (socket says 172.21.15.89:44858) 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccbe00640 1 -- 172.21.15.89:0/13138879 learned_addr learned my addr 172.21.15.89:0/13138879 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:33.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccb400640 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 0x55b4fd63cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdcd0a00640 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd4863f0 0x55b4fd63d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccbe00640 1 -- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd4863f0 msgr2=0x55b4fd63d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccbe00640 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd4863f0 0x55b4fd63d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccbe00640 1 -- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 msgr2=0x55b4fd63cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccbe00640 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 0x55b4fd63cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccbe00640 1 -- 172.21.15.89:0/13138879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4fd35efc0 con 0x55b4fd465960 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.567+0000 7fdccb400640 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 0x55b4fd63cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdccbe00640 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd63c890 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0b7040 tx=0x7fdcbc006320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c38ac1568728661 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcb4c00640 1 -- 172.21.15.89:0/13138879 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0d4060 con 0x55b4fd465960 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcb4c00640 1 -- 172.21.15.89:0/13138879 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdcbc0a5560 con 0x55b4fd465960 2024-08-31T04:41:33.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcd9fca000 1 -- 172.21.15.89:0/13138879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcbc003d70 con 0x55b4fd465960 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcb4c00640 1 -- 172.21.15.89:0/13138879 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdcbc0da050 con 0x55b4fd465960 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcd9fca000 10 client.6486 fetch_fsmap learned FSMap version 9 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcd9fca000 1 -- 172.21.15.89:0/13138879 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b4fd357e00 con 0x55b4fd465960 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcb4c00640 1 -- 172.21.15.89:0/13138879 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcbc003d70 con 0x55b4fd465960 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcb4c00640 1 -- 172.21.15.89:0/13138879 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdcbc0dd020 con 0x55b4fd465960 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcd9fca000 10 client.6486 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcd9fca000 10 client.6486 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcd9fca000 20 client.6486 populate_metadata read hostname 'smithi089' 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4fd05fe20 0x55b4fd5dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcd9fca000 4 client.6486 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.3, "await_for": 45.0}] 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcd9fca000 1 -- 172.21.15.89:0/13138879 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.3, "await_for": 45.0}) -- 0x55b4fd3dc210 con 0x55b4fd05fe20 2024-08-31T04:41:33.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdccb400640 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4fd05fe20 0x55b4fd5dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:33.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdccb400640 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4fd05fe20 0x55b4fd5dd3e0 crc :-1 s=READY pgs=1720 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54b5d75d89c67704 server_cookie=38b4f4f77daa3382 in_seq=0 out_seq=0 2024-08-31T04:41:33.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:33.571+0000 7fdcb4c00640 10 client.6486 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:34.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcb4c00640 1 -- 172.21.15.89:0/13138879 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55b4fd3dc210 con 0x55b4fd05fe20 2024-08-31T04:41:34.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcb4c00640 10 client.6486 handle_command_reply: tid=0 2024-08-31T04:41:34.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 client.6486 shutdown 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 -- 172.21.15.89:0/13138879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 msgr2=0x55b4fd63c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd63c890 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0b7040 tx=0x7fdcbc006320 comp rx=0 tx=0).stop 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 -- 172.21.15.89:0/13138879 shutdown_connections 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55b4fd05fe20 0x55b4fd5dd3e0 crc :-1 s=READY pgs=1720 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b4fd4863f0 0x55b4fd63d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b4fd47be90 0x55b4fd63cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcb4c00640 0 client.6486 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 --2- 172.21.15.89:0/13138879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b4fd465960 0x55b4fd63c890 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 -- 172.21.15.89:0/13138879 >> 172.21.15.89:0/13138879 conn(0x55b4fd08d210 msgr2=0x55b4fd5881b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 -- 172.21.15.89:0/13138879 shutdown_connections 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 1 -- 172.21.15.89:0/13138879 wait complete. 2024-08-31T04:41:34.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd9fca000 20 client.6486 trim_cache size 0 max 16384 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 134, 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "a656d4b": { 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 134, 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:41:34.442 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 143.3, 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:34.443 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:34.444 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:41:34.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 -- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdcac072260 msgr2=0x7fdcac074770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:34.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdcac072260 0x7fdcac074770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc001830 tx=0x7fdcbc019720 comp rx=0 tx=0).stop 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 -- 172.21.15.89:0/3823893554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14dc70 msgr2=0x7fdccc14e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14dc70 0x7fdccc14e080 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0c3c70 tx=0x7fdcc400fed0 comp rx=0 tx=0).stop 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 -- 172.21.15.89:0/3823893554 shutdown_connections 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdcac072260 0x7fdcac074770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdccc14dc70 0x7fdccc14e080 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdccc14a270 0x7fdccc14a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 --2- 172.21.15.89:0/3823893554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcb0003c20 0x7fdccc1f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 -- 172.21.15.89:0/3823893554 >> 172.21.15.89:0/3823893554 conn(0x7fdccc0c99b0 msgr2=0x7fdccc0736a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 -- 172.21.15.89:0/3823893554 shutdown_connections 2024-08-31T04:41:34.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:34.439+0000 7fdcd2a00640 1 -- 172.21.15.89:0/3823893554 wait complete. 2024-08-31T04:41:34.460 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a656d4b', quiesce took 1.5 seconds. Will release after: 21.8 2024-08-31T04:41:36.511 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:36.515 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 16 -eq 48 ] 2024-08-31T04:41:36.515 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.16 2024-08-31T04:41:36.515 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.16 2024-08-31T04:41:36.515 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.16 2024-08-31T04:41:36.515 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.16 2024-08-31T04:41:36.515 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:38.716 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:38.716 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.17 2024-08-31T04:41:38.717 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 17 -eq 48 ] 2024-08-31T04:41:38.717 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.17 2024-08-31T04:41:38.717 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.17 2024-08-31T04:41:38.717 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.17 2024-08-31T04:41:38.717 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:41.353 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:41.353 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 18 -eq 48 ] 2024-08-31T04:41:41.353 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.18 2024-08-31T04:41:41.354 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.18 2024-08-31T04:41:41.354 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.18 2024-08-31T04:41:41.354 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.18 2024-08-31T04:41:41.354 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:45.946 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:45.946 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 19 -eq 48 ] 2024-08-31T04:41:45.946 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.19 2024-08-31T04:41:45.947 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.19 2024-08-31T04:41:45.947 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.19 2024-08-31T04:41:45.947 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.19 2024-08-31T04:41:45.947 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:49.482 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:49.482 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 20 -eq 48 ] 2024-08-31T04:41:49.482 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.20 2024-08-31T04:41:49.483 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.20 2024-08-31T04:41:49.483 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.20 2024-08-31T04:41:49.483 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.20 2024-08-31T04:41:49.483 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:52.715 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:52.716 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.21 2024-08-31T04:41:52.716 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 21 -eq 48 ] 2024-08-31T04:41:52.716 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.21 2024-08-31T04:41:52.717 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.21 2024-08-31T04:41:52.717 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.21 2024-08-31T04:41:52.717 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:56.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:41:56.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.426+0000 7f2ab0600640 1 -- 172.21.15.89:0/3988734875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a900041d0 msgr2=0x7f2a90004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.426+0000 7f2ab0600640 1 --2- 172.21.15.89:0/3988734875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a900041d0 0x7f2a90004810 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80c25b0 tx=0x7f2a9401d1d0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.426+0000 7f2aae600640 1 -- 172.21.15.89:0/3988734875 reap_dead start 2024-08-31T04:41:56.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.426+0000 7f2ab0600640 1 -- 172.21.15.89:0/3988734875 shutdown_connections 2024-08-31T04:41:56.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.426+0000 7f2ab0600640 1 -- 172.21.15.89:0/3988734875 >> 172.21.15.89:0/3988734875 conn(0x7f2aa80ccf20 msgr2=0x7f2aa80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:56.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.426+0000 7f2ab0600640 1 -- 172.21.15.89:0/3988734875 shutdown_connections 2024-08-31T04:41:56.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.426+0000 7f2ab0600640 1 -- 172.21.15.89:0/3988734875 wait complete. 2024-08-31T04:41:56.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2ab0600640 1 Processor -- start 2024-08-31T04:41:56.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2ab0600640 1 -- start start 2024-08-31T04:41:56.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2ab0600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a900041d0 0x7f2aa81e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2ab0600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2aa80cb0a0 0x7f2aa814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2ab0600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa81e5c20 0x7f2aa81e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2ab0600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa80c8030 con 0x7f2aa81e5c20 2024-08-31T04:41:56.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2ab0600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa80c3150 con 0x7f2aa80cb0a0 2024-08-31T04:41:56.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2ab0600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa8074e30 con 0x7f2a900041d0 2024-08-31T04:41:56.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2aae600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa81e5c20 0x7f2aa81e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2aae600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa81e5c20 0x7f2aa81e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54908/0 (socket says 172.21.15.89:54908) 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2aae600640 1 -- 172.21.15.89:0/87747798 learned_addr learned my addr 172.21.15.89:0/87747798 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2aadc00640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a900041d0 0x7f2aa81e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.430+0000 7f2aad200640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2aa80cb0a0 0x7f2aa814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aae600640 1 -- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a900041d0 msgr2=0x7f2aa81e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aae600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a900041d0 0x7f2aa81e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aae600640 1 -- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2aa80cb0a0 msgr2=0x7f2aa814cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aae600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2aa80cb0a0 0x7f2aa814cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aae600640 1 -- 172.21.15.89:0/87747798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa81e68a0 con 0x7f2aa81e5c20 2024-08-31T04:41:56.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aae600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa81e5c20 0x7f2aa81e6030 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0000f90 tx=0x7f2aa0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:56.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aa5600640 1 -- 172.21.15.89:0/87747798 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0017070 con 0x7f2aa81e5c20 2024-08-31T04:41:56.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aa5600640 1 -- 172.21.15.89:0/87747798 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2aa000fbb0 con 0x7f2aa81e5c20 2024-08-31T04:41:56.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa81f6500 con 0x7f2aa81e5c20 2024-08-31T04:41:56.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aa5600640 1 -- 172.21.15.89:0/87747798 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0013450 con 0x7f2aa81e5c20 2024-08-31T04:41:56.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa81e1db0 con 0x7f2aa81e5c20 2024-08-31T04:41:56.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa814d700 con 0x7f2aa81e5c20 2024-08-31T04:41:56.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.434+0000 7f2aa5600640 1 -- 172.21.15.89:0/87747798 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2aa00135f0 con 0x7f2aa81e5c20 2024-08-31T04:41:56.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.438+0000 7f2aa5600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a880720f0 0x7f2a88074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.438+0000 7f2aa5600640 1 -- 172.21.15.89:0/87747798 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2aa0096ca0 con 0x7f2aa81e5c20 2024-08-31T04:41:56.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.438+0000 7f2aadc00640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a880720f0 0x7f2a88074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.438+0000 7f2aadc00640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a880720f0 0x7f2a88074600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c006fd0 tx=0x7f2a9c006c30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:56.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.442+0000 7f2aa5600640 1 -- 172.21.15.89:0/87747798 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2aa0061c60 con 0x7f2aa81e5c20 2024-08-31T04:41:56.525 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:41:56.525 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 22 -eq 48 ] 2024-08-31T04:41:56.525 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.22 2024-08-31T04:41:56.525 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.22 2024-08-31T04:41:56.526 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.22 2024-08-31T04:41:56.526 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.22 2024-08-31T04:41:56.526 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:41:56.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.654+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2aa8152a10 con 0x7f2aa81e5c20 2024-08-31T04:41:56.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2aa5600640 1 -- 172.21.15.89:0/87747798 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f2aa0066420 con 0x7f2aa81e5c20 2024-08-31T04:41:56.660 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:41:56.660 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:41:56.660 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a880720f0 msgr2=0x7f2a88074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a880720f0 0x7f2a88074600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c006fd0 tx=0x7f2a9c006c30 comp rx=0 tx=0).stop 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa81e5c20 msgr2=0x7f2aa81e6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa81e5c20 0x7f2aa81e6030 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0000f90 tx=0x7f2aa0011ab0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 shutdown_connections 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a880720f0 0x7f2a88074600 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2aa81e5c20 0x7f2aa81e6030 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2aa80cb0a0 0x7f2aa814cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 --2- 172.21.15.89:0/87747798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a900041d0 0x7f2aa81e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.662 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 >> 172.21.15.89:0/87747798 conn(0x7f2aa80ccf20 msgr2=0x7f2aa80c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:56.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 shutdown_connections 2024-08-31T04:41:56.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.658+0000 7f2ab0600640 1 -- 172.21.15.89:0/87747798 wait complete. 2024-08-31T04:41:56.682 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id a656d4b --release --await' 2024-08-31T04:41:56.682 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id a656d4b --release --await 2024-08-31T04:41:56.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.842+0000 7fdbe8000640 1 -- 172.21.15.89:0/3858309846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbc8004810 msgr2=0x7fdbc8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.842+0000 7fdbe8000640 1 --2- 172.21.15.89:0/3858309846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbc8004810 0x7fdbc8004c20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009b40 tx=0x7fdbcc01d250 comp rx=0 tx=0).stop 2024-08-31T04:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.842+0000 7fdbe8000640 1 -- 172.21.15.89:0/3858309846 shutdown_connections 2024-08-31T04:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.842+0000 7fdbe8000640 1 --2- 172.21.15.89:0/3858309846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbc8004810 0x7fdbc8004c20 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.842+0000 7fdbe8000640 1 -- 172.21.15.89:0/3858309846 >> 172.21.15.89:0/3858309846 conn(0x7fdbe006dd40 msgr2=0x7fdbe006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.842+0000 7fdbe8000640 1 -- 172.21.15.89:0/3858309846 shutdown_connections 2024-08-31T04:41:56.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.842+0000 7fdbe8000640 1 -- 172.21.15.89:0/3858309846 wait complete. 2024-08-31T04:41:56.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.842+0000 7fdbe8000640 1 Processor -- start 2024-08-31T04:41:56.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.842+0000 7fdbe8000640 1 -- start start 2024-08-31T04:41:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe8000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc8004810 0x7fdbe00cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe8000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbe0156ab0 0x7fdbe00ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe8000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0159980 0x7fdbe014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe8000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe00c8130 con 0x7fdbe0159980 2024-08-31T04:41:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe8000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe00c9640 con 0x7fdbe0156ab0 2024-08-31T04:41:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe8000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe00c82b0 con 0x7fdbc8004810 2024-08-31T04:41:56.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0159980 0x7fdbe014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0159980 0x7fdbe014f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54924/0 (socket says 172.21.15.89:54924) 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe6000640 1 -- 172.21.15.89:0/2631556277 learned_addr learned my addr 172.21.15.89:0/2631556277 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe5600640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc8004810 0x7fdbe00cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe4c00640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbe0156ab0 0x7fdbe00ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe6000640 1 -- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc8004810 msgr2=0x7fdbe00cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe6000640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc8004810 0x7fdbe00cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe6000640 1 -- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbe0156ab0 msgr2=0x7fdbe00ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe6000640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbe0156ab0 0x7fdbe00ab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe6000640 1 -- 172.21.15.89:0/2631556277 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe00cdbe0 con 0x7fdbe0159980 2024-08-31T04:41:56.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe6000640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0159980 0x7fdbe014f810 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fdbe015d410 tx=0x7fdbd8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:56.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbdd600640 1 -- 172.21.15.89:0/2631556277 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8017070 con 0x7fdbe0159980 2024-08-31T04:41:56.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbdd600640 1 -- 172.21.15.89:0/2631556277 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbd8013ad0 con 0x7fdbe0159980 2024-08-31T04:41:56.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe8000640 1 -- 172.21.15.89:0/2631556277 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe00aa4c0 con 0x7fdbe0159980 2024-08-31T04:41:56.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbdd600640 1 -- 172.21.15.89:0/2631556277 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800f450 con 0x7fdbe0159980 2024-08-31T04:41:56.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.846+0000 7fdbe8000640 1 -- 172.21.15.89:0/2631556277 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe00b32c0 con 0x7fdbe0159980 2024-08-31T04:41:56.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.850+0000 7fdbdd600640 1 -- 172.21.15.89:0/2631556277 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdbd800f5f0 con 0x7fdbe0159980 2024-08-31T04:41:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.850+0000 7fdbdd600640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc00720f0 0x7fdbc0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.850+0000 7fdbdd600640 1 -- 172.21.15.89:0/2631556277 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdbd8096c90 con 0x7fdbe0159980 2024-08-31T04:41:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.850+0000 7fdbe5600640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc00720f0 0x7fdbc0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.850+0000 7fdbef6c4000 1 Processor -- start 2024-08-31T04:41:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.850+0000 7fdbef6c4000 1 -- start start 2024-08-31T04:41:56.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.850+0000 7fdbe5600640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc00720f0 0x7fdbc0074600 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000c10 tx=0x7fdbd4006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.850+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920aa8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920aadad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 0x55c920aae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c920953f30 con 0x55c92098a950 2024-08-31T04:41:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c9208c9690 con 0x55c920965890 2024-08-31T04:41:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c9208b8c20 con 0x55c920974930 2024-08-31T04:41:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920aa8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920aa8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54936/0 (socket says 172.21.15.89:54936) 2024-08-31T04:41:56.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe5600640 1 -- 172.21.15.89:0/3668994769 learned_addr learned my addr 172.21.15.89:0/3668994769 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe4c00640 1 --2- 172.21.15.89:0/3668994769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920aadad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe6000640 1 --2- 172.21.15.89:0/3668994769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 0x55c920aae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe5600640 1 -- 172.21.15.89:0/3668994769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 msgr2=0x55c920aadad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe5600640 1 --2- 172.21.15.89:0/3668994769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920aadad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe5600640 1 -- 172.21.15.89:0/3668994769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 msgr2=0x55c920aae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe5600640 1 --2- 172.21.15.89:0/3668994769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 0x55c920aae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe5600640 1 -- 172.21.15.89:0/3668994769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c92086d8f0 con 0x55c92098a950 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbe5600640 1 --2- 172.21.15.89:0/3668994769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920aa8e30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4012790 tx=0x7fdbd4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31613f5709ad84b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbd1c00640 1 -- 172.21.15.89:0/3668994769 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4012d10 con 0x55c92098a950 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbd1c00640 1 -- 172.21.15.89:0/3668994769 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbd4024020 con 0x55c92098a950 2024-08-31T04:41:56.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbd1c00640 1 -- 172.21.15.89:0/3668994769 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4011950 con 0x55c92098a950 2024-08-31T04:41:56.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 -- 172.21.15.89:0/3668994769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 msgr2=0x55c920aa8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/3668994769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920aa8e30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4012790 tx=0x7fdbd4014000 comp rx=0 tx=0).stop 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 -- 172.21.15.89:0/3668994769 shutdown_connections 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/3668994769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 0x55c920aae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/3668994769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920aadad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/3668994769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920aa8e30 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 -- 172.21.15.89:0/3668994769 >> 172.21.15.89:0/3668994769 conn(0x55c92098a540 msgr2=0x55c920aab890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 -- 172.21.15.89:0/3668994769 shutdown_connections 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 -- 172.21.15.89:0/3668994769 wait complete. 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 -- start start 2024-08-31T04:41:56.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.854+0000 7fdbef6c4000 1 Processor -- start 2024-08-31T04:41:56.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 0x55c920aa8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920aa8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.863 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920ab2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c92083f500 con 0x55c92098a950 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c9208bcbd0 con 0x55c920965890 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c920860a30 con 0x55c920974930 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 10 client.0 _ll_register_callbacks cb 0x55c92096eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920ab2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920ab2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54948/0 (socket says 172.21.15.89:54948) 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe6000640 1 -- 172.21.15.89:0/1110880262 learned_addr learned my addr 172.21.15.89:0/1110880262 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe5600640 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 0x55c920aa8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe4c00640 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920aa8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe6000640 1 -- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 msgr2=0x55c920aa8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe6000640 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920aa8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe6000640 1 -- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 msgr2=0x55c920aa8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe6000640 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 0x55c920aa8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe6000640 1 -- 172.21.15.89:0/1110880262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9208586a0 con 0x55c92098a950 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe6000640 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920ab2bd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8094de0 tx=0x7fdbd805dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c33da5d0fbc0aa5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbc6000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbc6000640 1 -- 172.21.15.89:0/1110880262 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8022030 con 0x55c92098a950 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbc6000640 1 -- 172.21.15.89:0/1110880262 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdbd8060ea0 con 0x55c92098a950 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1110880262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c9208527e0 con 0x55c92098a950 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbc6000640 1 -- 172.21.15.89:0/1110880262 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdbd8066400 con 0x55c92098a950 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 10 client.6504 fetch_fsmap learned FSMap version 9 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1110880262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c9208771c0 con 0x55c92098a950 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbc6000640 1 -- 172.21.15.89:0/1110880262 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c9208527e0 con 0x55c92098a950 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbc6000640 1 -- 172.21.15.89:0/1110880262 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdbd8010040 con 0x55c92098a950 2024-08-31T04:41:56.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 10 client.6504 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:41:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 10 client.6504 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:41:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 20 client.6504 populate_metadata read hostname 'smithi089' 2024-08-31T04:41:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c92094efc0 0x55c920ab3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 4 client.6504 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:41:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1110880262 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9208cb5e0 con 0x55c92094efc0 2024-08-31T04:41:56.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.858+0000 7fdbe5600640 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c92094efc0 0x55c920ab3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbe5600640 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c92094efc0 0x55c920ab3970 crc :-1 s=READY pgs=1748 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b55bced1e76205ec server_cookie=aac8b262114e72b3 in_seq=0 out_seq=0 2024-08-31T04:41:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbc6000640 10 client.6504 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbc6000640 1 -- 172.21.15.89:0/1110880262 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c9208cb5e0 con 0x55c92094efc0 2024-08-31T04:41:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbc6000640 10 client.6504 handle_command_reply: tid=0 2024-08-31T04:41:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 client.6504 shutdown 2024-08-31T04:41:56.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1110880262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 msgr2=0x55c920ab2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920ab2bd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8094de0 tx=0x7fdbd805dc00 comp rx=0 tx=0).stop 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1110880262 shutdown_connections 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c92094efc0 0x55c920ab3970 crc :-1 s=READY pgs=1748 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c92098a950 0x55c920ab2bd0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920aa8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbc6000640 0 client.6504 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1110880262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c920965890 0x55c920aa8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1110880262 >> 172.21.15.89:0/1110880262 conn(0x55c92098a540 msgr2=0x55c920aa9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1110880262 shutdown_connections 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1110880262 wait complete. 2024-08-31T04:41:56.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.862+0000 7fdbef6c4000 20 client.6504 trim_cache size 0 max 16384 2024-08-31T04:41:56.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 Processor -- start 2024-08-31T04:41:56.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 -- start start 2024-08-31T04:41:56.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920965890 0x55c920ac77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920ac7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 0x55c920b2d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01ff1b0 con 0x55c920965890 2024-08-31T04:41:56.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01fe090 con 0x55c92098a950 2024-08-31T04:41:56.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe01f0910 con 0x55c920974930 2024-08-31T04:41:56.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920965890 0x55c920ac77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920965890 0x55c920ac77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54950/0 (socket says 172.21.15.89:54950) 2024-08-31T04:41:56.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe5600640 1 -- 172.21.15.89:0/1326308590 learned_addr learned my addr 172.21.15.89:0/1326308590 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:56.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe6000640 1 --2- 172.21.15.89:0/1326308590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 0x55c920b2d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe4c00640 1 --2- 172.21.15.89:0/1326308590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920ac7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe5600640 1 -- 172.21.15.89:0/1326308590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 msgr2=0x55c920ac7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:56.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe5600640 1 --2- 172.21.15.89:0/1326308590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920ac7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe5600640 1 -- 172.21.15.89:0/1326308590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 msgr2=0x55c920b2d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:56.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe5600640 1 --2- 172.21.15.89:0/1326308590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 0x55c920b2d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe5600640 1 -- 172.21.15.89:0/1326308590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c920ab2f40 con 0x55c920965890 2024-08-31T04:41:56.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbe5600640 1 --2- 172.21.15.89:0/1326308590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920965890 0x55c920ac77a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4026040 tx=0x7fdbd4001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6959eb7f7785198 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:56.887 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbd1200640 1 -- 172.21.15.89:0/1326308590 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4023040 con 0x55c920965890 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbd1200640 1 -- 172.21.15.89:0/1326308590 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbd4016070 con 0x55c920965890 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbd1200640 1 -- 172.21.15.89:0/1326308590 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4011c10 con 0x55c920965890 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1326308590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920965890 msgr2=0x55c920ac77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1326308590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920965890 0x55c920ac77a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4026040 tx=0x7fdbd4001130 comp rx=0 tx=0).stop 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1326308590 shutdown_connections 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1326308590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 0x55c920b2d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1326308590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920974930 0x55c920ac7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/1326308590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920965890 0x55c920ac77a0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1326308590 >> 172.21.15.89:0/1326308590 conn(0x55c92098a540 msgr2=0x55c920ab0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1326308590 shutdown_connections 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.882+0000 7fdbef6c4000 1 -- 172.21.15.89:0/1326308590 wait complete. 2024-08-31T04:41:56.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 -- start start 2024-08-31T04:41:56.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 Processor -- start 2024-08-31T04:41:56.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920965890 0x55c920b29ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920974930 0x55c920b267a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 0x55c920b26ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01fcc20 con 0x55c920974930 2024-08-31T04:41:56.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01fd9c0 con 0x55c92098a950 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe01fd2f0 con 0x55c920965890 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 10 client.0 _ll_register_callbacks cb 0x7fdbd4006b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920974930 0x55c920b267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe4c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920974930 0x55c920b267a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54962/0 (socket says 172.21.15.89:54962) 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe4c00640 1 -- 172.21.15.89:0/985310279 learned_addr learned my addr 172.21.15.89:0/985310279 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe6000640 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 0x55c920b26ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe5600640 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920965890 0x55c920b29ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe4c00640 1 -- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920965890 msgr2=0x55c920b29ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe4c00640 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920965890 0x55c920b29ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe4c00640 1 -- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 msgr2=0x55c920b26ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe4c00640 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 0x55c920b26ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe4c00640 1 -- 172.21.15.89:0/985310279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c92093d2f0 con 0x55c920974930 2024-08-31T04:41:56.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbe4c00640 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920974930 0x55c920b267a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc01d080 tx=0x7fdbcc005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837fbfa1e1ff5b9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbc6000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbc6000640 1 -- 172.21.15.89:0/985310279 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0c7060 con 0x55c920974930 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbc6000640 1 -- 172.21.15.89:0/985310279 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdbcc0048d0 con 0x55c920974930 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 -- 172.21.15.89:0/985310279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbd4016070 con 0x55c920974930 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbc6000640 1 -- 172.21.15.89:0/985310279 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdbcc0056d0 con 0x55c920974930 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 10 client.6510 fetch_fsmap learned FSMap version 9 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbef6c4000 1 -- 172.21.15.89:0/985310279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c920842b30 con 0x55c920974930 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbc6000640 1 -- 172.21.15.89:0/985310279 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbd4016070 con 0x55c920974930 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.886+0000 7fdbc6000640 1 -- 172.21.15.89:0/985310279 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fdbcc004ad0 con 0x55c920974930 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.890+0000 7fdbef6c4000 10 client.6510 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.890+0000 7fdbef6c4000 10 client.6510 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.890+0000 7fdbef6c4000 20 client.6510 populate_metadata read hostname 'smithi089' 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.890+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c92054ae80 0x55c920b27d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.890+0000 7fdbef6c4000 4 client.6510 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a656d4b", "release": true, "await": true}] 2024-08-31T04:41:56.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.890+0000 7fdbef6c4000 1 -- 172.21.15.89:0/985310279 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a656d4b", "release": true, "await": true}) -- 0x55c9208c7080 con 0x55c92054ae80 2024-08-31T04:41:56.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.890+0000 7fdbe5600640 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c92054ae80 0x55c920b27d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:41:56.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.890+0000 7fdbe5600640 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c92054ae80 0x55c920b27d70 crc :-1 s=READY pgs=1749 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4654aa39a795efdc server_cookie=63f157cee3b3bbf3 in_seq=0 out_seq=0 2024-08-31T04:41:56.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:56.890+0000 7fdbc6000640 10 client.6510 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:57.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbc6000640 1 -- 172.21.15.89:0/985310279 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55c9208c7080 con 0x55c92054ae80 2024-08-31T04:41:57.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbc6000640 10 client.6510 handle_command_reply: tid=0 2024-08-31T04:41:57.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 client.6510 shutdown 2024-08-31T04:41:57.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 -- 172.21.15.89:0/985310279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920974930 msgr2=0x55c920b267a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:57.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920974930 0x55c920b267a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc01d080 tx=0x7fdbcc005560 comp rx=0 tx=0).stop 2024-08-31T04:41:57.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 -- 172.21.15.89:0/985310279 shutdown_connections 2024-08-31T04:41:57.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c92054ae80 0x55c920b27d70 crc :-1 s=READY pgs=1749 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:57.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c920974930 0x55c920b267a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:57.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c92098a950 0x55c920b26ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:57.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 --2- 172.21.15.89:0/985310279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c920965890 0x55c920b29ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:57.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbc6000640 0 client.6510 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:41:57.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 -- 172.21.15.89:0/985310279 >> 172.21.15.89:0/985310279 conn(0x55c92098a540 msgr2=0x55c920ac8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:57.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 -- 172.21.15.89:0/985310279 shutdown_connections 2024-08-31T04:41:57.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 1 -- 172.21.15.89:0/985310279 wait complete. 2024-08-31T04:41:57.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbef6c4000 20 client.6510 trim_cache size 0 max 16384 2024-08-31T04:41:57.031 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:41:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:41:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:41:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 136, 2024-08-31T04:41:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:41:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "a656d4b": { 2024-08-31T04:41:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 136, 2024-08-31T04:41:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:41:57.032 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 143.3, 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:41:57.033 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:57.034 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:41:57.034 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 -- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc00720f0 msgr2=0x7fdbc0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc00720f0 0x7fdbc0074600 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000c10 tx=0x7fdbd4006c90 comp rx=0 tx=0).stop 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 -- 172.21.15.89:0/2631556277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0159980 msgr2=0x7fdbe014f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0159980 0x7fdbe014f810 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fdbe015d410 tx=0x7fdbd8011ab0 comp rx=0 tx=0).stop 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 -- 172.21.15.89:0/2631556277 shutdown_connections 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdbc00720f0 0x7fdbc0074600 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0159980 0x7fdbe014f810 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdbe0156ab0 0x7fdbe00ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 --2- 172.21.15.89:0/2631556277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdbc8004810 0x7fdbe00cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 -- 172.21.15.89:0/2631556277 >> 172.21.15.89:0/2631556277 conn(0x7fdbe006dd40 msgr2=0x7fdbe0159000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 -- 172.21.15.89:0/2631556277 shutdown_connections 2024-08-31T04:41:57.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:41:57.026+0000 7fdbe8000640 1 -- 172.21.15.89:0/2631556277 wait complete. 2024-08-31T04:41:57.051 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a656d4b', total seconds elapsed: 24.1 2024-08-31T04:42:02.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:02.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 23 -eq 48 ] 2024-08-31T04:42:02.493 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.23 2024-08-31T04:42:02.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.23 2024-08-31T04:42:02.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.23 2024-08-31T04:42:02.494 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.23 2024-08-31T04:42:02.494 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:08.536 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:08.536 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 24 -eq 48 ] 2024-08-31T04:42:08.536 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.24 2024-08-31T04:42:08.537 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.24 2024-08-31T04:42:08.537 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.24 2024-08-31T04:42:08.537 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.24 2024-08-31T04:42:08.537 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:13.472 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:13.473 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.25 2024-08-31T04:42:13.473 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 25 -eq 48 ] 2024-08-31T04:42:13.473 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.25 2024-08-31T04:42:13.473 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.25 2024-08-31T04:42:13.473 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.25 2024-08-31T04:42:13.473 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:16.940 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:16.940 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 26 -eq 48 ] 2024-08-31T04:42:16.940 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.26 2024-08-31T04:42:16.940 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.26 2024-08-31T04:42:16.940 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.26 2024-08-31T04:42:16.941 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.26 2024-08-31T04:42:16.941 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:20.725 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:20.725 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 27 -eq 48 ] 2024-08-31T04:42:20.725 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.27 2024-08-31T04:42:20.726 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.27 2024-08-31T04:42:20.726 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.27 2024-08-31T04:42:20.726 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.27 2024-08-31T04:42:20.726 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:23.986 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:23.987 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.28 2024-08-31T04:42:23.988 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 28 -eq 48 ] 2024-08-31T04:42:23.988 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.28 2024-08-31T04:42:23.988 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.28 2024-08-31T04:42:23.988 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.28 2024-08-31T04:42:23.988 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:24.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:42:24.297 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:42:26.651 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:26.651 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.29 2024-08-31T04:42:26.652 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 29 -eq 48 ] 2024-08-31T04:42:26.652 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.29 2024-08-31T04:42:26.652 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.29 2024-08-31T04:42:26.652 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.29 2024-08-31T04:42:26.652 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:29.737 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:29.737 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 30 -eq 48 ] 2024-08-31T04:42:29.737 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.30 2024-08-31T04:42:29.737 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.30 2024-08-31T04:42:29.738 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.30 2024-08-31T04:42:29.738 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.30 2024-08-31T04:42:29.738 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:33.883 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:33.884 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.31 2024-08-31T04:42:33.884 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 31 -eq 48 ] 2024-08-31T04:42:33.884 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.31 2024-08-31T04:42:33.884 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.31 2024-08-31T04:42:33.884 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.31 2024-08-31T04:42:33.884 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:37.492 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:37.492 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 32 -eq 48 ] 2024-08-31T04:42:37.492 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.32 2024-08-31T04:42:37.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.32 2024-08-31T04:42:37.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.32 2024-08-31T04:42:37.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.32 2024-08-31T04:42:37.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:41.693 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:41.693 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 33 -eq 48 ] 2024-08-31T04:42:41.693 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.33 2024-08-31T04:42:41.693 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.33 2024-08-31T04:42:41.694 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.33 2024-08-31T04:42:41.694 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.33 2024-08-31T04:42:41.694 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:46.054 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:46.054 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.34 2024-08-31T04:42:46.054 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 34 -eq 48 ] 2024-08-31T04:42:46.054 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.34 2024-08-31T04:42:46.055 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.34 2024-08-31T04:42:46.055 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.34 2024-08-31T04:42:46.055 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:49.596 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:49.596 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 35 -eq 48 ] 2024-08-31T04:42:49.597 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.35 2024-08-31T04:42:49.597 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.35 2024-08-31T04:42:49.597 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.35 2024-08-31T04:42:49.597 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.35 2024-08-31T04:42:49.597 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:53.876 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:53.876 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 36 -eq 48 ] 2024-08-31T04:42:53.877 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.36 2024-08-31T04:42:53.877 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.36 2024-08-31T04:42:53.877 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.36 2024-08-31T04:42:53.877 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.36 2024-08-31T04:42:53.877 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:42:54.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:42:54.371 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:42:58.660 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:42:58.660 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 37 -eq 48 ] 2024-08-31T04:42:58.661 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.37 2024-08-31T04:42:58.661 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.37 2024-08-31T04:42:58.661 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.37 2024-08-31T04:42:58.661 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.37 2024-08-31T04:42:58.661 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:01.370 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:01.370 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.38 2024-08-31T04:43:01.371 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 38 -eq 48 ] 2024-08-31T04:43:01.371 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.38 2024-08-31T04:43:01.371 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.38 2024-08-31T04:43:01.371 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.38 2024-08-31T04:43:01.371 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:07.065 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:07.065 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.39 2024-08-31T04:43:07.066 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 39 -eq 48 ] 2024-08-31T04:43:07.066 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.39 2024-08-31T04:43:07.066 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.39 2024-08-31T04:43:07.066 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.39 2024-08-31T04:43:07.066 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:11.186 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:11.187 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 40 -eq 48 ] 2024-08-31T04:43:11.187 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.40 2024-08-31T04:43:11.187 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.40 2024-08-31T04:43:11.187 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.40 2024-08-31T04:43:11.187 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.40 2024-08-31T04:43:11.187 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:14.673 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:14.674 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.41 2024-08-31T04:43:14.674 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 41 -eq 48 ] 2024-08-31T04:43:14.675 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.41 2024-08-31T04:43:14.675 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.41 2024-08-31T04:43:14.675 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.41 2024-08-31T04:43:14.675 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:18.822 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:18.823 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.42 2024-08-31T04:43:18.823 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 42 -eq 48 ] 2024-08-31T04:43:18.823 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.42 2024-08-31T04:43:18.824 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.42 2024-08-31T04:43:18.824 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.42 2024-08-31T04:43:18.824 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:23.577 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:23.577 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.43 2024-08-31T04:43:23.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 43 -eq 48 ] 2024-08-31T04:43:23.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.43 2024-08-31T04:43:23.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.43 2024-08-31T04:43:23.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.43 2024-08-31T04:43:23.578 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:23.595 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-08-31T04:43:23.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:43:23.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 -- 172.21.15.89:0/1650936748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f103006eba0 msgr2=0x7f1030161ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:23.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 --2- 172.21.15.89:0/1650936748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f103006eba0 0x7f1030161ff0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f10300730e0 tx=0x7f102801cd80 comp rx=0 tx=0).stop 2024-08-31T04:43:23.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 -- 172.21.15.89:0/1650936748 shutdown_connections 2024-08-31T04:43:23.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 --2- 172.21.15.89:0/1650936748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f103006eba0 0x7f1030161ff0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:23.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 --2- 172.21.15.89:0/1650936748 >> v2:172.21.15.170:3300/0 conn(0x7f10300c8580 0x7f103006e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:23.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 -- 172.21.15.89:0/1650936748 >> 172.21.15.89:0/1650936748 conn(0x7f10300cca80 msgr2=0x7f10300cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:23.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 -- 172.21.15.89:0/1650936748 shutdown_connections 2024-08-31T04:43:23.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 -- 172.21.15.89:0/1650936748 wait complete. 2024-08-31T04:43:23.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 Processor -- start 2024-08-31T04:43:23.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.768+0000 7f102fe00640 1 -- start start 2024-08-31T04:43:23.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103006eba0 0x7f10301f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c7ca0 0x7f1030153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102fe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10300c8580 0x7f10301604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102fe00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f10300cd720 con 0x7f10300c7ca0 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102fe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f10300cd5a0 con 0x7f103006eba0 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102fe00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f10300c62f0 con 0x7f10300c8580 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102e000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c7ca0 0x7f1030153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102e000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c7ca0 0x7f1030153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52932/0 (socket says 172.21.15.89:52932) 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102e000640 1 -- 172.21.15.89:0/3999749393 learned_addr learned my addr 172.21.15.89:0/3999749393 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102ea00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103006eba0 0x7f10301f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102f400640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10300c8580 0x7f10301604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102e000640 1 -- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10300c8580 msgr2=0x7f10301604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102e000640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10300c8580 0x7f10301604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:23.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102e000640 1 -- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103006eba0 msgr2=0x7f10301f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:23.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102e000640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103006eba0 0x7f10301f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:23.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102e000640 1 -- 172.21.15.89:0/3999749393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1030154a90 con 0x7f10300c7ca0 2024-08-31T04:43:23.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102e000640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c7ca0 0x7f1030153b50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f101c00d720 tx=0x7f101c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:23.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f1026a00640 1 -- 172.21.15.89:0/3999749393 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c017070 con 0x7f10300c7ca0 2024-08-31T04:43:23.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f1026a00640 1 -- 172.21.15.89:0/3999749393 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f101c009d20 con 0x7f10300c7ca0 2024-08-31T04:43:23.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10301f8e40 con 0x7f10300c7ca0 2024-08-31T04:43:23.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f1026a00640 1 -- 172.21.15.89:0/3999749393 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c005280 con 0x7f10300c7ca0 2024-08-31T04:43:23.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10300cbcc0 con 0x7f10300c7ca0 2024-08-31T04:43:23.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.772+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1030151d40 con 0x7f10300c7ca0 2024-08-31T04:43:23.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.776+0000 7f1026a00640 1 -- 172.21.15.89:0/3999749393 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f101c005420 con 0x7f10300c7ca0 2024-08-31T04:43:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.776+0000 7f1026a00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10100720c0 0x7f10100745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.776+0000 7f1026a00640 1 -- 172.21.15.89:0/3999749393 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f101c093070 con 0x7f10300c7ca0 2024-08-31T04:43:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.776+0000 7f102ea00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10100720c0 0x7f10100745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.776+0000 7f102ea00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10100720c0 0x7f10100745d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f10200098e0 tx=0x7f1020009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:23.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.780+0000 7f1026a00640 1 -- 172.21.15.89:0/3999749393 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f101c05df00 con 0x7f10300c7ca0 2024-08-31T04:43:23.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f103006def0 con 0x7f10300c7ca0 2024-08-31T04:43:23.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f1026a00640 1 -- 172.21.15.89:0/3999749393 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f101c0626c0 con 0x7f10300c7ca0 2024-08-31T04:43:23.988 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:43:23.988 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:43:23.988 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:43:23.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10100720c0 msgr2=0x7f10100745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:23.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10100720c0 0x7f10100745d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f10200098e0 tx=0x7f1020009060 comp rx=0 tx=0).stop 2024-08-31T04:43:23.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c7ca0 msgr2=0x7f1030153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:23.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c7ca0 0x7f1030153b50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f101c00d720 tx=0x7f101c00dbe0 comp rx=0 tx=0).stop 2024-08-31T04:43:23.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 shutdown_connections 2024-08-31T04:43:23.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f10100720c0 0x7f10100745d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:23.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10300c7ca0 0x7f1030153b50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:23.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10300c8580 0x7f10301604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:23.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 --2- 172.21.15.89:0/3999749393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103006eba0 0x7f10301f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:23.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 >> 172.21.15.89:0/3999749393 conn(0x7f10300cca80 msgr2=0x7f10300765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:23.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 shutdown_connections 2024-08-31T04:43:23.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:23.988+0000 7f102fe00640 1 -- 172.21.15.89:0/3999749393 wait complete. 2024-08-31T04:43:24.011 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-08-31T04:43:24.011 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-08-31T04:43:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.180+0000 7f55eae00640 1 -- 172.21.15.89:0/3001163589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e40b2860 msgr2=0x7f55e40b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.180+0000 7f55eae00640 1 --2- 172.21.15.89:0/3001163589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e40b2860 0x7f55e40b2d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009840 tx=0x7f55d401c760 comp rx=0 tx=0).stop 2024-08-31T04:43:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.180+0000 7f55eae00640 1 -- 172.21.15.89:0/3001163589 shutdown_connections 2024-08-31T04:43:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.180+0000 7f55eae00640 1 --2- 172.21.15.89:0/3001163589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e40c1ed0 0x7f55e4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.180+0000 7f55eae00640 1 --2- 172.21.15.89:0/3001163589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e40b2860 0x7f55e40b2d20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.180+0000 7f55eae00640 1 -- 172.21.15.89:0/3001163589 >> 172.21.15.89:0/3001163589 conn(0x7f55e40c99b0 msgr2=0x7f55e40c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:24.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.180+0000 7f55eae00640 1 -- 172.21.15.89:0/3001163589 shutdown_connections 2024-08-31T04:43:24.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.180+0000 7f55eae00640 1 -- 172.21.15.89:0/3001163589 wait complete. 2024-08-31T04:43:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55eae00640 1 Processor -- start 2024-08-31T04:43:24.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55eae00640 1 -- start start 2024-08-31T04:43:24.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55eae00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e40b2860 0x7f55e41599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55eae00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e40c1ed0 0x7f55e40c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55eae00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e40c90e0 0x7f55e414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55eae00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40c32e0 con 0x7f55e40c1ed0 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55eae00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40c3160 con 0x7f55e40c90e0 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55eae00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f55e4074ec0 con 0x7f55e40b2860 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55db400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e40c1ed0 0x7f55e40c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55db400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e40c1ed0 0x7f55e40c4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52948/0 (socket says 172.21.15.89:52948) 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55db400640 1 -- 172.21.15.89:0/3149639216 learned_addr learned my addr 172.21.15.89:0/3149639216 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55e3e00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e40b2860 0x7f55e41599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55e8e00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e40c90e0 0x7f55e414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55db400640 1 -- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e40b2860 msgr2=0x7f55e41599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55db400640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e40b2860 0x7f55e41599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55db400640 1 -- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e40c90e0 msgr2=0x7f55e414aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55db400640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e40c90e0 0x7f55e414aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55db400640 1 -- 172.21.15.89:0/3149639216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e40c51c0 con 0x7f55e40c1ed0 2024-08-31T04:43:24.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55e8e00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e40c90e0 0x7f55e414aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:24.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55db400640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e40c1ed0 0x7f55e40c4c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00e9c0 tx=0x7f55cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:24.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.184+0000 7f55e0c00640 1 -- 172.21.15.89:0/3149639216 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00cd80 con 0x7f55e40c1ed0 2024-08-31T04:43:24.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.188+0000 7f55e0c00640 1 -- 172.21.15.89:0/3149639216 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55cc004020 con 0x7f55e40c1ed0 2024-08-31T04:43:24.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.188+0000 7f55eae00640 1 -- 172.21.15.89:0/3149639216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e41f8230 con 0x7f55e40c1ed0 2024-08-31T04:43:24.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.188+0000 7f55e0c00640 1 -- 172.21.15.89:0/3149639216 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc004410 con 0x7f55e40c1ed0 2024-08-31T04:43:24.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.188+0000 7f55eae00640 1 -- 172.21.15.89:0/3149639216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41f87f0 con 0x7f55e40c1ed0 2024-08-31T04:43:24.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.188+0000 7f55e0c00640 1 -- 172.21.15.89:0/3149639216 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f55cc003600 con 0x7f55e40c1ed0 2024-08-31T04:43:24.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e0c00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c00720f0 0x7f55c0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55f23a4000 1 Processor -- start 2024-08-31T04:43:24.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e0c00640 1 -- 172.21.15.89:0/3149639216 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f55cc0937a0 con 0x7f55e40c1ed0 2024-08-31T04:43:24.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55f23a4000 1 -- start start 2024-08-31T04:43:24.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c00720f0 0x7f55c0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c00720f0 0x7f55c0074600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f55d40af000 tx=0x7f55d401afa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504e053f0 0x563504f3ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 0x563504f07ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 0x563504f08220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55f23a4000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563504d5d820 con 0x563504e053f0 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55f23a4000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563504d4cdb0 con 0x563504dfae90 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55f23a4000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563504d50d60 con 0x563504de4960 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504e053f0 0x563504f3ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504e053f0 0x563504f3ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52950/0 (socket says 172.21.15.89:52950) 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 -- 172.21.15.89:0/3931363896 learned_addr learned my addr 172.21.15.89:0/3931363896 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55db400640 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 0x563504f07ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e8e00640 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 0x563504f08220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 -- 172.21.15.89:0/3931363896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 msgr2=0x563504f08220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:24.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 0x563504f08220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 -- 172.21.15.89:0/3931363896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 msgr2=0x563504f07ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:24.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 0x563504f07ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 -- 172.21.15.89:0/3931363896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563504ce7b70 con 0x563504e053f0 2024-08-31T04:43:24.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55db400640 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 0x563504f07ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:24.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55e3e00640 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504e053f0 0x563504f3ed20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f55d4000c10 tx=0x7f55d40b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3dab399c72332ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:24.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55d8c00640 1 -- 172.21.15.89:0/3931363896 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d40b2040 con 0x563504e053f0 2024-08-31T04:43:24.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55d8c00640 1 -- 172.21.15.89:0/3931363896 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d40c7070 con 0x563504e053f0 2024-08-31T04:43:24.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.192+0000 7f55d8c00640 1 -- 172.21.15.89:0/3931363896 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4003600 con 0x563504e053f0 2024-08-31T04:43:24.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 -- 172.21.15.89:0/3931363896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504e053f0 msgr2=0x563504f3ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:24.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504e053f0 0x563504f3ed20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f55d4000c10 tx=0x7f55d40b7000 comp rx=0 tx=0).stop 2024-08-31T04:43:24.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 -- 172.21.15.89:0/3931363896 shutdown_connections 2024-08-31T04:43:24.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 0x563504f08220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 0x563504f07ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 --2- 172.21.15.89:0/3931363896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504e053f0 0x563504f3ed20 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 -- 172.21.15.89:0/3931363896 >> 172.21.15.89:0/3931363896 conn(0x563504a0c210 msgr2=0x563504f41990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:24.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 -- 172.21.15.89:0/3931363896 shutdown_connections 2024-08-31T04:43:24.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 -- 172.21.15.89:0/3931363896 wait complete. 2024-08-31T04:43:24.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 -- start start 2024-08-31T04:43:24.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 Processor -- start 2024-08-31T04:43:24.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 0x563504f3d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f3de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504e053f0 0x563504f3e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563504a13b10 con 0x563504dfae90 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563504cd36f0 con 0x563504e053f0 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563504d55390 con 0x563504de4960 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55f23a4000 10 client.0 _ll_register_callbacks cb 0x563504cf4b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55db400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f3de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55db400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f3de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52958/0 (socket says 172.21.15.89:52958) 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55db400640 1 -- 172.21.15.89:0/2605576160 learned_addr learned my addr 172.21.15.89:0/2605576160 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55e3e00640 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 0x563504f3d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55e8e00640 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504e053f0 0x563504f3e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55db400640 1 -- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 msgr2=0x563504f3d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:24.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55db400640 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 0x563504f3d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55db400640 1 -- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504e053f0 msgr2=0x563504f3e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55db400640 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504e053f0 0x563504f3e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55db400640 1 -- 172.21.15.89:0/2605576160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563504d0b380 con 0x563504dfae90 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55db400640 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f3de30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f55cc05b8a0 tx=0x7f55cc05ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e68403a033b071 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.196+0000 7f55d1600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55d1600640 1 -- 172.21.15.89:0/2605576160 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc067200 con 0x563504dfae90 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 -- 172.21.15.89:0/2605576160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563504d5bd20 con 0x563504dfae90 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55d1600640 1 -- 172.21.15.89:0/2605576160 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f55cc0650b0 con 0x563504dfae90 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55d1600640 1 -- 172.21.15.89:0/2605576160 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f55cc05e140 con 0x563504dfae90 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 10 client.6525 fetch_fsmap learned FSMap version 9 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 -- 172.21.15.89:0/2605576160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563504dd1e40 con 0x563504dfae90 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55d1600640 1 -- 172.21.15.89:0/2605576160 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563504d5bd20 con 0x563504dfae90 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55d1600640 1 -- 172.21.15.89:0/2605576160 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f55cc07a020 con 0x563504dfae90 2024-08-31T04:43:24.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 10 client.6525 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:43:24.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 10 client.6525 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:43:24.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 20 client.6525 populate_metadata read hostname 'smithi089' 2024-08-31T04:43:24.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635049f0dc0 0x563504f58f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 4 client.6525 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:43:24.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 -- 172.21.15.89:0/2605576160 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563504d5f770 con 0x5635049f0dc0 2024-08-31T04:43:24.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55e3e00640 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635049f0dc0 0x563504f58f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55d1600640 10 client.6525 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:24.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55e3e00640 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635049f0dc0 0x563504f58f90 crc :-1 s=READY pgs=1877 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b6fc533803ab5f5 server_cookie=107f4806e6a6b999 in_seq=0 out_seq=0 2024-08-31T04:43:24.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55d1600640 1 -- 172.21.15.89:0/2605576160 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563504d5f770 con 0x5635049f0dc0 2024-08-31T04:43:24.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55d1600640 10 client.6525 handle_command_reply: tid=0 2024-08-31T04:43:24.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 client.6525 shutdown 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 -- 172.21.15.89:0/2605576160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 msgr2=0x563504f3de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f3de30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f55cc05b8a0 tx=0x7f55cc05ec50 comp rx=0 tx=0).stop 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 -- 172.21.15.89:0/2605576160 shutdown_connections 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635049f0dc0 0x563504f58f90 crc :-1 s=READY pgs=1877 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f3de30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504e053f0 0x563504f3e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.200+0000 7f55d1600640 0 client.6525 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.204+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2605576160 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504de4960 0x563504f3d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.204+0000 7f55f23a4000 1 -- 172.21.15.89:0/2605576160 >> 172.21.15.89:0/2605576160 conn(0x563504a0c210 msgr2=0x563504f40340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.204+0000 7f55f23a4000 1 -- 172.21.15.89:0/2605576160 shutdown_connections 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.204+0000 7f55f23a4000 1 -- 172.21.15.89:0/2605576160 wait complete. 2024-08-31T04:43:24.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.204+0000 7f55f23a4000 20 client.6525 trim_cache size 0 max 16384 2024-08-31T04:43:24.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55f23a4000 1 Processor -- start 2024-08-31T04:43:24.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55f23a4000 1 -- start start 2024-08-31T04:43:24.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504de4960 0x563504f00c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 0x563504f011a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 0x563504f57f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55f23a4000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f55e414e1d0 con 0x563504de4960 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55f23a4000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4202810 con 0x563504dfae90 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55f23a4000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f55e4201a70 con 0x563504e053f0 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504de4960 0x563504f00c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504de4960 0x563504f00c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52960/0 (socket says 172.21.15.89:52960) 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e3e00640 1 -- 172.21.15.89:0/2135389740 learned_addr learned my addr 172.21.15.89:0/2135389740 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e8e00640 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 0x563504f57f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55db400640 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 0x563504f011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e3e00640 1 -- 172.21.15.89:0/2135389740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 msgr2=0x563504f57f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e3e00640 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 0x563504f57f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e3e00640 1 -- 172.21.15.89:0/2135389740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 msgr2=0x563504f011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e3e00640 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 0x563504f011a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e3e00640 1 -- 172.21.15.89:0/2135389740 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563504da95b0 con 0x563504de4960 2024-08-31T04:43:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.220+0000 7f55e8e00640 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 0x563504f57f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:43:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55e3e00640 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504de4960 0x563504f00c60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f55d401cc40 tx=0x7f55d40b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b034ea78049d78 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55d3e00640 1 -- 172.21.15.89:0/2135389740 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d40da070 con 0x563504de4960 2024-08-31T04:43:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55d3e00640 1 -- 172.21.15.89:0/2135389740 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d40c7040 con 0x563504de4960 2024-08-31T04:43:24.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55d3e00640 1 -- 172.21.15.89:0/2135389740 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d40b2040 con 0x563504de4960 2024-08-31T04:43:24.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 -- 172.21.15.89:0/2135389740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504de4960 msgr2=0x563504f00c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:24.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504de4960 0x563504f00c60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f55d401cc40 tx=0x7f55d40b7000 comp rx=0 tx=0).stop 2024-08-31T04:43:24.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 -- 172.21.15.89:0/2135389740 shutdown_connections 2024-08-31T04:43:24.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 0x563504f57f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504dfae90 0x563504f011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 --2- 172.21.15.89:0/2135389740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504de4960 0x563504f00c60 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 -- 172.21.15.89:0/2135389740 >> 172.21.15.89:0/2135389740 conn(0x563504a0c210 msgr2=0x563504f3df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:24.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 -- 172.21.15.89:0/2135389740 shutdown_connections 2024-08-31T04:43:24.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 -- 172.21.15.89:0/2135389740 wait complete. 2024-08-31T04:43:24.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 -- start start 2024-08-31T04:43:24.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 Processor -- start 2024-08-31T04:43:24.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504de4960 0x563504f5b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f5ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 0x563504fb9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563504cceeb0 con 0x563504dfae90 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4202140 con 0x563504de4960 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563504cf4f20 con 0x563504e053f0 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55f23a4000 10 client.0 _ll_register_callbacks cb 0x7f55cc005f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55db400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f5ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55db400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f5ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52972/0 (socket says 172.21.15.89:52972) 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.224+0000 7f55db400640 1 -- 172.21.15.89:0/4251563638 learned_addr learned my addr 172.21.15.89:0/4251563638 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55e8e00640 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 0x563504fb9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55e3e00640 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504de4960 0x563504f5b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55db400640 1 -- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 msgr2=0x563504fb9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55db400640 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 0x563504fb9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55db400640 1 -- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504de4960 msgr2=0x563504f5b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:24.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55db400640 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504de4960 0x563504f5b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55db400640 1 -- 172.21.15.89:0/4251563638 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563504cddfc0 con 0x563504dfae90 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55db400640 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f5ba70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f55cc05abd0 tx=0x7f55cc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6db7fef8dee48ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55d1600640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55d1600640 1 -- 172.21.15.89:0/4251563638 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc05df80 con 0x563504dfae90 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55d1600640 1 -- 172.21.15.89:0/4251563638 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f55cc0652b0 con 0x563504dfae90 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55f23a4000 1 -- 172.21.15.89:0/4251563638 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55d40c7040 con 0x563504dfae90 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55d1600640 1 -- 172.21.15.89:0/4251563638 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f55cc088050 con 0x563504dfae90 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55f23a4000 10 client.6531 fetch_fsmap learned FSMap version 9 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55f23a4000 1 -- 172.21.15.89:0/4251563638 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563504cd6e00 con 0x563504dfae90 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55d1600640 1 -- 172.21.15.89:0/4251563638 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d40c7040 con 0x563504dfae90 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55d1600640 1 -- 172.21.15.89:0/4251563638 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f55cc07a070 con 0x563504dfae90 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55f23a4000 10 client.6531 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55f23a4000 10 client.6531 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55f23a4000 20 client.6531 populate_metadata read hostname 'smithi089' 2024-08-31T04:43:24.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55f23a4000 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635049dee20 0x563504fb8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:24.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55f23a4000 4 client.6531 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-08-31T04:43:24.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55f23a4000 1 -- 172.21.15.89:0/4251563638 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x563504d5b210 con 0x5635049dee20 2024-08-31T04:43:24.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55e3e00640 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635049dee20 0x563504fb8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:24.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55e3e00640 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635049dee20 0x563504fb8870 crc :-1 s=READY pgs=1878 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a927931c280f93 server_cookie=5a1cba9e3fce7059 in_seq=0 out_seq=0 2024-08-31T04:43:24.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:24.228+0000 7f55d1600640 10 client.6531 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:24.479 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:43:24.483 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:43:25.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55d1600640 1 -- 172.21.15.89:0/4251563638 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563504d5b210 con 0x5635049dee20 2024-08-31T04:43:25.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55d1600640 10 client.6531 handle_command_reply: tid=0 2024-08-31T04:43:25.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 client.6531 shutdown 2024-08-31T04:43:25.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 -- 172.21.15.89:0/4251563638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 msgr2=0x563504f5ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:25.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f5ba70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f55cc05abd0 tx=0x7f55cc0046d0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 -- 172.21.15.89:0/4251563638 shutdown_connections 2024-08-31T04:43:25.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x5635049dee20 0x563504fb8870 crc :-1 s=READY pgs=1878 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563504dfae90 0x563504f5ba70 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563504e053f0 0x563504fb9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 --2- 172.21.15.89:0/4251563638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563504de4960 0x563504f5b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55d1600640 0 client.6531 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 -- 172.21.15.89:0/4251563638 >> 172.21.15.89:0/4251563638 conn(0x563504a0c210 msgr2=0x563504f00c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 -- 172.21.15.89:0/4251563638 shutdown_connections 2024-08-31T04:43:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 1 -- 172.21.15.89:0/4251563638 wait complete. 2024-08-31T04:43:25.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55f23a4000 20 client.6531 trim_cache size 0 max 16384 2024-08-31T04:43:25.026 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 138, 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "d2044d22": { 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 138, 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:43:25.027 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.0, 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "QUIESCED", 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:25.028 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:43:25.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 -- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c00720f0 msgr2=0x7f55c0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:25.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c00720f0 0x7f55c0074600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f55d40af000 tx=0x7f55d401afa0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 -- 172.21.15.89:0/3149639216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e40c1ed0 msgr2=0x7f55e40c4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:25.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e40c1ed0 0x7f55e40c4c80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00e9c0 tx=0x7f55cc00ee80 comp rx=0 tx=0).stop 2024-08-31T04:43:25.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 -- 172.21.15.89:0/3149639216 shutdown_connections 2024-08-31T04:43:25.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f55c00720f0 0x7f55c0074600 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55e40c1ed0 0x7f55e40c4c80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55e40c90e0 0x7f55e414aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 --2- 172.21.15.89:0/3149639216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f55e40b2860 0x7f55e41599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:25.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 -- 172.21.15.89:0/3149639216 >> 172.21.15.89:0/3149639216 conn(0x7f55e40c99b0 msgr2=0x7f55e4074770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:25.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 -- 172.21.15.89:0/3149639216 shutdown_connections 2024-08-31T04:43:25.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:25.024+0000 7f55eae00640 1 -- 172.21.15.89:0/3149639216 wait complete. 2024-08-31T04:43:25.051 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd2044d22', quiesce took 1.5 seconds. Will release after: 8.5 2024-08-31T04:43:31.957 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:31.957 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 44 -eq 48 ] 2024-08-31T04:43:31.958 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.44 2024-08-31T04:43:31.958 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.44 2024-08-31T04:43:31.958 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.44 2024-08-31T04:43:31.958 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.44 2024-08-31T04:43:31.958 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:33.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:43:33.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.716+0000 7fdc8aa00640 1 -- 172.21.15.89:0/1122223204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc840c9960 msgr2=0x7fdc840c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:33.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.716+0000 7fdc8aa00640 1 --2- 172.21.15.89:0/1122223204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc840c9960 0x7fdc840c9d70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdc84070c80 tx=0x7fdc7c01f580 comp rx=0 tx=0).stop 2024-08-31T04:43:33.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.716+0000 7fdc8aa00640 1 -- 172.21.15.89:0/1122223204 shutdown_connections 2024-08-31T04:43:33.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.716+0000 7fdc8aa00640 1 --2- 172.21.15.89:0/1122223204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc840c9960 0x7fdc840c9d70 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:33.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.716+0000 7fdc8aa00640 1 --2- 172.21.15.89:0/1122223204 >> v2:172.21.15.170:3300/0 conn(0x7fdc84071520 0x7fdc840c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:33.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.716+0000 7fdc8aa00640 1 -- 172.21.15.89:0/1122223204 >> 172.21.15.89:0/1122223204 conn(0x7fdc8406dd40 msgr2=0x7fdc8406e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:33.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.716+0000 7fdc8aa00640 1 -- 172.21.15.89:0/1122223204 shutdown_connections 2024-08-31T04:43:33.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.716+0000 7fdc8aa00640 1 -- 172.21.15.89:0/1122223204 wait complete. 2024-08-31T04:43:33.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc8aa00640 1 Processor -- start 2024-08-31T04:43:33.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc8aa00640 1 -- start start 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc8aa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc84071520 0x7fdc840c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc8aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc840c9960 0x7fdc8414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc8aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc841526d0 0x7fdc840b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc8aa00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdc840c88c0 con 0x7fdc841526d0 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc8aa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdc84070f40 con 0x7fdc840c9960 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc8aa00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdc840c35f0 con 0x7fdc84071520 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc88a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc841526d0 0x7fdc840b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc88a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc841526d0 0x7fdc840b2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48056/0 (socket says 172.21.15.89:48056) 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc88a00640 1 -- 172.21.15.89:0/3935724638 learned_addr learned my addr 172.21.15.89:0/3935724638 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc83e00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc84071520 0x7fdc840c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:33.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc7b400640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc840c9960 0x7fdc8414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:33.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc88a00640 1 -- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc84071520 msgr2=0x7fdc840c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:33.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc88a00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc84071520 0x7fdc840c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:33.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc88a00640 1 -- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc840c9960 msgr2=0x7fdc8414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:33.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.720+0000 7fdc88a00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc840c9960 0x7fdc8414dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:33.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc88a00640 1 -- 172.21.15.89:0/3935724638 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc840c6ac0 con 0x7fdc841526d0 2024-08-31T04:43:33.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc88a00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc841526d0 0x7fdc840b2b40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009bd0 tx=0x7fdc7c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc80c00640 1 -- 172.21.15.89:0/3935724638 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c004c50 con 0x7fdc841526d0 2024-08-31T04:43:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc80c00640 1 -- 172.21.15.89:0/3935724638 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc7c0be030 con 0x7fdc841526d0 2024-08-31T04:43:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc841f2af0 con 0x7fdc841526d0 2024-08-31T04:43:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc80c00640 1 -- 172.21.15.89:0/3935724638 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0afae0 con 0x7fdc841526d0 2024-08-31T04:43:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc840cc1e0 con 0x7fdc841526d0 2024-08-31T04:43:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc840704a0 con 0x7fdc841526d0 2024-08-31T04:43:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc80c00640 1 -- 172.21.15.89:0/3935724638 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fdc7c0afc80 con 0x7fdc841526d0 2024-08-31T04:43:33.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc80c00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc600720f0 0x7fdc60074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:33.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.724+0000 7fdc80c00640 1 -- 172.21.15.89:0/3935724638 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fdc7c131790 con 0x7fdc841526d0 2024-08-31T04:43:33.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.728+0000 7fdc83e00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc600720f0 0x7fdc60074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:33.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.728+0000 7fdc83e00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc600720f0 0x7fdc60074600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdc74001650 tx=0x7fdc74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:33.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.732+0000 7fdc80c00640 1 -- 172.21.15.89:0/3935724638 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdc7c0190e0 con 0x7fdc841526d0 2024-08-31T04:43:33.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.936+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc840c6850 con 0x7fdc841526d0 2024-08-31T04:43:33.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.936+0000 7fdc80c00640 1 -- 172.21.15.89:0/3935724638 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fdc7c0fcc70 con 0x7fdc841526d0 2024-08-31T04:43:33.939 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:43:33.939 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:43:33.939 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:43:33.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc600720f0 msgr2=0x7fdc60074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:33.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc600720f0 0x7fdc60074600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdc74001650 tx=0x7fdc74009040 comp rx=0 tx=0).stop 2024-08-31T04:43:33.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc841526d0 msgr2=0x7fdc840b2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:33.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc841526d0 0x7fdc840b2b40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009bd0 tx=0x7fdc7c0092c0 comp rx=0 tx=0).stop 2024-08-31T04:43:33.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 shutdown_connections 2024-08-31T04:43:33.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fdc600720f0 0x7fdc60074600 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:33.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc841526d0 0x7fdc840b2b40 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:33.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc840c9960 0x7fdc8414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:33.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 --2- 172.21.15.89:0/3935724638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc84071520 0x7fdc840c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:33.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 >> 172.21.15.89:0/3935724638 conn(0x7fdc8406dd40 msgr2=0x7fdc840c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:33.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 shutdown_connections 2024-08-31T04:43:33.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:33.940+0000 7fdc8aa00640 1 -- 172.21.15.89:0/3935724638 wait complete. 2024-08-31T04:43:33.961 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --set-id d2044d22 --release --await' 2024-08-31T04:43:33.961 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --set-id d2044d22 --release --await 2024-08-31T04:43:34.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.124+0000 7fab3be00640 1 -- 172.21.15.89:0/2945103912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab1c004220 msgr2=0x7fab1c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:34.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.124+0000 7fab3be00640 1 --2- 172.21.15.89:0/2945103912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab1c004220 0x7fab1c004810 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fab34072b90 tx=0x7fab2001c820 comp rx=0 tx=0).stop 2024-08-31T04:43:34.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.124+0000 7fab39e00640 1 -- 172.21.15.89:0/2945103912 reap_dead start 2024-08-31T04:43:34.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.124+0000 7fab3be00640 1 -- 172.21.15.89:0/2945103912 shutdown_connections 2024-08-31T04:43:34.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.124+0000 7fab3be00640 1 -- 172.21.15.89:0/2945103912 >> 172.21.15.89:0/2945103912 conn(0x7fab340c99b0 msgr2=0x7fab340c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:34.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.124+0000 7fab3be00640 1 -- 172.21.15.89:0/2945103912 shutdown_connections 2024-08-31T04:43:34.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.124+0000 7fab3be00640 1 -- 172.21.15.89:0/2945103912 wait complete. 2024-08-31T04:43:34.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.124+0000 7fab3be00640 1 Processor -- start 2024-08-31T04:43:34.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.124+0000 7fab3be00640 1 -- start start 2024-08-31T04:43:34.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab3be00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c004220 0x7fab341514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab3be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab340cbf90 0x7fab340c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab3be00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab340aeb70 0x7fab34155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab3be00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fab34158750 con 0x7fab340aeb70 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab3be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab341585d0 con 0x7fab340cbf90 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab3be00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab34164770 con 0x7fab1c004220 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab340aeb70 0x7fab34155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab340aeb70 0x7fab34155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48062/0 (socket says 172.21.15.89:48062) 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39e00640 1 -- 172.21.15.89:0/124117722 learned_addr learned my addr 172.21.15.89:0/124117722 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab38a00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab340cbf90 0x7fab340c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39400640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c004220 0x7fab341514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39e00640 1 -- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c004220 msgr2=0x7fab341514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39e00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c004220 0x7fab341514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39e00640 1 -- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab340cbf90 msgr2=0x7fab340c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39e00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab340cbf90 0x7fab340c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39e00640 1 -- 172.21.15.89:0/124117722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab340c4f00 con 0x7fab340aeb70 2024-08-31T04:43:34.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab39e00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab340aeb70 0x7fab34155470 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fab340b3290 tx=0x7fab2c006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:34.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab31600640 1 -- 172.21.15.89:0/124117722 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0107d0 con 0x7fab340aeb70 2024-08-31T04:43:34.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab31600640 1 -- 172.21.15.89:0/124117722 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab2c016070 con 0x7fab340aeb70 2024-08-31T04:43:34.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab3be00640 1 -- 172.21.15.89:0/124117722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab34159a70 con 0x7fab340aeb70 2024-08-31T04:43:34.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab31600640 1 -- 172.21.15.89:0/124117722 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c010d20 con 0x7fab340aeb70 2024-08-31T04:43:34.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.128+0000 7fab3be00640 1 -- 172.21.15.89:0/124117722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab340c67b0 con 0x7fab340aeb70 2024-08-31T04:43:34.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab31600640 1 -- 172.21.15.89:0/124117722 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fab2c01b460 con 0x7fab340aeb70 2024-08-31T04:43:34.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab31600640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab140720c0 0x7fab140745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab31600640 1 -- 172.21.15.89:0/124117722 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fab2c093980 con 0x7fab340aeb70 2024-08-31T04:43:34.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab434ca000 1 Processor -- start 2024-08-31T04:43:34.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab434ca000 1 -- start start 2024-08-31T04:43:34.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39400640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab140720c0 0x7fab140745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39400640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab140720c0 0x7fab140745d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fab28009a10 tx=0x7fab280091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:34.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab434ca000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715fa950 0x55c171718e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab434ca000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715e4930 0x55c17171dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab434ca000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715d5890 0x55c17171e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab434ca000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c1715c3f30 con 0x55c1715d5890 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab434ca000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c171539690 con 0x55c1715fa950 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab434ca000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c171528c20 con 0x55c1715e4930 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715d5890 0x55c17171e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715d5890 0x55c17171e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48078/0 (socket says 172.21.15.89:48078) 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39e00640 1 -- 172.21.15.89:0/3260060606 learned_addr learned my addr 172.21.15.89:0/3260060606 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39400640 1 --2- 172.21.15.89:0/3260060606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715fa950 0x55c171718e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab38a00640 1 --2- 172.21.15.89:0/3260060606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715e4930 0x55c17171dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39e00640 1 -- 172.21.15.89:0/3260060606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715e4930 msgr2=0x55c17171dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39e00640 1 --2- 172.21.15.89:0/3260060606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715e4930 0x55c17171dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39e00640 1 -- 172.21.15.89:0/3260060606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715fa950 msgr2=0x55c171718e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39e00640 1 --2- 172.21.15.89:0/3260060606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715fa950 0x55c171718e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.132+0000 7fab39e00640 1 -- 172.21.15.89:0/3260060606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1714dd8f0 con 0x55c1715d5890 2024-08-31T04:43:34.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab39e00640 1 --2- 172.21.15.89:0/3260060606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715d5890 0x55c17171e010 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fab2c05af10 tx=0x7fab2c05e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518f7dec00ec8b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:34.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab25c00640 1 -- 172.21.15.89:0/3260060606 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c05e920 con 0x55c1715d5890 2024-08-31T04:43:34.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab25c00640 1 -- 172.21.15.89:0/3260060606 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab2c067b20 con 0x55c1715d5890 2024-08-31T04:43:34.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab25c00640 1 -- 172.21.15.89:0/3260060606 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c05db80 con 0x55c1715d5890 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 -- 172.21.15.89:0/3260060606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715d5890 msgr2=0x55c17171e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 --2- 172.21.15.89:0/3260060606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715d5890 0x55c17171e010 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fab2c05af10 tx=0x7fab2c05e820 comp rx=0 tx=0).stop 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 -- 172.21.15.89:0/3260060606 shutdown_connections 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 --2- 172.21.15.89:0/3260060606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715d5890 0x55c17171e010 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 --2- 172.21.15.89:0/3260060606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715e4930 0x55c17171dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 --2- 172.21.15.89:0/3260060606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715fa950 0x55c171718e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 -- 172.21.15.89:0/3260060606 >> 172.21.15.89:0/3260060606 conn(0x55c1715fa540 msgr2=0x55c17171b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 -- 172.21.15.89:0/3260060606 shutdown_connections 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 -- 172.21.15.89:0/3260060606 wait complete. 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 -- start start 2024-08-31T04:43:34.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.136+0000 7fab434ca000 1 Processor -- start 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171718030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171718570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171722bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c1714af500 con 0x55c1715e4930 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c17152cbd0 con 0x55c1715d5890 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c1714d0a30 con 0x55c1715fa950 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 10 client.0 _ll_register_callbacks cb 0x55c1715deb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab38a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171718570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab38a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171718570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48084/0 (socket says 172.21.15.89:48084) 2024-08-31T04:43:34.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab38a00640 1 -- 172.21.15.89:0/510855101 learned_addr learned my addr 172.21.15.89:0/510855101 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:34.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab39400640 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171718030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab39e00640 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171722bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab38a00640 1 -- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 msgr2=0x55c171722bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:34.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab38a00640 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171722bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab38a00640 1 -- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 msgr2=0x55c171718030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:34.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab38a00640 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171718030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab38a00640 1 -- 172.21.15.89:0/510855101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1714c86a0 con 0x55c1715e4930 2024-08-31T04:43:34.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab38a00640 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171718570 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fab20005040 tx=0x7fab20006570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2aad2474efec7c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab1a000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab1a000640 1 -- 172.21.15.89:0/510855101 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20003600 con 0x55c1715e4930 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab1a000640 1 -- 172.21.15.89:0/510855101 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fab200037a0 con 0x55c1715e4930 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 -- 172.21.15.89:0/510855101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c1714c27e0 con 0x55c1715e4930 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab1a000640 1 -- 172.21.15.89:0/510855101 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fab200c3050 con 0x55c1715e4930 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 10 client.6549 fetch_fsmap learned FSMap version 9 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 -- 172.21.15.89:0/510855101 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c1714e71c0 con 0x55c1715e4930 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab1a000640 1 -- 172.21.15.89:0/510855101 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c1714c27e0 con 0x55c1715e4930 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab1a000640 1 -- 172.21.15.89:0/510855101 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fab200039a0 con 0x55c1715e4930 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 10 client.6549 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 10 client.6549 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:43:34.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 20 client.6549 populate_metadata read hostname 'smithi089' 2024-08-31T04:43:34.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c1715befc0 0x55c171723970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 4 client.6549 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:43:34.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab434ca000 1 -- 172.21.15.89:0/510855101 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c17153b5e0 con 0x55c1715befc0 2024-08-31T04:43:34.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab39400640 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c1715befc0 0x55c171723970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab39400640 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c1715befc0 0x55c171723970 crc :-1 s=READY pgs=1887 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a36a274e8ecf3d01 server_cookie=cc9062c10448b11c in_seq=0 out_seq=0 2024-08-31T04:43:34.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.140+0000 7fab1a000640 10 client.6549 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:34.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab1a000640 1 -- 172.21.15.89:0/510855101 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c17153b5e0 con 0x55c1715befc0 2024-08-31T04:43:34.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab1a000640 10 client.6549 handle_command_reply: tid=0 2024-08-31T04:43:34.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 client.6549 shutdown 2024-08-31T04:43:34.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 -- 172.21.15.89:0/510855101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 msgr2=0x55c171718570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:34.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171718570 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fab20005040 tx=0x7fab20006570 comp rx=0 tx=0).stop 2024-08-31T04:43:34.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 -- 172.21.15.89:0/510855101 shutdown_connections 2024-08-31T04:43:34.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c1715befc0 0x55c171723970 crc :-1 s=READY pgs=1887 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171718570 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171722bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 --2- 172.21.15.89:0/510855101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171718030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab1a000640 0 client.6549 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:34.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 -- 172.21.15.89:0/510855101 >> 172.21.15.89:0/510855101 conn(0x55c1715fa540 msgr2=0x55c171719040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:34.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 -- 172.21.15.89:0/510855101 shutdown_connections 2024-08-31T04:43:34.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 1 -- 172.21.15.89:0/510855101 wait complete. 2024-08-31T04:43:34.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.144+0000 7fab434ca000 20 client.6549 trim_cache size 0 max 16384 2024-08-31T04:43:34.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab434ca000 1 Processor -- start 2024-08-31T04:43:34.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab434ca000 1 -- start start 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab434ca000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171721d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab434ca000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171722250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab434ca000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171791920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab434ca000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fab34204950 con 0x55c1715e4930 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab434ca000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab34203830 con 0x55c1715d5890 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab434ca000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab34201d70 con 0x55c1715fa950 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab38a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171722250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab38a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171722250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48100/0 (socket says 172.21.15.89:48100) 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab38a00640 1 -- 172.21.15.89:0/828141305 learned_addr learned my addr 172.21.15.89:0/828141305 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:34.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab39400640 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171721d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.164+0000 7fab39e00640 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171791920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab38a00640 1 -- 172.21.15.89:0/828141305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 msgr2=0x55c171791920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:34.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab38a00640 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171791920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab38a00640 1 -- 172.21.15.89:0/828141305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 msgr2=0x55c171721d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:34.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab38a00640 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171721d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab38a00640 1 -- 172.21.15.89:0/828141305 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c171722f40 con 0x55c1715e4930 2024-08-31T04:43:34.168 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab39400640 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171721d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:34.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab38a00640 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171722250 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fab200c1040 tx=0x7fab20006aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96153473bbfaeb06 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:34.169 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab25200640 1 -- 172.21.15.89:0/828141305 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab200b4070 con 0x55c1715e4930 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab25200640 1 -- 172.21.15.89:0/828141305 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab20003e50 con 0x55c1715e4930 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab25200640 1 -- 172.21.15.89:0/828141305 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20003a10 con 0x55c1715e4930 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 -- 172.21.15.89:0/828141305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 msgr2=0x55c171722250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171722250 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fab200c1040 tx=0x7fab20006aa0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 -- 172.21.15.89:0/828141305 shutdown_connections 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171722250 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171791920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 --2- 172.21.15.89:0/828141305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171721d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 -- 172.21.15.89:0/828141305 >> 172.21.15.89:0/828141305 conn(0x55c1715fa540 msgr2=0x55c171738600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 -- 172.21.15.89:0/828141305 shutdown_connections 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 -- 172.21.15.89:0/828141305 wait complete. 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 -- start start 2024-08-31T04:43:34.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.168+0000 7fab434ca000 1 Processor -- start 2024-08-31T04:43:34.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171737b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171738800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171738d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fab342023c0 con 0x55c1715e4930 2024-08-31T04:43:34.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab34203160 con 0x55c1715d5890 2024-08-31T04:43:34.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab34202a90 con 0x55c1715fa950 2024-08-31T04:43:34.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 10 client.0 _ll_register_callbacks cb 0x7fab1c003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab38a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171738800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab38a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171738800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48104/0 (socket says 172.21.15.89:48104) 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab38a00640 1 -- 172.21.15.89:0/592451528 learned_addr learned my addr 172.21.15.89:0/592451528 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab39400640 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171737b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab39e00640 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171738d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab38a00640 1 -- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 msgr2=0x55c171738d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab38a00640 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171738d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab38a00640 1 -- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 msgr2=0x55c171737b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab38a00640 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171737b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab38a00640 1 -- 172.21.15.89:0/592451528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1715ad2f0 con 0x55c1715e4930 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab38a00640 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171738800 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fab2001cd90 tx=0x7fab200a5290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e88acee6400bb79 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab1a000640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:43:34.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab1a000640 1 -- 172.21.15.89:0/592451528 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab200b4040 con 0x55c1715e4930 2024-08-31T04:43:34.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab1a000640 1 -- 172.21.15.89:0/592451528 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fab20003880 con 0x55c1715e4930 2024-08-31T04:43:34.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 -- 172.21.15.89:0/592451528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab20003e50 con 0x55c1715e4930 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab1a000640 1 -- 172.21.15.89:0/592451528 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fab20003a80 con 0x55c1715e4930 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 10 client.6555 fetch_fsmap learned FSMap version 9 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 -- 172.21.15.89:0/592451528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c1714b2b30 con 0x55c1715e4930 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab1a000640 1 -- 172.21.15.89:0/592451528 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab20003e50 con 0x55c1715e4930 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab1a000640 1 -- 172.21.15.89:0/592451528 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fab200a56a0 con 0x55c1715e4930 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 10 client.6555 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 10 client.6555 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 20 client.6555 populate_metadata read hostname 'smithi089' 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c1711bae80 0x55c171735930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:34.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 4 client.6555 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d2044d22", "release": true, "await": true}] 2024-08-31T04:43:34.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab434ca000 1 -- 172.21.15.89:0/592451528 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d2044d22", "release": true, "await": true}) -- 0x55c171537080 con 0x55c1711bae80 2024-08-31T04:43:34.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab39400640 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c1711bae80 0x55c171735930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:34.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab39400640 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c1711bae80 0x55c171735930 crc :-1 s=READY pgs=1888 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1eda5edc29aaa28a server_cookie=5edc9692ccd22765 in_seq=0 out_seq=0 2024-08-31T04:43:34.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.172+0000 7fab1a000640 10 client.6555 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab1a000640 1 -- 172.21.15.89:0/592451528 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c171537080 con 0x55c1711bae80 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab1a000640 10 client.6555 handle_command_reply: tid=0 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 client.6555 shutdown 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 -- 172.21.15.89:0/592451528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 msgr2=0x55c171738800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171738800 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fab2001cd90 tx=0x7fab200a5290 comp rx=0 tx=0).stop 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 -- 172.21.15.89:0/592451528 shutdown_connections 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x55c1711bae80 0x55c171735930 crc :-1 s=READY pgs=1888 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1715e4930 0x55c171738800 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c1715fa950 0x55c171738d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 --2- 172.21.15.89:0/592451528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1715d5890 0x55c171737b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab1a000640 0 client.6555 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 -- 172.21.15.89:0/592451528 >> 172.21.15.89:0/592451528 conn(0x55c1715fa540 msgr2=0x55c1717216c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 -- 172.21.15.89:0/592451528 shutdown_connections 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 1 -- 172.21.15.89:0/592451528 wait complete. 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab434ca000 20 client.6555 trim_cache size 0 max 16384 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 140, 2024-08-31T04:43:34.354 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": { 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "d2044d22": { 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "version": 140, 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "age_ref": 0.0, 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "timeout": 90.0, 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "expiration": 130.0, 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "members": { 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "file:/": { 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "excluded": false, 2024-08-31T04:43:34.355 INFO:teuthology.orchestra.run.smithi089.stdout: "state": { 2024-08-31T04:43:34.356 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "RELEASED", 2024-08-31T04:43:34.356 INFO:teuthology.orchestra.run.smithi089.stdout: "age": 0.0 2024-08-31T04:43:34.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:34.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:34.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:34.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:34.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-08-31T04:43:34.356 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 -- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab140720c0 msgr2=0x7fab140745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab140720c0 0x7fab140745d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fab28009a10 tx=0x7fab280091e0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 -- 172.21.15.89:0/124117722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab340aeb70 msgr2=0x7fab34155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab340aeb70 0x7fab34155470 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fab340b3290 tx=0x7fab2c006420 comp rx=0 tx=0).stop 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 -- 172.21.15.89:0/124117722 shutdown_connections 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fab140720c0 0x7fab140745d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab340aeb70 0x7fab34155470 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab340cbf90 0x7fab340c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 --2- 172.21.15.89:0/124117722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c004220 0x7fab341514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 -- 172.21.15.89:0/124117722 >> 172.21.15.89:0/124117722 conn(0x7fab340c99b0 msgr2=0x7fab34156ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:34.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 -- 172.21.15.89:0/124117722 shutdown_connections 2024-08-31T04:43:34.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:34.352+0000 7fab3be00640 1 -- 172.21.15.89:0/124117722 wait complete. 2024-08-31T04:43:34.375 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd2044d22', total seconds elapsed: 10.8 2024-08-31T04:43:37.320 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:37.320 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.45 2024-08-31T04:43:37.321 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 45 -eq 48 ] 2024-08-31T04:43:37.321 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.45 2024-08-31T04:43:37.321 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.45 2024-08-31T04:43:37.321 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.45 2024-08-31T04:43:37.321 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:41.833 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:41.833 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.46 2024-08-31T04:43:41.834 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 46 -eq 48 ] 2024-08-31T04:43:41.834 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.46 2024-08-31T04:43:41.834 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.46 2024-08-31T04:43:41.834 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.46 2024-08-31T04:43:41.834 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:47.273 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd ../.. 2024-08-31T04:43:47.273 INFO:tasks.workunit.client.0.smithi089.stderr:+ [ 47 -eq 48 ] 2024-08-31T04:43:47.273 INFO:tasks.workunit.client.0.smithi089.stderr:+ ver=v0.47 2024-08-31T04:43:47.273 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo checking v0.47 2024-08-31T04:43:47.273 INFO:tasks.workunit.client.0.smithi089.stdout:checking v0.47 2024-08-31T04:43:47.273 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd .snap/v0.47 2024-08-31T04:43:47.274 INFO:tasks.workunit.client.0.smithi089.stderr:+ git diff --exit-code 2024-08-31T04:43:51.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:diff --git a/src/librbd.cc b/src/librbd.cc 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:index 7bc0f262264..e69de29bb2d 100644 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:--- a/src/librbd.cc 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:+++ b/src/librbd.cc 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:@@ -1,2580 +0,0 @@ 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:-// -*- mode:C++; tab-width:8; c-basic-offset:2; indent-tabs-mode:t -*- 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:-// vim: ts=8 sw=2 smarttab 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:-/* 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:- * Ceph - scalable distributed file system 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:- * 2024-08-31T04:43:51.270 INFO:tasks.workunit.client.0.smithi089.stdout:- * Copyright (C) 2011 New Dream Network 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:- * 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:- * This is free software; you can redistribute it and/or 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:- * modify it under the terms of the GNU General Public 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:- * License version 2.1, as published by the Free Software 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:- * Foundation. See file COPYING. 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:- * 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:- */ 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:-#include 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:-#include 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:-#include "common/Cond.h" 2024-08-31T04:43:51.271 INFO:tasks.workunit.client.0.smithi089.stdout:-#include "common/dout.h" 2024-08-31T04:43:51.272 INFO:tasks.workunit.client.0.smithi089.stdout:-#include "common/errno.h" 2024-08-31T04:43:51.272 INFO:tasks.workunit.client.0.smithi089.stdout:-#include "common/snap_types.h" 2024-08-31T04:43:51.272 INFO:tasks.workunit.client.0.smithi089.stdout:-#include "common/perf_counters.h" 2024-08-31T04:43:51.272 INFO:tasks.workunit.client.0.smithi089.stdout:-#include "include/Context.h" 2024-08-31T04:43:51.272 INFO:tasks.workunit.client.0.smithi089.stdout:-#include "include/rbd/librbd.hpp" 2024-08-31T04:43:51.272 INFO:tasks.workunit.client.0.smithi089.stdout:-#include "osdc/ObjectCacher.h" 2024-08-31T04:43:51.272 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.272 INFO:tasks.workunit.client.0.smithi089.stdout:-#include "librbd/LibrbdWriteback.h" 2024-08-31T04:43:51.272 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:-#define dout_subsys ceph_subsys_rbd 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:-#undef dout_prefix 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:-#define dout_prefix *_dout << "librbd: " 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:-namespace librbd { 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- enum { 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_first = 26000, 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_rd, // read ops 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_rd_bytes, // bytes read 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_wr, 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_wr_bytes, 2024-08-31T04:43:51.273 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_discard, 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_discard_bytes, 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_flush, 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_aio_rd, // read ops 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_aio_rd_bytes, // bytes read 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_aio_wr, 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_aio_wr_bytes, 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_aio_discard, 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_aio_discard_bytes, 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_snap_create, 2024-08-31T04:43:51.274 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_snap_remove, 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_snap_rollback, 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_notify, 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_resize, 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- l_librbd_last, 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- }; 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- using ceph::bufferlist; 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- using librados::snap_t; 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- using librados::IoCtx; 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- using librados::Rados; 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.275 INFO:tasks.workunit.client.0.smithi089.stdout:- // raw callbacks 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- void rados_cb(rados_completion_t cb, void *arg); 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- void rados_aio_sparse_read_cb(rados_completion_t cb, void *arg); 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- class WatchCtx; 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- struct SnapInfo { 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- snap_t id; 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t size; 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- SnapInfo(snap_t _id, uint64_t _size) : id(_id), size(_size) {}; 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- }; 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- struct AioCompletion; 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.276 INFO:tasks.workunit.client.0.smithi089.stdout:- struct AioBlockCompletion : Context { 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct; 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- struct AioCompletion *completion; 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t ofs; 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t len; 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- char *buf; 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- map m; 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist data_bl; 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::ObjectWriteOperation write_op; 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- AioBlockCompletion(CephContext *cct_, AioCompletion *aio_completion, 2024-08-31T04:43:51.277 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t _ofs, size_t _len, char *_buf) 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- : cct(cct_), completion(aio_completion), 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- ofs(_ofs), len(_len), buf(_buf) {} 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- virtual ~AioBlockCompletion() {} 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- virtual void finish(int r); 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- }; 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- struct ImageCtx { 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct; 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- PerfCounters *perfcounter; 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- struct rbd_obj_header_ondisk header; 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- ::SnapContext snapc; 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- vector snaps; 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- std::map snaps_by_name; 2024-08-31T04:43:51.278 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t snapid; 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- bool snap_exists; // false if our snapid was deleted 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- std::string name; 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- std::string snapname; 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- IoCtx data_ctx, md_ctx; 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- WatchCtx *wctx; 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- bool needs_refresh; 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex refresh_lock; 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex lock; // protects access to snapshot and header information 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex cache_lock; // used as client_lock for the ObjectCacher 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- ObjectCacher *object_cacher; 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- LibrbdWriteback *writeback_handler; 2024-08-31T04:43:51.279 INFO:tasks.workunit.client.0.smithi089.stdout:- ObjectCacher::ObjectSet *object_set; 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx(std::string imgname, const char *snap, IoCtx& p) 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- : cct((CephContext*)p.cct()), 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- perfcounter(NULL), 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- snapid(CEPH_NOSNAP), 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- snap_exists(true), 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- name(imgname), 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- needs_refresh(true), 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- refresh_lock("librbd::ImageCtx::refresh_lock"), 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- lock("librbd::ImageCtx::lock"), 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- cache_lock("librbd::ImageCtx::cache_lock"), 2024-08-31T04:43:51.280 INFO:tasks.workunit.client.0.smithi089.stdout:- object_cacher(NULL), writeback_handler(NULL), object_set(NULL) 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- md_ctx.dup(p); 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- data_ctx.dup(p); 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- string pname = string("librbd-") + data_ctx.get_pool_name() + string("/") + name; 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- if (snap) { 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- snapname = snap; 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- pname += "@"; 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- pname += snapname; 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- perf_start(pname); 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.281 INFO:tasks.workunit.client.0.smithi089.stdout:- if (cct->_conf->rbd_cache) { 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(cache_lock); 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "enabling writback caching..." << dendl; 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- writeback_handler = new LibrbdWriteback(data_ctx, cache_lock); 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- object_cacher = new ObjectCacher(cct, pname, *writeback_handler, cache_lock, 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- NULL, NULL, 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- cct->_conf->rbd_cache_size, 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- cct->_conf->rbd_cache_max_dirty, 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- cct->_conf->rbd_cache_target_dirty, 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- cct->_conf->rbd_cache_max_dirty_age); 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- object_set = new ObjectCacher::ObjectSet(NULL, data_ctx.get_id(), 0); 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- object_cacher->start(); 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.282 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- ~ImageCtx() { 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- perf_stop(); 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- if (object_cacher) { 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- delete object_cacher; 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- object_cacher = NULL; 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- if (writeback_handler) { 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- delete writeback_handler; 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- writeback_handler = NULL; 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- if (object_set) { 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- delete object_set; 2024-08-31T04:43:51.283 INFO:tasks.workunit.client.0.smithi089.stdout:- object_set = NULL; 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- void perf_start(string name) { 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- PerfCountersBuilder plb(cct, name, l_librbd_first, l_librbd_last); 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_rd, "rd"); 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_rd_bytes, "rd_bytes"); 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_wr, "wr"); 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_wr_bytes, "wr_bytes"); 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_discard, "discard"); 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_discard_bytes, "discard_bytes"); 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_flush, "flush"); 2024-08-31T04:43:51.284 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_aio_rd, "aio_rd"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_aio_rd_bytes, "aio_rd_bytes"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_aio_wr, "aio_wr"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_aio_wr_bytes, "aio_wr_bytes"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_aio_discard, "aio_discard"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_aio_discard_bytes, "aio_discard_bytes"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_snap_create, "snap_create"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_snap_remove, "snap_remove"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_snap_rollback, "snap_rollback"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_notify, "notify"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- plb.add_u64_counter(l_librbd_resize, "resize"); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- perfcounter = plb.create_perf_counters(); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- cct->get_perfcounters_collection()->add(perfcounter); 2024-08-31T04:43:51.285 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- void perf_stop() { 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(perfcounter); 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- cct->get_perfcounters_collection()->remove(perfcounter); 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- delete perfcounter; 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- int snap_set(std::string snap_name) 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- std::map::iterator it = snaps_by_name.find(snap_name); 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- if (it != snaps_by_name.end()) { 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- snapname = snap_name; 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- snapid = it->second.id; 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.286 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOENT; 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- void snap_unset() 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- snapid = CEPH_NOSNAP; 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- snapname = ""; 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- snap_t get_snapid(std::string snap_name) const 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- std::map::const_iterator it = snaps_by_name.find(snap_name); 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- if (it != snaps_by_name.end()) 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- return it->second.id; 2024-08-31T04:43:51.287 INFO:tasks.workunit.client.0.smithi089.stdout:- return CEPH_NOSNAP; 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- int get_snap_size(std::string snap_name, uint64_t *size) const 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- std::map::const_iterator it = snaps_by_name.find(snap_name); 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- if (it != snaps_by_name.end()) { 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- *size = it->second.size; 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOENT; 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.288 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- void add_snap(std::string snap_name, snap_t id, uint64_t size) 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- snapc.snaps.push_back(id); 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps.push_back(id); 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- struct SnapInfo info(id, size); 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps_by_name.insert(std::pair(snap_name, info)); 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- const string md_oid() const 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- return name + RBD_SUFFIX; 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.289 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t get_image_size() const 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- if (snapname.length() == 0) { 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- return header.image_size; 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- } else { 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- map::const_iterator p = snaps_by_name.find(snapname); 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- if (p == snaps_by_name.end()) 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- return p->second.size; 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.290 INFO:tasks.workunit.client.0.smithi089.stdout:- void aio_read_from_cache(object_t o, bufferlist *bl, size_t len, 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t off, Context *onfinish) { 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- ObjectCacher::OSDRead *rd = object_cacher->prepare_read(snapid, bl, 0); 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Unlock(); 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- ObjectExtent extent(o, off, len); 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- extent.oloc.pool = data_ctx.get_id(); 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- extent.buffer_extents[0] = len; 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- rd->extents.push_back(extent); 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- cache_lock.Lock(); 2024-08-31T04:43:51.291 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = object_cacher->readx(rd, object_set, onfinish); 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- cache_lock.Unlock(); 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r > 0) 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- onfinish->complete(r); 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- void write_to_cache(object_t o, bufferlist& bl, size_t len, uint64_t off) { 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- ObjectCacher::OSDWrite *wr = object_cacher->prepare_write(snapc, bl, 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- utime_t(), 0); 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Unlock(); 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- ObjectExtent extent(o, off, len); 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- extent.oloc.pool = data_ctx.get_id(); 2024-08-31T04:43:51.292 INFO:tasks.workunit.client.0.smithi089.stdout:- extent.buffer_extents[0] = len; 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- wr->extents.push_back(extent); 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(cache_lock); 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- object_cacher->writex(wr, object_set, cache_lock); 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- int read_from_cache(object_t o, bufferlist *bl, size_t len, uint64_t off) { 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- int r; 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex mylock("librbd::ImageCtx::read_from_cache"); 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- Cond cond; 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- bool done; 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- Context *onfinish = new C_SafeCond(&mylock, &cond, &done, &r); 2024-08-31T04:43:51.293 INFO:tasks.workunit.client.0.smithi089.stdout:- aio_read_from_cache(o, bl, len, off, onfinish); 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- mylock.Lock(); 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- while (!done) 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- cond.Wait(mylock); 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- mylock.Unlock(); 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- int flush_cache() { 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = 0; 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex mylock("librbd::ImageCtx::flush_cache"); 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- Cond cond; 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- bool done; 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- Context *onfinish = new C_SafeCond(&mylock, &cond, &done, &r); 2024-08-31T04:43:51.294 INFO:tasks.workunit.client.0.smithi089.stdout:- cache_lock.Lock(); 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- bool already_flushed = object_cacher->commit_set(object_set, onfinish); 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- cache_lock.Unlock(); 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!already_flushed) { 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- mylock.Lock(); 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- while (!done) { 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "waiting for cache to be flushed" << dendl; 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- cond.Wait(mylock); 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- mylock.Unlock(); 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "finished flushing cache" << dendl; 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.295 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- void shutdown_cache() { 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- invalidate_cache(); 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Unlock(); 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- object_cacher->stop(); 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- void invalidate_cache() { 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(lock.is_locked()); 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!object_cacher) 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- return; 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- cache_lock.Lock(); 2024-08-31T04:43:51.296 INFO:tasks.workunit.client.0.smithi089.stdout:- object_cacher->release_set(object_set); 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- cache_lock.Unlock(); 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = flush_cache(); 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r) 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "flush_cache returned " << r << dendl; 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- cache_lock.Lock(); 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- bool unclean = object_cacher->release_set(object_set); 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- cache_lock.Unlock(); 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- if (unclean) 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "could not release all objects from cache" << dendl; 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- }; 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- class WatchCtx : public librados::WatchCtx { 2024-08-31T04:43:51.297 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx; 2024-08-31T04:43:51.298 INFO:tasks.workunit.client.0.smithi089.stdout:- bool valid; 2024-08-31T04:43:51.298 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex lock; 2024-08-31T04:43:51.298 INFO:tasks.workunit.client.0.smithi089.stdout:- public: 2024-08-31T04:43:51.298 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t cookie; 2024-08-31T04:43:51.298 INFO:tasks.workunit.client.0.smithi089.stdout:- WatchCtx(ImageCtx *ctx) : ictx(ctx), 2024-08-31T04:43:51.298 INFO:tasks.workunit.client.0.smithi089.stdout:- valid(true), 2024-08-31T04:43:51.298 INFO:tasks.workunit.client.0.smithi089.stdout:- lock("librbd::WatchCtx") {} 2024-08-31T04:43:51.298 INFO:tasks.workunit.client.0.smithi089.stdout:- virtual ~WatchCtx() {} 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- void invalidate(); 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- virtual void notify(uint8_t opcode, uint64_t ver, bufferlist& bl); 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- }; 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- struct AioCompletion { 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex lock; 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- Cond cond; 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- bool done; 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- ssize_t rval; 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- callback_t complete_cb; 2024-08-31T04:43:51.299 INFO:tasks.workunit.client.0.smithi089.stdout:- void *complete_arg; 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- rbd_completion_t rbd_comp; 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- int pending_count; 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- int ref; 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- bool released; 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- AioCompletion() : lock("AioCompletion::lock", true), 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- done(false), rval(0), complete_cb(NULL), complete_arg(NULL), 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- rbd_comp(NULL), pending_count(1), ref(1), released(false) { 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.300 INFO:tasks.workunit.client.0.smithi089.stdout:- ~AioCompletion() { 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- int wait_for_complete() { 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- while (!done) 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- cond.Wait(lock); 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Unlock(); 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- void add_block_completion(AioBlockCompletion *aio_completion) { 2024-08-31T04:43:51.301 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- pending_count++; 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Unlock(); 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- get(); 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- void finish_adding_completions() { 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(pending_count); 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- int count = --pending_count; 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!count) { 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- complete(); 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Unlock(); 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.302 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- void complete() { 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(lock.is_locked()); 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- if (complete_cb) { 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- complete_cb(rbd_comp, complete_arg); 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- done = true; 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- cond.Signal(); 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- void set_complete_cb(void *cb_arg, callback_t cb) { 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- complete_cb = cb; 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- complete_arg = cb_arg; 2024-08-31T04:43:51.303 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.304 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.304 INFO:tasks.workunit.client.0.smithi089.stdout:- void complete_block(AioBlockCompletion *block_completion, ssize_t r); 2024-08-31T04:43:51.304 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.304 INFO:tasks.workunit.client.0.smithi089.stdout:- ssize_t get_return_value() { 2024-08-31T04:43:51.304 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.304 INFO:tasks.workunit.client.0.smithi089.stdout:- ssize_t r = rval; 2024-08-31T04:43:51.304 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Unlock(); 2024-08-31T04:43:51.304 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.304 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- void get() { 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(ref > 0); 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- ref++; 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Unlock(); 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- void release() { 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(!released); 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- released = true; 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- put_unlock(); 2024-08-31T04:43:51.305 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- void put() { 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- put_unlock(); 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- void put_unlock() { 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(ref > 0); 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- int n = --ref; 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Unlock(); 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!n) 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- delete this; 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- }; 2024-08-31T04:43:51.306 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int snap_set(ImageCtx *ictx, const char *snap_name); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int list(IoCtx& io_ctx, std::vector& names); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int create(IoCtx& io_ctx, const char *imgname, uint64_t size, int *order); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int rename(IoCtx& io_ctx, const char *srcname, const char *dstname); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int info(ImageCtx *ictx, image_info_t& info, size_t image_size); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int remove(IoCtx& io_ctx, const char *imgname, ProgressContext& prog_ctx); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int resize(ImageCtx *ictx, uint64_t size, ProgressContext& prog_ctx); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int resize_helper(ImageCtx *ictx, uint64_t size, ProgressContext& prog_ctx); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int snap_create(ImageCtx *ictx, const char *snap_name); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int snap_list(ImageCtx *ictx, std::vector& snaps); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int snap_rollback(ImageCtx *ictx, const char *snap_name, ProgressContext& prog_ctx); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int snap_remove(ImageCtx *ictx, const char *snap_name); 2024-08-31T04:43:51.307 INFO:tasks.workunit.client.0.smithi089.stdout:- int add_snap(ImageCtx *ictx, const char *snap_name); 2024-08-31T04:43:51.308 INFO:tasks.workunit.client.0.smithi089.stdout:- int rm_snap(ImageCtx *ictx, const char *snap_name); 2024-08-31T04:43:51.308 INFO:tasks.workunit.client.0.smithi089.stdout:- int ictx_check(ImageCtx *ictx); 2024-08-31T04:43:51.308 INFO:tasks.workunit.client.0.smithi089.stdout:- int ictx_refresh(ImageCtx *ictx); 2024-08-31T04:43:51.308 INFO:tasks.workunit.client.0.smithi089.stdout:- int copy(ImageCtx& srci, IoCtx& dest_md_ctx, const char *destname); 2024-08-31T04:43:51.308 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.308 INFO:tasks.workunit.client.0.smithi089.stdout:- int open_image(ImageCtx *ictx); 2024-08-31T04:43:51.308 INFO:tasks.workunit.client.0.smithi089.stdout:- void close_image(ImageCtx *ictx); 2024-08-31T04:43:51.308 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- void trim_image(IoCtx& io_ctx, const rbd_obj_header_ondisk &header, uint64_t newsize, 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- ProgressContext& prog_ctx); 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- int read_rbd_info(IoCtx& io_ctx, const string& info_oid, struct rbd_info *info); 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- int touch_rbd_info(IoCtx& io_ctx, const string& info_oid); 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- int rbd_assign_bid(IoCtx& io_ctx, const string& info_oid, uint64_t *id); 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- int read_header_bl(IoCtx& io_ctx, const string& md_oid, bufferlist& header, uint64_t *ver); 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- int notify_change(IoCtx& io_ctx, const string& oid, uint64_t *pver, ImageCtx *ictx); 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- int read_header(IoCtx& io_ctx, const string& md_oid, struct rbd_obj_header_ondisk *header, uint64_t *ver); 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- int write_header(IoCtx& io_ctx, const string& md_oid, bufferlist& header); 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- int tmap_set(IoCtx& io_ctx, const string& imgname); 2024-08-31T04:43:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:- int tmap_rm(IoCtx& io_ctx, const string& imgname); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- int rollback_image(ImageCtx *ictx, uint64_t snapid, ProgressContext& prog_ctx); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- void image_info(const ImageCtx& ictx, image_info_t& info, size_t info_size); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- string get_block_oid(const rbd_obj_header_ondisk &header, uint64_t num); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t get_max_block(uint64_t size, int obj_order); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t get_max_block(const rbd_obj_header_ondisk &header); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t get_block_size(const rbd_obj_header_ondisk &header); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t get_block_num(const rbd_obj_header_ondisk &header, uint64_t ofs); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t get_block_ofs(const rbd_obj_header_ondisk &header, uint64_t ofs); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- int check_io(ImageCtx *ictx, uint64_t off, uint64_t len); 2024-08-31T04:43:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:- int init_rbd_info(struct rbd_info *info); 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- void init_rbd_header(struct rbd_obj_header_ondisk& ondisk, 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t size, int *order, uint64_t bid); 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- int64_t read_iterate(ImageCtx *ictx, uint64_t off, size_t len, 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- int (*cb)(uint64_t, size_t, const char *, void *), 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- void *arg); 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- ssize_t read(ImageCtx *ictx, uint64_t off, size_t len, char *buf); 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- ssize_t write(ImageCtx *ictx, uint64_t off, size_t len, const char *buf); 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- int discard(ImageCtx *ictx, uint64_t off, uint64_t len); 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- int aio_write(ImageCtx *ictx, uint64_t off, size_t len, const char *buf, 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- AioCompletion *c); 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- int aio_discard(ImageCtx *ictx, uint64_t off, size_t len, AioCompletion *c); 2024-08-31T04:43:51.311 INFO:tasks.workunit.client.0.smithi089.stdout:- int aio_read(ImageCtx *ictx, uint64_t off, size_t len, 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- char *buf, AioCompletion *c); 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- int flush(ImageCtx *ictx); 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- int _flush(ImageCtx *ictx); 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- ssize_t handle_sparse_read(CephContext *cct, 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist data_bl, 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_ofs, 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- const map &data_map, 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t buf_ofs, 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t buf_len, 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- int (*cb)(uint64_t, size_t, const char *, void *), 2024-08-31T04:43:51.312 INFO:tasks.workunit.client.0.smithi089.stdout:- void *arg); 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- AioCompletion *aio_create_completion() { 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- AioCompletion *c= new AioCompletion(); 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- return c; 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- AioCompletion *aio_create_completion(void *cb_arg, callback_t cb_complete) { 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- AioCompletion *c = new AioCompletion(); 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- c->set_complete_cb(cb_arg, cb_complete); 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- return c; 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:-void WatchCtx::invalidate() 2024-08-31T04:43:51.313 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(lock); 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- valid = false; 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:-void WatchCtx::notify(uint8_t opcode, uint64_t ver, bufferlist& bl) 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(lock); 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 1) << " got notification opcode=" << (int)opcode << " ver=" << ver << " cookie=" << cookie << dendl; 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- if (valid) { 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker lictx(ictx->refresh_lock); 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->needs_refresh = true; 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_notify); 2024-08-31T04:43:51.314 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:-void init_rbd_header(struct rbd_obj_header_ondisk& ondisk, 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t size, int *order, uint64_t bid) 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:- uint32_t hi = bid >> 32; 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:- uint32_t lo = bid & 0xFFFFFFFF; 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:- memset(&ondisk, 0, sizeof(ondisk)); 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:- memcpy(&ondisk.text, RBD_HEADER_TEXT, sizeof(RBD_HEADER_TEXT)); 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:- memcpy(&ondisk.signature, RBD_HEADER_SIGNATURE, sizeof(RBD_HEADER_SIGNATURE)); 2024-08-31T04:43:51.315 INFO:tasks.workunit.client.0.smithi089.stdout:- memcpy(&ondisk.version, RBD_HEADER_VERSION, sizeof(RBD_HEADER_VERSION)); 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- snprintf(ondisk.block_name, sizeof(ondisk.block_name), "rb.%x.%x", hi, lo); 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!*order) 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- *order = RBD_DEFAULT_OBJ_ORDER; 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- ondisk.image_size = size; 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- ondisk.options.order = *order; 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- ondisk.options.crypt_type = RBD_CRYPT_NONE; 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- ondisk.options.comp_type = RBD_COMP_NONE; 2024-08-31T04:43:51.316 INFO:tasks.workunit.client.0.smithi089.stdout:- ondisk.snap_seq = 0; 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- ondisk.snap_count = 0; 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- ondisk.reserved = 0; 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- ondisk.snap_names_len = 0; 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:-void image_info(const ImageCtx& ictx, image_info_t& info, size_t infosize) 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- int obj_order = ictx.header.options.order; 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- info.size = ictx.get_image_size(); 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- info.obj_size = 1 << obj_order; 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- info.num_objs = ictx.get_image_size() >> obj_order; 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- info.order = obj_order; 2024-08-31T04:43:51.317 INFO:tasks.workunit.client.0.smithi089.stdout:- memcpy(&info.block_name_prefix, &ictx.header.block_name, RBD_MAX_BLOCK_NAME_SIZE); 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:- info.parent_pool = -1; 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:- bzero(&info.parent_name, RBD_MAX_IMAGE_NAME_SIZE); 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:-string get_block_oid(const rbd_obj_header_ondisk &header, uint64_t num) 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:- char o[RBD_MAX_BLOCK_NAME_SIZE]; 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:- snprintf(o, RBD_MAX_BLOCK_NAME_SIZE, 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:- "%s.%012" PRIx64, header.block_name, num); 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:- return o; 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.318 INFO:tasks.workunit.client.0.smithi089.stdout:-uint64_t get_max_block(uint64_t size, int obj_order) 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_size = 1 << obj_order; 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t numseg = (size + block_size - 1) >> obj_order; 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:- return numseg; 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:-uint64_t get_max_block(const rbd_obj_header_ondisk &header) 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:- return get_max_block(header.image_size, header.options.order); 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:-uint64_t get_block_ofs(const rbd_obj_header_ondisk &header, uint64_t ofs) 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.319 INFO:tasks.workunit.client.0.smithi089.stdout:- int obj_order = header.options.order; 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_size = 1 << obj_order; 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:- return ofs & (block_size - 1); 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:-uint64_t get_block_size(const rbd_obj_header_ondisk &header) 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:- return 1 << header.options.order; 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:-uint64_t get_block_num(const rbd_obj_header_ondisk &header, uint64_t ofs) 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.320 INFO:tasks.workunit.client.0.smithi089.stdout:- int obj_order = header.options.order; 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t num = ofs >> obj_order; 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:- return num; 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:-int init_rbd_info(struct rbd_info *info) 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:- memset(info, 0, sizeof(*info)); 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:-void trim_image(IoCtx& io_ctx, const rbd_obj_header_ondisk &header, uint64_t newsize, 2024-08-31T04:43:51.321 INFO:tasks.workunit.client.0.smithi089.stdout:- ProgressContext& prog_ctx) 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = (CephContext *)io_ctx.cct(); 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t bsize = get_block_size(header); 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t numseg = get_max_block(header); 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t start = get_block_num(header, newsize); 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_ofs = get_block_ofs(header, newsize); 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- if (block_ofs) { 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "trim_image object " << numseg << " truncate to " << block_ofs << dendl; 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- string oid = get_block_oid(header, start); 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::ObjectWriteOperation write_op; 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- write_op.truncate(block_ofs); 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- io_ctx.operate(oid, &write_op); 2024-08-31T04:43:51.322 INFO:tasks.workunit.client.0.smithi089.stdout:- start++; 2024-08-31T04:43:51.323 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.323 INFO:tasks.workunit.client.0.smithi089.stdout:- if (start < numseg) { 2024-08-31T04:43:51.323 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "trim_image objects " << start << " to " << (numseg-1) << dendl; 2024-08-31T04:43:51.323 INFO:tasks.workunit.client.0.smithi089.stdout:- for (uint64_t i=start; ilock.is_locked()); 2024-08-31T04:43:51.329 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->refresh_lock.Lock(); 2024-08-31T04:43:51.329 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->needs_refresh = true; 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->refresh_lock.Unlock(); 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- if (pver) 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- ver = *pver; 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- else 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- ver = io_ctx.get_last_version(); 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl; 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- io_ctx.notify(oid, ver, bl); 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.330 INFO:tasks.workunit.client.0.smithi089.stdout:-int read_header(IoCtx& io_ctx, const string& md_oid, struct rbd_obj_header_ondisk *header, uint64_t *ver) 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist header_bl; 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = read_header_bl(io_ctx, md_oid, header_bl, ver); 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- if (header_bl.length() < (int)sizeof(*header)) 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EIO; 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- memcpy(header, header_bl.c_str(), sizeof(*header)); 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.331 INFO:tasks.workunit.client.0.smithi089.stdout:-int write_header(IoCtx& io_ctx, const string& md_oid, bufferlist& header) 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl; 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = io_ctx.write(md_oid, header, header.length(), 0); 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:- notify_change(io_ctx, md_oid, NULL, NULL); 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:-int tmap_set(IoCtx& io_ctx, const string& imgname) 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.332 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist cmdbl, emptybl; 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- __u8 c = CEPH_OSD_TMAP_SET; 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- ::encode(c, cmdbl); 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- ::encode(imgname, cmdbl); 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- ::encode(emptybl, cmdbl); 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- return io_ctx.tmap_update(RBD_DIRECTORY, cmdbl); 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:-int tmap_rm(IoCtx& io_ctx, const string& imgname) 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist cmdbl; 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- __u8 c = CEPH_OSD_TMAP_RM; 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- ::encode(c, cmdbl); 2024-08-31T04:43:51.333 INFO:tasks.workunit.client.0.smithi089.stdout:- ::encode(imgname, cmdbl); 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- return io_ctx.tmap_update(RBD_DIRECTORY, cmdbl); 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:-int rollback_image(ImageCtx *ictx, uint64_t snapid, ProgressContext& prog_ctx) 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(ictx->lock.is_locked()); 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t numseg = get_max_block(ictx->header); 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t bsize = get_block_size(ictx->header); 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- for (uint64_t i = 0; i < numseg; i++) { 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- int r; 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- string oid = get_block_oid(ictx->header, i); 2024-08-31T04:43:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->data_ctx.selfmanaged_snap_rollback(oid, snapid); 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 10) << "selfmanaged_snap_rollback on " << oid << " to " << snapid << " returned " << r << dendl; 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- prog_ctx.update_progress(i * bsize, numseg * bsize); 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0 && r != -ENOENT) 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:-int list(IoCtx& io_ctx, std::vector& names) 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = (CephContext *)io_ctx.cct(); 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "list " << &io_ctx << dendl; 2024-08-31T04:43:51.335 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl; 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = io_ctx.read(RBD_DIRECTORY, bl, 0, 0); 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist::iterator p = bl.begin(); 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist header; 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- map m; 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- ::decode(header, p); 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- ::decode(m, p); 2024-08-31T04:43:51.336 INFO:tasks.workunit.client.0.smithi089.stdout:- for (map::iterator q = m.begin(); q != m.end(); q++) 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- names.push_back(q->first); 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:-int snap_create(ImageCtx *ictx, const char *snap_name) 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "snap_create " << ictx << " " << snap_name << dendl; 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.337 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(ictx->lock); 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- r = add_snap(ictx, snap_name); 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- notify_change(ictx->md_ctx, ictx->md_oid(), NULL, ictx); 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_snap_create); 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:-int snap_remove(ImageCtx *ictx, const char *snap_name) 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.338 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "snap_remove " << ictx << " " << snap_name << dendl; 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(ictx->lock); 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- snap_t snapid = ictx->get_snapid(snap_name); 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- if (snapid == CEPH_NOSNAP) 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOENT; 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- r = rm_snap(ictx, snap_name); 2024-08-31T04:43:51.339 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->data_ctx.selfmanaged_snap_remove(snapid); 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- notify_change(ictx->md_ctx, ictx->md_oid(), NULL, ictx); 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_snap_remove); 2024-08-31T04:43:51.340 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.341 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.341 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.341 INFO:tasks.workunit.client.0.smithi089.stdout:-int create(IoCtx& io_ctx, const char *imgname, uint64_t size, int *order) 2024-08-31T04:43:51.341 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.341 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = (CephContext *)io_ctx.cct(); 2024-08-31T04:43:51.341 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "create " << &io_ctx << " name = " << imgname << " size = " << size << dendl; 2024-08-31T04:43:51.341 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.341 INFO:tasks.workunit.client.0.smithi089.stdout:- string md_oid = imgname; 2024-08-31T04:43:51.341 INFO:tasks.workunit.client.0.smithi089.stdout:- md_oid += RBD_SUFFIX; 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- // make sure it doesn't already exist 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = io_ctx.stat(md_oid, NULL, NULL); 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r == 0) { 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "rbd image header " << md_oid << " already exists" << dendl; 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EEXIST; 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t bid; 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- string dir_info = RBD_INFO; 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- r = rbd_assign_bid(io_ctx, dir_info, &bid); 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.342 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "failed to assign a block name for image" << dendl; 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- struct rbd_obj_header_ondisk header; 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- init_rbd_header(header, size, order, bid); 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl; 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- bl.append((const char *)&header, sizeof(header)); 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "adding rbd image to directory..." << dendl; 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- r = tmap_set(io_ctx, imgname); 2024-08-31T04:43:51.343 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "error adding img to directory: " << cpp_strerror(-r)<< dendl; 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "creating rbd image..." << dendl; 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- r = io_ctx.write(md_oid, bl, bl.length(), 0); 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "error writing header: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "done." << dendl; 2024-08-31T04:43:51.344 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:-int rename(IoCtx& io_ctx, const char *srcname, const char *dstname) 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = (CephContext *)io_ctx.cct(); 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "rename " << &io_ctx << " " << srcname << " -> " << dstname << dendl; 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- string md_oid = srcname; 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- md_oid += RBD_SUFFIX; 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- string dst_md_oid = dstname; 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- dst_md_oid += RBD_SUFFIX; 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- string dstname_str = dstname; 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- string imgname_str = srcname; 2024-08-31T04:43:51.345 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t ver; 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist header; 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = read_header_bl(io_ctx, md_oid, header, &ver); 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "error reading header: " << md_oid << ": " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- r = io_ctx.stat(dst_md_oid, NULL, NULL); 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r == 0) { 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "rbd image header " << dst_md_oid << " already exists" << dendl; 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EEXIST; 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- r = write_header(io_ctx, dst_md_oid, header); 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.346 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "error writing header: " << dst_md_oid << ": " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- r = tmap_set(io_ctx, dstname_str); 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- io_ctx.remove(dst_md_oid); 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "can't add " << dst_md_oid << " to directory" << dendl; 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- r = tmap_rm(io_ctx, imgname_str); 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "warning: couldn't remove old entry from directory (" << imgname_str << ")" << dendl; 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- r = io_ctx.remove(md_oid); 2024-08-31T04:43:51.347 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0 && r != -ENOENT) 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "warning: couldn't remove old metadata" << dendl; 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- notify_change(io_ctx, md_oid, NULL, NULL); 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:-int info(ImageCtx *ictx, image_info_t& info, size_t infosize) 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "info " << ictx << dendl; 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.348 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(ictx->lock); 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:- image_info(*ictx, info, infosize); 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:-bool has_snaps(IoCtx& io_ctx, const std::string& md_oid) 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct((CephContext *)io_ctx.cct()); 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "has_snaps " << &io_ctx << " " << md_oid << dendl; 2024-08-31T04:43:51.349 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.350 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl, bl2; 2024-08-31T04:43:51.350 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = io_ctx.exec(md_oid, "rbd", "snap_list", bl, bl2); 2024-08-31T04:43:51.350 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.350 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "Error listing snapshots: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.350 INFO:tasks.workunit.client.0.smithi089.stdout:- return true; 2024-08-31T04:43:51.350 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.350 INFO:tasks.workunit.client.0.smithi089.stdout:- uint32_t num_snaps; 2024-08-31T04:43:51.350 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t snap_seq; 2024-08-31T04:43:51.350 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist::iterator iter = bl2.begin(); 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- ::decode(snap_seq, iter); 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- ::decode(num_snaps, iter); 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- return num_snaps > 0; 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:-int remove(IoCtx& io_ctx, const char *imgname, ProgressContext& prog_ctx) 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct((CephContext *)io_ctx.cct()); 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "remove " << &io_ctx << " " << imgname << dendl; 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- string md_oid = imgname; 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- md_oid += RBD_SUFFIX; 2024-08-31T04:43:51.351 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- struct rbd_obj_header_ondisk header; 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = read_header(io_ctx, md_oid, &header, NULL); 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "error reading header: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r >= 0) { 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- if (has_snaps(io_ctx, md_oid)) { 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "image has snapshots - not removing" << dendl; 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOTEMPTY; 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- trim_image(io_ctx, header, 0, prog_ctx); 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "removing header..." << dendl; 2024-08-31T04:43:51.352 INFO:tasks.workunit.client.0.smithi089.stdout:- r = io_ctx.remove(md_oid); 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0 && r != -ENOENT) { 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "error removing header: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "removing rbd image from directory..." << dendl; 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- r = tmap_rm(io_ctx, imgname); 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "error removing img from directory: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.353 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "done." << dendl; 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:-int resize_helper(ImageCtx *ictx, uint64_t size, ProgressContext& prog_ctx) 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = ictx->cct; 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- if (size == ictx->header.image_size) { 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "no change in size (" << ictx->header.image_size << " -> " << size << ")" << dendl; 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- if (size > ictx->header.image_size) { 2024-08-31T04:43:51.354 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "expanding image " << ictx->header.image_size << " -> " << size << dendl; 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->header.image_size = size; 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- } else { 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "shrinking image " << ictx->header.image_size << " -> " << size << dendl; 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- trim_image(ictx->data_ctx, ictx->header, size, prog_ctx); 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->header.image_size = size; 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- // rewrite header 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl; 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- bl.append((const char *)&(ictx->header), sizeof(ictx->header)); 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx->md_ctx.write(ictx->md_oid(), bl, bl.length(), 0); 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.355 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r == -ERANGE) 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "operation might have conflicted with another client!" << dendl; 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "error writing header: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- } else { 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- notify_change(ictx->md_ctx, ictx->md_oid(), NULL, ictx); 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:-int resize(ImageCtx *ictx, uint64_t size, ProgressContext& prog_ctx) 2024-08-31T04:43:51.356 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = ictx->cct; 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "resize " << ictx << " " << ictx->header.image_size << " -> " << size << dendl; 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(ictx->lock); 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- if (size < ictx->header.image_size && ictx->object_cacher) { 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- // need to invalidate since we're deleting objects, and 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- // ObjectCacher doesn't track non-existent objects 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->invalidate_cache(); 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.357 INFO:tasks.workunit.client.0.smithi089.stdout:- resize_helper(ictx, size, prog_ctx); 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "done." << dendl; 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_resize); 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:-int snap_list(ImageCtx *ictx, std::vector& snaps) 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "snap_list " << ictx << dendl; 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.358 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl, bl2; 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(ictx->lock); 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- for (std::map::iterator it = ictx->snaps_by_name.begin(); 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- it != ictx->snaps_by_name.end(); ++it) { 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- snap_info_t info; 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- info.name = it->first; 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- info.id = it->second.id; 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- info.size = it->second.size; 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps.push_back(info); 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.359 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:-int add_snap(ImageCtx *ictx, const char *snap_name) 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(ictx->lock.is_locked()); 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl, bl2; 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t snap_id; 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx->md_ctx.selfmanaged_snap_create(&snap_id); 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(ictx->cct) << "failed to create snap id: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.360 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- ::encode(snap_name, bl); 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- ::encode(snap_id, bl); 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->md_ctx.exec(ictx->md_oid(), "rbd", "snap_add", bl, bl2); 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(ictx->cct) << "rbd.snap_add execution failed failed: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- notify_change(ictx->md_ctx, ictx->md_oid(), NULL, ictx); 2024-08-31T04:43:51.361 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:-int rm_snap(ImageCtx *ictx, const char *snap_name) 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(ictx->lock.is_locked()); 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl, bl2; 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:- ::encode(snap_name, bl); 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx->md_ctx.exec(ictx->md_oid(), "rbd", "snap_remove", bl, bl2); 2024-08-31T04:43:51.362 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(ictx->cct) << "rbd.snap_remove execution failed: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:-int ictx_check(ImageCtx *ictx) 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = ictx->cct; 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "ictx_check " << ictx << dendl; 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->refresh_lock.Lock(); 2024-08-31T04:43:51.363 INFO:tasks.workunit.client.0.smithi089.stdout:- bool needs_refresh = ictx->needs_refresh; 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->refresh_lock.Unlock(); 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- if (needs_refresh) { 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(ictx->lock); 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_refresh(ictx); 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "Error re-reading rbd header: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.364 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:-int ictx_refresh(ImageCtx *ictx) 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = ictx->cct; 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(ictx->lock.is_locked()); 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl, bl2; 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "ictx_refresh " << ictx << dendl; 2024-08-31T04:43:51.365 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->refresh_lock.Lock(); 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->needs_refresh = false; 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->refresh_lock.Unlock(); 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = read_header(ictx->md_ctx, ictx->md_oid(), &(ictx->header), NULL); 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "Error reading header: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.366 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->md_ctx.exec(ictx->md_oid(), "rbd", "snap_list", bl, bl2); 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "Error listing snapshots: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- r = 0; 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- std::map old_snap_ids; 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- for (std::map::iterator it = 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->snaps_by_name.begin(); it != ictx->snaps_by_name.end(); ++it) { 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- old_snap_ids[it->second.id] = it->first; 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- bool new_snap = false; 2024-08-31T04:43:51.367 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->snaps.clear(); 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->snapc.snaps.clear(); 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->snaps_by_name.clear(); 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- uint32_t num_snaps; 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist::iterator iter = bl2.begin(); 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- ::decode(ictx->snapc.seq, iter); 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- ::decode(num_snaps, iter); 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- for (uint32_t i=0; i < num_snaps; i++) { 2024-08-31T04:43:51.368 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t id, image_size; 2024-08-31T04:43:51.369 INFO:tasks.workunit.client.0.smithi089.stdout:- string s; 2024-08-31T04:43:51.369 INFO:tasks.workunit.client.0.smithi089.stdout:- ::decode(id, iter); 2024-08-31T04:43:51.369 INFO:tasks.workunit.client.0.smithi089.stdout:- ::decode(image_size, iter); 2024-08-31T04:43:51.369 INFO:tasks.workunit.client.0.smithi089.stdout:- ::decode(s, iter); 2024-08-31T04:43:51.369 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->add_snap(s, id, image_size); 2024-08-31T04:43:51.369 INFO:tasks.workunit.client.0.smithi089.stdout:- std::map::const_iterator it = old_snap_ids.find(id); 2024-08-31T04:43:51.369 INFO:tasks.workunit.client.0.smithi089.stdout:- if (it == old_snap_ids.end()) { 2024-08-31T04:43:51.369 INFO:tasks.workunit.client.0.smithi089.stdout:- new_snap = true; 2024-08-31T04:43:51.369 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "new snapshot " << s << " size " << image_size << dendl; 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- if (new_snap) { 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- _flush(ictx); 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!ictx->snapc.is_valid()) { 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "image snap context is invalid!" << dendl; 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->refresh_lock.Lock(); 2024-08-31T04:43:51.370 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->needs_refresh = true; 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->refresh_lock.Unlock(); 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EIO; 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->snapid != CEPH_NOSNAP && 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->get_snapid(ictx->snapname) == CEPH_NOSNAP) { 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "tried to read from a snapshot that no longer exists: " 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- << ictx->snapname << dendl; 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->snap_exists = false; 2024-08-31T04:43:51.371 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->data_ctx.selfmanaged_snap_set_write_ctx(ictx->snapc.seq, ictx->snaps); 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:-ProgressContext::~ProgressContext() 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:-class NoOpProgressContext : public librbd::ProgressContext 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:-public: 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:- NoOpProgressContext() 2024-08-31T04:43:51.372 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- int update_progress(uint64_t offset, uint64_t src_size) 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:-}; 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:-class CProgressContext : public librbd::ProgressContext 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:-public: 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- CProgressContext(librbd_progress_fn_t fn, void *data) 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- : m_fn(fn), m_data(data) 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.373 INFO:tasks.workunit.client.0.smithi089.stdout:- int update_progress(uint64_t offset, uint64_t src_size) 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- return m_fn(offset, src_size, m_data); 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:-private: 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd_progress_fn_t m_fn; 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- void *m_data; 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:-}; 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:-int snap_rollback(ImageCtx *ictx, const char *snap_name, ProgressContext& prog_ctx) 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = ictx->cct; 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "snap_rollback " << ictx << " snap = " << snap_name << dendl; 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!ictx->snap_exists) 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOENT; 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->snapid != CEPH_NOSNAP) 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EROFS; 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(ictx->lock); 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- snap_t snapid = ictx->get_snapid(snap_name); 2024-08-31T04:43:51.375 INFO:tasks.workunit.client.0.smithi089.stdout:- if (snapid == CEPH_NOSNAP) { 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "No such snapshot found." << dendl; 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOENT; 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- // need to flush any pending writes before resizing and rolling back - 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- // writes might create new snapshots. Rolling back will replace 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- // the current version, so we have to invalidate that too. 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->invalidate_cache(); 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t new_size = ictx->get_image_size(); 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->get_snap_size(snap_name, &new_size); 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 2) << "resizing to snapshot size..." << dendl; 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- NoOpProgressContext no_op; 2024-08-31T04:43:51.376 INFO:tasks.workunit.client.0.smithi089.stdout:- r = resize_helper(ictx, new_size, no_op); 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "Error resizing to snapshot size: " 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- r = rollback_image(ictx, snapid, prog_ctx); 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "Error rolling back image: " << cpp_strerror(-r) << dendl; 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.377 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx_refresh(ictx); 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- snap_t new_snapid = ictx->get_snapid(snap_name); 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "snapid is " << ictx->snapid << " new snapid is " << new_snapid << dendl; 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- notify_change(ictx->md_ctx, ictx->md_oid(), NULL, ictx); 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_snap_rollback); 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:-struct CopyProgressCtx { 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- CopyProgressCtx(ProgressContext &p) 2024-08-31T04:43:51.378 INFO:tasks.workunit.client.0.smithi089.stdout:- : prog_ctx(p) 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- { 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *destictx; 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t src_size; 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- ProgressContext &prog_ctx; 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:-}; 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:-int do_copy_extent(uint64_t offset, size_t len, const char *buf, void *data) 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- CopyProgressCtx *cp = reinterpret_cast(data); 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- cp->prog_ctx.update_progress(offset, cp->src_size); 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- int ret = 0; 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- if (buf) { 2024-08-31T04:43:51.379 INFO:tasks.workunit.client.0.smithi089.stdout:- ret = write(cp->destictx, offset, len, buf); 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:- return ret; 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:-int copy(ImageCtx& ictx, IoCtx& dest_md_ctx, const char *destname, 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:- ProgressContext &prog_ctx) 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = (CephContext *)dest_md_ctx.cct(); 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:- CopyProgressCtx cp(prog_ctx); 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t src_size = ictx.get_image_size(); 2024-08-31T04:43:51.380 INFO:tasks.workunit.client.0.smithi089.stdout:- int64_t r; 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- int order = ictx.header.options.order; 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- r = create(dest_md_ctx, destname, src_size, &order); 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "header creation failed" << dendl; 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- cp.destictx = new librbd::ImageCtx(destname, NULL, dest_md_ctx); 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- cp.src_size = src_size; 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- r = open_image(cp.destictx); 2024-08-31T04:43:51.381 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "failed to read newly created header" << dendl; 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- r = read_iterate(&ictx, 0, src_size, do_copy_extent, &cp); 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r >= 0) { 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- // don't return total bytes read, which may not fit in an int 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- r = 0; 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- prog_ctx.update_progress(cp.src_size, cp.src_size); 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- close_image(cp.destictx); 2024-08-31T04:43:51.382 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:-int snap_set(ImageCtx *ictx, const char *snap_name) 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "snap_set " << ictx << " snap = " 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:- << (snap_name ? snap_name : "NULL") << dendl; 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:- Mutex::Locker l(ictx->lock); 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:- if (snap_name) { 2024-08-31T04:43:51.383 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx->snap_set(snap_name); 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- } else { 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->snap_unset(); 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->snap_exists = true; 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->data_ctx.snap_set_read(ictx->snapid); 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.384 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:-int open_image(ImageCtx *ictx) 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "open_image: ictx = " << ictx 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- << " name = '" << ictx->name << "' snap_name = '" 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- << ictx->snapname << "'" << dendl; 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_refresh(ictx); 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.385 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->snap_set(ictx->snapname); 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->data_ctx.snap_set_read(ictx->snapid); 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- WatchCtx *wctx = new WatchCtx(ictx); 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!wctx) 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOMEM; 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->wctx = wctx; 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->md_ctx.watch(ictx->md_oid(), 0, &(wctx->cookie), wctx); 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.386 INFO:tasks.workunit.client.0.smithi089.stdout:-void close_image(ImageCtx *ictx) 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "close_image " << ictx << dendl; 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->shutdown_cache(); // implicitly flushes 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- else 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- flush(ictx); 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->wctx->invalidate(); 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->md_ctx.unwatch(ictx->md_oid(), ictx->wctx->cookie); 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- delete ictx->wctx; 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- delete ictx; 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.387 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:-int64_t read_iterate(ImageCtx *ictx, uint64_t off, size_t len, 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- int (*cb)(uint64_t, size_t, const char *, void *), 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- void *arg) 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "read_iterate " << ictx << " off = " << off << " len = " << len << dendl; 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- r = check_io(ictx, off, len); 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.388 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- int64_t ret; 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- int64_t total_read = 0; 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t start_block = get_block_num(ictx->header, off); 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t end_block = get_block_num(ictx->header, off + len - 1); 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_size = get_block_size(ictx->header); 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t left = len; 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- for (uint64_t i = start_block; i <= end_block; i++) { 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl; 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.389 INFO:tasks.workunit.client.0.smithi089.stdout:- string oid = get_block_oid(ictx->header, i); 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_ofs = get_block_ofs(ictx->header, off + total_read); 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t read_len = min(block_size - block_ofs, left); 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t bytes_read; 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) { 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->read_from_cache(oid, &bl, read_len, block_ofs); 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0 && r != -ENOENT) 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r == -ENOENT) 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- r = cb(total_read, read_len, NULL, arg); 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- else 2024-08-31T04:43:51.390 INFO:tasks.workunit.client.0.smithi089.stdout:- r = cb(total_read, read_len, bl.c_str(), arg); 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- bytes_read = read_len; // ObjectCacher pads with zeroes at end of object 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- } else { 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- map m; 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->data_ctx.sparse_read(oid, m, bl, read_len, block_ofs); 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0 && r == -ENOENT) 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- r = 0; 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- r = handle_sparse_read(ictx->cct, bl, block_ofs, m, total_read, read_len, cb, arg); 2024-08-31T04:43:51.391 INFO:tasks.workunit.client.0.smithi089.stdout:- bytes_read = r; 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- total_read += bytes_read; 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- left -= bytes_read; 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- ret = total_read; 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_rd); 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_rd_bytes, len); 2024-08-31T04:43:51.392 INFO:tasks.workunit.client.0.smithi089.stdout:- return ret; 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:-static int simple_read_cb(uint64_t ofs, size_t len, const char *buf, void *arg) 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- char *dest_buf = (char *)arg; 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- if (buf) 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- memcpy(dest_buf + ofs, buf, len); 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- else 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- memset(dest_buf + ofs, 0, len); 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.393 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:-ssize_t read(ImageCtx *ictx, uint64_t ofs, size_t len, char *buf) 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- return read_iterate(ictx, ofs, len, simple_read_cb, buf); 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:-ssize_t write(ImageCtx *ictx, uint64_t off, size_t len, const char *buf) 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "write " << ictx << " off = " << off << " len = " << len << dendl; 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!len) 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.394 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- r = check_io(ictx, off, len); 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t total_write = 0; 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t start_block = get_block_num(ictx->header, off); 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t end_block = get_block_num(ictx->header, off + len - 1); 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_size = get_block_size(ictx->header); 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- snapid_t snap = ictx->snapid; 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t left = len; 2024-08-31T04:43:51.395 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- if (snap != CEPH_NOSNAP) 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EROFS; 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- for (uint64_t i = start_block; i <= end_block; i++) { 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl; 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- string oid = get_block_oid(ictx->header, i); 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_ofs = get_block_ofs(ictx->header, off + total_write); 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t write_len = min(block_size - block_ofs, left); 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- bl.append(buf + total_write, write_len); 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) { 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->write_to_cache(oid, bl, write_len, block_ofs); 2024-08-31T04:43:51.396 INFO:tasks.workunit.client.0.smithi089.stdout:- } else { 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->data_ctx.write(oid, bl, write_len, block_ofs); 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- if ((uint64_t)r != write_len) 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EIO; 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- total_write += write_len; 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- left -= write_len; 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_wr); 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_wr_bytes, total_write); 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- return total_write; 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.397 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:-int discard(ImageCtx *ictx, uint64_t off, uint64_t len) 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "discard " << ictx << " off = " << off << " len = " << len << dendl; 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!len) 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- r = check_io(ictx, off, len); 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.398 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t total_write = 0; 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t start_block = get_block_num(ictx->header, off); 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t end_block = get_block_num(ictx->header, off + len - 1); 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_size = get_block_size(ictx->header); 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t left = len; 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- vector v; 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- v.reserve(end_block - start_block + 1); 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- for (uint64_t i = start_block; i <= end_block; i++) { 2024-08-31T04:43:51.399 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- string oid = get_block_oid(ictx->header, i); 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_ofs = get_block_ofs(ictx->header, off + total_write); 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t write_len = min(block_size - block_ofs, left); 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) { 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- v.push_back(ObjectExtent(oid, block_ofs, write_len)); 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- v.back().oloc.pool = ictx->data_ctx.get_id(); 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::ObjectWriteOperation write_op; 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- if (block_ofs == 0 && write_len == block_size) 2024-08-31T04:43:51.400 INFO:tasks.workunit.client.0.smithi089.stdout:- write_op.remove(); 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- else if (write_len + block_ofs == block_size) 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- write_op.truncate(block_ofs); 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- else 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- write_op.zero(block_ofs, write_len); 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->data_ctx.operate(oid, &write_op); 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- total_write += write_len; 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- left -= write_len; 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.401 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->object_cacher->discard_set(ictx->object_set, v); 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_discard); 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_discard_bytes, total_write); 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:- return total_write; 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:-ssize_t handle_sparse_read(CephContext *cct, 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist data_bl, 2024-08-31T04:43:51.402 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_ofs, 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- const map &data_map, 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t buf_ofs, // offset into buffer 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t buf_len, // length in buffer (not size of buffer!) 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- int (*cb)(uint64_t, size_t, const char *, void *), 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- void *arg) 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- int r; 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t bl_ofs = 0; 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t buf_left = buf_len; 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- for (map::const_iterator iter = data_map.begin(); 2024-08-31T04:43:51.403 INFO:tasks.workunit.client.0.smithi089.stdout:- iter != data_map.end(); 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- ++iter) { 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t extent_ofs = iter->first; 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t extent_len = iter->second; 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 10) << "extent_ofs=" << extent_ofs 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- << " extent_len=" << extent_len << dendl; 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 10) << "block_ofs=" << block_ofs << dendl; 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- /* a hole? */ 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- if (extent_ofs > block_ofs) { 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t gap = extent_ofs - block_ofs; 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 10) << "<1>zeroing " << buf_ofs << "~" << gap << dendl; 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- r = cb(buf_ofs, gap, NULL, arg); 2024-08-31T04:43:51.404 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- buf_ofs += gap; 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- buf_left -= gap; 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- block_ofs = extent_ofs; 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- } else if (extent_ofs < block_ofs) { 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(0 == "osd returned data prior to what we asked for"); 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EIO; 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- if (bl_ofs + extent_len > (buf_ofs + buf_left)) { 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(0 == "osd returned more data than we asked for"); 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EIO; 2024-08-31T04:43:51.405 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- /* data */ 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 10) << "<2>copying " << buf_ofs << "~" << extent_len 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- << " from ofs=" << bl_ofs << dendl; 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- r = cb(buf_ofs, extent_len, data_bl.c_str() + bl_ofs, arg); 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- bl_ofs += extent_len; 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- buf_ofs += extent_len; 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(buf_left >= extent_len); 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- buf_left -= extent_len; 2024-08-31T04:43:51.406 INFO:tasks.workunit.client.0.smithi089.stdout:- block_ofs += extent_len; 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- /* last hole */ 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- if (buf_left > 0) { 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 10) << "<3>zeroing " << buf_ofs << "~" << buf_left << dendl; 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- r = cb(buf_ofs, buf_left, NULL, arg); 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- return buf_len; 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.407 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:-void AioBlockCompletion::finish(int r) 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 10) << "AioBlockCompletion::finish()" << dendl; 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:- if ((r >= 0 || r == -ENOENT) && buf) { // this was a sparse_read operation 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 10) << "ofs=" << ofs << " len=" << len << dendl; 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:- r = handle_sparse_read(cct, data_bl, ofs, m, 0, len, simple_read_cb, buf); 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:- completion->complete_block(this, r); 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:-void AioCompletion::complete_block(AioBlockCompletion *block_completion, ssize_t r) 2024-08-31T04:43:51.408 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = block_completion->cct; 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "AioCompletion::complete_block() this=" 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- << (void *)this << " complete_cb=" << (void *)complete_cb << dendl; 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- lock.Lock(); 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- if (rval >= 0) { 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0 && r != -EEXIST) 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- rval = r; 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- else if (r > 0) 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- rval += r; 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- assert(pending_count); 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- int count = --pending_count; 2024-08-31T04:43:51.409 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!count) { 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:- complete(); 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:- put_unlock(); 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:-void rados_cb(rados_completion_t c, void *arg) 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:- AioBlockCompletion *block_completion = (AioBlockCompletion *)arg; 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:- block_completion->finish(rados_aio_get_return_value(c)); 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:- delete block_completion; 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:-int check_io(ImageCtx *ictx, uint64_t off, uint64_t len) 2024-08-31T04:43:51.410 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t image_size = ictx->get_image_size(); 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- bool snap_exists = ictx->snap_exists; 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!snap_exists) 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOENT; 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- if ((uint64_t)(off + len) > image_size) 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EINVAL; 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.411 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:-int flush(ImageCtx *ictx) 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = ictx->cct; 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "flush " << ictx << dendl; 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:- return _flush(ictx); 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:-int _flush(ImageCtx *ictx) 2024-08-31T04:43:51.412 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = ictx->cct; 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- int r; 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- // flush any outstanding writes 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) { 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->flush_cache(); 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- } else { 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->data_ctx.aio_flush(); 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r) 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- lderr(cct) << "_flush " << ictx << " r = " << r << dendl; 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.413 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:-int aio_write(ImageCtx *ictx, uint64_t off, size_t len, const char *buf, 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- AioCompletion *c) 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = ictx->cct; 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "aio_write " << ictx << " off = " << off << " len = " << len << dendl; 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!len) 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.414 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t total_write = 0; 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t start_block = get_block_num(ictx->header, off); 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t end_block = get_block_num(ictx->header, off + len - 1); 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_size = get_block_size(ictx->header); 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- snapid_t snap = ictx->snapid; 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t left = len; 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- r = check_io(ictx, off, len); 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.415 INFO:tasks.workunit.client.0.smithi089.stdout:- if (snap != CEPH_NOSNAP) 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EROFS; 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- c->get(); 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- for (uint64_t i = start_block; i <= end_block; i++) { 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- string oid = get_block_oid(ictx->header, i); 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_ofs = get_block_ofs(ictx->header, off + total_write); 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t write_len = min(block_size - block_ofs, left); 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl; 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- bl.append(buf + total_write, write_len); 2024-08-31T04:43:51.416 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) { 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- // may block 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->write_to_cache(oid, bl, write_len, block_ofs); 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- } else { 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- AioBlockCompletion *block_completion = new AioBlockCompletion(cct, c, off, len, NULL); 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- c->add_block_completion(block_completion); 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::AioCompletion *rados_completion = 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- Rados::aio_create_completion(block_completion, NULL, rados_cb); 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->data_ctx.aio_write(oid, rados_completion, bl, write_len, block_ofs); 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- rados_completion->release(); 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.417 INFO:tasks.workunit.client.0.smithi089.stdout:- goto done; 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- total_write += write_len; 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- left -= write_len; 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:-done: 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- c->finish_adding_completions(); 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- c->put(); 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_aio_wr); 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_aio_wr_bytes, len); 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- /* FIXME: cleanup all the allocated stuff */ 2024-08-31T04:43:51.418 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:-int aio_discard(ImageCtx *ictx, uint64_t off, uint64_t len, AioCompletion *c) 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:- CephContext *cct = ictx->cct; 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(cct, 20) << "aio_discard " << ictx << " off = " << off << " len = " << len << dendl; 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!len) 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.419 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t total_write = 0; 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t start_block = get_block_num(ictx->header, off); 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t end_block = get_block_num(ictx->header, off + len - 1); 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_size = get_block_size(ictx->header); 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t left = len; 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.420 INFO:tasks.workunit.client.0.smithi089.stdout:- r = check_io(ictx, off, len); 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- vector v; 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- v.reserve(end_block - start_block + 1); 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- c->get(); 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- for (uint64_t i = start_block; i <= end_block; i++) { 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- string oid = get_block_oid(ictx->header, i); 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_ofs = get_block_ofs(ictx->header, off + total_write); 2024-08-31T04:43:51.421 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- AioBlockCompletion *block_completion = new AioBlockCompletion(cct, c, off, len, NULL); 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t write_len = min(block_size - block_ofs, left); 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) { 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- v.push_back(ObjectExtent(oid, block_ofs, write_len)); 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- v.back().oloc.pool = ictx->data_ctx.get_id(); 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- if (block_ofs == 0 && write_len == block_size) 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- block_completion->write_op.remove(); 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- else if (block_ofs + write_len == block_size) 2024-08-31T04:43:51.422 INFO:tasks.workunit.client.0.smithi089.stdout:- block_completion->write_op.truncate(block_ofs); 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- else 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- block_completion->write_op.zero(block_ofs, write_len); 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- c->add_block_completion(block_completion); 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::AioCompletion *rados_completion = 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- Rados::aio_create_completion(block_completion, NULL, rados_cb); 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->data_ctx.aio_operate(oid, rados_completion, &block_completion->write_op); 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- rados_completion->release(); 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- goto done; 2024-08-31T04:43:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:- total_write += write_len; 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- left -= write_len; 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- r = 0; 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:-done: 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->object_cacher->discard_set(ictx->object_set, v); 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- c->finish_adding_completions(); 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- c->put(); 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_aio_discard); 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_aio_discard_bytes, len); 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.424 INFO:tasks.workunit.client.0.smithi089.stdout:- /* FIXME: cleanup all the allocated stuff */ 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:-void rados_aio_sparse_read_cb(rados_completion_t c, void *arg) 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:- AioBlockCompletion *block_completion = (AioBlockCompletion *)arg; 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:- block_completion->finish(rados_aio_get_return_value(c)); 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:- delete block_completion; 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:-int aio_read(ImageCtx *ictx, uint64_t off, size_t len, 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:- char *buf, 2024-08-31T04:43:51.425 INFO:tasks.workunit.client.0.smithi089.stdout:- AioCompletion *c) 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 20) << "aio_read " << ictx << " off = " << off << " len = " << len << dendl; 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = ictx_check(ictx); 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- r = check_io(ictx, off, len); 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- int64_t ret; 2024-08-31T04:43:51.426 INFO:tasks.workunit.client.0.smithi089.stdout:- int total_read = 0; 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t start_block = get_block_num(ictx->header, off); 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t end_block = get_block_num(ictx->header, off + len - 1); 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_size = get_block_size(ictx->header); 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t left = len; 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- c->get(); 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- for (uint64_t i = start_block; i <= end_block; i++) { 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferlist bl; 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Lock(); 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- string oid = get_block_oid(ictx->header, i); 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t block_ofs = get_block_ofs(ictx->header, off + total_read); 2024-08-31T04:43:51.427 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->lock.Unlock(); 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- uint64_t read_len = min(block_size - block_ofs, left); 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- map m; 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- map::iterator iter; 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- AioBlockCompletion *block_completion = 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- new AioBlockCompletion(ictx->cct, c, block_ofs, read_len, buf + total_read); 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- c->add_block_completion(block_completion); 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ictx->object_cacher) { 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- block_completion->m[block_ofs] = read_len; 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->aio_read_from_cache(oid, &block_completion->data_bl, 2024-08-31T04:43:51.428 INFO:tasks.workunit.client.0.smithi089.stdout:- read_len, block_ofs, block_completion); 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- } else { 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::AioCompletion *rados_completion = 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- Rados::aio_create_completion(block_completion, rados_aio_sparse_read_cb, NULL); 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- r = ictx->data_ctx.aio_sparse_read(oid, rados_completion, 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- &block_completion->m, &block_completion->data_bl, 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- read_len, block_ofs); 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- rados_completion->release(); 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0 && r == -ENOENT) 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- r = 0; 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) { 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- ret = r; 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- goto done; 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.429 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- total_read += read_len; 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- left -= read_len; 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- ret = total_read; 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:-done: 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- c->finish_adding_completions(); 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- c->put(); 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_aio_rd); 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- ictx->perfcounter->inc(l_librbd_aio_rd_bytes, len); 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.430 INFO:tasks.workunit.client.0.smithi089.stdout:- return ret; 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-/* 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:- RBD 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-*/ 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-RBD::RBD() 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-RBD::~RBD() 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.431 INFO:tasks.workunit.client.0.smithi089.stdout:-void RBD::version(int *major, int *minor, int *extra) 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:- rbd_version(major, minor, extra); 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:-int RBD::open(IoCtx& io_ctx, Image& image, const char *name) 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:- return open(io_ctx, image, name, NULL); 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:-int RBD::open(IoCtx& io_ctx, Image& image, const char *name, const char *snapname) 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = new ImageCtx(name, snapname, io_ctx); 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!ictx) 2024-08-31T04:43:51.432 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOMEM; 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::open_image(ictx); 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- image.ctx = (image_ctx_t) ictx; 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:-int RBD::create(IoCtx& io_ctx, const char *name, uint64_t size, int *order) 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::create(io_ctx, name, size, order); 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.433 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:-int RBD::remove(IoCtx& io_ctx, const char *name) 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::NoOpProgressContext prog_ctx; 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::remove(io_ctx, name, prog_ctx); 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:-int RBD::remove_with_progress(IoCtx& io_ctx, const char *name, ProgressContext& pctx) 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::remove(io_ctx, name, pctx); 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.434 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:-int RBD::list(IoCtx& io_ctx, std::vector& names) 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::list(io_ctx, names); 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:-int RBD::rename(IoCtx& src_io_ctx, const char *srcname, const char *destname) 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::rename(src_io_ctx, srcname, destname); 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.435 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:-RBD::AioCompletion::AioCompletion(void *cb_arg, callback_t complete_cb) 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::AioCompletion *c = librbd::aio_create_completion(cb_arg, complete_cb); 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:- pc = (void *)c; 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:- c->rbd_comp = this; 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:-int RBD::AioCompletion::wait_for_complete() 2024-08-31T04:43:51.436 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::AioCompletion *c = (librbd::AioCompletion *)pc; 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:- return c->wait_for_complete(); 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:-ssize_t RBD::AioCompletion::get_return_value() 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::AioCompletion *c = (librbd::AioCompletion *)pc; 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:- return c->get_return_value(); 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:-void RBD::AioCompletion::release() 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::AioCompletion *c = (librbd::AioCompletion *)pc; 2024-08-31T04:43:51.437 INFO:tasks.workunit.client.0.smithi089.stdout:- c->release(); 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:- delete this; 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:-/* 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:- Image 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:-*/ 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:-Image::Image() : ctx(NULL) 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:-Image::~Image() 2024-08-31T04:43:51.438 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- if (ctx) { 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- close_image(ictx); 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::resize(uint64_t size) 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::NoOpProgressContext prog_ctx; 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::resize(ictx, size, prog_ctx); 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.439 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::resize_with_progress(uint64_t size, librbd::ProgressContext& pctx) 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::resize(ictx, size, pctx); 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::stat(image_info_t& info, size_t infosize) 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::info(ictx, info, infosize); 2024-08-31T04:43:51.440 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::copy(IoCtx& dest_io_ctx, const char *destname) 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::NoOpProgressContext prog_ctx; 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::copy(*ictx, dest_io_ctx, destname, prog_ctx); 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::copy_with_progress(IoCtx& dest_io_ctx, const char *destname, 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ProgressContext &pctx) 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.441 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::copy(*ictx, dest_io_ctx, destname, pctx); 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::snap_create(const char *snap_name) 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::snap_create(ictx, snap_name); 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::snap_remove(const char *snap_name) 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.442 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::snap_remove(ictx, snap_name); 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::snap_rollback(const char *snap_name) 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::NoOpProgressContext prog_ctx; 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::snap_rollback(ictx, snap_name, prog_ctx); 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::snap_rollback_with_progress(const char *snap_name, ProgressContext& prog_ctx) 2024-08-31T04:43:51.443 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::snap_rollback(ictx, snap_name, prog_ctx); 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::snap_list(std::vector& snaps) 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::snap_list(ictx, snaps); 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::snap_set(const char *snap_name) 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.444 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::snap_set(ictx, snap_name); 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:-ssize_t Image::read(uint64_t ofs, size_t len, bufferlist& bl) 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferptr ptr(len); 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:- bl.push_back(ptr); 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::read(ictx, ofs, len, bl.c_str()); 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:-int64_t Image::read_iterate(uint64_t ofs, size_t len, 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:- int (*cb)(uint64_t, size_t, const char *, void *), void *arg) 2024-08-31T04:43:51.445 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::read_iterate(ictx, ofs, len, cb, arg); 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:-ssize_t Image::write(uint64_t ofs, size_t len, bufferlist& bl) 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:- if (bl.length() < len) 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EINVAL; 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::write(ictx, ofs, len, bl.c_str()); 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::discard(uint64_t ofs, uint64_t len) 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.446 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::discard(ictx, ofs, len); 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::aio_write(uint64_t off, size_t len, bufferlist& bl, RBD::AioCompletion *c) 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:- if (bl.length() < len) 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EINVAL; 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::aio_write(ictx, off, len, bl.c_str(), (librbd::AioCompletion *)c->pc); 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::aio_discard(uint64_t off, uint64_t len, RBD::AioCompletion *c) 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.447 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::aio_discard(ictx, off, len, (librbd::AioCompletion *)c->pc); 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::aio_read(uint64_t off, size_t len, bufferlist& bl, RBD::AioCompletion *c) 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:- bufferptr ptr(len); 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:- bl.push_back(ptr); 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:- ldout(ictx->cct, 10) << "Image::aio_read() buf=" << (void *)bl.c_str() << "~" << (void *)(bl.c_str() + len - 1) << dendl; 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::aio_read(ictx, off, len, bl.c_str(), (librbd::AioCompletion *)c->pc); 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:-int Image::flush() 2024-08-31T04:43:51.448 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- ImageCtx *ictx = (ImageCtx *)ctx; 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::flush(ictx); 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:-} // namespace librbd 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" void rbd_version(int *major, int *minor, int *extra) 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- if (major) 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- *major = LIBRBD_VER_MAJOR; 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- if (minor) 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- *minor = LIBRBD_VER_MINOR; 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- if (extra) 2024-08-31T04:43:51.449 INFO:tasks.workunit.client.0.smithi089.stdout:- *extra = LIBRBD_VER_EXTRA; 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:-/* images */ 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_list(rados_ioctx_t p, char *names, size_t *size) 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx io_ctx; 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx::from_rados_ioctx_t(p, io_ctx); 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- std::vector cpp_names; 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::list(io_ctx, cpp_names); 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r == -ENOENT) 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.450 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.451 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.451 INFO:tasks.workunit.client.0.smithi089.stdout:- size_t expected_size = 0; 2024-08-31T04:43:51.451 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.451 INFO:tasks.workunit.client.0.smithi089.stdout:- for (size_t i = 0; i < cpp_names.size(); i++) { 2024-08-31T04:43:51.451 INFO:tasks.workunit.client.0.smithi089.stdout:- expected_size += cpp_names[i].size() + 1; 2024-08-31T04:43:51.451 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.451 INFO:tasks.workunit.client.0.smithi089.stdout:- if (*size < expected_size) { 2024-08-31T04:43:51.451 INFO:tasks.workunit.client.0.smithi089.stdout:- *size = expected_size; 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ERANGE; 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:- for (int i = 0; i < (int)cpp_names.size(); i++) { 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:- strcpy(names, cpp_names[i].c_str()); 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:- names += strlen(names) + 1; 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:- return (int)expected_size; 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_create(rados_ioctx_t p, const char *name, uint64_t size, int *order) 2024-08-31T04:43:51.452 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx io_ctx; 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx::from_rados_ioctx_t(p, io_ctx); 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::create(io_ctx, name, size, order); 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_remove(rados_ioctx_t p, const char *name) 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx io_ctx; 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx::from_rados_ioctx_t(p, io_ctx); 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::NoOpProgressContext prog_ctx; 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::remove(io_ctx, name, prog_ctx); 2024-08-31T04:43:51.453 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_remove_with_progress(rados_ioctx_t p, const char *name, 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd_progress_fn_t cb, void *cbdata) 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx io_ctx; 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx::from_rados_ioctx_t(p, io_ctx); 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::CProgressContext prog_ctx(cb, cbdata); 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::remove(io_ctx, name, prog_ctx); 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_copy(rbd_image_t image, rados_ioctx_t dest_p, const char *destname) 2024-08-31T04:43:51.454 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx dest_io_ctx; 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx::from_rados_ioctx_t(dest_p, dest_io_ctx); 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::NoOpProgressContext prog_ctx; 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::copy(*ictx, dest_io_ctx, destname, prog_ctx); 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_copy_with_progress(rbd_image_t image, rados_ioctx_t dest_p, 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:- const char *destname, librbd_progress_fn_t fn, void *data) 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.455 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx dest_io_ctx; 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx::from_rados_ioctx_t(dest_p, dest_io_ctx); 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::CProgressContext prog_ctx(fn, data); 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:- int ret = librbd::copy(*ictx, dest_io_ctx, destname, prog_ctx); 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:- return ret; 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_rename(rados_ioctx_t src_p, const char *srcname, const char *destname) 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx src_io_ctx; 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx::from_rados_ioctx_t(src_p, src_io_ctx); 2024-08-31T04:43:51.456 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::rename(src_io_ctx, srcname, destname); 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_open(rados_ioctx_t p, const char *name, rbd_image_t *image, const char *snap_name) 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx io_ctx; 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:- librados::IoCtx::from_rados_ioctx_t(p, io_ctx); 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = new librbd::ImageCtx(name, snap_name, io_ctx); 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!ictx) 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOMEM; 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::open_image(ictx); 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:- *image = (rbd_image_t)ictx; 2024-08-31T04:43:51.457 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_close(rbd_image_t image) 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ctx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::close_image(ctx); 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_resize(rbd_image_t image, uint64_t size) 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::NoOpProgressContext prog_ctx; 2024-08-31T04:43:51.458 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::resize(ictx, size, prog_ctx); 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_resize_with_progress(rbd_image_t image, uint64_t size, 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd_progress_fn_t cb, void *cbdata) 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::CProgressContext prog_ctx(cb, cbdata); 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::resize(ictx, size, prog_ctx); 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_stat(rbd_image_t image, rbd_image_info_t *info, size_t infosize) 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::info(ictx, *info, infosize); 2024-08-31T04:43:51.459 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:-/* snapshots */ 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_snap_create(rbd_image_t image, const char *snap_name) 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::snap_create(ictx, snap_name); 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_snap_remove(rbd_image_t image, const char *snap_name) 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::snap_remove(ictx, snap_name); 2024-08-31T04:43:51.460 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_snap_rollback(rbd_image_t image, const char *snap_name) 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::NoOpProgressContext prog_ctx; 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::snap_rollback(ictx, snap_name, prog_ctx); 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_snap_rollback_with_progress(rbd_image_t image, const char *snap_name, 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd_progress_fn_t cb, void *cbdata) 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.461 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::CProgressContext prog_ctx(cb, cbdata); 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::snap_rollback(ictx, snap_name, prog_ctx); 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_snap_list(rbd_image_t image, rbd_snap_info_t *snaps, int *max_snaps) 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- std::vector cpp_snaps; 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- int r = librbd::snap_list(ictx, cpp_snaps); 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r == -ENOENT) 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- if (r < 0) 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- return r; 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!max_snaps) 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- return -EINVAL; 2024-08-31T04:43:51.462 INFO:tasks.workunit.client.0.smithi089.stdout:- if (*max_snaps < (int)cpp_snaps.size() + 1) { 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- *max_snaps = (int)cpp_snaps.size() + 1; 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ERANGE; 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- int i; 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- for (i = 0; i < (int)cpp_snaps.size(); i++) { 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps[i].id = cpp_snaps[i].id; 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps[i].size = cpp_snaps[i].size; 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps[i].name = strdup(cpp_snaps[i].name.c_str()); 2024-08-31T04:43:51.463 INFO:tasks.workunit.client.0.smithi089.stdout:- if (!snaps[i].name) { 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- for (int j = 0; j < i; j++) 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- free((void *)snaps[j].name); 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- return -ENOMEM; 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps[i].id = 0; 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps[i].size = 0; 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps[i].name = NULL; 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:- return (int)cpp_snaps.size(); 2024-08-31T04:43:51.464 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" void rbd_snap_list_end(rbd_snap_info_t *snaps) 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:- while (snaps->name) { 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:- free((void *)snaps->name); 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:- snaps++; 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:- } 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_snap_set(rbd_image_t image, const char *snapname) 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::snap_set(ictx, snapname); 2024-08-31T04:43:51.465 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:-/* I/O */ 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" ssize_t rbd_read(rbd_image_t image, uint64_t ofs, size_t len, char *buf) 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::read(ictx, ofs, len, buf); 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int64_t rbd_read_iterate(rbd_image_t image, uint64_t ofs, size_t len, 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:- int (*cb)(uint64_t, size_t, const char *, void *), void *arg) 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::read_iterate(ictx, ofs, len, cb, arg); 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" ssize_t rbd_write(rbd_image_t image, uint64_t ofs, size_t len, const char *buf) 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::write(ictx, ofs, len, buf); 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_discard(rbd_image_t image, uint64_t ofs, uint64_t len) 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::discard(ictx, ofs, len); 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_aio_create_completion(void *cb_arg, rbd_callback_t complete_cb, rbd_completion_t *c) 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::RBD::AioCompletion *rbd_comp = new librbd::RBD::AioCompletion(cb_arg, complete_cb); 2024-08-31T04:43:51.467 INFO:tasks.workunit.client.0.smithi089.stdout:- *c = (rbd_completion_t) rbd_comp; 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:- return 0; 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_aio_write(rbd_image_t image, uint64_t off, size_t len, const char *buf, rbd_completion_t c) 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::RBD::AioCompletion *comp = (librbd::RBD::AioCompletion *)c; 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::aio_write(ictx, off, len, buf, (librbd::AioCompletion *)comp->pc); 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_aio_discard(rbd_image_t image, uint64_t off, uint64_t len, rbd_completion_t c) 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.468 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::RBD::AioCompletion *comp = (librbd::RBD::AioCompletion *)c; 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::aio_discard(ictx, off, len, (librbd::AioCompletion *)comp->pc); 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_aio_read(rbd_image_t image, uint64_t off, size_t len, char *buf, rbd_completion_t c) 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::RBD::AioCompletion *comp = (librbd::RBD::AioCompletion *)c; 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::aio_read(ictx, off, len, buf, (librbd::AioCompletion *)comp->pc); 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_flush(rbd_image_t image) 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::ImageCtx *ictx = (librbd::ImageCtx *)image; 2024-08-31T04:43:51.469 INFO:tasks.workunit.client.0.smithi089.stdout:- return librbd::flush(ictx); 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" int rbd_aio_wait_for_complete(rbd_completion_t c) 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::RBD::AioCompletion *comp = (librbd::RBD::AioCompletion *)c; 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:- return comp->wait_for_complete(); 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" ssize_t rbd_aio_get_return_value(rbd_completion_t c) 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::RBD::AioCompletion *comp = (librbd::RBD::AioCompletion *)c; 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:- return comp->get_return_value(); 2024-08-31T04:43:51.470 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.471 INFO:tasks.workunit.client.0.smithi089.stdout:- 2024-08-31T04:43:51.471 INFO:tasks.workunit.client.0.smithi089.stdout:-extern "C" void rbd_aio_release(rbd_completion_t c) 2024-08-31T04:43:51.471 INFO:tasks.workunit.client.0.smithi089.stdout:-{ 2024-08-31T04:43:51.471 INFO:tasks.workunit.client.0.smithi089.stdout:- librbd::RBD::AioCompletion *comp = (librbd::RBD::AioCompletion *)c; 2024-08-31T04:43:51.471 INFO:tasks.workunit.client.0.smithi089.stdout:- comp->release(); 2024-08-31T04:43:51.471 INFO:tasks.workunit.client.0.smithi089.stdout:-} 2024-08-31T04:43:51.471 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2024-08-31T04:43:51.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-31T04:43:52.414 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-08-31T04:43:52.652 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8e5bbcbbce664084ac03fac8486600fd Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-08-31T04:43:52.655 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-31T04:43:52.666 INFO:tasks.quiescer:joining Quiescers 2024-08-31T04:43:52.666 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-31T04:43:52.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:43:52.823 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 -- 172.21.15.89:0/3014768932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 msgr2=0x7f8f340c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:52.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 --2- 172.21.15.89:0/3014768932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 0x7f8f340c9330 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8f34073250 tx=0x7f8f2001f0b0 comp rx=0 tx=0).stop 2024-08-31T04:43:52.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 -- 172.21.15.89:0/3014768932 shutdown_connections 2024-08-31T04:43:52.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 --2- 172.21.15.89:0/3014768932 >> v2:172.21.15.170:3300/0 conn(0x7f8f340c7920 0x7f8f340c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:52.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 --2- 172.21.15.89:0/3014768932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 0x7f8f340c9330 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:52.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 --2- 172.21.15.89:0/3014768932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f3415bc70 0x7f8f34152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:52.824 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 -- 172.21.15.89:0/3014768932 >> 172.21.15.89:0/3014768932 conn(0x7f8f340ccf20 msgr2=0x7f8f340cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:52.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 -- 172.21.15.89:0/3014768932 shutdown_connections 2024-08-31T04:43:52.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 -- 172.21.15.89:0/3014768932 wait complete. 2024-08-31T04:43:52.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 Processor -- start 2024-08-31T04:43:52.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.823+0000 7f8f38e00640 1 -- start start 2024-08-31T04:43:52.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f38e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 0x7f8f34156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:52.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f38e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f340c7920 0x7f8f34155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:52.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f38e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f3415bc70 0x7f8f3414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:52.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f38e00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8f340748a0 con 0x7f8f340c1f40 2024-08-31T04:43:52.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f38e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8f34074720 con 0x7f8f340c7920 2024-08-31T04:43:52.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f38e00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8f34074a20 con 0x7f8f3415bc70 2024-08-31T04:43:52.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 0x7f8f34156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:52.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 0x7f8f34156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49362/0 (socket says 172.21.15.89:49362) 2024-08-31T04:43:52.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31e00640 1 -- 172.21.15.89:0/2028231738 learned_addr learned my addr 172.21.15.89:0/2028231738 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:52.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31400640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f340c7920 0x7f8f34155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:52.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f32800640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f3415bc70 0x7f8f3414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:52.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31e00640 1 -- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f3415bc70 msgr2=0x7f8f3414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:52.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31e00640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f3415bc70 0x7f8f3414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:52.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31e00640 1 -- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f340c7920 msgr2=0x7f8f34155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:52.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31e00640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f340c7920 0x7f8f34155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:52.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31e00640 1 -- 172.21.15.89:0/2028231738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f340b0820 con 0x7f8f340c1f40 2024-08-31T04:43:52.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31400640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f340c7920 0x7f8f34155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:52.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f31e00640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 0x7f8f34156c60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400ea50 tx=0x7f8f2400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:52.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f2a000640 1 -- 172.21.15.89:0/2028231738 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400cdc0 con 0x7f8f340c1f40 2024-08-31T04:43:52.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f2a000640 1 -- 172.21.15.89:0/2028231738 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f24004c20 con 0x7f8f340c1f40 2024-08-31T04:43:52.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f340b0580 con 0x7f8f340c1f40 2024-08-31T04:43:52.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f2a000640 1 -- 172.21.15.89:0/2028231738 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24005020 con 0x7f8f340c1f40 2024-08-31T04:43:52.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f341516c0 con 0x7f8f340c1f40 2024-08-31T04:43:52.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f34074ea0 con 0x7f8f340c1f40 2024-08-31T04:43:52.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.827+0000 7f8f2a000640 1 -- 172.21.15.89:0/2028231738 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f8f240051c0 con 0x7f8f340c1f40 2024-08-31T04:43:52.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.831+0000 7f8f2a000640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8f140720f0 0x7f8f14074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:52.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.831+0000 7f8f2a000640 1 -- 172.21.15.89:0/2028231738 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8f240938e0 con 0x7f8f340c1f40 2024-08-31T04:43:52.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.831+0000 7f8f31400640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8f140720f0 0x7f8f14074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:52.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.831+0000 7f8f31400640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8f140720f0 0x7f8f14074600 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b2000 tx=0x7f8f2001d8f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:52.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:52.835+0000 7f8f2a000640 1 -- 172.21.15.89:0/2028231738 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8f24016030 con 0x7f8f340c1f40 2024-08-31T04:43:52.947 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:43:52.947 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.95 2024-08-31T04:43:52.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:43:53.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.039+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f340c82f0 con 0x7f8f340c1f40 2024-08-31T04:43:53.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.039+0000 7f8f2a000640 1 -- 172.21.15.89:0/2028231738 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f8f2405ee50 con 0x7f8f340c1f40 2024-08-31T04:43:53.043 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:43:53.043 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:43:53.043 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:43:53.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8f140720f0 msgr2=0x7f8f14074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8f140720f0 0x7f8f14074600 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b2000 tx=0x7f8f2001d8f0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 msgr2=0x7f8f34156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 0x7f8f34156c60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400ea50 tx=0x7f8f2400ef10 comp rx=0 tx=0).stop 2024-08-31T04:43:53.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 shutdown_connections 2024-08-31T04:43:53.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f8f140720f0 0x7f8f14074600 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f3415bc70 0x7f8f3414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f340c7920 0x7f8f34155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 --2- 172.21.15.89:0/2028231738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f340c1f40 0x7f8f34156c60 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 >> 172.21.15.89:0/2028231738 conn(0x7f8f340ccf20 msgr2=0x7f8f340c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 shutdown_connections 2024-08-31T04:43:53.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.043+0000 7f8f38e00640 1 -- 172.21.15.89:0/2028231738 wait complete. 2024-08-31T04:43:53.066 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4420 quiesce db --cancel --all' 2024-08-31T04:43:53.066 DEBUG:teuthology.orchestra.run.smithi089:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4420 quiesce db --cancel --all 2024-08-31T04:43:53.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.111+0000 7f39c7a00640 1 -- 172.21.15.89:0/372804524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 msgr2=0x7f39c015a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.111+0000 7f39c7a00640 1 --2- 172.21.15.89:0/372804524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 0x7f39c015a370 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009840 tx=0x7f39ac01c820 comp rx=0 tx=0).stop 2024-08-31T04:43:53.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.111+0000 7f39c7a00640 1 -- 172.21.15.89:0/372804524 shutdown_connections 2024-08-31T04:43:53.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.111+0000 7f39c7a00640 1 --2- 172.21.15.89:0/372804524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 0x7f39c015a370 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.111+0000 7f39c7a00640 1 -- 172.21.15.89:0/372804524 >> 172.21.15.89:0/372804524 conn(0x7f39c0071be0 msgr2=0x7f39c006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.111+0000 7f39c7a00640 1 -- 172.21.15.89:0/372804524 shutdown_connections 2024-08-31T04:43:53.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.111+0000 7f39c7a00640 1 -- 172.21.15.89:0/372804524 wait complete. 2024-08-31T04:43:53.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.111+0000 7f39c7a00640 1 Processor -- start 2024-08-31T04:43:53.114 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.111+0000 7f39c7a00640 1 -- start start 2024-08-31T04:43:53.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c7a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c00c97e0 0x7f39c0151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c7a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c00cedf0 0x7f39c014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c7a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 0x7f39c00cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c7a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39c01596f0 con 0x7f39c0159f60 2024-08-31T04:43:53.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c7a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00cf610 con 0x7f39c00c97e0 2024-08-31T04:43:53.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c7a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39c00c5160 con 0x7f39c00cedf0 2024-08-31T04:43:53.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 0x7f39c00cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 0x7f39c00cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49382/0 (socket says 172.21.15.89:49382) 2024-08-31T04:43:53.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5a00640 1 -- 172.21.15.89:0/3543169368 learned_addr learned my addr 172.21.15.89:0/3543169368 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:53.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5000640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c00c97e0 0x7f39c0151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39bfe00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c00cedf0 0x7f39c014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5a00640 1 -- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c00cedf0 msgr2=0x7f39c014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5a00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c00cedf0 0x7f39c014dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5a00640 1 -- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c00c97e0 msgr2=0x7f39c0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5a00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c00c97e0 0x7f39c0151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5a00640 1 -- 172.21.15.89:0/3543169368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c0151750 con 0x7f39c0159f60 2024-08-31T04:43:53.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c5a00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 0x7f39c00cdc90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c6e0 tx=0x7f39b800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39bcc00640 1 -- 172.21.15.89:0/3543169368 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8003b80 con 0x7f39c0159f60 2024-08-31T04:43:53.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39bcc00640 1 -- 172.21.15.89:0/3543169368 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b8003d20 con 0x7f39c0159f60 2024-08-31T04:43:53.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c0150d60 con 0x7f39c0159f60 2024-08-31T04:43:53.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39bcc00640 1 -- 172.21.15.89:0/3543169368 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8005330 con 0x7f39c0159f60 2024-08-31T04:43:53.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c0151960 con 0x7f39c0159f60 2024-08-31T04:43:53.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.115+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c00c5d30 con 0x7f39c0159f60 2024-08-31T04:43:53.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.119+0000 7f39bcc00640 1 -- 172.21.15.89:0/3543169368 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f39b80054d0 con 0x7f39c0159f60 2024-08-31T04:43:53.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.119+0000 7f39bcc00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39a00720f0 0x7f39a0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.119+0000 7f39bcc00640 1 -- 172.21.15.89:0/3543169368 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f39b8092ab0 con 0x7f39c0159f60 2024-08-31T04:43:53.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.119+0000 7f39c5000640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39a00720f0 0x7f39a0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.119+0000 7f39c5000640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39a00720f0 0x7f39a0074600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f39b40046c0 tx=0x7f39b4007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.123+0000 7f39bcc00640 1 -- 172.21.15.89:0/3543169368 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f39b805da70 con 0x7f39c0159f60 2024-08-31T04:43:53.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.227+0000 7f167c400640 1 -- 172.21.15.89:0/922671546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 msgr2=0x7f16740c5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.227+0000 7f167c400640 1 --2- 172.21.15.89:0/922671546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 0x7f16740c5130 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f16740c3fc0 tx=0x7f166c01cd60 comp rx=0 tx=0).stop 2024-08-31T04:43:53.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.227+0000 7f167c400640 1 -- 172.21.15.89:0/922671546 shutdown_connections 2024-08-31T04:43:53.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.227+0000 7f167c400640 1 --2- 172.21.15.89:0/922671546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 0x7f16740c5130 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.227+0000 7f167c400640 1 --2- 172.21.15.89:0/922671546 >> v2:172.21.15.170:3300/0 conn(0x7f1674157010 0x7f16740c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.227+0000 7f167c400640 1 -- 172.21.15.89:0/922671546 >> 172.21.15.89:0/922671546 conn(0x7f1674071a70 msgr2=0x7f167406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.227+0000 7f167c400640 1 -- 172.21.15.89:0/922671546 shutdown_connections 2024-08-31T04:43:53.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.227+0000 7f167c400640 1 -- 172.21.15.89:0/922671546 wait complete. 2024-08-31T04:43:53.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f167c400640 1 Processor -- start 2024-08-31T04:43:53.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f167c400640 1 -- start start 2024-08-31T04:43:53.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f167c400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 0x7f16741550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f167c400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1674156c00 0x7f167414f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f167c400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16741f5d00 0x7f167414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f167c400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16740ccc80 con 0x7f16740c4d20 2024-08-31T04:43:53.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f167c400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f16740cbf80 con 0x7f16741f5d00 2024-08-31T04:43:53.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f167c400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f16740ccff0 con 0x7f1674156c00 2024-08-31T04:43:53.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f1679a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 0x7f16741550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f1679a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 0x7f16741550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49388/0 (socket says 172.21.15.89:49388) 2024-08-31T04:43:53.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.231+0000 7f1679a00640 1 -- 172.21.15.89:0/2013049083 learned_addr learned my addr 172.21.15.89:0/2013049083 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:53.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1679000640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1674156c00 0x7f167414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f167a400640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16741f5d00 0x7f167414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1679a00640 1 -- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1674156c00 msgr2=0x7f167414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1679a00640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1674156c00 0x7f167414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1679a00640 1 -- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16741f5d00 msgr2=0x7f167414f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1679a00640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16741f5d00 0x7f167414f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1679a00640 1 -- 172.21.15.89:0/2013049083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167415ad60 con 0x7f16740c4d20 2024-08-31T04:43:53.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1679000640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1674156c00 0x7f167414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:53.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1679a00640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 0x7f16741550c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f166800c3c0 tx=0x7f166800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1671600640 1 -- 172.21.15.89:0/2013049083 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668017070 con 0x7f16740c4d20 2024-08-31T04:43:53.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1671600640 1 -- 172.21.15.89:0/2013049083 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16680053c0 con 0x7f16740c4d20 2024-08-31T04:43:53.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f167c400640 1 -- 172.21.15.89:0/2013049083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f167415b040 con 0x7f16740c4d20 2024-08-31T04:43:53.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f1671600640 1 -- 172.21.15.89:0/2013049083 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668003860 con 0x7f16740c4d20 2024-08-31T04:43:53.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.235+0000 7f167c400640 1 -- 172.21.15.89:0/2013049083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f167415b600 con 0x7f16740c4d20 2024-08-31T04:43:53.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1671600640 1 -- 172.21.15.89:0/2013049083 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f166801a070 con 0x7f16740c4d20 2024-08-31T04:43:53.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1671600640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720c0 0x7f16540745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1683c66000 1 Processor -- start 2024-08-31T04:43:53.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1671600640 1 -- 172.21.15.89:0/2013049083 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f16680921e0 con 0x7f16740c4d20 2024-08-31T04:43:53.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1683c66000 1 -- start start 2024-08-31T04:43:53.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679000640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720c0 0x7f16540745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1683c66000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b132e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679000640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720c0 0x7f16540745d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1674163f00 tx=0x7f16600091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1683c66000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 0x56290b1378d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1683c66000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b137e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1683c66000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56290afde470 con 0x56290afcf3e0 2024-08-31T04:43:53.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1683c66000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56290aef51e0 con 0x56290afc6320 2024-08-31T04:43:53.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1683c66000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56290af51240 con 0x56290afc6b30 2024-08-31T04:43:53.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b132e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b132e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49398/0 (socket says 172.21.15.89:49398) 2024-08-31T04:43:53.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679a00640 1 -- 172.21.15.89:0/444148467 learned_addr learned my addr 172.21.15.89:0/444148467 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:53.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f167a400640 1 --2- 172.21.15.89:0/444148467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b137e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679000640 1 --2- 172.21.15.89:0/444148467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 0x56290b1378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679a00640 1 -- 172.21.15.89:0/444148467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 msgr2=0x56290b137e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:53.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679a00640 1 --2- 172.21.15.89:0/444148467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b137e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679a00640 1 -- 172.21.15.89:0/444148467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 msgr2=0x56290b1378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:53.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679a00640 1 --2- 172.21.15.89:0/444148467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 0x56290b1378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679a00640 1 -- 172.21.15.89:0/444148467 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290af0faa0 con 0x56290afcf3e0 2024-08-31T04:43:53.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.239+0000 7f1679a00640 1 --2- 172.21.15.89:0/444148467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b132e40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f16680902e0 tx=0x7f166805cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe1abbb921def3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1666000640 1 -- 172.21.15.89:0/444148467 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16680618d0 con 0x56290afcf3e0 2024-08-31T04:43:53.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1666000640 1 -- 172.21.15.89:0/444148467 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16680662f0 con 0x56290afcf3e0 2024-08-31T04:43:53.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1666000640 1 -- 172.21.15.89:0/444148467 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668064dc0 con 0x56290afcf3e0 2024-08-31T04:43:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 -- 172.21.15.89:0/444148467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 msgr2=0x56290b132e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 --2- 172.21.15.89:0/444148467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b132e40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f16680902e0 tx=0x7f166805cc20 comp rx=0 tx=0).stop 2024-08-31T04:43:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 -- 172.21.15.89:0/444148467 shutdown_connections 2024-08-31T04:43:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 --2- 172.21.15.89:0/444148467 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b137e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 --2- 172.21.15.89:0/444148467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 0x56290b1378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 --2- 172.21.15.89:0/444148467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b132e40 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 -- 172.21.15.89:0/444148467 >> 172.21.15.89:0/444148467 conn(0x56290affd250 msgr2=0x56290b135690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 -- 172.21.15.89:0/444148467 shutdown_connections 2024-08-31T04:43:53.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 -- 172.21.15.89:0/444148467 wait complete. 2024-08-31T04:43:53.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 -- start start 2024-08-31T04:43:53.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 Processor -- start 2024-08-31T04:43:53.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b131a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6b30 0x56290b131f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afcf3e0 0x56290b132490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56290af44780 con 0x56290afc6320 2024-08-31T04:43:53.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56290af407d0 con 0x56290afc6b30 2024-08-31T04:43:53.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56290aee60e0 con 0x56290afcf3e0 2024-08-31T04:43:53.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.243+0000 7f1683c66000 10 client.0 _ll_register_callbacks cb 0x56290b0e2240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:43:53.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b131a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b131a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49412/0 (socket says 172.21.15.89:49412) 2024-08-31T04:43:53.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679a00640 1 -- 172.21.15.89:0/2048510133 learned_addr learned my addr 172.21.15.89:0/2048510133 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:53.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679000640 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6b30 0x56290b131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f167a400640 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afcf3e0 0x56290b132490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679a00640 1 -- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afcf3e0 msgr2=0x56290b132490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:53.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679a00640 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afcf3e0 0x56290b132490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679a00640 1 -- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6b30 msgr2=0x56290b131f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:53.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679a00640 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6b30 0x56290b131f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679a00640 1 -- 172.21.15.89:0/2048510133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290aee00c0 con 0x56290afc6320 2024-08-31T04:43:53.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679000640 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6b30 0x56290b131f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:53.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679a00640 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b131a10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f166805ce10 tx=0x7f1668059850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267c2fb9ac5262e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f165aa00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:43:53.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f165aa00640 1 -- 172.21.15.89:0/2048510133 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668076070 con 0x56290afc6320 2024-08-31T04:43:53.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f165aa00640 1 -- 172.21.15.89:0/2048510133 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f1668061420 con 0x56290afc6320 2024-08-31T04:43:53.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1683c66000 1 -- 172.21.15.89:0/2048510133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56290af4f740 con 0x56290afc6320 2024-08-31T04:43:53.254 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f165aa00640 1 -- 172.21.15.89:0/2048510133 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1668061640 con 0x56290afc6320 2024-08-31T04:43:53.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1683c66000 10 client.6582 fetch_fsmap learned FSMap version 9 2024-08-31T04:43:53.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1683c66000 1 -- 172.21.15.89:0/2048510133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56290af0b920 con 0x56290afc6320 2024-08-31T04:43:53.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f165aa00640 1 -- 172.21.15.89:0/2048510133 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56290af4f740 con 0x56290afc6320 2024-08-31T04:43:53.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f165aa00640 1 -- 172.21.15.89:0/2048510133 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f166805c370 con 0x56290afc6320 2024-08-31T04:43:53.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1683c66000 10 client.6582 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:43:53.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1683c66000 10 client.6582 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:43:53.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1683c66000 20 client.6582 populate_metadata read hostname 'smithi089' 2024-08-31T04:43:53.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1683c66000 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56290abe4b10 0x56290b14c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1683c66000 4 client.6582 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:43:53.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1683c66000 1 -- 172.21.15.89:0/2048510133 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56290af53190 con 0x56290abe4b10 2024-08-31T04:43:53.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679000640 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56290abe4b10 0x56290b14c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f165aa00640 10 client.6582 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:53.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.247+0000 7f1679000640 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56290abe4b10 0x56290b14c430 crc :-1 s=READY pgs=1920 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d0c64041d02181 server_cookie=2a5850b46ed46069 in_seq=0 out_seq=0 2024-08-31T04:43:53.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f165aa00640 1 -- 172.21.15.89:0/2048510133 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56290af53190 con 0x56290abe4b10 2024-08-31T04:43:53.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f165aa00640 10 client.6582 handle_command_reply: tid=0 2024-08-31T04:43:53.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 client.6582 shutdown 2024-08-31T04:43:53.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 -- 172.21.15.89:0/2048510133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 msgr2=0x56290b131a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b131a10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f166805ce10 tx=0x7f1668059850 comp rx=0 tx=0).stop 2024-08-31T04:43:53.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 -- 172.21.15.89:0/2048510133 shutdown_connections 2024-08-31T04:43:53.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56290abe4b10 0x56290b14c430 crc :-1 s=READY pgs=1920 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afcf3e0 0x56290b132490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6b30 0x56290b131f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 --2- 172.21.15.89:0/2048510133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b131a10 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f165aa00640 0 client.6582 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:53.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 -- 172.21.15.89:0/2048510133 >> 172.21.15.89:0/2048510133 conn(0x56290affd250 msgr2=0x56290b132e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 -- 172.21.15.89:0/2048510133 shutdown_connections 2024-08-31T04:43:53.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 1 -- 172.21.15.89:0/2048510133 wait complete. 2024-08-31T04:43:53.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.251+0000 7f1683c66000 20 client.6582 trim_cache size 0 max 16384 2024-08-31T04:43:53.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.267+0000 7f1683c66000 1 Processor -- start 2024-08-31T04:43:53.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.267+0000 7f1683c66000 1 -- start start 2024-08-31T04:43:53.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b13f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b1386b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afcf3e0 0x56290b138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1674203ce0 con 0x56290afc6320 2024-08-31T04:43:53.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1674202bc0 con 0x56290afcf3e0 2024-08-31T04:43:53.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1674162e20 con 0x56290afc6b30 2024-08-31T04:43:53.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b13f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b13f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49422/0 (socket says 172.21.15.89:49422) 2024-08-31T04:43:53.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679a00640 1 -- 172.21.15.89:0/1092651997 learned_addr learned my addr 172.21.15.89:0/1092651997 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:53.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f167a400640 1 --2- 172.21.15.89:0/1092651997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afcf3e0 0x56290b138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679000640 1 --2- 172.21.15.89:0/1092651997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b1386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679a00640 1 -- 172.21.15.89:0/1092651997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 msgr2=0x56290b1386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:53.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679a00640 1 --2- 172.21.15.89:0/1092651997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b1386b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679a00640 1 -- 172.21.15.89:0/1092651997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afcf3e0 msgr2=0x56290b138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:53.274 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679a00640 1 --2- 172.21.15.89:0/1092651997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afcf3e0 0x56290b138bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679a00640 1 -- 172.21.15.89:0/1092651997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290af9e170 con 0x56290afc6320 2024-08-31T04:43:53.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1679a00640 1 --2- 172.21.15.89:0/1092651997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b13f530 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1668059140 tx=0x7f1668058a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7654bbdb9219d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1665600640 1 -- 172.21.15.89:0/1092651997 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668076040 con 0x56290afc6320 2024-08-31T04:43:53.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1665600640 1 -- 172.21.15.89:0/1092651997 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16680662f0 con 0x56290afc6320 2024-08-31T04:43:53.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1665600640 1 -- 172.21.15.89:0/1092651997 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166805c370 con 0x56290afc6320 2024-08-31T04:43:53.277 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 -- 172.21.15.89:0/1092651997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 msgr2=0x56290b13f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 --2- 172.21.15.89:0/1092651997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b13f530 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1668059140 tx=0x7f1668058a80 comp rx=0 tx=0).stop 2024-08-31T04:43:53.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 -- 172.21.15.89:0/1092651997 shutdown_connections 2024-08-31T04:43:53.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 --2- 172.21.15.89:0/1092651997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afcf3e0 0x56290b138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 --2- 172.21.15.89:0/1092651997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b1386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 --2- 172.21.15.89:0/1092651997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afc6320 0x56290b13f530 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 -- 172.21.15.89:0/1092651997 >> 172.21.15.89:0/1092651997 conn(0x56290affd250 msgr2=0x56290b13e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 -- 172.21.15.89:0/1092651997 shutdown_connections 2024-08-31T04:43:53.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 -- 172.21.15.89:0/1092651997 wait complete. 2024-08-31T04:43:53.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 -- start start 2024-08-31T04:43:53.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.271+0000 7f1683c66000 1 Processor -- start 2024-08-31T04:43:53.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 0x56290b0fbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b0f9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b0f9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16742017a0 con 0x56290afcf3e0 2024-08-31T04:43:53.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f16742024f0 con 0x56290afc6320 2024-08-31T04:43:53.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1674201e50 con 0x56290afc6b30 2024-08-31T04:43:53.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 10 client.0 _ll_register_callbacks cb 0x7f166805cf90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:43:53.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f167a400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b0f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f167a400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b0f9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49430/0 (socket says 172.21.15.89:49430) 2024-08-31T04:43:53.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f167a400640 1 -- 172.21.15.89:0/2908568039 learned_addr learned my addr 172.21.15.89:0/2908568039 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:53.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1679a00640 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 0x56290b0fbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1679000640 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b0f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f167a400640 1 -- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 msgr2=0x56290b0f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:53.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f167a400640 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b0f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f167a400640 1 -- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 msgr2=0x56290b0fbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:43:53.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f167a400640 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 0x56290b0fbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f167a400640 1 -- 172.21.15.89:0/2908568039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290aeca960 con 0x56290afcf3e0 2024-08-31T04:43:53.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f167a400640 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b0f9770 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f166c009bd0 tx=0x7f166c003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaca4c8a03e0370 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f165aa00640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-08-31T04:43:53.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f165aa00640 1 -- 172.21.15.89:0/2908568039 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c0b2040 con 0x56290afcf3e0 2024-08-31T04:43:53.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f165aa00640 1 -- 172.21.15.89:0/2908568039 <== mon.0 v2:172.21.15.89:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f166c004040 con 0x56290afcf3e0 2024-08-31T04:43:53.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 -- 172.21.15.89:0/2908568039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16680662f0 con 0x56290afcf3e0 2024-08-31T04:43:53.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f165aa00640 1 -- 172.21.15.89:0/2908568039 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f166c004240 con 0x56290afcf3e0 2024-08-31T04:43:53.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 10 client.6588 fetch_fsmap learned FSMap version 9 2024-08-31T04:43:53.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 -- 172.21.15.89:0/2908568039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56290aed7b20 con 0x56290afcf3e0 2024-08-31T04:43:53.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f165aa00640 1 -- 172.21.15.89:0/2908568039 <== mon.0 v2:172.21.15.89:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16680662f0 con 0x56290afcf3e0 2024-08-31T04:43:53.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f165aa00640 1 -- 172.21.15.89:0/2908568039 <== mon.0 v2:172.21.15.89:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7f166c0043e0 con 0x56290afcf3e0 2024-08-31T04:43:53.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 10 client.6588 fetch_fsmap finished waiting for FSMap version 9 2024-08-31T04:43:53.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 10 client.6588 resolve_mds: validated gid 4420 aka daemon mds.b 2024-08-31T04:43:53.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 20 client.6588 populate_metadata read hostname 'smithi089' 2024-08-31T04:43:53.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56290abd2b70 0x56290b0f9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 4 client.6588 mds_command: new command op to 4420 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-31T04:43:53.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1683c66000 1 -- 172.21.15.89:0/2908568039 --> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x56290af4ec30 con 0x56290abd2b70 2024-08-31T04:43:53.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.275+0000 7f1679a00640 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56290abd2b70 0x56290b0f9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f165aa00640 10 client.6588 ms_handle_connect on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:53.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1679a00640 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56290abd2b70 0x56290b0f9cb0 crc :-1 s=READY pgs=1921 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=923f5dec33634bc6 server_cookie=61d7980c9b2205b8 in_seq=0 out_seq=0 2024-08-31T04:43:53.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f165aa00640 1 -- 172.21.15.89:0/2908568039 <== mds.0 v2:172.21.15.170:6834/890662790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x56290af4ec30 con 0x56290abd2b70 2024-08-31T04:43:53.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f165aa00640 10 client.6588 handle_command_reply: tid=0 2024-08-31T04:43:53.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 client.6588 shutdown 2024-08-31T04:43:53.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 -- 172.21.15.89:0/2908568039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 msgr2=0x56290b0f9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b0f9770 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f166c009bd0 tx=0x7f166c003ea0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 -- 172.21.15.89:0/2908568039 shutdown_connections 2024-08-31T04:43:53.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:6834/890662790,v1:172.21.15.170:6835/890662790] conn(0x56290abd2b70 0x56290b0f9cb0 crc :-1 s=READY pgs=1921 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56290afcf3e0 0x56290b0f9770 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56290afc6b30 0x56290b0f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 --2- 172.21.15.89:0/2908568039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56290afc6320 0x56290b0fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 -- 172.21.15.89:0/2908568039 >> 172.21.15.89:0/2908568039 conn(0x56290affd250 msgr2=0x56290b13e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f165aa00640 0 client.6588 ms_handle_reset on v2:172.21.15.170:6834/890662790 2024-08-31T04:43:53.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 -- 172.21.15.89:0/2908568039 shutdown_connections 2024-08-31T04:43:53.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 1 -- 172.21.15.89:0/2908568039 wait complete. 2024-08-31T04:43:53.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f1683c66000 20 client.6588 trim_cache size 0 max 16384 2024-08-31T04:43:53.288 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:43:53.288 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 9, 2024-08-31T04:43:53.288 INFO:teuthology.orchestra.run.smithi089.stdout: "leader": 4420, 2024-08-31T04:43:53.288 INFO:teuthology.orchestra.run.smithi089.stdout: "set_version": 140, 2024-08-31T04:43:53.288 INFO:teuthology.orchestra.run.smithi089.stdout: "sets": {} 2024-08-31T04:43:53.288 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:43:53.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 -- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720c0 msgr2=0x7f16540745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720c0 0x7f16540745d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1674163f00 tx=0x7f16600091e0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 -- 172.21.15.89:0/2013049083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 msgr2=0x7f16741550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 0x7f16741550c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f166800c3c0 tx=0x7f166800c880 comp rx=0 tx=0).stop 2024-08-31T04:43:53.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 -- 172.21.15.89:0/2013049083 shutdown_connections 2024-08-31T04:43:53.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f16540720c0 0x7f16540745d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16741f5d00 0x7f167414f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1674156c00 0x7f167414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 --2- 172.21.15.89:0/2013049083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16740c4d20 0x7f16741550c0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 -- 172.21.15.89:0/2013049083 >> 172.21.15.89:0/2013049083 conn(0x7f1674071a70 msgr2=0x7f1674153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 -- 172.21.15.89:0/2013049083 shutdown_connections 2024-08-31T04:43:53.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.279+0000 7f167c400640 1 -- 172.21.15.89:0/2013049083 wait complete. 2024-08-31T04:43:53.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.335+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39c0156d10 con 0x7f39c0159f60 2024-08-31T04:43:53.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.335+0000 7f39bcc00640 1 -- 172.21.15.89:0/3543169368 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f39b8062230 con 0x7f39c0159f60 2024-08-31T04:43:53.338 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:43:53.338 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:43:53.339 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:43:53.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39a00720f0 msgr2=0x7f39a0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39a00720f0 0x7f39a0074600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f39b40046c0 tx=0x7f39b4007ea0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 msgr2=0x7f39c00cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.340 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 0x7f39c00cdc90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c6e0 tx=0x7f39b800cba0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 shutdown_connections 2024-08-31T04:43:53.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f39a00720f0 0x7f39a0074600 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c0159f60 0x7f39c00cdc90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c00cedf0 0x7f39c014dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 --2- 172.21.15.89:0/3543169368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c00c97e0 0x7f39c0151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 >> 172.21.15.89:0/3543169368 conn(0x7f39c0071be0 msgr2=0x7f39c0152850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 shutdown_connections 2024-08-31T04:43:53.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.339+0000 7f39c7a00640 1 -- 172.21.15.89:0/3543169368 wait complete. 2024-08-31T04:43:53.361 INFO:tasks.quiescer:done joining Quiescers 2024-08-31T04:43:53.362 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-31T04:43:53.370 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-31T04:43:53.370 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:43:53.370 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:43:53.415 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-08-31T04:43:53.415 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:43:53.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-31T04:43:53.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.663+0000 7fae70400640 1 -- 172.21.15.89:0/3863708278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c7920 msgr2=0x7fae680c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.663+0000 7fae70400640 1 --2- 172.21.15.89:0/3863708278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c7920 0x7fae680c7d30 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fae68072540 tx=0x7fae6001f580 comp rx=0 tx=0).stop 2024-08-31T04:43:53.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.663+0000 7fae70400640 1 -- 172.21.15.89:0/3863708278 shutdown_connections 2024-08-31T04:43:53.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.663+0000 7fae70400640 1 --2- 172.21.15.89:0/3863708278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c7920 0x7fae680c7d30 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.663+0000 7fae70400640 1 --2- 172.21.15.89:0/3863708278 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae680c1f40 0x7fae680c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.663+0000 7fae70400640 1 --2- 172.21.15.89:0/3863708278 >> v2:172.21.15.170:3300/0 conn(0x7fae6815bc70 0x7fae68152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.663+0000 7fae70400640 1 -- 172.21.15.89:0/3863708278 >> 172.21.15.89:0/3863708278 conn(0x7fae680ccf20 msgr2=0x7fae680cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.663+0000 7fae70400640 1 -- 172.21.15.89:0/3863708278 shutdown_connections 2024-08-31T04:43:53.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.663+0000 7fae70400640 1 -- 172.21.15.89:0/3863708278 wait complete. 2024-08-31T04:43:53.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae70400640 1 Processor -- start 2024-08-31T04:43:53.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae70400640 1 -- start start 2024-08-31T04:43:53.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae70400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c1f40 0x7fae68153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae70400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae680c7920 0x7fae680cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae70400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae6815bc70 0x7fae6814ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae70400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fae680710c0 con 0x7fae680c1f40 2024-08-31T04:43:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae70400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fae68070f40 con 0x7fae6815bc70 2024-08-31T04:43:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae70400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fae68071240 con 0x7fae680c7920 2024-08-31T04:43:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c1f40 0x7fae68153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c1f40 0x7fae68153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49450/0 (socket says 172.21.15.89:49450) 2024-08-31T04:43:53.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6da00640 1 -- 172.21.15.89:0/4106662450 learned_addr learned my addr 172.21.15.89:0/4106662450 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:53.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6e400640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae6815bc70 0x7fae6814ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6d000640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae680c7920 0x7fae680cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6da00640 1 -- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae680c7920 msgr2=0x7fae680cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6da00640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae680c7920 0x7fae680cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6da00640 1 -- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae6815bc70 msgr2=0x7fae6814ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6da00640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae6815bc70 0x7fae6814ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6da00640 1 -- 172.21.15.89:0/4106662450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae68153b70 con 0x7fae680c1f40 2024-08-31T04:43:53.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae6da00640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c1f40 0x7fae68153630 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00d950 tx=0x7fae5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae65600640 1 -- 172.21.15.89:0/4106662450 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c017070 con 0x7fae680c1f40 2024-08-31T04:43:53.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae65600640 1 -- 172.21.15.89:0/4106662450 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae5c009d20 con 0x7fae680c1f40 2024-08-31T04:43:53.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.667+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6814d200 con 0x7fae680c1f40 2024-08-31T04:43:53.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.671+0000 7fae65600640 1 -- 172.21.15.89:0/4106662450 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0106c0 con 0x7fae680c1f40 2024-08-31T04:43:53.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.671+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6814d7c0 con 0x7fae680c1f40 2024-08-31T04:43:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.671+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6814da00 con 0x7fae680c1f40 2024-08-31T04:43:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.671+0000 7fae65600640 1 -- 172.21.15.89:0/4106662450 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fae5c01a070 con 0x7fae680c1f40 2024-08-31T04:43:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.671+0000 7fae65600640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fae480720c0 0x7fae480745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.671+0000 7fae65600640 1 -- 172.21.15.89:0/4106662450 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fae5c0930d0 con 0x7fae680c1f40 2024-08-31T04:43:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.671+0000 7fae6d000640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fae480720c0 0x7fae480745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.675+0000 7fae6d000640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fae480720c0 0x7fae480745d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fae54005fd0 tx=0x7fae54005d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:53.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.675+0000 7fae65600640 1 -- 172.21.15.89:0/4106662450 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fae6814da00 con 0x7fae680c1f40 2024-08-31T04:43:53.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fae680c7d30 con 0x7fae680c1f40 2024-08-31T04:43:53.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae65600640 1 -- 172.21.15.89:0/4106662450 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) ==== 80+0+0 (secure 0 0 0) 0x7fae5c05df60 con 0x7fae680c1f40 2024-08-31T04:43:53.857 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2024-08-31T04:43:53.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fae480720c0 msgr2=0x7fae480745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fae480720c0 0x7fae480745d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fae54005fd0 tx=0x7fae54005d80 comp rx=0 tx=0).stop 2024-08-31T04:43:53.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c1f40 msgr2=0x7fae68153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:53.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c1f40 0x7fae68153630 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00d950 tx=0x7fae5c00de10 comp rx=0 tx=0).stop 2024-08-31T04:43:53.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 shutdown_connections 2024-08-31T04:43:53.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fae480720c0 0x7fae480745d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae6815bc70 0x7fae6814ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae680c7920 0x7fae680cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 --2- 172.21.15.89:0/4106662450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae680c1f40 0x7fae68153630 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:53.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.855+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 >> 172.21.15.89:0/4106662450 conn(0x7fae680ccf20 msgr2=0x7fae680cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:53.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.859+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 shutdown_connections 2024-08-31T04:43:53.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:53.859+0000 7fae70400640 1 -- 172.21.15.89:0/4106662450 wait complete. 2024-08-31T04:43:53.880 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-31T04:43:53.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:43:53.880 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-31T04:43:54.331 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:43:54.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:43:54.332 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-31T04:43:54.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:43:54.341 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-08-31T04:43:54.393 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-31T04:43:54.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:43:54.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T04:43:54.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:43:54.456 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-08-31T04:43:54.576 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:43:54.579 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:43:55.061 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-31T04:43:55.071 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-31T04:43:55.071 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:43:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.223+0000 7fa3aaa00640 1 -- 172.21.15.89:0/2325589618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a415bc70 msgr2=0x7fa3a4152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.223+0000 7fa3aaa00640 1 --2- 172.21.15.89:0/2325589618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a415bc70 0x7fa3a4152a10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa394009900 tx=0x7fa39401f0d0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.223+0000 7fa3aaa00640 1 -- 172.21.15.89:0/2325589618 shutdown_connections 2024-08-31T04:43:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.223+0000 7fa3aaa00640 1 --2- 172.21.15.89:0/2325589618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a415bc70 0x7fa3a4152a10 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.223+0000 7fa3aaa00640 1 -- 172.21.15.89:0/2325589618 >> 172.21.15.89:0/2325589618 conn(0x7fa3a40ccf20 msgr2=0x7fa3a40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.223+0000 7fa3aaa00640 1 -- 172.21.15.89:0/2325589618 shutdown_connections 2024-08-31T04:43:55.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.223+0000 7fa3aaa00640 1 -- 172.21.15.89:0/2325589618 wait complete. 2024-08-31T04:43:55.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.223+0000 7fa3aaa00640 1 Processor -- start 2024-08-31T04:43:55.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.223+0000 7fa3aaa00640 1 -- start start 2024-08-31T04:43:55.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3aaa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a40c1f40 0x7fa3a41efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:55.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3aaa00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3a40c9330 0x7fa3a414e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:55.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3aaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3a415bc70 0x7fa3a41482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:55.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3aaa00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a40c8030 con 0x7fa3a40c1f40 2024-08-31T04:43:55.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3aaa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a40c3150 con 0x7fa3a415bc70 2024-08-31T04:43:55.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3aaa00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a4074e30 con 0x7fa3a40c9330 2024-08-31T04:43:55.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a40c1f40 0x7fa3a41efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:55.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a3e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a40c1f40 0x7fa3a41efd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49470/0 (socket says 172.21.15.89:49470) 2024-08-31T04:43:55.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a3e00640 1 -- 172.21.15.89:0/624178369 learned_addr learned my addr 172.21.15.89:0/624178369 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:55.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa39be00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3a40c9330 0x7fa3a414e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:55.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a8a00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3a415bc70 0x7fa3a41482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:55.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a3e00640 1 -- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3a40c9330 msgr2=0x7fa3a414e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a3e00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3a40c9330 0x7fa3a414e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a3e00640 1 -- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3a415bc70 msgr2=0x7fa3a41482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a3e00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3a415bc70 0x7fa3a41482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a3e00640 1 -- 172.21.15.89:0/624178369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a4155e30 con 0x7fa3a40c1f40 2024-08-31T04:43:55.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a3e00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a40c1f40 0x7fa3a41efd70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa394009850 tx=0x7fa3940a8ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:55.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a0c00640 1 -- 172.21.15.89:0/624178369 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3940b5040 con 0x7fa3a40c1f40 2024-08-31T04:43:55.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a0c00640 1 -- 172.21.15.89:0/624178369 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa394003970 con 0x7fa3a40c1f40 2024-08-31T04:43:55.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a4154f10 con 0x7fa3a40c1f40 2024-08-31T04:43:55.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3a0c00640 1 -- 172.21.15.89:0/624178369 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa394003d40 con 0x7fa3a40c1f40 2024-08-31T04:43:55.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a414c6b0 con 0x7fa3a40c1f40 2024-08-31T04:43:55.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.227+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a4152a10 con 0x7fa3a40c1f40 2024-08-31T04:43:55.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.231+0000 7fa3a0c00640 1 -- 172.21.15.89:0/624178369 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa3940c0060 con 0x7fa3a40c1f40 2024-08-31T04:43:55.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.231+0000 7fa3a0c00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa3800720c0 0x7fa3800745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:55.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.231+0000 7fa3a0c00640 1 -- 172.21.15.89:0/624178369 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa39412ffe0 con 0x7fa3a40c1f40 2024-08-31T04:43:55.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.231+0000 7fa39be00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa3800720c0 0x7fa3800745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:55.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.231+0000 7fa39be00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa3800720c0 0x7fa3800745d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa3a41559f0 tx=0x7fa38c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:55.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.235+0000 7fa3a0c00640 1 -- 172.21.15.89:0/624178369 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa394018c30 con 0x7fa3a40c1f40 2024-08-31T04:43:55.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.399+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3a41560a0 con 0x7fa3800720c0 2024-08-31T04:43:55.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.419+0000 7fa3a0c00640 1 -- 172.21.15.89:0/624178369 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+338116 (secure 0 0 0) 0x7fa3a41560a0 con 0x7fa3800720c0 2024-08-31T04:43:55.422 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:43:55.427 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:43:55.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa3800720c0 msgr2=0x7fa3800745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa3800720c0 0x7fa3800745d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa3a41559f0 tx=0x7fa38c008040 comp rx=0 tx=0).stop 2024-08-31T04:43:55.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a40c1f40 msgr2=0x7fa3a41efd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a40c1f40 0x7fa3a41efd70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa394009850 tx=0x7fa3940a8ce0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 shutdown_connections 2024-08-31T04:43:55.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa3800720c0 0x7fa3800745d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3a415bc70 0x7fa3a41482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3a40c9330 0x7fa3a414e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 --2- 172.21.15.89:0/624178369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a40c1f40 0x7fa3a41efd70 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 >> 172.21.15.89:0/624178369 conn(0x7fa3a40ccf20 msgr2=0x7fa3a4151b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:55.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 shutdown_connections 2024-08-31T04:43:55.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.423+0000 7fa3aaa00640 1 -- 172.21.15.89:0/624178369 wait complete. 2024-08-31T04:43:55.446 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1245,"stamp":"2024-08-31T04:43:55.291863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2002428513,"num_objects":43771,"num_object_clones":18986,"num_object_copies":166070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43771,"num_whiteouts":18810,"num_read":8394,"num_read_kb":6751486,"num_write":113772,"num_write_kb":3919722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163298,"ondisk_log_size":163298,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6321912,"kb_used_data":4116792,"kb_used_omap":12,"kb_used_meta":2204979,"kb_avail":748652808,"statfs":{"total":773094113280,"available":766620475392,"internally_reserved":0,"allocated":4215595008,"data_stored":4214755198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":2257899056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2082,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":13015,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005976"},"pg_stats":[{"pgid":"2.1f","version":"48'789","reported_seq":875,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.483441+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:43:41.483441+0000","last_peered":"2024-08-31T04:43:41.483441+0000","last_clean":"2024-08-31T04:43:41.483441+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:43:41.483441+0000","last_undegraded":"2024-08-31T04:43:41.483441+0000","last_fullsized":"2024-08-31T04:43:41.483441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37414551,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":823,"num_write_kb":58134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"48'592","reported_seq":2696,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.303935+0000","last_change":"2024-08-31T04:10:27.645410+0000","last_active":"2024-08-31T04:43:54.303935+0000","last_peered":"2024-08-31T04:43:54.303935+0000","last_clean":"2024-08-31T04:43:54.303935+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:43:54.303935+0000","last_undegraded":"2024-08-31T04:43:54.303935+0000","last_fullsized":"2024-08-31T04:43:54.303935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:46.278499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012836803000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"48'2838","reported_seq":4603,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.098808+0000","last_change":"2024-08-31T04:10:27.668465+0000","last_active":"2024-08-31T04:43:51.098808+0000","last_peered":"2024-08-31T04:43:51.098808+0000","last_clean":"2024-08-31T04:43:51.098808+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:43:51.098808+0000","last_undegraded":"2024-08-31T04:43:51.098808+0000","last_fullsized":"2024-08-31T04:43:51.098808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2838,"log_dups_size":0,"ondisk_log_size":2838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:56:27.977319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058952350000000004,"stat_sum":{"num_bytes":50597461,"num_objects":1198,"num_object_clones":550,"num_object_copies":4792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1198,"num_whiteouts":550,"num_read":212,"num_read_kb":376919,"num_write":2332,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"48'672","reported_seq":758,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.189267+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:41:10.189267+0000","last_peered":"2024-08-31T04:41:10.189267+0000","last_clean":"2024-08-31T04:41:10.189267+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:41:10.189267+0000","last_undegraded":"2024-08-31T04:41:10.189267+0000","last_fullsized":"2024-08-31T04:41:10.189267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":697,"num_write_kb":66604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"48'579","reported_seq":2684,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315803+0000","last_change":"2024-08-31T04:10:27.645689+0000","last_active":"2024-08-31T04:43:54.315803+0000","last_peered":"2024-08-31T04:43:54.315803+0000","last_clean":"2024-08-31T04:43:54.315803+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:43:54.315803+0000","last_undegraded":"2024-08-31T04:43:54.315803+0000","last_fullsized":"2024-08-31T04:43:54.315803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:21.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012881510000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"48'3007","reported_seq":4768,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.337761+0000","last_change":"2024-08-31T04:10:27.629997+0000","last_active":"2024-08-31T04:43:31.337761+0000","last_peered":"2024-08-31T04:43:31.337761+0000","last_clean":"2024-08-31T04:43:31.337761+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:43:31.337761+0000","last_undegraded":"2024-08-31T04:43:31.337761+0000","last_fullsized":"2024-08-31T04:43:31.337761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:34:13.962324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059980260000000001,"stat_sum":{"num_bytes":71770879,"num_objects":1258,"num_object_clones":586,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":586,"num_read":244,"num_read_kb":407504,"num_write":2470,"num_write_kb":85232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"48'1251","reported_seq":1333,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.959569+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:40:51.959569+0000","last_peered":"2024-08-31T04:40:51.959569+0000","last_clean":"2024-08-31T04:40:51.959569+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:40:51.959569+0000","last_undegraded":"2024-08-31T04:40:51.959569+0000","last_fullsized":"2024-08-31T04:40:51.959569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1251,"log_dups_size":0,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1281,"num_write_kb":120075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"48'616","reported_seq":2715,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.968852+0000","last_change":"2024-08-31T04:10:27.626701+0000","last_active":"2024-08-31T04:40:56.968852+0000","last_peered":"2024-08-31T04:40:56.968852+0000","last_clean":"2024-08-31T04:40:56.968852+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:40:56.968852+0000","last_undegraded":"2024-08-31T04:40:56.968852+0000","last_fullsized":"2024-08-31T04:40:56.968852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:11:39.748424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032840360000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"48'3005","reported_seq":4694,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.758723+0000","last_change":"2024-08-31T04:10:27.632736+0000","last_active":"2024-08-31T04:43:41.758723+0000","last_peered":"2024-08-31T04:43:41.758723+0000","last_clean":"2024-08-31T04:43:41.758723+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:43:41.758723+0000","last_undegraded":"2024-08-31T04:43:41.758723+0000","last_fullsized":"2024-08-31T04:43:41.758723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:27.569361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058445240000000002,"stat_sum":{"num_bytes":38693415,"num_objects":1292,"num_object_clones":602,"num_object_copies":5168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":602,"num_read":189,"num_read_kb":291224,"num_write":2458,"num_write_kb":41612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"48'400","reported_seq":482,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.971895+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:41:01.971895+0000","last_peered":"2024-08-31T04:41:01.971895+0000","last_clean":"2024-08-31T04:41:01.971895+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:41:01.971895+0000","last_undegraded":"2024-08-31T04:41:01.971895+0000","last_fullsized":"2024-08-31T04:41:01.971895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":451,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"48'585","reported_seq":2687,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.968477+0000","last_change":"2024-08-31T04:10:27.683387+0000","last_active":"2024-08-31T04:40:51.968477+0000","last_peered":"2024-08-31T04:40:51.968477+0000","last_clean":"2024-08-31T04:40:51.968477+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:40:51.968477+0000","last_undegraded":"2024-08-31T04:40:51.968477+0000","last_fullsized":"2024-08-31T04:40:51.968477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:29:21.522834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070378919999999996,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"48'2845","reported_seq":4609,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:07.038822+0000","last_change":"2024-08-31T04:10:27.629946+0000","last_active":"2024-08-31T04:43:07.038822+0000","last_peered":"2024-08-31T04:43:07.038822+0000","last_clean":"2024-08-31T04:43:07.038822+0000","last_became_active":"2024-08-31T04:04:41.418200+0000","last_became_peered":"2024-08-31T04:04:41.418200+0000","last_unstale":"2024-08-31T04:43:07.038822+0000","last_undegraded":"2024-08-31T04:43:07.038822+0000","last_fullsized":"2024-08-31T04:43:07.038822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:27.685667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059467970000000002,"stat_sum":{"num_bytes":46428419,"num_objects":1209,"num_object_clones":554,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":554,"num_read":208,"num_read_kb":267627,"num_write":2344,"num_write_kb":53603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"48'611","reported_seq":2711,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:55.950255+0000","last_change":"2024-08-31T04:10:27.682710+0000","last_active":"2024-08-31T04:40:55.950255+0000","last_peered":"2024-08-31T04:40:55.950255+0000","last_clean":"2024-08-31T04:40:55.950255+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:40:55.950255+0000","last_undegraded":"2024-08-31T04:40:55.950255+0000","last_fullsized":"2024-08-31T04:40:55.950255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.550862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068528089999999996,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"48'1182","reported_seq":1266,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.979593+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:41:10.979593+0000","last_peered":"2024-08-31T04:41:10.979593+0000","last_clean":"2024-08-31T04:41:10.979593+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:41:10.979593+0000","last_undegraded":"2024-08-31T04:41:10.979593+0000","last_fullsized":"2024-08-31T04:41:10.979593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1278,"num_write_kb":83819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"48'2943","reported_seq":4739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.900700+0000","last_change":"2024-08-31T04:10:27.682154+0000","last_active":"2024-08-31T04:43:31.900700+0000","last_peered":"2024-08-31T04:43:31.900700+0000","last_clean":"2024-08-31T04:43:31.900700+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:43:31.900700+0000","last_undegraded":"2024-08-31T04:43:31.900700+0000","last_fullsized":"2024-08-31T04:43:31.900700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:43.247408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066428290000000003,"stat_sum":{"num_bytes":56765051,"num_objects":1275,"num_object_clones":585,"num_object_copies":5100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1275,"num_whiteouts":585,"num_read":277,"num_read_kb":424079,"num_write":2416,"num_write_kb":67833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"48'620","reported_seq":2720,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.100428+0000","last_change":"2024-08-31T04:10:27.670686+0000","last_active":"2024-08-31T04:40:43.100428+0000","last_peered":"2024-08-31T04:40:43.100428+0000","last_clean":"2024-08-31T04:40:43.100428+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:40:43.100428+0000","last_undegraded":"2024-08-31T04:40:43.100428+0000","last_fullsized":"2024-08-31T04:40:43.100428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:35.821184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066355329999999999,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"48'686","reported_seq":771,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.978927+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:41:10.978927+0000","last_peered":"2024-08-31T04:41:10.978927+0000","last_clean":"2024-08-31T04:41:10.978927+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:41:10.978927+0000","last_undegraded":"2024-08-31T04:41:10.978927+0000","last_fullsized":"2024-08-31T04:41:10.978927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":738,"num_write_kb":87340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"48'2909","reported_seq":4540,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:07.042576+0000","last_change":"2024-08-31T04:10:27.799102+0000","last_active":"2024-08-31T04:43:07.042576+0000","last_peered":"2024-08-31T04:43:07.042576+0000","last_clean":"2024-08-31T04:43:07.042576+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:43:07.042576+0000","last_undegraded":"2024-08-31T04:43:07.042576+0000","last_fullsized":"2024-08-31T04:43:07.042576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2909,"log_dups_size":0,"ondisk_log_size":2909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:44:32.822098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043859299999999997,"stat_sum":{"num_bytes":16936662,"num_objects":1190,"num_object_clones":558,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":558,"num_read":85,"num_read_kb":9403,"num_write":2392,"num_write_kb":37720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"48'650","reported_seq":2747,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:50.444732+0000","last_change":"2024-08-31T04:10:27.821258+0000","last_active":"2024-08-31T04:40:50.444732+0000","last_peered":"2024-08-31T04:40:50.444732+0000","last_clean":"2024-08-31T04:40:50.444732+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:40:50.444732+0000","last_undegraded":"2024-08-31T04:40:50.444732+0000","last_fullsized":"2024-08-31T04:40:50.444732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:06.689884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018377836000000002,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":14,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"48'562","reported_seq":647,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.856125+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:40:56.856125+0000","last_peered":"2024-08-31T04:40:56.856125+0000","last_clean":"2024-08-31T04:40:56.856125+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:40:56.856125+0000","last_undegraded":"2024-08-31T04:40:56.856125+0000","last_fullsized":"2024-08-31T04:40:56.856125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":615,"num_write_kb":58408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"48'2896","reported_seq":4576,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.040546+0000","last_change":"2024-08-31T04:10:27.671256+0000","last_active":"2024-08-31T04:43:51.040546+0000","last_peered":"2024-08-31T04:43:51.040546+0000","last_clean":"2024-08-31T04:43:51.040546+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:43:51.040546+0000","last_undegraded":"2024-08-31T04:43:51.040546+0000","last_fullsized":"2024-08-31T04:43:51.040546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2896,"log_dups_size":0,"ondisk_log_size":2896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:44.158201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070696559999999997,"stat_sum":{"num_bytes":20275415,"num_objects":1227,"num_object_clones":567,"num_object_copies":4908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1227,"num_whiteouts":567,"num_read":143,"num_read_kb":118630,"num_write":2381,"num_write_kb":31494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'627","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:50.949382+0000","last_change":"2024-08-31T04:10:27.681396+0000","last_active":"2024-08-31T04:40:50.949382+0000","last_peered":"2024-08-31T04:40:50.949382+0000","last_clean":"2024-08-31T04:40:50.949382+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:40:50.949382+0000","last_undegraded":"2024-08-31T04:40:50.949382+0000","last_fullsized":"2024-08-31T04:40:50.949382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:59:06.965998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060537480000000003,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"48'371","reported_seq":456,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.972445+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:41:01.972445+0000","last_peered":"2024-08-31T04:41:01.972445+0000","last_clean":"2024-08-31T04:41:01.972445+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:41:01.972445+0000","last_undegraded":"2024-08-31T04:41:01.972445+0000","last_fullsized":"2024-08-31T04:41:01.972445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":417,"num_write_kb":42100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"48'2828","reported_seq":4501,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.825205+0000","last_change":"2024-08-31T04:10:27.634238+0000","last_active":"2024-08-31T04:43:41.825205+0000","last_peered":"2024-08-31T04:43:41.825205+0000","last_clean":"2024-08-31T04:43:41.825205+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:43:41.825205+0000","last_undegraded":"2024-08-31T04:43:41.825205+0000","last_fullsized":"2024-08-31T04:43:41.825205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2828,"log_dups_size":0,"ondisk_log_size":2828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:01:42.230553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062106380000000001,"stat_sum":{"num_bytes":38082532,"num_objects":1243,"num_object_clones":581,"num_object_copies":4972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1243,"num_whiteouts":581,"num_read":150,"num_read_kb":116527,"num_write":2283,"num_write_kb":45420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"48'601","reported_seq":2701,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:50.444879+0000","last_change":"2024-08-31T04:10:27.824154+0000","last_active":"2024-08-31T04:40:50.444879+0000","last_peered":"2024-08-31T04:40:50.444879+0000","last_clean":"2024-08-31T04:40:50.444879+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:40:50.444879+0000","last_undegraded":"2024-08-31T04:40:50.444879+0000","last_fullsized":"2024-08-31T04:40:50.444879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:58.773731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018455160000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"48'542","reported_seq":627,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.979531+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:41:10.979531+0000","last_peered":"2024-08-31T04:41:10.979531+0000","last_clean":"2024-08-31T04:41:10.979531+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:41:10.979531+0000","last_undegraded":"2024-08-31T04:41:10.979531+0000","last_fullsized":"2024-08-31T04:41:10.979531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":604,"num_write_kb":70753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"48'2858","reported_seq":4620,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.781881+0000","last_change":"2024-08-31T04:10:27.632339+0000","last_active":"2024-08-31T04:43:41.781881+0000","last_peered":"2024-08-31T04:43:41.781881+0000","last_clean":"2024-08-31T04:43:41.781881+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:43:41.781881+0000","last_undegraded":"2024-08-31T04:43:41.781881+0000","last_fullsized":"2024-08-31T04:43:41.781881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:58.968159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076718680000000001,"stat_sum":{"num_bytes":46058979,"num_objects":1175,"num_object_clones":539,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":539,"num_read":195,"num_read_kb":329230,"num_write":2367,"num_write_kb":53816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"48'571","reported_seq":2669,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.995777+0000","last_change":"2024-08-31T04:10:27.825042+0000","last_active":"2024-08-31T04:40:51.995777+0000","last_peered":"2024-08-31T04:40:51.995777+0000","last_clean":"2024-08-31T04:40:51.995777+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:40:51.995777+0000","last_undegraded":"2024-08-31T04:40:51.995777+0000","last_fullsized":"2024-08-31T04:40:51.995777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:27.395562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019117552999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":13,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"48'1959","reported_seq":2044,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:01.067325+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:43:01.067325+0000","last_peered":"2024-08-31T04:43:01.067325+0000","last_clean":"2024-08-31T04:43:01.067325+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:43:01.067325+0000","last_undegraded":"2024-08-31T04:43:01.067325+0000","last_fullsized":"2024-08-31T04:43:01.067325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":4153,"num_write_kb":64616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"48'2942","reported_seq":4706,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:37.314647+0000","last_change":"2024-08-31T04:10:27.820585+0000","last_active":"2024-08-31T04:43:37.314647+0000","last_peered":"2024-08-31T04:43:37.314647+0000","last_clean":"2024-08-31T04:43:37.314647+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:43:37.314647+0000","last_undegraded":"2024-08-31T04:43:37.314647+0000","last_fullsized":"2024-08-31T04:43:37.314647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2942,"log_dups_size":0,"ondisk_log_size":2942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:41:28.078827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018717636999999999,"stat_sum":{"num_bytes":43745379,"num_objects":1223,"num_object_clones":566,"num_object_copies":4892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1223,"num_whiteouts":566,"num_read":224,"num_read_kb":327563,"num_write":2430,"num_write_kb":52706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"48'636","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.295540+0000","last_change":"2024-08-31T04:10:27.827955+0000","last_active":"2024-08-31T04:43:54.295540+0000","last_peered":"2024-08-31T04:43:54.295540+0000","last_clean":"2024-08-31T04:43:54.295540+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:43:54.295540+0000","last_undegraded":"2024-08-31T04:43:54.295540+0000","last_fullsized":"2024-08-31T04:43:54.295540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:49.670904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024325223999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":20,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"48'1150","reported_seq":1236,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:35.955058+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:41:35.955058+0000","last_peered":"2024-08-31T04:41:35.955058+0000","last_clean":"2024-08-31T04:41:35.955058+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:41:35.955058+0000","last_undegraded":"2024-08-31T04:41:35.955058+0000","last_fullsized":"2024-08-31T04:41:35.955058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":1214,"num_write_kb":79665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"48'3005","reported_seq":4719,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.066272+0000","last_change":"2024-08-31T04:10:27.828574+0000","last_active":"2024-08-31T04:43:51.066272+0000","last_peered":"2024-08-31T04:43:51.066272+0000","last_clean":"2024-08-31T04:43:51.066272+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:43:51.066272+0000","last_undegraded":"2024-08-31T04:43:51.066272+0000","last_fullsized":"2024-08-31T04:43:51.066272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:42:38.219220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025625698999999998,"stat_sum":{"num_bytes":43095232,"num_objects":1282,"num_object_clones":604,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":604,"num_read":212,"num_read_kb":287774,"num_write":2444,"num_write_kb":46619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"48'628","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:40.955698+0000","last_change":"2024-08-31T04:10:27.633137+0000","last_active":"2024-08-31T04:41:40.955698+0000","last_peered":"2024-08-31T04:41:40.955698+0000","last_clean":"2024-08-31T04:41:40.955698+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:41:40.955698+0000","last_undegraded":"2024-08-31T04:41:40.955698+0000","last_fullsized":"2024-08-31T04:41:40.955698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:41.923099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058084670000000003,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"48'804","reported_seq":890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.152652+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:41:30.152652+0000","last_peered":"2024-08-31T04:41:30.152652+0000","last_clean":"2024-08-31T04:41:30.152652+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:41:30.152652+0000","last_undegraded":"2024-08-31T04:41:30.152652+0000","last_fullsized":"2024-08-31T04:41:30.152652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":843,"num_write_kb":95373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"48'2913","reported_seq":4551,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.071323+0000","last_change":"2024-08-31T04:10:27.828980+0000","last_active":"2024-08-31T04:43:51.071323+0000","last_peered":"2024-08-31T04:43:51.071323+0000","last_clean":"2024-08-31T04:43:51.071323+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:43:51.071323+0000","last_undegraded":"2024-08-31T04:43:51.071323+0000","last_fullsized":"2024-08-31T04:43:51.071323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:55.109838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024539147000000001,"stat_sum":{"num_bytes":16912754,"num_objects":1252,"num_object_clones":571,"num_object_copies":5008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1252,"num_whiteouts":571,"num_read":103,"num_read_kb":5348,"num_write":2409,"num_write_kb":25816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"48'612","reported_seq":2718,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954146+0000","last_change":"2024-08-31T04:10:27.797983+0000","last_active":"2024-08-31T04:41:30.954146+0000","last_peered":"2024-08-31T04:41:30.954146+0000","last_clean":"2024-08-31T04:41:30.954146+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:41:30.954146+0000","last_undegraded":"2024-08-31T04:41:30.954146+0000","last_fullsized":"2024-08-31T04:41:30.954146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:34.286214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00335798,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"48'348","reported_seq":434,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954530+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:41:30.954530+0000","last_peered":"2024-08-31T04:41:30.954530+0000","last_clean":"2024-08-31T04:41:30.954530+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:41:30.954530+0000","last_undegraded":"2024-08-31T04:41:30.954530+0000","last_fullsized":"2024-08-31T04:41:30.954530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":379,"num_write_kb":74722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"48'2860","reported_seq":4522,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.779031+0000","last_change":"2024-08-31T04:10:27.826301+0000","last_active":"2024-08-31T04:43:41.779031+0000","last_peered":"2024-08-31T04:43:41.779031+0000","last_clean":"2024-08-31T04:43:41.779031+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:43:41.779031+0000","last_undegraded":"2024-08-31T04:43:41.779031+0000","last_fullsized":"2024-08-31T04:43:41.779031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:16:10.628373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024774918,"stat_sum":{"num_bytes":28766340,"num_objects":1202,"num_object_clones":562,"num_object_copies":4808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":562,"num_read":118,"num_read_kb":82244,"num_write":2340,"num_write_kb":38944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"48'646","reported_seq":2744,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315747+0000","last_change":"2024-08-31T04:10:27.638464+0000","last_active":"2024-08-31T04:43:54.315747+0000","last_peered":"2024-08-31T04:43:54.315747+0000","last_clean":"2024-08-31T04:43:54.315747+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:43:54.315747+0000","last_undegraded":"2024-08-31T04:43:54.315747+0000","last_fullsized":"2024-08-31T04:43:54.315747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:56:21.122785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011184838000000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"48'1718","reported_seq":2844,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:32.140583+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:41:32.140583+0000","last_peered":"2024-08-31T04:41:32.140583+0000","last_clean":"2024-08-31T04:41:32.140583+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:41:32.140583+0000","last_undegraded":"2024-08-31T04:41:32.140583+0000","last_fullsized":"2024-08-31T04:41:32.140583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1718,"log_dups_size":0,"ondisk_log_size":1718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1088,"num_read_kb":4789,"num_write":1771,"num_write_kb":92200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"48'2769","reported_seq":4518,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.169748+0000","last_change":"2024-08-31T04:10:27.824008+0000","last_active":"2024-08-31T04:43:51.169748+0000","last_peered":"2024-08-31T04:43:51.169748+0000","last_clean":"2024-08-31T04:43:51.169748+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:43:51.169748+0000","last_undegraded":"2024-08-31T04:43:51.169748+0000","last_fullsized":"2024-08-31T04:43:51.169748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2769,"log_dups_size":0,"ondisk_log_size":2769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:59.789550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024776765999999999,"stat_sum":{"num_bytes":32718964,"num_objects":1190,"num_object_clones":545,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":545,"num_read":189,"num_read_kb":237912,"num_write":2280,"num_write_kb":50056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"48'588","reported_seq":2690,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.291011+0000","last_change":"2024-08-31T04:10:27.830527+0000","last_active":"2024-08-31T04:43:54.291011+0000","last_peered":"2024-08-31T04:43:54.291011+0000","last_clean":"2024-08-31T04:43:54.291011+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:43:54.291011+0000","last_undegraded":"2024-08-31T04:43:54.291011+0000","last_fullsized":"2024-08-31T04:43:54.291011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:25:35.143895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023142859000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"48'735","reported_seq":821,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.340061+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:40:56.340061+0000","last_peered":"2024-08-31T04:40:56.340061+0000","last_clean":"2024-08-31T04:40:56.340061+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:40:56.340061+0000","last_undegraded":"2024-08-31T04:40:56.340061+0000","last_fullsized":"2024-08-31T04:40:56.340061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":805,"num_write_kb":79377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"48'2886","reported_seq":4556,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.755282+0000","last_change":"2024-08-31T04:10:27.643289+0000","last_active":"2024-08-31T04:43:41.755282+0000","last_peered":"2024-08-31T04:43:41.755282+0000","last_clean":"2024-08-31T04:43:41.755282+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:43:41.755282+0000","last_undegraded":"2024-08-31T04:43:41.755282+0000","last_fullsized":"2024-08-31T04:43:41.755282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:02.372383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014346418999999999,"stat_sum":{"num_bytes":16814987,"num_objects":1183,"num_object_clones":546,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":546,"num_read":112,"num_read_kb":15010,"num_write":2390,"num_write_kb":22596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'618","reported_seq":2713,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.451571+0000","last_change":"2024-08-31T04:10:27.815323+0000","last_active":"2024-08-31T04:41:30.451571+0000","last_peered":"2024-08-31T04:41:30.451571+0000","last_clean":"2024-08-31T04:41:30.451571+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:41:30.451571+0000","last_undegraded":"2024-08-31T04:41:30.451571+0000","last_fullsized":"2024-08-31T04:41:30.451571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:27:36.200935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013467437000000001,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"48'775","reported_seq":861,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954543+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:41:30.954543+0000","last_peered":"2024-08-31T04:41:30.954543+0000","last_clean":"2024-08-31T04:41:30.954543+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:41:30.954543+0000","last_undegraded":"2024-08-31T04:41:30.954543+0000","last_fullsized":"2024-08-31T04:41:30.954543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":842,"num_write_kb":66986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":182,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:00.942030+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:40:00.942030+0000","last_peered":"2024-08-31T04:40:00.942030+0000","last_clean":"2024-08-31T04:40:00.942030+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:40:00.942030+0000","last_undegraded":"2024-08-31T04:40:00.942030+0000","last_fullsized":"2024-08-31T04:40:00.942030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"48'2855","reported_seq":4681,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:45.973319+0000","last_change":"2024-08-31T04:10:27.683701+0000","last_active":"2024-08-31T04:43:45.973319+0000","last_peered":"2024-08-31T04:43:45.973319+0000","last_clean":"2024-08-31T04:43:45.973319+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:43:45.973319+0000","last_undegraded":"2024-08-31T04:43:45.973319+0000","last_fullsized":"2024-08-31T04:43:45.973319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:57.102473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069147610000000002,"stat_sum":{"num_bytes":57940200,"num_objects":1195,"num_object_clones":554,"num_object_copies":4780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":554,"num_read":274,"num_read_kb":360546,"num_write":2343,"num_write_kb":69963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"48'613","reported_seq":2709,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.063279+0000","last_change":"2024-08-31T04:10:27.683489+0000","last_active":"2024-08-31T04:40:43.063279+0000","last_peered":"2024-08-31T04:40:43.063279+0000","last_clean":"2024-08-31T04:40:43.063279+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:40:43.063279+0000","last_undegraded":"2024-08-31T04:40:43.063279+0000","last_fullsized":"2024-08-31T04:40:43.063279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:13.850189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067171050000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"48'1620","reported_seq":1704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.978440+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:40:56.978440+0000","last_peered":"2024-08-31T04:40:56.978440+0000","last_clean":"2024-08-31T04:40:56.978440+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:40:56.978440+0000","last_undegraded":"2024-08-31T04:40:56.978440+0000","last_fullsized":"2024-08-31T04:40:56.978440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":1668,"num_write_kb":75070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"48'2903","reported_seq":4558,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.810585+0000","last_change":"2024-08-31T04:10:27.630304+0000","last_active":"2024-08-31T04:43:41.810585+0000","last_peered":"2024-08-31T04:43:41.810585+0000","last_clean":"2024-08-31T04:43:41.810585+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:43:41.810585+0000","last_undegraded":"2024-08-31T04:43:41.810585+0000","last_fullsized":"2024-08-31T04:43:41.810585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:39.898341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059273310000000001,"stat_sum":{"num_bytes":26554957,"num_objects":1237,"num_object_clones":582,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":582,"num_read":132,"num_read_kb":127199,"num_write":2367,"num_write_kb":33368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"48'631","reported_seq":2729,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.971994+0000","last_change":"2024-08-31T04:10:27.801079+0000","last_active":"2024-08-31T04:40:56.971994+0000","last_peered":"2024-08-31T04:40:56.971994+0000","last_clean":"2024-08-31T04:40:56.971994+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:40:56.971994+0000","last_undegraded":"2024-08-31T04:40:56.971994+0000","last_fullsized":"2024-08-31T04:40:56.971994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:07.707273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055968709999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"48'1164","reported_seq":1248,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.931281+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:41:10.931281+0000","last_peered":"2024-08-31T04:41:10.931281+0000","last_clean":"2024-08-31T04:41:10.931281+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:41:10.931281+0000","last_undegraded":"2024-08-31T04:41:10.931281+0000","last_fullsized":"2024-08-31T04:41:10.931281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37753176,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":1208,"num_write_kb":91501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"48'2868","reported_seq":4560,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.821138+0000","last_change":"2024-08-31T04:10:27.642551+0000","last_active":"2024-08-31T04:43:41.821138+0000","last_peered":"2024-08-31T04:43:41.821138+0000","last_clean":"2024-08-31T04:43:41.821138+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:43:41.821138+0000","last_undegraded":"2024-08-31T04:43:41.821138+0000","last_fullsized":"2024-08-31T04:43:41.821138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:40.314782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013964779,"stat_sum":{"num_bytes":24232544,"num_objects":1215,"num_object_clones":563,"num_object_copies":4860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":563,"num_read":151,"num_read_kb":172254,"num_write":2354,"num_write_kb":29314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"48'600","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.967674+0000","last_change":"2024-08-31T04:10:27.800767+0000","last_active":"2024-08-31T04:40:51.967674+0000","last_peered":"2024-08-31T04:40:51.967674+0000","last_clean":"2024-08-31T04:40:51.967674+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:40:51.967674+0000","last_undegraded":"2024-08-31T04:40:51.967674+0000","last_fullsized":"2024-08-31T04:40:51.967674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:19.279530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052273500000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"48'547","reported_seq":631,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.928718+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:41:01.928718+0000","last_peered":"2024-08-31T04:41:01.928718+0000","last_clean":"2024-08-31T04:41:01.928718+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:41:01.928718+0000","last_undegraded":"2024-08-31T04:41:01.928718+0000","last_fullsized":"2024-08-31T04:41:01.928718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":607,"num_write_kb":87317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"48'2923","reported_seq":4623,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:37.318589+0000","last_change":"2024-08-31T04:10:27.681554+0000","last_active":"2024-08-31T04:43:37.318589+0000","last_peered":"2024-08-31T04:43:37.318589+0000","last_clean":"2024-08-31T04:43:37.318589+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:43:37.318589+0000","last_undegraded":"2024-08-31T04:43:37.318589+0000","last_fullsized":"2024-08-31T04:43:37.318589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2923,"log_dups_size":0,"ondisk_log_size":2923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:39:43.060510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065855360000000003,"stat_sum":{"num_bytes":30081699,"num_objects":1235,"num_object_clones":576,"num_object_copies":4940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1235,"num_whiteouts":576,"num_read":171,"num_read_kb":189059,"num_write":2389,"num_write_kb":43568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"48'612","reported_seq":2712,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.024856+0000","last_change":"2024-08-31T04:10:27.634646+0000","last_active":"2024-08-31T04:40:43.024856+0000","last_peered":"2024-08-31T04:40:43.024856+0000","last_clean":"2024-08-31T04:40:43.024856+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:40:43.024856+0000","last_undegraded":"2024-08-31T04:40:43.024856+0000","last_fullsized":"2024-08-31T04:40:43.024856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:43.424732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057184189999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"48'535","reported_seq":619,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.615251+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:40:56.615251+0000","last_peered":"2024-08-31T04:40:56.615251+0000","last_clean":"2024-08-31T04:40:56.615251+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:40:56.615251+0000","last_undegraded":"2024-08-31T04:40:56.615251+0000","last_fullsized":"2024-08-31T04:40:56.615251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971542,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":585,"num_write_kb":62565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"48'2832","reported_seq":4602,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.910403+0000","last_change":"2024-08-31T04:10:27.624180+0000","last_active":"2024-08-31T04:43:31.910403+0000","last_peered":"2024-08-31T04:43:31.910403+0000","last_clean":"2024-08-31T04:43:31.910403+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:43:31.910403+0000","last_undegraded":"2024-08-31T04:43:31.910403+0000","last_fullsized":"2024-08-31T04:43:31.910403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:14:38.588901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001644726,"stat_sum":{"num_bytes":45550886,"num_objects":1209,"num_object_clones":562,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":562,"num_read":227,"num_read_kb":373101,"num_write":2312,"num_write_kb":56902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"48'624","reported_seq":2727,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953246+0000","last_change":"2024-08-31T04:10:27.680074+0000","last_active":"2024-08-31T04:41:20.953246+0000","last_peered":"2024-08-31T04:41:20.953246+0000","last_clean":"2024-08-31T04:41:20.953246+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:41:20.953246+0000","last_undegraded":"2024-08-31T04:41:20.953246+0000","last_fullsized":"2024-08-31T04:41:20.953246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:52:30.799187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051653649999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":7,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"48'681","reported_seq":765,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.449539+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:41:20.449539+0000","last_peered":"2024-08-31T04:41:20.449539+0000","last_clean":"2024-08-31T04:41:20.449539+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:41:20.449539+0000","last_undegraded":"2024-08-31T04:41:20.449539+0000","last_fullsized":"2024-08-31T04:41:20.449539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":760,"num_write_kb":71301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"48'2735","reported_seq":4393,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.739755+0000","last_change":"2024-08-31T04:10:27.644231+0000","last_active":"2024-08-31T04:43:41.739755+0000","last_peered":"2024-08-31T04:43:41.739755+0000","last_clean":"2024-08-31T04:43:41.739755+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:43:41.739755+0000","last_undegraded":"2024-08-31T04:43:41.739755+0000","last_fullsized":"2024-08-31T04:43:41.739755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:17.265946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012604237000000001,"stat_sum":{"num_bytes":16809799,"num_objects":1152,"num_object_clones":538,"num_object_copies":4608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":538,"num_read":93,"num_read_kb":855,"num_write":2242,"num_write_kb":21215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"48'606","reported_seq":2704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.952763+0000","last_change":"2024-08-31T04:10:27.626377+0000","last_active":"2024-08-31T04:41:20.952763+0000","last_peered":"2024-08-31T04:41:20.952763+0000","last_clean":"2024-08-31T04:41:20.952763+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:41:20.952763+0000","last_undegraded":"2024-08-31T04:41:20.952763+0000","last_fullsized":"2024-08-31T04:41:20.952763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:54:33.315553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036328670000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":12,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"48'358","reported_seq":442,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.952862+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:41:20.952862+0000","last_peered":"2024-08-31T04:41:20.952862+0000","last_clean":"2024-08-31T04:41:20.952862+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:41:20.952862+0000","last_undegraded":"2024-08-31T04:41:20.952862+0000","last_fullsized":"2024-08-31T04:41:20.952862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":374,"num_write_kb":62134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"48'3078","reported_seq":4700,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.753103+0000","last_change":"2024-08-31T04:10:27.644984+0000","last_active":"2024-08-31T04:43:41.753103+0000","last_peered":"2024-08-31T04:43:41.753103+0000","last_clean":"2024-08-31T04:43:41.753103+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:43:41.753103+0000","last_undegraded":"2024-08-31T04:43:41.753103+0000","last_fullsized":"2024-08-31T04:43:41.753103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3078,"log_dups_size":0,"ondisk_log_size":3078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:59.996448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012777844,"stat_sum":{"num_bytes":35172120,"num_objects":1354,"num_object_clones":682,"num_object_copies":5416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1354,"num_whiteouts":594,"num_read":201,"num_read_kb":245482,"num_write":2432,"num_write_kb":44882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'605","reported_seq":2709,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953294+0000","last_change":"2024-08-31T04:10:27.682802+0000","last_active":"2024-08-31T04:41:20.953294+0000","last_peered":"2024-08-31T04:41:20.953294+0000","last_clean":"2024-08-31T04:41:20.953294+0000","last_became_active":"2024-08-31T04:04:41.425024+0000","last_became_peered":"2024-08-31T04:04:41.425024+0000","last_unstale":"2024-08-31T04:41:20.953294+0000","last_undegraded":"2024-08-31T04:41:20.953294+0000","last_fullsized":"2024-08-31T04:41:20.953294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:00.707504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006804175,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"48'514","reported_seq":598,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953275+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:41:20.953275+0000","last_peered":"2024-08-31T04:41:20.953275+0000","last_clean":"2024-08-31T04:41:20.953275+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:41:20.953275+0000","last_undegraded":"2024-08-31T04:41:20.953275+0000","last_fullsized":"2024-08-31T04:41:20.953275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":556,"num_write_kb":54279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"48'2880","reported_seq":4600,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.215076+0000","last_change":"2024-08-31T04:10:27.825912+0000","last_active":"2024-08-31T04:43:51.215076+0000","last_peered":"2024-08-31T04:43:51.215076+0000","last_clean":"2024-08-31T04:43:51.215076+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:43:51.215076+0000","last_undegraded":"2024-08-31T04:43:51.215076+0000","last_fullsized":"2024-08-31T04:43:51.215076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2880,"log_dups_size":0,"ondisk_log_size":2880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:02.879075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025415436,"stat_sum":{"num_bytes":43622224,"num_objects":1251,"num_object_clones":583,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1251,"num_whiteouts":583,"num_read":199,"num_read_kb":207126,"num_write":2328,"num_write_kb":56286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"48'585","reported_seq":2686,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.279324+0000","last_change":"2024-08-31T04:10:27.830297+0000","last_active":"2024-08-31T04:43:54.279324+0000","last_peered":"2024-08-31T04:43:54.279324+0000","last_clean":"2024-08-31T04:43:54.279324+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:43:54.279324+0000","last_undegraded":"2024-08-31T04:43:54.279324+0000","last_fullsized":"2024-08-31T04:43:54.279324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:11.469305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023919682000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"48'1257","reported_seq":1341,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:22.138550+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:41:22.138550+0000","last_peered":"2024-08-31T04:41:22.138550+0000","last_clean":"2024-08-31T04:41:22.138550+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:41:22.138550+0000","last_undegraded":"2024-08-31T04:41:22.138550+0000","last_fullsized":"2024-08-31T04:41:22.138550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1306,"num_write_kb":67222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"48'2891","reported_seq":4581,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.953320+0000","last_change":"2024-08-31T04:10:27.683052+0000","last_active":"2024-08-31T04:43:31.953320+0000","last_peered":"2024-08-31T04:43:31.953320+0000","last_clean":"2024-08-31T04:43:31.953320+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:43:31.953320+0000","last_undegraded":"2024-08-31T04:43:31.953320+0000","last_fullsized":"2024-08-31T04:43:31.953320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.116451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069575569999999996,"stat_sum":{"num_bytes":34789039,"num_objects":1260,"num_object_clones":583,"num_object_copies":5040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1260,"num_whiteouts":583,"num_read":170,"num_read_kb":170411,"num_write":2360,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"48'603","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.051596+0000","last_change":"2024-08-31T04:10:27.799884+0000","last_active":"2024-08-31T04:40:43.051596+0000","last_peered":"2024-08-31T04:40:43.051596+0000","last_clean":"2024-08-31T04:40:43.051596+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:40:43.051596+0000","last_undegraded":"2024-08-31T04:40:43.051596+0000","last_fullsized":"2024-08-31T04:40:43.051596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:43.034574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047916210000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"48'1156","reported_seq":1240,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:46.484670+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:43:46.484670+0000","last_peered":"2024-08-31T04:43:46.484670+0000","last_clean":"2024-08-31T04:43:46.484670+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:43:46.484670+0000","last_undegraded":"2024-08-31T04:43:46.484670+0000","last_fullsized":"2024-08-31T04:43:46.484670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1156,"log_dups_size":0,"ondisk_log_size":1156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555104,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1203,"num_write_kb":103869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"48'2948","reported_seq":4614,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.831104+0000","last_change":"2024-08-31T04:10:27.802246+0000","last_active":"2024-08-31T04:43:41.831104+0000","last_peered":"2024-08-31T04:43:41.831104+0000","last_clean":"2024-08-31T04:43:41.831104+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:43:41.831104+0000","last_undegraded":"2024-08-31T04:43:41.831104+0000","last_fullsized":"2024-08-31T04:43:41.831104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2948,"log_dups_size":0,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:12:15.664092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046964119999999996,"stat_sum":{"num_bytes":37035283,"num_objects":1250,"num_object_clones":626,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":538,"num_read":188,"num_read_kb":159531,"num_write":2363,"num_write_kb":48541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"48'617","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:25.953944+0000","last_change":"2024-08-31T04:10:27.682269+0000","last_active":"2024-08-31T04:41:25.953944+0000","last_peered":"2024-08-31T04:41:25.953944+0000","last_clean":"2024-08-31T04:41:25.953944+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:41:25.953944+0000","last_undegraded":"2024-08-31T04:41:25.953944+0000","last_fullsized":"2024-08-31T04:41:25.953944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:25.121383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006690306,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"48'1380","reported_seq":1463,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:57.021975+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:40:57.021975+0000","last_peered":"2024-08-31T04:40:57.021975+0000","last_clean":"2024-08-31T04:40:57.021975+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:40:57.021975+0000","last_undegraded":"2024-08-31T04:40:57.021975+0000","last_fullsized":"2024-08-31T04:40:57.021975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1380,"log_dups_size":0,"ondisk_log_size":1380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554522,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1433,"num_write_kb":71604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"48'2822","reported_seq":4502,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.815516+0000","last_change":"2024-08-31T04:10:27.633146+0000","last_active":"2024-08-31T04:43:41.815516+0000","last_peered":"2024-08-31T04:43:41.815516+0000","last_clean":"2024-08-31T04:43:41.815516+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:43:41.815516+0000","last_undegraded":"2024-08-31T04:43:41.815516+0000","last_fullsized":"2024-08-31T04:43:41.815516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2822,"log_dups_size":0,"ondisk_log_size":2822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:44.513348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060660929999999998,"stat_sum":{"num_bytes":30139631,"num_objects":1254,"num_object_clones":586,"num_object_copies":5016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1254,"num_whiteouts":586,"num_read":162,"num_read_kb":134523,"num_write":2263,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"48'602","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315538+0000","last_change":"2024-08-31T04:10:27.646230+0000","last_active":"2024-08-31T04:43:54.315538+0000","last_peered":"2024-08-31T04:43:54.315538+0000","last_clean":"2024-08-31T04:43:54.315538+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:43:54.315538+0000","last_undegraded":"2024-08-31T04:43:54.315538+0000","last_fullsized":"2024-08-31T04:43:54.315538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:50.268225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012319801999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"48'1612","reported_seq":1695,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.961246+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:40:51.961246+0000","last_peered":"2024-08-31T04:40:51.961246+0000","last_clean":"2024-08-31T04:40:51.961246+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:40:51.961246+0000","last_undegraded":"2024-08-31T04:40:51.961246+0000","last_fullsized":"2024-08-31T04:40:51.961246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1665,"num_write_kb":95716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"48'2860","reported_seq":4648,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:47.167374+0000","last_change":"2024-08-31T04:10:27.670280+0000","last_active":"2024-08-31T04:43:47.167374+0000","last_peered":"2024-08-31T04:43:47.167374+0000","last_clean":"2024-08-31T04:43:47.167374+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:43:47.167374+0000","last_undegraded":"2024-08-31T04:43:47.167374+0000","last_fullsized":"2024-08-31T04:43:47.167374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:45.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006760248,"stat_sum":{"num_bytes":54090295,"num_objects":1208,"num_object_clones":563,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":563,"num_read":248,"num_read_kb":382949,"num_write":2323,"num_write_kb":60670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"48'606","reported_seq":2705,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.981507+0000","last_change":"2024-08-31T04:10:27.634493+0000","last_active":"2024-08-31T04:40:56.981507+0000","last_peered":"2024-08-31T04:40:56.981507+0000","last_clean":"2024-08-31T04:40:56.981507+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:40:56.981507+0000","last_undegraded":"2024-08-31T04:40:56.981507+0000","last_fullsized":"2024-08-31T04:40:56.981507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:55:26.933384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058567369999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":10,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"48'954","reported_seq":1208,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:57.015780+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:40:57.015780+0000","last_peered":"2024-08-31T04:40:57.015780+0000","last_clean":"2024-08-31T04:40:57.015780+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:40:57.015780+0000","last_undegraded":"2024-08-31T04:40:57.015780+0000","last_fullsized":"2024-08-31T04:40:57.015780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21620066,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":215,"num_read_kb":746,"num_write":1006,"num_write_kb":67606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"48'2946","reported_seq":4665,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.798172+0000","last_change":"2024-08-31T04:10:27.822236+0000","last_active":"2024-08-31T04:43:41.798172+0000","last_peered":"2024-08-31T04:43:41.798172+0000","last_clean":"2024-08-31T04:43:41.798172+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:43:41.798172+0000","last_undegraded":"2024-08-31T04:43:41.798172+0000","last_fullsized":"2024-08-31T04:43:41.798172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:33.068422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017565338,"stat_sum":{"num_bytes":42002217,"num_objects":1219,"num_object_clones":563,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1219,"num_whiteouts":563,"num_read":178,"num_read_kb":306206,"num_write":2428,"num_write_kb":54614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"48'2738","reported_seq":4469,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.742397+0000","last_change":"2024-08-31T04:10:27.822515+0000","last_active":"2024-08-31T04:43:41.742397+0000","last_peered":"2024-08-31T04:43:41.742397+0000","last_clean":"2024-08-31T04:43:41.742397+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:43:41.742397+0000","last_undegraded":"2024-08-31T04:43:41.742397+0000","last_fullsized":"2024-08-31T04:43:41.742397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2738,"log_dups_size":0,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:20.225606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017721323000000001,"stat_sum":{"num_bytes":29550305,"num_objects":1162,"num_object_clones":544,"num_object_copies":4648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":544,"num_read":169,"num_read_kb":167515,"num_write":2228,"num_write_kb":37428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"48'591","reported_seq":2694,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.996085+0000","last_change":"2024-08-31T04:10:27.823888+0000","last_active":"2024-08-31T04:40:51.996085+0000","last_peered":"2024-08-31T04:40:51.996085+0000","last_clean":"2024-08-31T04:40:51.996085+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:40:51.996085+0000","last_undegraded":"2024-08-31T04:40:51.996085+0000","last_fullsized":"2024-08-31T04:40:51.996085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:08:01.933323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018675580000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"48'1868","reported_seq":1951,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.980531+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:41:10.980531+0000","last_peered":"2024-08-31T04:41:10.980531+0000","last_clean":"2024-08-31T04:41:10.980531+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:41:10.980531+0000","last_undegraded":"2024-08-31T04:41:10.980531+0000","last_fullsized":"2024-08-31T04:41:10.980531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1868,"log_dups_size":0,"ondisk_log_size":1868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1929,"num_write_kb":92217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"48'2766","reported_seq":4481,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.955819+0000","last_change":"2024-08-31T04:10:27.800227+0000","last_active":"2024-08-31T04:43:31.955819+0000","last_peered":"2024-08-31T04:43:31.955819+0000","last_clean":"2024-08-31T04:43:31.955819+0000","last_became_active":"2024-08-31T04:04:41.417946+0000","last_became_peered":"2024-08-31T04:04:41.417946+0000","last_unstale":"2024-08-31T04:43:31.955819+0000","last_undegraded":"2024-08-31T04:43:31.955819+0000","last_fullsized":"2024-08-31T04:43:31.955819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:41:51.661343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00503113,"stat_sum":{"num_bytes":35643591,"num_objects":1177,"num_object_clones":542,"num_object_copies":4708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1177,"num_whiteouts":542,"num_read":158,"num_read_kb":132473,"num_write":2281,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'704","reported_seq":2801,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.317201+0000","last_change":"2024-08-31T04:10:27.641968+0000","last_active":"2024-08-31T04:43:54.317201+0000","last_peered":"2024-08-31T04:43:54.317201+0000","last_clean":"2024-08-31T04:43:54.317201+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:43:54.317201+0000","last_undegraded":"2024-08-31T04:43:54.317201+0000","last_fullsized":"2024-08-31T04:43:54.317201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:11.260535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014046813,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"48'645","reported_seq":728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.924988+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:41:01.924988+0000","last_peered":"2024-08-31T04:41:01.924988+0000","last_clean":"2024-08-31T04:41:01.924988+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:41:01.924988+0000","last_undegraded":"2024-08-31T04:41:01.924988+0000","last_fullsized":"2024-08-31T04:41:01.924988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":715,"num_write_kb":62992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"48'2252","reported_seq":2334,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.602123+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:40:43.602123+0000","last_peered":"2024-08-31T04:40:43.602123+0000","last_clean":"2024-08-31T04:40:43.602123+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:40:43.602123+0000","last_undegraded":"2024-08-31T04:40:43.602123+0000","last_fullsized":"2024-08-31T04:40:43.602123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2298,"num_write_kb":79805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'604","reported_seq":2701,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.096310+0000","last_change":"2024-08-31T04:10:27.814455+0000","last_active":"2024-08-31T04:40:43.096310+0000","last_peered":"2024-08-31T04:40:43.096310+0000","last_clean":"2024-08-31T04:40:43.096310+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:40:43.096310+0000","last_undegraded":"2024-08-31T04:40:43.096310+0000","last_fullsized":"2024-08-31T04:40:43.096310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:14.250771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013275207000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":11,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"48'2940","reported_seq":4625,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.843891+0000","last_change":"2024-08-31T04:10:27.821490+0000","last_active":"2024-08-31T04:43:41.843891+0000","last_peered":"2024-08-31T04:43:41.843891+0000","last_clean":"2024-08-31T04:43:41.843891+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:43:41.843891+0000","last_undegraded":"2024-08-31T04:43:41.843891+0000","last_fullsized":"2024-08-31T04:43:41.843891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2940,"log_dups_size":0,"ondisk_log_size":2940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:50.331472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016882483,"stat_sum":{"num_bytes":22283462,"num_objects":1259,"num_object_clones":585,"num_object_copies":5036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1259,"num_whiteouts":585,"num_read":168,"num_read_kb":61698,"num_write":2408,"num_write_kb":31485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"48'1130","reported_seq":1212,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.973278+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:41:01.973278+0000","last_peered":"2024-08-31T04:41:01.973278+0000","last_clean":"2024-08-31T04:41:01.973278+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:41:01.973278+0000","last_undegraded":"2024-08-31T04:41:01.973278+0000","last_fullsized":"2024-08-31T04:41:01.973278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1166,"num_write_kb":91251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"48'627","reported_seq":2724,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.107384+0000","last_change":"2024-08-31T04:10:27.627749+0000","last_active":"2024-08-31T04:40:43.107384+0000","last_peered":"2024-08-31T04:40:43.107384+0000","last_clean":"2024-08-31T04:40:43.107384+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:40:43.107384+0000","last_undegraded":"2024-08-31T04:40:43.107384+0000","last_fullsized":"2024-08-31T04:40:43.107384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:05.454693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038995560000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"48'2848","reported_seq":4571,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.786083+0000","last_change":"2024-08-31T04:10:27.669930+0000","last_active":"2024-08-31T04:43:41.786083+0000","last_peered":"2024-08-31T04:43:41.786083+0000","last_clean":"2024-08-31T04:43:41.786083+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:43:41.786083+0000","last_undegraded":"2024-08-31T04:43:41.786083+0000","last_fullsized":"2024-08-31T04:43:41.786083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:44.356566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065935439999999998,"stat_sum":{"num_bytes":37885613,"num_objects":1228,"num_object_clones":569,"num_object_copies":4912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1228,"num_whiteouts":569,"num_read":190,"num_read_kb":257974,"num_write":2324,"num_write_kb":54067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"48'628","reported_seq":2725,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954633+0000","last_change":"2024-08-31T04:10:27.632258+0000","last_active":"2024-08-31T04:41:30.954633+0000","last_peered":"2024-08-31T04:41:30.954633+0000","last_clean":"2024-08-31T04:41:30.954633+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:41:30.954633+0000","last_undegraded":"2024-08-31T04:41:30.954633+0000","last_fullsized":"2024-08-31T04:41:30.954633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:17:04.382806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078040410000000003,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":15,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"48'646","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:32.140522+0000","last_change":"2024-08-31T04:10:27.668912+0000","last_active":"2024-08-31T04:41:32.140522+0000","last_peered":"2024-08-31T04:41:32.140522+0000","last_clean":"2024-08-31T04:41:32.140522+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:41:32.140522+0000","last_undegraded":"2024-08-31T04:41:32.140522+0000","last_fullsized":"2024-08-31T04:41:32.140522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:32.767357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060576730000000004,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":9,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"48'618","reported_seq":2722,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954479+0000","last_change":"2024-08-31T04:10:27.682416+0000","last_active":"2024-08-31T04:41:30.954479+0000","last_peered":"2024-08-31T04:41:30.954479+0000","last_clean":"2024-08-31T04:41:30.954479+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:41:30.954479+0000","last_undegraded":"2024-08-31T04:41:30.954479+0000","last_fullsized":"2024-08-31T04:41:30.954479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:37.569659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067294099999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":8,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"48'662","reported_seq":2760,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.307324+0000","last_change":"2024-08-31T04:10:27.643926+0000","last_active":"2024-08-31T04:43:54.307324+0000","last_peered":"2024-08-31T04:43:54.307324+0000","last_clean":"2024-08-31T04:43:54.307324+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:43:54.307324+0000","last_undegraded":"2024-08-31T04:43:54.307324+0000","last_fullsized":"2024-08-31T04:43:54.307324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:22:41.496309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01443145,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"48'614","reported_seq":2713,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.282781+0000","last_change":"2024-08-31T04:10:27.827546+0000","last_active":"2024-08-31T04:43:54.282781+0000","last_peered":"2024-08-31T04:43:54.282781+0000","last_clean":"2024-08-31T04:43:54.282781+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:43:54.282781+0000","last_undegraded":"2024-08-31T04:43:54.282781+0000","last_fullsized":"2024-08-31T04:43:54.282781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:51.784003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024833572000000002,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'595","reported_seq":2699,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.276230+0000","last_change":"2024-08-31T04:10:27.824141+0000","last_active":"2024-08-31T04:43:54.276230+0000","last_peered":"2024-08-31T04:43:54.276230+0000","last_clean":"2024-08-31T04:43:54.276230+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:43:54.276230+0000","last_undegraded":"2024-08-31T04:43:54.276230+0000","last_fullsized":"2024-08-31T04:43:54.276230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:33:51.196460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024839776000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"48'636","reported_seq":2739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.981571+0000","last_change":"2024-08-31T04:10:27.634372+0000","last_active":"2024-08-31T04:40:56.981571+0000","last_peered":"2024-08-31T04:40:56.981571+0000","last_clean":"2024-08-31T04:40:56.981571+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:40:56.981571+0000","last_undegraded":"2024-08-31T04:40:56.981571+0000","last_fullsized":"2024-08-31T04:40:56.981571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:59.694688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060308059999999997,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"48'593","reported_seq":2698,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.307572+0000","last_change":"2024-08-31T04:10:27.644765+0000","last_active":"2024-08-31T04:43:54.307572+0000","last_peered":"2024-08-31T04:43:54.307572+0000","last_clean":"2024-08-31T04:43:54.307572+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:43:54.307572+0000","last_undegraded":"2024-08-31T04:43:54.307572+0000","last_fullsized":"2024-08-31T04:43:54.307572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:50.112615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012931465,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":6,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"48'617","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:55.950214+0000","last_change":"2024-08-31T04:10:27.681657+0000","last_active":"2024-08-31T04:40:55.950214+0000","last_peered":"2024-08-31T04:40:55.950214+0000","last_clean":"2024-08-31T04:40:55.950214+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:40:55.950214+0000","last_undegraded":"2024-08-31T04:40:55.950214+0000","last_fullsized":"2024-08-31T04:40:55.950214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:16.233374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062469689999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"48'592","reported_seq":2696,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.314417+0000","last_change":"2024-08-31T04:10:27.638483+0000","last_active":"2024-08-31T04:43:54.314417+0000","last_peered":"2024-08-31T04:43:54.314417+0000","last_clean":"2024-08-31T04:43:54.314417+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:43:54.314417+0000","last_undegraded":"2024-08-31T04:43:54.314417+0000","last_fullsized":"2024-08-31T04:43:54.314417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:09.181389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011311599,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"48'641","reported_seq":2739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:39.009032+0000","last_change":"2024-08-31T04:10:27.626932+0000","last_active":"2024-08-31T04:40:39.009032+0000","last_peered":"2024-08-31T04:40:39.009032+0000","last_clean":"2024-08-31T04:40:39.009032+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:40:39.009032+0000","last_undegraded":"2024-08-31T04:40:39.009032+0000","last_fullsized":"2024-08-31T04:40:39.009032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:29.687132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035095819999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"48'602","reported_seq":2704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.096155+0000","last_change":"2024-08-31T04:10:27.806718+0000","last_active":"2024-08-31T04:40:43.096155+0000","last_peered":"2024-08-31T04:40:43.096155+0000","last_clean":"2024-08-31T04:40:43.096155+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:40:43.096155+0000","last_undegraded":"2024-08-31T04:40:43.096155+0000","last_fullsized":"2024-08-31T04:40:43.096155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:40.726314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055677180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"48'635","reported_seq":2733,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:38.729639+0000","last_change":"2024-08-31T04:10:27.799928+0000","last_active":"2024-08-31T04:40:38.729639+0000","last_peered":"2024-08-31T04:40:38.729639+0000","last_clean":"2024-08-31T04:40:38.729639+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:40:38.729639+0000","last_undegraded":"2024-08-31T04:40:38.729639+0000","last_fullsized":"2024-08-31T04:40:38.729639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:49.971542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047976060000000003,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"48'637","reported_seq":2737,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:38.731595+0000","last_change":"2024-08-31T04:10:27.683751+0000","last_active":"2024-08-31T04:40:38.731595+0000","last_peered":"2024-08-31T04:40:38.731595+0000","last_clean":"2024-08-31T04:40:38.731595+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:40:38.731595+0000","last_undegraded":"2024-08-31T04:40:38.731595+0000","last_fullsized":"2024-08-31T04:40:38.731595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:15:51.447225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066178469999999996,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"48'584","reported_seq":2683,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:22.138621+0000","last_change":"2024-08-31T04:10:27.671492+0000","last_active":"2024-08-31T04:41:22.138621+0000","last_peered":"2024-08-31T04:41:22.138621+0000","last_clean":"2024-08-31T04:41:22.138621+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:41:22.138621+0000","last_undegraded":"2024-08-31T04:41:22.138621+0000","last_fullsized":"2024-08-31T04:41:22.138621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:08:25.848770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050893520000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"48'629","reported_seq":2733,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953329+0000","last_change":"2024-08-31T04:10:27.683243+0000","last_active":"2024-08-31T04:41:20.953329+0000","last_peered":"2024-08-31T04:41:20.953329+0000","last_clean":"2024-08-31T04:41:20.953329+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:41:20.953329+0000","last_undegraded":"2024-08-31T04:41:20.953329+0000","last_fullsized":"2024-08-31T04:41:20.953329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:05:34.589760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068720639999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":6,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"48'604","reported_seq":2707,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953215+0000","last_change":"2024-08-31T04:10:27.680920+0000","last_active":"2024-08-31T04:41:20.953215+0000","last_peered":"2024-08-31T04:41:20.953215+0000","last_clean":"2024-08-31T04:41:20.953215+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:41:20.953215+0000","last_undegraded":"2024-08-31T04:41:20.953215+0000","last_fullsized":"2024-08-31T04:41:20.953215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:22.809894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059141749999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":7,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"48'651","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.308059+0000","last_change":"2024-08-31T04:10:27.636678+0000","last_active":"2024-08-31T04:43:54.308059+0000","last_peered":"2024-08-31T04:43:54.308059+0000","last_clean":"2024-08-31T04:43:54.308059+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:43:54.308059+0000","last_undegraded":"2024-08-31T04:43:54.308059+0000","last_fullsized":"2024-08-31T04:43:54.308059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:48:32.668716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098583990000000003,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"48'622","reported_seq":2720,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.290857+0000","last_change":"2024-08-31T04:10:27.829545+0000","last_active":"2024-08-31T04:43:54.290857+0000","last_peered":"2024-08-31T04:43:54.290857+0000","last_clean":"2024-08-31T04:43:54.290857+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:43:54.290857+0000","last_undegraded":"2024-08-31T04:43:54.290857+0000","last_fullsized":"2024-08-31T04:43:54.290857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:56:41.550447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023950035000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":12,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"48'599","reported_seq":2699,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.281814+0000","last_change":"2024-08-31T04:10:27.827114+0000","last_active":"2024-08-31T04:43:54.281814+0000","last_peered":"2024-08-31T04:43:54.281814+0000","last_clean":"2024-08-31T04:43:54.281814+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:43:54.281814+0000","last_undegraded":"2024-08-31T04:43:54.281814+0000","last_fullsized":"2024-08-31T04:43:54.281814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:28.164149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025118893999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'592","reported_seq":2693,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.033771+0000","last_change":"2024-08-31T04:10:27.800501+0000","last_active":"2024-08-31T04:40:43.033771+0000","last_peered":"2024-08-31T04:40:43.033771+0000","last_clean":"2024-08-31T04:40:43.033771+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:40:43.033771+0000","last_undegraded":"2024-08-31T04:40:43.033771+0000","last_fullsized":"2024-08-31T04:40:43.033771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:19.639843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051269660000000002,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"48'621","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:39.022887+0000","last_change":"2024-08-31T04:10:27.799550+0000","last_active":"2024-08-31T04:40:39.022887+0000","last_peered":"2024-08-31T04:40:39.022887+0000","last_clean":"2024-08-31T04:40:39.022887+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:40:39.022887+0000","last_undegraded":"2024-08-31T04:40:39.022887+0000","last_fullsized":"2024-08-31T04:40:39.022887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:56:52.315777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045307300000000002,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"48'570","reported_seq":2668,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:39.013045+0000","last_change":"2024-08-31T04:10:27.801153+0000","last_active":"2024-08-31T04:40:39.013045+0000","last_peered":"2024-08-31T04:40:39.013045+0000","last_clean":"2024-08-31T04:40:39.013045+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:40:39.013045+0000","last_undegraded":"2024-08-31T04:40:39.013045+0000","last_fullsized":"2024-08-31T04:40:39.013045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:49:14.674631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053663419999999996,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"48'620","reported_seq":2719,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.053543+0000","last_change":"2024-08-31T04:10:27.627028+0000","last_active":"2024-08-31T04:40:43.053543+0000","last_peered":"2024-08-31T04:40:43.053543+0000","last_clean":"2024-08-31T04:40:43.053543+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:40:43.053543+0000","last_undegraded":"2024-08-31T04:40:43.053543+0000","last_fullsized":"2024-08-31T04:40:43.053543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:14:52.550351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003298704,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"48'581","reported_seq":2681,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.317590+0000","last_change":"2024-08-31T04:10:27.635962+0000","last_active":"2024-08-31T04:43:54.317590+0000","last_peered":"2024-08-31T04:43:54.317590+0000","last_clean":"2024-08-31T04:43:54.317590+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:43:54.317590+0000","last_undegraded":"2024-08-31T04:43:54.317590+0000","last_fullsized":"2024-08-31T04:43:54.317590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:43:12.087921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0091212849999999998,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'607","reported_seq":2703,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.052964+0000","last_change":"2024-08-31T04:10:27.796436+0000","last_active":"2024-08-31T04:40:43.052964+0000","last_peered":"2024-08-31T04:40:43.052964+0000","last_clean":"2024-08-31T04:40:43.052964+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:40:43.052964+0000","last_undegraded":"2024-08-31T04:40:43.052964+0000","last_fullsized":"2024-08-31T04:40:43.052964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:45.563958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020846939999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"48'587","reported_seq":2682,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.976350+0000","last_change":"2024-08-31T04:10:27.632700+0000","last_active":"2024-08-31T04:40:56.976350+0000","last_peered":"2024-08-31T04:40:56.976350+0000","last_clean":"2024-08-31T04:40:56.976350+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:40:56.976350+0000","last_undegraded":"2024-08-31T04:40:56.976350+0000","last_fullsized":"2024-08-31T04:40:56.976350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:47.487017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079797440000000004,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":13,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"48'662","reported_seq":2751,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.108705+0000","last_change":"2024-08-31T04:10:27.799557+0000","last_active":"2024-08-31T04:40:43.108705+0000","last_peered":"2024-08-31T04:40:43.108705+0000","last_clean":"2024-08-31T04:40:43.108705+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:40:43.108705+0000","last_undegraded":"2024-08-31T04:40:43.108705+0000","last_fullsized":"2024-08-31T04:40:43.108705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:41.279910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047669089999999997,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":19,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":19,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"48'616","reported_seq":2723,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.052569+0000","last_change":"2024-08-31T04:10:27.633848+0000","last_active":"2024-08-31T04:40:43.052569+0000","last_peered":"2024-08-31T04:40:43.052569+0000","last_clean":"2024-08-31T04:40:43.052569+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:40:43.052569+0000","last_undegraded":"2024-08-31T04:40:43.052569+0000","last_fullsized":"2024-08-31T04:40:43.052569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:19:00.071541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063128230000000004,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":5,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":5,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"48'624","reported_seq":2726,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.304567+0000","last_change":"2024-08-31T04:10:27.643240+0000","last_active":"2024-08-31T04:43:54.304567+0000","last_peered":"2024-08-31T04:43:54.304567+0000","last_clean":"2024-08-31T04:43:54.304567+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:43:54.304567+0000","last_undegraded":"2024-08-31T04:43:54.304567+0000","last_fullsized":"2024-08-31T04:43:54.304567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:28:05.502942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013845079999999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"48'584","reported_seq":2687,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.304120+0000","last_change":"2024-08-31T04:10:27.645944+0000","last_active":"2024-08-31T04:43:54.304120+0000","last_peered":"2024-08-31T04:43:54.304120+0000","last_clean":"2024-08-31T04:43:54.304120+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:43:54.304120+0000","last_undegraded":"2024-08-31T04:43:54.304120+0000","last_fullsized":"2024-08-31T04:43:54.304120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:47:36.656806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012861716,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"48'593","reported_seq":2690,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954204+0000","last_change":"2024-08-31T04:10:27.800212+0000","last_active":"2024-08-31T04:41:30.954204+0000","last_peered":"2024-08-31T04:41:30.954204+0000","last_clean":"2024-08-31T04:41:30.954204+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:41:30.954204+0000","last_undegraded":"2024-08-31T04:41:30.954204+0000","last_fullsized":"2024-08-31T04:41:30.954204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:06.926644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048876299999999996,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1171046334,"num_objects":39264,"num_object_clones":18317,"num_object_copies":157056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39264,"num_whiteouts":18141,"num_read":5740,"num_read_kb":6745896,"num_write":75481,"num_write_kb":1474785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2548367360,"data_stored":2549710848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92337,"ondisk_log_size":92337,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":2792,"num_object_clones":669,"num_object_copies":5584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2792,"num_whiteouts":669,"num_read":0,"num_read_kb":0,"num_write":2800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39272,"ondisk_log_size":39272,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":830791811,"num_objects":1713,"num_object_clones":0,"num_object_copies":3426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1713,"num_whiteouts":0,"num_read":2588,"num_read_kb":5535,"num_write":35390,"num_write_kb":2443309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1661648896,"data_stored":1661583622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31617,"ondisk_log_size":31617,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477220,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":996976,"kb_used_data":627232,"kb_used_omap":1,"kb_used_meta":369726,"kb_avail":93374864,"statfs":{"total":96636764160,"available":95615860736,"internally_reserved":0,"allocated":642285568,"data_stored":642183134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":378599879},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477220,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":638272,"kb_used_data":418288,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93733568,"statfs":{"total":96636764160,"available":95983173632,"internally_reserved":0,"allocated":428326912,"data_stored":428055527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477221,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":857192,"kb_used_data":569176,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93514648,"statfs":{"total":96636764160,"available":95758999552,"internally_reserved":0,"allocated":582836224,"data_stored":582730273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477221,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":813360,"kb_used_data":525408,"kb_used_omap":1,"kb_used_meta":287934,"kb_avail":93558480,"statfs":{"total":96636764160,"available":95803883520,"internally_reserved":0,"allocated":538017792,"data_stored":537913727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294844869},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509924,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":692036,"kb_used_data":458228,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":93679804,"statfs":{"total":96636764160,"available":95928119296,"internally_reserved":0,"allocated":469225472,"data_stored":469129543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239401414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509925,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757676,"kb_used_data":487772,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":93614164,"statfs":{"total":96636764160,"available":95860903936,"internally_reserved":0,"allocated":499478528,"data_stored":499539157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509923,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":811432,"kb_used_data":549848,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":93560408,"statfs":{"total":96636764160,"available":95805857792,"internally_reserved":0,"allocated":563044352,"data_stored":563095610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267844037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575332,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":754968,"kb_used_data":480840,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93616872,"statfs":{"total":96636764160,"available":95863676928,"internally_reserved":0,"allocated":492380160,"data_stored":492108227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":314580992,"data_stored":314572856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":201986048,"data_stored":201979578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":113254400,"data_stored":113246880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":284884992,"data_stored":284878487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":243605504,"data_stored":243584755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":226504704,"data_stored":226496878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":138412032,"data_stored":138412032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":138420224,"data_stored":138412156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":222887936,"data_stored":223055872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":379707392,"data_stored":379875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":314523648,"data_stored":314523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":356851712,"data_stored":357019648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":318889984,"data_stored":319225856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":271831040,"data_stored":272166912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":330264576,"data_stored":330432512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":353411072,"data_stored":353411072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:43:55.456 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:43:55.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.639+0000 7fa0fba00640 1 -- 172.21.15.89:0/2470251280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0d8004810 msgr2=0x7fa0d8004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.639+0000 7fa0fba00640 1 --2- 172.21.15.89:0/2470251280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0d8004810 0x7fa0d8004c60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00017d0 tx=0x7fa0e001f000 comp rx=0 tx=0).stop 2024-08-31T04:43:55.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.639+0000 7fa0f9a00640 1 -- 172.21.15.89:0/2470251280 reap_dead start 2024-08-31T04:43:55.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.639+0000 7fa0fba00640 1 -- 172.21.15.89:0/2470251280 shutdown_connections 2024-08-31T04:43:55.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.639+0000 7fa0fba00640 1 -- 172.21.15.89:0/2470251280 >> 172.21.15.89:0/2470251280 conn(0x7fa0f40ccf20 msgr2=0x7fa0f40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:55.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.639+0000 7fa0fba00640 1 -- 172.21.15.89:0/2470251280 shutdown_connections 2024-08-31T04:43:55.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.639+0000 7fa0fba00640 1 -- 172.21.15.89:0/2470251280 wait complete. 2024-08-31T04:43:55.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 Processor -- start 2024-08-31T04:43:55.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 -- start start 2024-08-31T04:43:55.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0d8004810 0x7fa0f40c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f40c4ba0 0x7fa0f40cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0f41478c0 0x7fa0f4147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f40c2650 con 0x7fa0f41478c0 2024-08-31T04:43:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f40c4040 con 0x7fa0f40c4ba0 2024-08-31T04:43:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f40c27d0 con 0x7fa0d8004810 2024-08-31T04:43:55.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0f41478c0 0x7fa0f4147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0f41478c0 0x7fa0f4147cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49486/0 (socket says 172.21.15.89:49486) 2024-08-31T04:43:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9a00640 1 -- 172.21.15.89:0/33145756 learned_addr learned my addr 172.21.15.89:0/33145756 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9000640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0d8004810 0x7fa0f40c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f3e00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f40c4ba0 0x7fa0f40cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9a00640 1 -- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0d8004810 msgr2=0x7fa0f40c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9a00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0d8004810 0x7fa0f40c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9a00640 1 -- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f40c4ba0 msgr2=0x7fa0f40cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9a00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f40c4ba0 0x7fa0f40cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9a00640 1 -- 172.21.15.89:0/33145756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f4153550 con 0x7fa0f41478c0 2024-08-31T04:43:55.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9000640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0d8004810 0x7fa0f40c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:55.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f9a00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0f41478c0 0x7fa0f4147cd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4070ff0 tx=0x7fa0ec00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:55.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f0c00640 1 -- 172.21.15.89:0/33145756 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec003980 con 0x7fa0f41478c0 2024-08-31T04:43:55.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f0c00640 1 -- 172.21.15.89:0/33145756 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0ec003b20 con 0x7fa0f41478c0 2024-08-31T04:43:55.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0f0c00640 1 -- 172.21.15.89:0/33145756 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec004030 con 0x7fa0f41478c0 2024-08-31T04:43:55.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f4153830 con 0x7fa0f41478c0 2024-08-31T04:43:55.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.643+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f4152da0 con 0x7fa0f41478c0 2024-08-31T04:43:55.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.647+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f4158800 con 0x7fa0f41478c0 2024-08-31T04:43:55.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.647+0000 7fa0f0c00640 1 -- 172.21.15.89:0/33145756 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa0ec0041d0 con 0x7fa0f41478c0 2024-08-31T04:43:55.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.647+0000 7fa0f0c00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0d40720f0 0x7fa0d4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:55.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.647+0000 7fa0f0c00640 1 -- 172.21.15.89:0/33145756 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa0ec0936c0 con 0x7fa0f41478c0 2024-08-31T04:43:55.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.647+0000 7fa0f9000640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0d40720f0 0x7fa0d4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:55.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.647+0000 7fa0f9000640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0d40720f0 0x7fa0d4074600 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4072820 tx=0x7fa0e40015d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:55.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.651+0000 7fa0f0c00640 1 -- 172.21.15.89:0/33145756 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa0ec05e5e0 con 0x7fa0f41478c0 2024-08-31T04:43:55.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.815+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0f41557f0 con 0x7fa0d40720f0 2024-08-31T04:43:55.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.831+0000 7fa0f0c00640 1 -- 172.21.15.89:0/33145756 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+338116 (secure 0 0 0) 0x7fa0f41557f0 con 0x7fa0d40720f0 2024-08-31T04:43:55.836 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:43:55.838 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:43:55.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0d40720f0 msgr2=0x7fa0d4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0d40720f0 0x7fa0d4074600 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4072820 tx=0x7fa0e40015d0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0f41478c0 msgr2=0x7fa0f4147cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:55.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0f41478c0 0x7fa0f4147cd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4070ff0 tx=0x7fa0ec00d7b0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 shutdown_connections 2024-08-31T04:43:55.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa0d40720f0 0x7fa0d4074600 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0f41478c0 0x7fa0f4147cd0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f40c4ba0 0x7fa0f40cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 --2- 172.21.15.89:0/33145756 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0d8004810 0x7fa0f40c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:55.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 >> 172.21.15.89:0/33145756 conn(0x7fa0f40ccf20 msgr2=0x7fa0f4074480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:55.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 shutdown_connections 2024-08-31T04:43:55.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:55.835+0000 7fa0fba00640 1 -- 172.21.15.89:0/33145756 wait complete. 2024-08-31T04:43:55.857 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1245,"stamp":"2024-08-31T04:43:55.291863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2002428513,"num_objects":43771,"num_object_clones":18986,"num_object_copies":166070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43771,"num_whiteouts":18810,"num_read":8394,"num_read_kb":6751486,"num_write":113772,"num_write_kb":3919722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163298,"ondisk_log_size":163298,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6321912,"kb_used_data":4116792,"kb_used_omap":12,"kb_used_meta":2204979,"kb_avail":748652808,"statfs":{"total":773094113280,"available":766620475392,"internally_reserved":0,"allocated":4215595008,"data_stored":4214755198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":2257899056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2082,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":13015,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005976"},"pg_stats":[{"pgid":"2.1f","version":"48'789","reported_seq":875,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.483441+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:43:41.483441+0000","last_peered":"2024-08-31T04:43:41.483441+0000","last_clean":"2024-08-31T04:43:41.483441+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:43:41.483441+0000","last_undegraded":"2024-08-31T04:43:41.483441+0000","last_fullsized":"2024-08-31T04:43:41.483441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37414551,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":823,"num_write_kb":58134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"48'592","reported_seq":2696,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.303935+0000","last_change":"2024-08-31T04:10:27.645410+0000","last_active":"2024-08-31T04:43:54.303935+0000","last_peered":"2024-08-31T04:43:54.303935+0000","last_clean":"2024-08-31T04:43:54.303935+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:43:54.303935+0000","last_undegraded":"2024-08-31T04:43:54.303935+0000","last_fullsized":"2024-08-31T04:43:54.303935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:46.278499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012836803000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"48'2838","reported_seq":4603,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.098808+0000","last_change":"2024-08-31T04:10:27.668465+0000","last_active":"2024-08-31T04:43:51.098808+0000","last_peered":"2024-08-31T04:43:51.098808+0000","last_clean":"2024-08-31T04:43:51.098808+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:43:51.098808+0000","last_undegraded":"2024-08-31T04:43:51.098808+0000","last_fullsized":"2024-08-31T04:43:51.098808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2838,"log_dups_size":0,"ondisk_log_size":2838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:56:27.977319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058952350000000004,"stat_sum":{"num_bytes":50597461,"num_objects":1198,"num_object_clones":550,"num_object_copies":4792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1198,"num_whiteouts":550,"num_read":212,"num_read_kb":376919,"num_write":2332,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"48'672","reported_seq":758,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.189267+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:41:10.189267+0000","last_peered":"2024-08-31T04:41:10.189267+0000","last_clean":"2024-08-31T04:41:10.189267+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:41:10.189267+0000","last_undegraded":"2024-08-31T04:41:10.189267+0000","last_fullsized":"2024-08-31T04:41:10.189267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":697,"num_write_kb":66604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"48'579","reported_seq":2684,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315803+0000","last_change":"2024-08-31T04:10:27.645689+0000","last_active":"2024-08-31T04:43:54.315803+0000","last_peered":"2024-08-31T04:43:54.315803+0000","last_clean":"2024-08-31T04:43:54.315803+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:43:54.315803+0000","last_undegraded":"2024-08-31T04:43:54.315803+0000","last_fullsized":"2024-08-31T04:43:54.315803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:21.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012881510000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"48'3007","reported_seq":4768,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.337761+0000","last_change":"2024-08-31T04:10:27.629997+0000","last_active":"2024-08-31T04:43:31.337761+0000","last_peered":"2024-08-31T04:43:31.337761+0000","last_clean":"2024-08-31T04:43:31.337761+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:43:31.337761+0000","last_undegraded":"2024-08-31T04:43:31.337761+0000","last_fullsized":"2024-08-31T04:43:31.337761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:34:13.962324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059980260000000001,"stat_sum":{"num_bytes":71770879,"num_objects":1258,"num_object_clones":586,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":586,"num_read":244,"num_read_kb":407504,"num_write":2470,"num_write_kb":85232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"48'1251","reported_seq":1333,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.959569+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:40:51.959569+0000","last_peered":"2024-08-31T04:40:51.959569+0000","last_clean":"2024-08-31T04:40:51.959569+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:40:51.959569+0000","last_undegraded":"2024-08-31T04:40:51.959569+0000","last_fullsized":"2024-08-31T04:40:51.959569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1251,"log_dups_size":0,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1281,"num_write_kb":120075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"48'616","reported_seq":2715,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.968852+0000","last_change":"2024-08-31T04:10:27.626701+0000","last_active":"2024-08-31T04:40:56.968852+0000","last_peered":"2024-08-31T04:40:56.968852+0000","last_clean":"2024-08-31T04:40:56.968852+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:40:56.968852+0000","last_undegraded":"2024-08-31T04:40:56.968852+0000","last_fullsized":"2024-08-31T04:40:56.968852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:11:39.748424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032840360000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"48'3005","reported_seq":4694,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.758723+0000","last_change":"2024-08-31T04:10:27.632736+0000","last_active":"2024-08-31T04:43:41.758723+0000","last_peered":"2024-08-31T04:43:41.758723+0000","last_clean":"2024-08-31T04:43:41.758723+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:43:41.758723+0000","last_undegraded":"2024-08-31T04:43:41.758723+0000","last_fullsized":"2024-08-31T04:43:41.758723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:27.569361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058445240000000002,"stat_sum":{"num_bytes":38693415,"num_objects":1292,"num_object_clones":602,"num_object_copies":5168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":602,"num_read":189,"num_read_kb":291224,"num_write":2458,"num_write_kb":41612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"48'400","reported_seq":482,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.971895+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:41:01.971895+0000","last_peered":"2024-08-31T04:41:01.971895+0000","last_clean":"2024-08-31T04:41:01.971895+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:41:01.971895+0000","last_undegraded":"2024-08-31T04:41:01.971895+0000","last_fullsized":"2024-08-31T04:41:01.971895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":451,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"48'585","reported_seq":2687,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.968477+0000","last_change":"2024-08-31T04:10:27.683387+0000","last_active":"2024-08-31T04:40:51.968477+0000","last_peered":"2024-08-31T04:40:51.968477+0000","last_clean":"2024-08-31T04:40:51.968477+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:40:51.968477+0000","last_undegraded":"2024-08-31T04:40:51.968477+0000","last_fullsized":"2024-08-31T04:40:51.968477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:29:21.522834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070378919999999996,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"48'2845","reported_seq":4609,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:07.038822+0000","last_change":"2024-08-31T04:10:27.629946+0000","last_active":"2024-08-31T04:43:07.038822+0000","last_peered":"2024-08-31T04:43:07.038822+0000","last_clean":"2024-08-31T04:43:07.038822+0000","last_became_active":"2024-08-31T04:04:41.418200+0000","last_became_peered":"2024-08-31T04:04:41.418200+0000","last_unstale":"2024-08-31T04:43:07.038822+0000","last_undegraded":"2024-08-31T04:43:07.038822+0000","last_fullsized":"2024-08-31T04:43:07.038822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:27.685667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059467970000000002,"stat_sum":{"num_bytes":46428419,"num_objects":1209,"num_object_clones":554,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":554,"num_read":208,"num_read_kb":267627,"num_write":2344,"num_write_kb":53603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"48'611","reported_seq":2711,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:55.950255+0000","last_change":"2024-08-31T04:10:27.682710+0000","last_active":"2024-08-31T04:40:55.950255+0000","last_peered":"2024-08-31T04:40:55.950255+0000","last_clean":"2024-08-31T04:40:55.950255+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:40:55.950255+0000","last_undegraded":"2024-08-31T04:40:55.950255+0000","last_fullsized":"2024-08-31T04:40:55.950255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.550862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068528089999999996,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"48'1182","reported_seq":1266,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.979593+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:41:10.979593+0000","last_peered":"2024-08-31T04:41:10.979593+0000","last_clean":"2024-08-31T04:41:10.979593+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:41:10.979593+0000","last_undegraded":"2024-08-31T04:41:10.979593+0000","last_fullsized":"2024-08-31T04:41:10.979593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1278,"num_write_kb":83819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"48'2943","reported_seq":4739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.900700+0000","last_change":"2024-08-31T04:10:27.682154+0000","last_active":"2024-08-31T04:43:31.900700+0000","last_peered":"2024-08-31T04:43:31.900700+0000","last_clean":"2024-08-31T04:43:31.900700+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:43:31.900700+0000","last_undegraded":"2024-08-31T04:43:31.900700+0000","last_fullsized":"2024-08-31T04:43:31.900700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:43.247408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066428290000000003,"stat_sum":{"num_bytes":56765051,"num_objects":1275,"num_object_clones":585,"num_object_copies":5100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1275,"num_whiteouts":585,"num_read":277,"num_read_kb":424079,"num_write":2416,"num_write_kb":67833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"48'620","reported_seq":2720,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.100428+0000","last_change":"2024-08-31T04:10:27.670686+0000","last_active":"2024-08-31T04:40:43.100428+0000","last_peered":"2024-08-31T04:40:43.100428+0000","last_clean":"2024-08-31T04:40:43.100428+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:40:43.100428+0000","last_undegraded":"2024-08-31T04:40:43.100428+0000","last_fullsized":"2024-08-31T04:40:43.100428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:35.821184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066355329999999999,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"48'686","reported_seq":771,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.978927+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:41:10.978927+0000","last_peered":"2024-08-31T04:41:10.978927+0000","last_clean":"2024-08-31T04:41:10.978927+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:41:10.978927+0000","last_undegraded":"2024-08-31T04:41:10.978927+0000","last_fullsized":"2024-08-31T04:41:10.978927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":738,"num_write_kb":87340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"48'2909","reported_seq":4540,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:07.042576+0000","last_change":"2024-08-31T04:10:27.799102+0000","last_active":"2024-08-31T04:43:07.042576+0000","last_peered":"2024-08-31T04:43:07.042576+0000","last_clean":"2024-08-31T04:43:07.042576+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:43:07.042576+0000","last_undegraded":"2024-08-31T04:43:07.042576+0000","last_fullsized":"2024-08-31T04:43:07.042576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2909,"log_dups_size":0,"ondisk_log_size":2909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:44:32.822098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043859299999999997,"stat_sum":{"num_bytes":16936662,"num_objects":1190,"num_object_clones":558,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":558,"num_read":85,"num_read_kb":9403,"num_write":2392,"num_write_kb":37720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"48'650","reported_seq":2747,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:50.444732+0000","last_change":"2024-08-31T04:10:27.821258+0000","last_active":"2024-08-31T04:40:50.444732+0000","last_peered":"2024-08-31T04:40:50.444732+0000","last_clean":"2024-08-31T04:40:50.444732+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:40:50.444732+0000","last_undegraded":"2024-08-31T04:40:50.444732+0000","last_fullsized":"2024-08-31T04:40:50.444732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:06.689884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018377836000000002,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":14,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"48'562","reported_seq":647,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.856125+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:40:56.856125+0000","last_peered":"2024-08-31T04:40:56.856125+0000","last_clean":"2024-08-31T04:40:56.856125+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:40:56.856125+0000","last_undegraded":"2024-08-31T04:40:56.856125+0000","last_fullsized":"2024-08-31T04:40:56.856125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":615,"num_write_kb":58408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"48'2896","reported_seq":4576,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.040546+0000","last_change":"2024-08-31T04:10:27.671256+0000","last_active":"2024-08-31T04:43:51.040546+0000","last_peered":"2024-08-31T04:43:51.040546+0000","last_clean":"2024-08-31T04:43:51.040546+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:43:51.040546+0000","last_undegraded":"2024-08-31T04:43:51.040546+0000","last_fullsized":"2024-08-31T04:43:51.040546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2896,"log_dups_size":0,"ondisk_log_size":2896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:44.158201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070696559999999997,"stat_sum":{"num_bytes":20275415,"num_objects":1227,"num_object_clones":567,"num_object_copies":4908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1227,"num_whiteouts":567,"num_read":143,"num_read_kb":118630,"num_write":2381,"num_write_kb":31494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'627","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:50.949382+0000","last_change":"2024-08-31T04:10:27.681396+0000","last_active":"2024-08-31T04:40:50.949382+0000","last_peered":"2024-08-31T04:40:50.949382+0000","last_clean":"2024-08-31T04:40:50.949382+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:40:50.949382+0000","last_undegraded":"2024-08-31T04:40:50.949382+0000","last_fullsized":"2024-08-31T04:40:50.949382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:59:06.965998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060537480000000003,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"48'371","reported_seq":456,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.972445+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:41:01.972445+0000","last_peered":"2024-08-31T04:41:01.972445+0000","last_clean":"2024-08-31T04:41:01.972445+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:41:01.972445+0000","last_undegraded":"2024-08-31T04:41:01.972445+0000","last_fullsized":"2024-08-31T04:41:01.972445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":417,"num_write_kb":42100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"48'2828","reported_seq":4501,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.825205+0000","last_change":"2024-08-31T04:10:27.634238+0000","last_active":"2024-08-31T04:43:41.825205+0000","last_peered":"2024-08-31T04:43:41.825205+0000","last_clean":"2024-08-31T04:43:41.825205+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:43:41.825205+0000","last_undegraded":"2024-08-31T04:43:41.825205+0000","last_fullsized":"2024-08-31T04:43:41.825205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2828,"log_dups_size":0,"ondisk_log_size":2828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:01:42.230553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062106380000000001,"stat_sum":{"num_bytes":38082532,"num_objects":1243,"num_object_clones":581,"num_object_copies":4972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1243,"num_whiteouts":581,"num_read":150,"num_read_kb":116527,"num_write":2283,"num_write_kb":45420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"48'601","reported_seq":2701,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:50.444879+0000","last_change":"2024-08-31T04:10:27.824154+0000","last_active":"2024-08-31T04:40:50.444879+0000","last_peered":"2024-08-31T04:40:50.444879+0000","last_clean":"2024-08-31T04:40:50.444879+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:40:50.444879+0000","last_undegraded":"2024-08-31T04:40:50.444879+0000","last_fullsized":"2024-08-31T04:40:50.444879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:58.773731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018455160000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"48'542","reported_seq":627,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.979531+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:41:10.979531+0000","last_peered":"2024-08-31T04:41:10.979531+0000","last_clean":"2024-08-31T04:41:10.979531+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:41:10.979531+0000","last_undegraded":"2024-08-31T04:41:10.979531+0000","last_fullsized":"2024-08-31T04:41:10.979531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":604,"num_write_kb":70753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"48'2858","reported_seq":4620,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.781881+0000","last_change":"2024-08-31T04:10:27.632339+0000","last_active":"2024-08-31T04:43:41.781881+0000","last_peered":"2024-08-31T04:43:41.781881+0000","last_clean":"2024-08-31T04:43:41.781881+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:43:41.781881+0000","last_undegraded":"2024-08-31T04:43:41.781881+0000","last_fullsized":"2024-08-31T04:43:41.781881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:58.968159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076718680000000001,"stat_sum":{"num_bytes":46058979,"num_objects":1175,"num_object_clones":539,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":539,"num_read":195,"num_read_kb":329230,"num_write":2367,"num_write_kb":53816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"48'571","reported_seq":2669,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.995777+0000","last_change":"2024-08-31T04:10:27.825042+0000","last_active":"2024-08-31T04:40:51.995777+0000","last_peered":"2024-08-31T04:40:51.995777+0000","last_clean":"2024-08-31T04:40:51.995777+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:40:51.995777+0000","last_undegraded":"2024-08-31T04:40:51.995777+0000","last_fullsized":"2024-08-31T04:40:51.995777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:27.395562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019117552999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":13,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"48'1959","reported_seq":2044,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:01.067325+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:43:01.067325+0000","last_peered":"2024-08-31T04:43:01.067325+0000","last_clean":"2024-08-31T04:43:01.067325+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:43:01.067325+0000","last_undegraded":"2024-08-31T04:43:01.067325+0000","last_fullsized":"2024-08-31T04:43:01.067325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":4153,"num_write_kb":64616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"48'2942","reported_seq":4706,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:37.314647+0000","last_change":"2024-08-31T04:10:27.820585+0000","last_active":"2024-08-31T04:43:37.314647+0000","last_peered":"2024-08-31T04:43:37.314647+0000","last_clean":"2024-08-31T04:43:37.314647+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:43:37.314647+0000","last_undegraded":"2024-08-31T04:43:37.314647+0000","last_fullsized":"2024-08-31T04:43:37.314647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2942,"log_dups_size":0,"ondisk_log_size":2942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:41:28.078827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018717636999999999,"stat_sum":{"num_bytes":43745379,"num_objects":1223,"num_object_clones":566,"num_object_copies":4892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1223,"num_whiteouts":566,"num_read":224,"num_read_kb":327563,"num_write":2430,"num_write_kb":52706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"48'636","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.295540+0000","last_change":"2024-08-31T04:10:27.827955+0000","last_active":"2024-08-31T04:43:54.295540+0000","last_peered":"2024-08-31T04:43:54.295540+0000","last_clean":"2024-08-31T04:43:54.295540+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:43:54.295540+0000","last_undegraded":"2024-08-31T04:43:54.295540+0000","last_fullsized":"2024-08-31T04:43:54.295540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:49.670904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024325223999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":20,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"48'1150","reported_seq":1236,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:35.955058+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:41:35.955058+0000","last_peered":"2024-08-31T04:41:35.955058+0000","last_clean":"2024-08-31T04:41:35.955058+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:41:35.955058+0000","last_undegraded":"2024-08-31T04:41:35.955058+0000","last_fullsized":"2024-08-31T04:41:35.955058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":1214,"num_write_kb":79665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"48'3005","reported_seq":4719,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.066272+0000","last_change":"2024-08-31T04:10:27.828574+0000","last_active":"2024-08-31T04:43:51.066272+0000","last_peered":"2024-08-31T04:43:51.066272+0000","last_clean":"2024-08-31T04:43:51.066272+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:43:51.066272+0000","last_undegraded":"2024-08-31T04:43:51.066272+0000","last_fullsized":"2024-08-31T04:43:51.066272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:42:38.219220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025625698999999998,"stat_sum":{"num_bytes":43095232,"num_objects":1282,"num_object_clones":604,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":604,"num_read":212,"num_read_kb":287774,"num_write":2444,"num_write_kb":46619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"48'628","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:40.955698+0000","last_change":"2024-08-31T04:10:27.633137+0000","last_active":"2024-08-31T04:41:40.955698+0000","last_peered":"2024-08-31T04:41:40.955698+0000","last_clean":"2024-08-31T04:41:40.955698+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:41:40.955698+0000","last_undegraded":"2024-08-31T04:41:40.955698+0000","last_fullsized":"2024-08-31T04:41:40.955698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:41.923099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058084670000000003,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"48'804","reported_seq":890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.152652+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:41:30.152652+0000","last_peered":"2024-08-31T04:41:30.152652+0000","last_clean":"2024-08-31T04:41:30.152652+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:41:30.152652+0000","last_undegraded":"2024-08-31T04:41:30.152652+0000","last_fullsized":"2024-08-31T04:41:30.152652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":843,"num_write_kb":95373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"48'2913","reported_seq":4551,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.071323+0000","last_change":"2024-08-31T04:10:27.828980+0000","last_active":"2024-08-31T04:43:51.071323+0000","last_peered":"2024-08-31T04:43:51.071323+0000","last_clean":"2024-08-31T04:43:51.071323+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:43:51.071323+0000","last_undegraded":"2024-08-31T04:43:51.071323+0000","last_fullsized":"2024-08-31T04:43:51.071323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:55.109838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024539147000000001,"stat_sum":{"num_bytes":16912754,"num_objects":1252,"num_object_clones":571,"num_object_copies":5008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1252,"num_whiteouts":571,"num_read":103,"num_read_kb":5348,"num_write":2409,"num_write_kb":25816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"48'612","reported_seq":2718,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954146+0000","last_change":"2024-08-31T04:10:27.797983+0000","last_active":"2024-08-31T04:41:30.954146+0000","last_peered":"2024-08-31T04:41:30.954146+0000","last_clean":"2024-08-31T04:41:30.954146+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:41:30.954146+0000","last_undegraded":"2024-08-31T04:41:30.954146+0000","last_fullsized":"2024-08-31T04:41:30.954146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:34.286214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00335798,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"48'348","reported_seq":434,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954530+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:41:30.954530+0000","last_peered":"2024-08-31T04:41:30.954530+0000","last_clean":"2024-08-31T04:41:30.954530+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:41:30.954530+0000","last_undegraded":"2024-08-31T04:41:30.954530+0000","last_fullsized":"2024-08-31T04:41:30.954530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":379,"num_write_kb":74722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"48'2860","reported_seq":4522,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.779031+0000","last_change":"2024-08-31T04:10:27.826301+0000","last_active":"2024-08-31T04:43:41.779031+0000","last_peered":"2024-08-31T04:43:41.779031+0000","last_clean":"2024-08-31T04:43:41.779031+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:43:41.779031+0000","last_undegraded":"2024-08-31T04:43:41.779031+0000","last_fullsized":"2024-08-31T04:43:41.779031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:16:10.628373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024774918,"stat_sum":{"num_bytes":28766340,"num_objects":1202,"num_object_clones":562,"num_object_copies":4808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":562,"num_read":118,"num_read_kb":82244,"num_write":2340,"num_write_kb":38944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"48'646","reported_seq":2744,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315747+0000","last_change":"2024-08-31T04:10:27.638464+0000","last_active":"2024-08-31T04:43:54.315747+0000","last_peered":"2024-08-31T04:43:54.315747+0000","last_clean":"2024-08-31T04:43:54.315747+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:43:54.315747+0000","last_undegraded":"2024-08-31T04:43:54.315747+0000","last_fullsized":"2024-08-31T04:43:54.315747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:56:21.122785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011184838000000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"48'1718","reported_seq":2844,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:32.140583+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:41:32.140583+0000","last_peered":"2024-08-31T04:41:32.140583+0000","last_clean":"2024-08-31T04:41:32.140583+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:41:32.140583+0000","last_undegraded":"2024-08-31T04:41:32.140583+0000","last_fullsized":"2024-08-31T04:41:32.140583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1718,"log_dups_size":0,"ondisk_log_size":1718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1088,"num_read_kb":4789,"num_write":1771,"num_write_kb":92200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"48'2769","reported_seq":4518,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.169748+0000","last_change":"2024-08-31T04:10:27.824008+0000","last_active":"2024-08-31T04:43:51.169748+0000","last_peered":"2024-08-31T04:43:51.169748+0000","last_clean":"2024-08-31T04:43:51.169748+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:43:51.169748+0000","last_undegraded":"2024-08-31T04:43:51.169748+0000","last_fullsized":"2024-08-31T04:43:51.169748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2769,"log_dups_size":0,"ondisk_log_size":2769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:59.789550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024776765999999999,"stat_sum":{"num_bytes":32718964,"num_objects":1190,"num_object_clones":545,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":545,"num_read":189,"num_read_kb":237912,"num_write":2280,"num_write_kb":50056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"48'588","reported_seq":2690,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.291011+0000","last_change":"2024-08-31T04:10:27.830527+0000","last_active":"2024-08-31T04:43:54.291011+0000","last_peered":"2024-08-31T04:43:54.291011+0000","last_clean":"2024-08-31T04:43:54.291011+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:43:54.291011+0000","last_undegraded":"2024-08-31T04:43:54.291011+0000","last_fullsized":"2024-08-31T04:43:54.291011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:25:35.143895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023142859000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"48'735","reported_seq":821,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.340061+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:40:56.340061+0000","last_peered":"2024-08-31T04:40:56.340061+0000","last_clean":"2024-08-31T04:40:56.340061+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:40:56.340061+0000","last_undegraded":"2024-08-31T04:40:56.340061+0000","last_fullsized":"2024-08-31T04:40:56.340061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":805,"num_write_kb":79377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"48'2886","reported_seq":4556,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.755282+0000","last_change":"2024-08-31T04:10:27.643289+0000","last_active":"2024-08-31T04:43:41.755282+0000","last_peered":"2024-08-31T04:43:41.755282+0000","last_clean":"2024-08-31T04:43:41.755282+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:43:41.755282+0000","last_undegraded":"2024-08-31T04:43:41.755282+0000","last_fullsized":"2024-08-31T04:43:41.755282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:02.372383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014346418999999999,"stat_sum":{"num_bytes":16814987,"num_objects":1183,"num_object_clones":546,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":546,"num_read":112,"num_read_kb":15010,"num_write":2390,"num_write_kb":22596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'618","reported_seq":2713,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.451571+0000","last_change":"2024-08-31T04:10:27.815323+0000","last_active":"2024-08-31T04:41:30.451571+0000","last_peered":"2024-08-31T04:41:30.451571+0000","last_clean":"2024-08-31T04:41:30.451571+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:41:30.451571+0000","last_undegraded":"2024-08-31T04:41:30.451571+0000","last_fullsized":"2024-08-31T04:41:30.451571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:27:36.200935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013467437000000001,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"48'775","reported_seq":861,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954543+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:41:30.954543+0000","last_peered":"2024-08-31T04:41:30.954543+0000","last_clean":"2024-08-31T04:41:30.954543+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:41:30.954543+0000","last_undegraded":"2024-08-31T04:41:30.954543+0000","last_fullsized":"2024-08-31T04:41:30.954543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":842,"num_write_kb":66986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":182,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:00.942030+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:40:00.942030+0000","last_peered":"2024-08-31T04:40:00.942030+0000","last_clean":"2024-08-31T04:40:00.942030+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:40:00.942030+0000","last_undegraded":"2024-08-31T04:40:00.942030+0000","last_fullsized":"2024-08-31T04:40:00.942030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"48'2855","reported_seq":4681,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:45.973319+0000","last_change":"2024-08-31T04:10:27.683701+0000","last_active":"2024-08-31T04:43:45.973319+0000","last_peered":"2024-08-31T04:43:45.973319+0000","last_clean":"2024-08-31T04:43:45.973319+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:43:45.973319+0000","last_undegraded":"2024-08-31T04:43:45.973319+0000","last_fullsized":"2024-08-31T04:43:45.973319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:57.102473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069147610000000002,"stat_sum":{"num_bytes":57940200,"num_objects":1195,"num_object_clones":554,"num_object_copies":4780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":554,"num_read":274,"num_read_kb":360546,"num_write":2343,"num_write_kb":69963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"48'613","reported_seq":2709,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.063279+0000","last_change":"2024-08-31T04:10:27.683489+0000","last_active":"2024-08-31T04:40:43.063279+0000","last_peered":"2024-08-31T04:40:43.063279+0000","last_clean":"2024-08-31T04:40:43.063279+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:40:43.063279+0000","last_undegraded":"2024-08-31T04:40:43.063279+0000","last_fullsized":"2024-08-31T04:40:43.063279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:13.850189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067171050000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"48'1620","reported_seq":1704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.978440+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:40:56.978440+0000","last_peered":"2024-08-31T04:40:56.978440+0000","last_clean":"2024-08-31T04:40:56.978440+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:40:56.978440+0000","last_undegraded":"2024-08-31T04:40:56.978440+0000","last_fullsized":"2024-08-31T04:40:56.978440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":1668,"num_write_kb":75070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"48'2903","reported_seq":4558,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.810585+0000","last_change":"2024-08-31T04:10:27.630304+0000","last_active":"2024-08-31T04:43:41.810585+0000","last_peered":"2024-08-31T04:43:41.810585+0000","last_clean":"2024-08-31T04:43:41.810585+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:43:41.810585+0000","last_undegraded":"2024-08-31T04:43:41.810585+0000","last_fullsized":"2024-08-31T04:43:41.810585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:39.898341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059273310000000001,"stat_sum":{"num_bytes":26554957,"num_objects":1237,"num_object_clones":582,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":582,"num_read":132,"num_read_kb":127199,"num_write":2367,"num_write_kb":33368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"48'631","reported_seq":2729,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.971994+0000","last_change":"2024-08-31T04:10:27.801079+0000","last_active":"2024-08-31T04:40:56.971994+0000","last_peered":"2024-08-31T04:40:56.971994+0000","last_clean":"2024-08-31T04:40:56.971994+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:40:56.971994+0000","last_undegraded":"2024-08-31T04:40:56.971994+0000","last_fullsized":"2024-08-31T04:40:56.971994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:07.707273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055968709999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"48'1164","reported_seq":1248,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.931281+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:41:10.931281+0000","last_peered":"2024-08-31T04:41:10.931281+0000","last_clean":"2024-08-31T04:41:10.931281+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:41:10.931281+0000","last_undegraded":"2024-08-31T04:41:10.931281+0000","last_fullsized":"2024-08-31T04:41:10.931281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37753176,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":1208,"num_write_kb":91501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"48'2868","reported_seq":4560,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.821138+0000","last_change":"2024-08-31T04:10:27.642551+0000","last_active":"2024-08-31T04:43:41.821138+0000","last_peered":"2024-08-31T04:43:41.821138+0000","last_clean":"2024-08-31T04:43:41.821138+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:43:41.821138+0000","last_undegraded":"2024-08-31T04:43:41.821138+0000","last_fullsized":"2024-08-31T04:43:41.821138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:40.314782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013964779,"stat_sum":{"num_bytes":24232544,"num_objects":1215,"num_object_clones":563,"num_object_copies":4860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":563,"num_read":151,"num_read_kb":172254,"num_write":2354,"num_write_kb":29314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"48'600","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.967674+0000","last_change":"2024-08-31T04:10:27.800767+0000","last_active":"2024-08-31T04:40:51.967674+0000","last_peered":"2024-08-31T04:40:51.967674+0000","last_clean":"2024-08-31T04:40:51.967674+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:40:51.967674+0000","last_undegraded":"2024-08-31T04:40:51.967674+0000","last_fullsized":"2024-08-31T04:40:51.967674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:19.279530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052273500000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"48'547","reported_seq":631,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.928718+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:41:01.928718+0000","last_peered":"2024-08-31T04:41:01.928718+0000","last_clean":"2024-08-31T04:41:01.928718+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:41:01.928718+0000","last_undegraded":"2024-08-31T04:41:01.928718+0000","last_fullsized":"2024-08-31T04:41:01.928718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":607,"num_write_kb":87317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"48'2923","reported_seq":4623,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:37.318589+0000","last_change":"2024-08-31T04:10:27.681554+0000","last_active":"2024-08-31T04:43:37.318589+0000","last_peered":"2024-08-31T04:43:37.318589+0000","last_clean":"2024-08-31T04:43:37.318589+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:43:37.318589+0000","last_undegraded":"2024-08-31T04:43:37.318589+0000","last_fullsized":"2024-08-31T04:43:37.318589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2923,"log_dups_size":0,"ondisk_log_size":2923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:39:43.060510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065855360000000003,"stat_sum":{"num_bytes":30081699,"num_objects":1235,"num_object_clones":576,"num_object_copies":4940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1235,"num_whiteouts":576,"num_read":171,"num_read_kb":189059,"num_write":2389,"num_write_kb":43568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"48'612","reported_seq":2712,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.024856+0000","last_change":"2024-08-31T04:10:27.634646+0000","last_active":"2024-08-31T04:40:43.024856+0000","last_peered":"2024-08-31T04:40:43.024856+0000","last_clean":"2024-08-31T04:40:43.024856+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:40:43.024856+0000","last_undegraded":"2024-08-31T04:40:43.024856+0000","last_fullsized":"2024-08-31T04:40:43.024856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:43.424732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057184189999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"48'535","reported_seq":619,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.615251+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:40:56.615251+0000","last_peered":"2024-08-31T04:40:56.615251+0000","last_clean":"2024-08-31T04:40:56.615251+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:40:56.615251+0000","last_undegraded":"2024-08-31T04:40:56.615251+0000","last_fullsized":"2024-08-31T04:40:56.615251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971542,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":585,"num_write_kb":62565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"48'2832","reported_seq":4602,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.910403+0000","last_change":"2024-08-31T04:10:27.624180+0000","last_active":"2024-08-31T04:43:31.910403+0000","last_peered":"2024-08-31T04:43:31.910403+0000","last_clean":"2024-08-31T04:43:31.910403+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:43:31.910403+0000","last_undegraded":"2024-08-31T04:43:31.910403+0000","last_fullsized":"2024-08-31T04:43:31.910403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:14:38.588901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001644726,"stat_sum":{"num_bytes":45550886,"num_objects":1209,"num_object_clones":562,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":562,"num_read":227,"num_read_kb":373101,"num_write":2312,"num_write_kb":56902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"48'624","reported_seq":2727,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953246+0000","last_change":"2024-08-31T04:10:27.680074+0000","last_active":"2024-08-31T04:41:20.953246+0000","last_peered":"2024-08-31T04:41:20.953246+0000","last_clean":"2024-08-31T04:41:20.953246+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:41:20.953246+0000","last_undegraded":"2024-08-31T04:41:20.953246+0000","last_fullsized":"2024-08-31T04:41:20.953246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:52:30.799187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051653649999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":7,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"48'681","reported_seq":765,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.449539+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:41:20.449539+0000","last_peered":"2024-08-31T04:41:20.449539+0000","last_clean":"2024-08-31T04:41:20.449539+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:41:20.449539+0000","last_undegraded":"2024-08-31T04:41:20.449539+0000","last_fullsized":"2024-08-31T04:41:20.449539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":760,"num_write_kb":71301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"48'2735","reported_seq":4393,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.739755+0000","last_change":"2024-08-31T04:10:27.644231+0000","last_active":"2024-08-31T04:43:41.739755+0000","last_peered":"2024-08-31T04:43:41.739755+0000","last_clean":"2024-08-31T04:43:41.739755+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:43:41.739755+0000","last_undegraded":"2024-08-31T04:43:41.739755+0000","last_fullsized":"2024-08-31T04:43:41.739755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:17.265946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012604237000000001,"stat_sum":{"num_bytes":16809799,"num_objects":1152,"num_object_clones":538,"num_object_copies":4608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":538,"num_read":93,"num_read_kb":855,"num_write":2242,"num_write_kb":21215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"48'606","reported_seq":2704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.952763+0000","last_change":"2024-08-31T04:10:27.626377+0000","last_active":"2024-08-31T04:41:20.952763+0000","last_peered":"2024-08-31T04:41:20.952763+0000","last_clean":"2024-08-31T04:41:20.952763+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:41:20.952763+0000","last_undegraded":"2024-08-31T04:41:20.952763+0000","last_fullsized":"2024-08-31T04:41:20.952763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:54:33.315553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036328670000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":12,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"48'358","reported_seq":442,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.952862+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:41:20.952862+0000","last_peered":"2024-08-31T04:41:20.952862+0000","last_clean":"2024-08-31T04:41:20.952862+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:41:20.952862+0000","last_undegraded":"2024-08-31T04:41:20.952862+0000","last_fullsized":"2024-08-31T04:41:20.952862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":374,"num_write_kb":62134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"48'3078","reported_seq":4700,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.753103+0000","last_change":"2024-08-31T04:10:27.644984+0000","last_active":"2024-08-31T04:43:41.753103+0000","last_peered":"2024-08-31T04:43:41.753103+0000","last_clean":"2024-08-31T04:43:41.753103+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:43:41.753103+0000","last_undegraded":"2024-08-31T04:43:41.753103+0000","last_fullsized":"2024-08-31T04:43:41.753103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3078,"log_dups_size":0,"ondisk_log_size":3078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:59.996448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012777844,"stat_sum":{"num_bytes":35172120,"num_objects":1354,"num_object_clones":682,"num_object_copies":5416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1354,"num_whiteouts":594,"num_read":201,"num_read_kb":245482,"num_write":2432,"num_write_kb":44882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'605","reported_seq":2709,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953294+0000","last_change":"2024-08-31T04:10:27.682802+0000","last_active":"2024-08-31T04:41:20.953294+0000","last_peered":"2024-08-31T04:41:20.953294+0000","last_clean":"2024-08-31T04:41:20.953294+0000","last_became_active":"2024-08-31T04:04:41.425024+0000","last_became_peered":"2024-08-31T04:04:41.425024+0000","last_unstale":"2024-08-31T04:41:20.953294+0000","last_undegraded":"2024-08-31T04:41:20.953294+0000","last_fullsized":"2024-08-31T04:41:20.953294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:00.707504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006804175,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"48'514","reported_seq":598,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953275+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:41:20.953275+0000","last_peered":"2024-08-31T04:41:20.953275+0000","last_clean":"2024-08-31T04:41:20.953275+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:41:20.953275+0000","last_undegraded":"2024-08-31T04:41:20.953275+0000","last_fullsized":"2024-08-31T04:41:20.953275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":556,"num_write_kb":54279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"48'2880","reported_seq":4600,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.215076+0000","last_change":"2024-08-31T04:10:27.825912+0000","last_active":"2024-08-31T04:43:51.215076+0000","last_peered":"2024-08-31T04:43:51.215076+0000","last_clean":"2024-08-31T04:43:51.215076+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:43:51.215076+0000","last_undegraded":"2024-08-31T04:43:51.215076+0000","last_fullsized":"2024-08-31T04:43:51.215076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2880,"log_dups_size":0,"ondisk_log_size":2880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:02.879075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025415436,"stat_sum":{"num_bytes":43622224,"num_objects":1251,"num_object_clones":583,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1251,"num_whiteouts":583,"num_read":199,"num_read_kb":207126,"num_write":2328,"num_write_kb":56286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"48'585","reported_seq":2686,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.279324+0000","last_change":"2024-08-31T04:10:27.830297+0000","last_active":"2024-08-31T04:43:54.279324+0000","last_peered":"2024-08-31T04:43:54.279324+0000","last_clean":"2024-08-31T04:43:54.279324+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:43:54.279324+0000","last_undegraded":"2024-08-31T04:43:54.279324+0000","last_fullsized":"2024-08-31T04:43:54.279324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:11.469305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023919682000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"48'1257","reported_seq":1341,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:22.138550+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:41:22.138550+0000","last_peered":"2024-08-31T04:41:22.138550+0000","last_clean":"2024-08-31T04:41:22.138550+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:41:22.138550+0000","last_undegraded":"2024-08-31T04:41:22.138550+0000","last_fullsized":"2024-08-31T04:41:22.138550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1306,"num_write_kb":67222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"48'2891","reported_seq":4581,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.953320+0000","last_change":"2024-08-31T04:10:27.683052+0000","last_active":"2024-08-31T04:43:31.953320+0000","last_peered":"2024-08-31T04:43:31.953320+0000","last_clean":"2024-08-31T04:43:31.953320+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:43:31.953320+0000","last_undegraded":"2024-08-31T04:43:31.953320+0000","last_fullsized":"2024-08-31T04:43:31.953320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.116451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069575569999999996,"stat_sum":{"num_bytes":34789039,"num_objects":1260,"num_object_clones":583,"num_object_copies":5040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1260,"num_whiteouts":583,"num_read":170,"num_read_kb":170411,"num_write":2360,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"48'603","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.051596+0000","last_change":"2024-08-31T04:10:27.799884+0000","last_active":"2024-08-31T04:40:43.051596+0000","last_peered":"2024-08-31T04:40:43.051596+0000","last_clean":"2024-08-31T04:40:43.051596+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:40:43.051596+0000","last_undegraded":"2024-08-31T04:40:43.051596+0000","last_fullsized":"2024-08-31T04:40:43.051596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:43.034574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047916210000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"48'1156","reported_seq":1240,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:46.484670+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:43:46.484670+0000","last_peered":"2024-08-31T04:43:46.484670+0000","last_clean":"2024-08-31T04:43:46.484670+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:43:46.484670+0000","last_undegraded":"2024-08-31T04:43:46.484670+0000","last_fullsized":"2024-08-31T04:43:46.484670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1156,"log_dups_size":0,"ondisk_log_size":1156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555104,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1203,"num_write_kb":103869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"48'2948","reported_seq":4614,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.831104+0000","last_change":"2024-08-31T04:10:27.802246+0000","last_active":"2024-08-31T04:43:41.831104+0000","last_peered":"2024-08-31T04:43:41.831104+0000","last_clean":"2024-08-31T04:43:41.831104+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:43:41.831104+0000","last_undegraded":"2024-08-31T04:43:41.831104+0000","last_fullsized":"2024-08-31T04:43:41.831104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2948,"log_dups_size":0,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:12:15.664092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046964119999999996,"stat_sum":{"num_bytes":37035283,"num_objects":1250,"num_object_clones":626,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":538,"num_read":188,"num_read_kb":159531,"num_write":2363,"num_write_kb":48541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"48'617","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:25.953944+0000","last_change":"2024-08-31T04:10:27.682269+0000","last_active":"2024-08-31T04:41:25.953944+0000","last_peered":"2024-08-31T04:41:25.953944+0000","last_clean":"2024-08-31T04:41:25.953944+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:41:25.953944+0000","last_undegraded":"2024-08-31T04:41:25.953944+0000","last_fullsized":"2024-08-31T04:41:25.953944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:25.121383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006690306,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"48'1380","reported_seq":1463,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:57.021975+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:40:57.021975+0000","last_peered":"2024-08-31T04:40:57.021975+0000","last_clean":"2024-08-31T04:40:57.021975+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:40:57.021975+0000","last_undegraded":"2024-08-31T04:40:57.021975+0000","last_fullsized":"2024-08-31T04:40:57.021975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1380,"log_dups_size":0,"ondisk_log_size":1380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554522,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1433,"num_write_kb":71604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"48'2822","reported_seq":4502,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.815516+0000","last_change":"2024-08-31T04:10:27.633146+0000","last_active":"2024-08-31T04:43:41.815516+0000","last_peered":"2024-08-31T04:43:41.815516+0000","last_clean":"2024-08-31T04:43:41.815516+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:43:41.815516+0000","last_undegraded":"2024-08-31T04:43:41.815516+0000","last_fullsized":"2024-08-31T04:43:41.815516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2822,"log_dups_size":0,"ondisk_log_size":2822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:44.513348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060660929999999998,"stat_sum":{"num_bytes":30139631,"num_objects":1254,"num_object_clones":586,"num_object_copies":5016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1254,"num_whiteouts":586,"num_read":162,"num_read_kb":134523,"num_write":2263,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"48'602","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315538+0000","last_change":"2024-08-31T04:10:27.646230+0000","last_active":"2024-08-31T04:43:54.315538+0000","last_peered":"2024-08-31T04:43:54.315538+0000","last_clean":"2024-08-31T04:43:54.315538+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:43:54.315538+0000","last_undegraded":"2024-08-31T04:43:54.315538+0000","last_fullsized":"2024-08-31T04:43:54.315538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:50.268225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012319801999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"48'1612","reported_seq":1695,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.961246+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:40:51.961246+0000","last_peered":"2024-08-31T04:40:51.961246+0000","last_clean":"2024-08-31T04:40:51.961246+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:40:51.961246+0000","last_undegraded":"2024-08-31T04:40:51.961246+0000","last_fullsized":"2024-08-31T04:40:51.961246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1665,"num_write_kb":95716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"48'2860","reported_seq":4648,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:47.167374+0000","last_change":"2024-08-31T04:10:27.670280+0000","last_active":"2024-08-31T04:43:47.167374+0000","last_peered":"2024-08-31T04:43:47.167374+0000","last_clean":"2024-08-31T04:43:47.167374+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:43:47.167374+0000","last_undegraded":"2024-08-31T04:43:47.167374+0000","last_fullsized":"2024-08-31T04:43:47.167374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:45.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006760248,"stat_sum":{"num_bytes":54090295,"num_objects":1208,"num_object_clones":563,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":563,"num_read":248,"num_read_kb":382949,"num_write":2323,"num_write_kb":60670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"48'606","reported_seq":2705,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.981507+0000","last_change":"2024-08-31T04:10:27.634493+0000","last_active":"2024-08-31T04:40:56.981507+0000","last_peered":"2024-08-31T04:40:56.981507+0000","last_clean":"2024-08-31T04:40:56.981507+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:40:56.981507+0000","last_undegraded":"2024-08-31T04:40:56.981507+0000","last_fullsized":"2024-08-31T04:40:56.981507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:55:26.933384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058567369999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":10,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"48'954","reported_seq":1208,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:57.015780+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:40:57.015780+0000","last_peered":"2024-08-31T04:40:57.015780+0000","last_clean":"2024-08-31T04:40:57.015780+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:40:57.015780+0000","last_undegraded":"2024-08-31T04:40:57.015780+0000","last_fullsized":"2024-08-31T04:40:57.015780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21620066,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":215,"num_read_kb":746,"num_write":1006,"num_write_kb":67606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"48'2946","reported_seq":4665,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.798172+0000","last_change":"2024-08-31T04:10:27.822236+0000","last_active":"2024-08-31T04:43:41.798172+0000","last_peered":"2024-08-31T04:43:41.798172+0000","last_clean":"2024-08-31T04:43:41.798172+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:43:41.798172+0000","last_undegraded":"2024-08-31T04:43:41.798172+0000","last_fullsized":"2024-08-31T04:43:41.798172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:33.068422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017565338,"stat_sum":{"num_bytes":42002217,"num_objects":1219,"num_object_clones":563,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1219,"num_whiteouts":563,"num_read":178,"num_read_kb":306206,"num_write":2428,"num_write_kb":54614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"48'2738","reported_seq":4469,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.742397+0000","last_change":"2024-08-31T04:10:27.822515+0000","last_active":"2024-08-31T04:43:41.742397+0000","last_peered":"2024-08-31T04:43:41.742397+0000","last_clean":"2024-08-31T04:43:41.742397+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:43:41.742397+0000","last_undegraded":"2024-08-31T04:43:41.742397+0000","last_fullsized":"2024-08-31T04:43:41.742397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2738,"log_dups_size":0,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:20.225606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017721323000000001,"stat_sum":{"num_bytes":29550305,"num_objects":1162,"num_object_clones":544,"num_object_copies":4648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":544,"num_read":169,"num_read_kb":167515,"num_write":2228,"num_write_kb":37428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"48'591","reported_seq":2694,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.996085+0000","last_change":"2024-08-31T04:10:27.823888+0000","last_active":"2024-08-31T04:40:51.996085+0000","last_peered":"2024-08-31T04:40:51.996085+0000","last_clean":"2024-08-31T04:40:51.996085+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:40:51.996085+0000","last_undegraded":"2024-08-31T04:40:51.996085+0000","last_fullsized":"2024-08-31T04:40:51.996085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:08:01.933323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018675580000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"48'1868","reported_seq":1951,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.980531+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:41:10.980531+0000","last_peered":"2024-08-31T04:41:10.980531+0000","last_clean":"2024-08-31T04:41:10.980531+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:41:10.980531+0000","last_undegraded":"2024-08-31T04:41:10.980531+0000","last_fullsized":"2024-08-31T04:41:10.980531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1868,"log_dups_size":0,"ondisk_log_size":1868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1929,"num_write_kb":92217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"48'2766","reported_seq":4481,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.955819+0000","last_change":"2024-08-31T04:10:27.800227+0000","last_active":"2024-08-31T04:43:31.955819+0000","last_peered":"2024-08-31T04:43:31.955819+0000","last_clean":"2024-08-31T04:43:31.955819+0000","last_became_active":"2024-08-31T04:04:41.417946+0000","last_became_peered":"2024-08-31T04:04:41.417946+0000","last_unstale":"2024-08-31T04:43:31.955819+0000","last_undegraded":"2024-08-31T04:43:31.955819+0000","last_fullsized":"2024-08-31T04:43:31.955819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:41:51.661343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00503113,"stat_sum":{"num_bytes":35643591,"num_objects":1177,"num_object_clones":542,"num_object_copies":4708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1177,"num_whiteouts":542,"num_read":158,"num_read_kb":132473,"num_write":2281,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'704","reported_seq":2801,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.317201+0000","last_change":"2024-08-31T04:10:27.641968+0000","last_active":"2024-08-31T04:43:54.317201+0000","last_peered":"2024-08-31T04:43:54.317201+0000","last_clean":"2024-08-31T04:43:54.317201+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:43:54.317201+0000","last_undegraded":"2024-08-31T04:43:54.317201+0000","last_fullsized":"2024-08-31T04:43:54.317201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:11.260535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014046813,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"48'645","reported_seq":728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.924988+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:41:01.924988+0000","last_peered":"2024-08-31T04:41:01.924988+0000","last_clean":"2024-08-31T04:41:01.924988+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:41:01.924988+0000","last_undegraded":"2024-08-31T04:41:01.924988+0000","last_fullsized":"2024-08-31T04:41:01.924988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":715,"num_write_kb":62992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"48'2252","reported_seq":2334,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.602123+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:40:43.602123+0000","last_peered":"2024-08-31T04:40:43.602123+0000","last_clean":"2024-08-31T04:40:43.602123+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:40:43.602123+0000","last_undegraded":"2024-08-31T04:40:43.602123+0000","last_fullsized":"2024-08-31T04:40:43.602123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2298,"num_write_kb":79805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'604","reported_seq":2701,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.096310+0000","last_change":"2024-08-31T04:10:27.814455+0000","last_active":"2024-08-31T04:40:43.096310+0000","last_peered":"2024-08-31T04:40:43.096310+0000","last_clean":"2024-08-31T04:40:43.096310+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:40:43.096310+0000","last_undegraded":"2024-08-31T04:40:43.096310+0000","last_fullsized":"2024-08-31T04:40:43.096310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:14.250771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013275207000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":11,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"48'2940","reported_seq":4625,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.843891+0000","last_change":"2024-08-31T04:10:27.821490+0000","last_active":"2024-08-31T04:43:41.843891+0000","last_peered":"2024-08-31T04:43:41.843891+0000","last_clean":"2024-08-31T04:43:41.843891+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:43:41.843891+0000","last_undegraded":"2024-08-31T04:43:41.843891+0000","last_fullsized":"2024-08-31T04:43:41.843891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2940,"log_dups_size":0,"ondisk_log_size":2940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:50.331472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016882483,"stat_sum":{"num_bytes":22283462,"num_objects":1259,"num_object_clones":585,"num_object_copies":5036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1259,"num_whiteouts":585,"num_read":168,"num_read_kb":61698,"num_write":2408,"num_write_kb":31485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"48'1130","reported_seq":1212,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.973278+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:41:01.973278+0000","last_peered":"2024-08-31T04:41:01.973278+0000","last_clean":"2024-08-31T04:41:01.973278+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:41:01.973278+0000","last_undegraded":"2024-08-31T04:41:01.973278+0000","last_fullsized":"2024-08-31T04:41:01.973278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1166,"num_write_kb":91251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"48'627","reported_seq":2724,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.107384+0000","last_change":"2024-08-31T04:10:27.627749+0000","last_active":"2024-08-31T04:40:43.107384+0000","last_peered":"2024-08-31T04:40:43.107384+0000","last_clean":"2024-08-31T04:40:43.107384+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:40:43.107384+0000","last_undegraded":"2024-08-31T04:40:43.107384+0000","last_fullsized":"2024-08-31T04:40:43.107384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:05.454693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038995560000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"48'2848","reported_seq":4571,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.786083+0000","last_change":"2024-08-31T04:10:27.669930+0000","last_active":"2024-08-31T04:43:41.786083+0000","last_peered":"2024-08-31T04:43:41.786083+0000","last_clean":"2024-08-31T04:43:41.786083+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:43:41.786083+0000","last_undegraded":"2024-08-31T04:43:41.786083+0000","last_fullsized":"2024-08-31T04:43:41.786083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:44.356566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065935439999999998,"stat_sum":{"num_bytes":37885613,"num_objects":1228,"num_object_clones":569,"num_object_copies":4912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1228,"num_whiteouts":569,"num_read":190,"num_read_kb":257974,"num_write":2324,"num_write_kb":54067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"48'628","reported_seq":2725,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954633+0000","last_change":"2024-08-31T04:10:27.632258+0000","last_active":"2024-08-31T04:41:30.954633+0000","last_peered":"2024-08-31T04:41:30.954633+0000","last_clean":"2024-08-31T04:41:30.954633+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:41:30.954633+0000","last_undegraded":"2024-08-31T04:41:30.954633+0000","last_fullsized":"2024-08-31T04:41:30.954633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:17:04.382806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078040410000000003,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":15,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"48'646","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:32.140522+0000","last_change":"2024-08-31T04:10:27.668912+0000","last_active":"2024-08-31T04:41:32.140522+0000","last_peered":"2024-08-31T04:41:32.140522+0000","last_clean":"2024-08-31T04:41:32.140522+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:41:32.140522+0000","last_undegraded":"2024-08-31T04:41:32.140522+0000","last_fullsized":"2024-08-31T04:41:32.140522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:32.767357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060576730000000004,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":9,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"48'618","reported_seq":2722,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954479+0000","last_change":"2024-08-31T04:10:27.682416+0000","last_active":"2024-08-31T04:41:30.954479+0000","last_peered":"2024-08-31T04:41:30.954479+0000","last_clean":"2024-08-31T04:41:30.954479+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:41:30.954479+0000","last_undegraded":"2024-08-31T04:41:30.954479+0000","last_fullsized":"2024-08-31T04:41:30.954479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:37.569659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067294099999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":8,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"48'662","reported_seq":2760,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.307324+0000","last_change":"2024-08-31T04:10:27.643926+0000","last_active":"2024-08-31T04:43:54.307324+0000","last_peered":"2024-08-31T04:43:54.307324+0000","last_clean":"2024-08-31T04:43:54.307324+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:43:54.307324+0000","last_undegraded":"2024-08-31T04:43:54.307324+0000","last_fullsized":"2024-08-31T04:43:54.307324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:22:41.496309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01443145,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"48'614","reported_seq":2713,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.282781+0000","last_change":"2024-08-31T04:10:27.827546+0000","last_active":"2024-08-31T04:43:54.282781+0000","last_peered":"2024-08-31T04:43:54.282781+0000","last_clean":"2024-08-31T04:43:54.282781+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:43:54.282781+0000","last_undegraded":"2024-08-31T04:43:54.282781+0000","last_fullsized":"2024-08-31T04:43:54.282781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:51.784003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024833572000000002,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'595","reported_seq":2699,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.276230+0000","last_change":"2024-08-31T04:10:27.824141+0000","last_active":"2024-08-31T04:43:54.276230+0000","last_peered":"2024-08-31T04:43:54.276230+0000","last_clean":"2024-08-31T04:43:54.276230+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:43:54.276230+0000","last_undegraded":"2024-08-31T04:43:54.276230+0000","last_fullsized":"2024-08-31T04:43:54.276230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:33:51.196460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024839776000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"48'636","reported_seq":2739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.981571+0000","last_change":"2024-08-31T04:10:27.634372+0000","last_active":"2024-08-31T04:40:56.981571+0000","last_peered":"2024-08-31T04:40:56.981571+0000","last_clean":"2024-08-31T04:40:56.981571+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:40:56.981571+0000","last_undegraded":"2024-08-31T04:40:56.981571+0000","last_fullsized":"2024-08-31T04:40:56.981571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:59.694688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060308059999999997,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"48'593","reported_seq":2698,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.307572+0000","last_change":"2024-08-31T04:10:27.644765+0000","last_active":"2024-08-31T04:43:54.307572+0000","last_peered":"2024-08-31T04:43:54.307572+0000","last_clean":"2024-08-31T04:43:54.307572+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:43:54.307572+0000","last_undegraded":"2024-08-31T04:43:54.307572+0000","last_fullsized":"2024-08-31T04:43:54.307572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:50.112615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012931465,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":6,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"48'617","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:55.950214+0000","last_change":"2024-08-31T04:10:27.681657+0000","last_active":"2024-08-31T04:40:55.950214+0000","last_peered":"2024-08-31T04:40:55.950214+0000","last_clean":"2024-08-31T04:40:55.950214+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:40:55.950214+0000","last_undegraded":"2024-08-31T04:40:55.950214+0000","last_fullsized":"2024-08-31T04:40:55.950214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:16.233374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062469689999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"48'592","reported_seq":2696,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.314417+0000","last_change":"2024-08-31T04:10:27.638483+0000","last_active":"2024-08-31T04:43:54.314417+0000","last_peered":"2024-08-31T04:43:54.314417+0000","last_clean":"2024-08-31T04:43:54.314417+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:43:54.314417+0000","last_undegraded":"2024-08-31T04:43:54.314417+0000","last_fullsized":"2024-08-31T04:43:54.314417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:09.181389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011311599,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"48'641","reported_seq":2739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:39.009032+0000","last_change":"2024-08-31T04:10:27.626932+0000","last_active":"2024-08-31T04:40:39.009032+0000","last_peered":"2024-08-31T04:40:39.009032+0000","last_clean":"2024-08-31T04:40:39.009032+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:40:39.009032+0000","last_undegraded":"2024-08-31T04:40:39.009032+0000","last_fullsized":"2024-08-31T04:40:39.009032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:29.687132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035095819999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"48'602","reported_seq":2704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.096155+0000","last_change":"2024-08-31T04:10:27.806718+0000","last_active":"2024-08-31T04:40:43.096155+0000","last_peered":"2024-08-31T04:40:43.096155+0000","last_clean":"2024-08-31T04:40:43.096155+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:40:43.096155+0000","last_undegraded":"2024-08-31T04:40:43.096155+0000","last_fullsized":"2024-08-31T04:40:43.096155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:40.726314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055677180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"48'635","reported_seq":2733,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:38.729639+0000","last_change":"2024-08-31T04:10:27.799928+0000","last_active":"2024-08-31T04:40:38.729639+0000","last_peered":"2024-08-31T04:40:38.729639+0000","last_clean":"2024-08-31T04:40:38.729639+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:40:38.729639+0000","last_undegraded":"2024-08-31T04:40:38.729639+0000","last_fullsized":"2024-08-31T04:40:38.729639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:49.971542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047976060000000003,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"48'637","reported_seq":2737,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:38.731595+0000","last_change":"2024-08-31T04:10:27.683751+0000","last_active":"2024-08-31T04:40:38.731595+0000","last_peered":"2024-08-31T04:40:38.731595+0000","last_clean":"2024-08-31T04:40:38.731595+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:40:38.731595+0000","last_undegraded":"2024-08-31T04:40:38.731595+0000","last_fullsized":"2024-08-31T04:40:38.731595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:15:51.447225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066178469999999996,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"48'584","reported_seq":2683,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:22.138621+0000","last_change":"2024-08-31T04:10:27.671492+0000","last_active":"2024-08-31T04:41:22.138621+0000","last_peered":"2024-08-31T04:41:22.138621+0000","last_clean":"2024-08-31T04:41:22.138621+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:41:22.138621+0000","last_undegraded":"2024-08-31T04:41:22.138621+0000","last_fullsized":"2024-08-31T04:41:22.138621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:08:25.848770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050893520000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"48'629","reported_seq":2733,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953329+0000","last_change":"2024-08-31T04:10:27.683243+0000","last_active":"2024-08-31T04:41:20.953329+0000","last_peered":"2024-08-31T04:41:20.953329+0000","last_clean":"2024-08-31T04:41:20.953329+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:41:20.953329+0000","last_undegraded":"2024-08-31T04:41:20.953329+0000","last_fullsized":"2024-08-31T04:41:20.953329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:05:34.589760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068720639999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":6,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"48'604","reported_seq":2707,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953215+0000","last_change":"2024-08-31T04:10:27.680920+0000","last_active":"2024-08-31T04:41:20.953215+0000","last_peered":"2024-08-31T04:41:20.953215+0000","last_clean":"2024-08-31T04:41:20.953215+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:41:20.953215+0000","last_undegraded":"2024-08-31T04:41:20.953215+0000","last_fullsized":"2024-08-31T04:41:20.953215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:22.809894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059141749999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":7,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"48'651","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.308059+0000","last_change":"2024-08-31T04:10:27.636678+0000","last_active":"2024-08-31T04:43:54.308059+0000","last_peered":"2024-08-31T04:43:54.308059+0000","last_clean":"2024-08-31T04:43:54.308059+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:43:54.308059+0000","last_undegraded":"2024-08-31T04:43:54.308059+0000","last_fullsized":"2024-08-31T04:43:54.308059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:48:32.668716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098583990000000003,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"48'622","reported_seq":2720,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.290857+0000","last_change":"2024-08-31T04:10:27.829545+0000","last_active":"2024-08-31T04:43:54.290857+0000","last_peered":"2024-08-31T04:43:54.290857+0000","last_clean":"2024-08-31T04:43:54.290857+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:43:54.290857+0000","last_undegraded":"2024-08-31T04:43:54.290857+0000","last_fullsized":"2024-08-31T04:43:54.290857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:56:41.550447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023950035000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":12,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"48'599","reported_seq":2699,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.281814+0000","last_change":"2024-08-31T04:10:27.827114+0000","last_active":"2024-08-31T04:43:54.281814+0000","last_peered":"2024-08-31T04:43:54.281814+0000","last_clean":"2024-08-31T04:43:54.281814+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:43:54.281814+0000","last_undegraded":"2024-08-31T04:43:54.281814+0000","last_fullsized":"2024-08-31T04:43:54.281814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:28.164149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025118893999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'592","reported_seq":2693,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.033771+0000","last_change":"2024-08-31T04:10:27.800501+0000","last_active":"2024-08-31T04:40:43.033771+0000","last_peered":"2024-08-31T04:40:43.033771+0000","last_clean":"2024-08-31T04:40:43.033771+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:40:43.033771+0000","last_undegraded":"2024-08-31T04:40:43.033771+0000","last_fullsized":"2024-08-31T04:40:43.033771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:19.639843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051269660000000002,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"48'621","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:39.022887+0000","last_change":"2024-08-31T04:10:27.799550+0000","last_active":"2024-08-31T04:40:39.022887+0000","last_peered":"2024-08-31T04:40:39.022887+0000","last_clean":"2024-08-31T04:40:39.022887+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:40:39.022887+0000","last_undegraded":"2024-08-31T04:40:39.022887+0000","last_fullsized":"2024-08-31T04:40:39.022887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:56:52.315777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045307300000000002,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"48'570","reported_seq":2668,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:39.013045+0000","last_change":"2024-08-31T04:10:27.801153+0000","last_active":"2024-08-31T04:40:39.013045+0000","last_peered":"2024-08-31T04:40:39.013045+0000","last_clean":"2024-08-31T04:40:39.013045+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:40:39.013045+0000","last_undegraded":"2024-08-31T04:40:39.013045+0000","last_fullsized":"2024-08-31T04:40:39.013045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:49:14.674631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053663419999999996,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"48'620","reported_seq":2719,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.053543+0000","last_change":"2024-08-31T04:10:27.627028+0000","last_active":"2024-08-31T04:40:43.053543+0000","last_peered":"2024-08-31T04:40:43.053543+0000","last_clean":"2024-08-31T04:40:43.053543+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:40:43.053543+0000","last_undegraded":"2024-08-31T04:40:43.053543+0000","last_fullsized":"2024-08-31T04:40:43.053543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:14:52.550351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003298704,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"48'581","reported_seq":2681,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.317590+0000","last_change":"2024-08-31T04:10:27.635962+0000","last_active":"2024-08-31T04:43:54.317590+0000","last_peered":"2024-08-31T04:43:54.317590+0000","last_clean":"2024-08-31T04:43:54.317590+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:43:54.317590+0000","last_undegraded":"2024-08-31T04:43:54.317590+0000","last_fullsized":"2024-08-31T04:43:54.317590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:43:12.087921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0091212849999999998,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'607","reported_seq":2703,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.052964+0000","last_change":"2024-08-31T04:10:27.796436+0000","last_active":"2024-08-31T04:40:43.052964+0000","last_peered":"2024-08-31T04:40:43.052964+0000","last_clean":"2024-08-31T04:40:43.052964+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:40:43.052964+0000","last_undegraded":"2024-08-31T04:40:43.052964+0000","last_fullsized":"2024-08-31T04:40:43.052964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:45.563958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020846939999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"48'587","reported_seq":2682,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.976350+0000","last_change":"2024-08-31T04:10:27.632700+0000","last_active":"2024-08-31T04:40:56.976350+0000","last_peered":"2024-08-31T04:40:56.976350+0000","last_clean":"2024-08-31T04:40:56.976350+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:40:56.976350+0000","last_undegraded":"2024-08-31T04:40:56.976350+0000","last_fullsized":"2024-08-31T04:40:56.976350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:47.487017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079797440000000004,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":13,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"48'662","reported_seq":2751,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.108705+0000","last_change":"2024-08-31T04:10:27.799557+0000","last_active":"2024-08-31T04:40:43.108705+0000","last_peered":"2024-08-31T04:40:43.108705+0000","last_clean":"2024-08-31T04:40:43.108705+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:40:43.108705+0000","last_undegraded":"2024-08-31T04:40:43.108705+0000","last_fullsized":"2024-08-31T04:40:43.108705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:41.279910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047669089999999997,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":19,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":19,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"48'616","reported_seq":2723,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.052569+0000","last_change":"2024-08-31T04:10:27.633848+0000","last_active":"2024-08-31T04:40:43.052569+0000","last_peered":"2024-08-31T04:40:43.052569+0000","last_clean":"2024-08-31T04:40:43.052569+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:40:43.052569+0000","last_undegraded":"2024-08-31T04:40:43.052569+0000","last_fullsized":"2024-08-31T04:40:43.052569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:19:00.071541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063128230000000004,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":5,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":5,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"48'624","reported_seq":2726,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.304567+0000","last_change":"2024-08-31T04:10:27.643240+0000","last_active":"2024-08-31T04:43:54.304567+0000","last_peered":"2024-08-31T04:43:54.304567+0000","last_clean":"2024-08-31T04:43:54.304567+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:43:54.304567+0000","last_undegraded":"2024-08-31T04:43:54.304567+0000","last_fullsized":"2024-08-31T04:43:54.304567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:28:05.502942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013845079999999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"48'584","reported_seq":2687,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.304120+0000","last_change":"2024-08-31T04:10:27.645944+0000","last_active":"2024-08-31T04:43:54.304120+0000","last_peered":"2024-08-31T04:43:54.304120+0000","last_clean":"2024-08-31T04:43:54.304120+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:43:54.304120+0000","last_undegraded":"2024-08-31T04:43:54.304120+0000","last_fullsized":"2024-08-31T04:43:54.304120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:47:36.656806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012861716,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"48'593","reported_seq":2690,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954204+0000","last_change":"2024-08-31T04:10:27.800212+0000","last_active":"2024-08-31T04:41:30.954204+0000","last_peered":"2024-08-31T04:41:30.954204+0000","last_clean":"2024-08-31T04:41:30.954204+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:41:30.954204+0000","last_undegraded":"2024-08-31T04:41:30.954204+0000","last_fullsized":"2024-08-31T04:41:30.954204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:06.926644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048876299999999996,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1171046334,"num_objects":39264,"num_object_clones":18317,"num_object_copies":157056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39264,"num_whiteouts":18141,"num_read":5740,"num_read_kb":6745896,"num_write":75481,"num_write_kb":1474785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2548367360,"data_stored":2549710848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92337,"ondisk_log_size":92337,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":2792,"num_object_clones":669,"num_object_copies":5584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2792,"num_whiteouts":669,"num_read":0,"num_read_kb":0,"num_write":2800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39272,"ondisk_log_size":39272,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":830791811,"num_objects":1713,"num_object_clones":0,"num_object_copies":3426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1713,"num_whiteouts":0,"num_read":2588,"num_read_kb":5535,"num_write":35390,"num_write_kb":2443309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1661648896,"data_stored":1661583622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31617,"ondisk_log_size":31617,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477220,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":996976,"kb_used_data":627232,"kb_used_omap":1,"kb_used_meta":369726,"kb_avail":93374864,"statfs":{"total":96636764160,"available":95615860736,"internally_reserved":0,"allocated":642285568,"data_stored":642183134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":378599879},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477220,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":638272,"kb_used_data":418288,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93733568,"statfs":{"total":96636764160,"available":95983173632,"internally_reserved":0,"allocated":428326912,"data_stored":428055527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477221,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":857192,"kb_used_data":569176,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93514648,"statfs":{"total":96636764160,"available":95758999552,"internally_reserved":0,"allocated":582836224,"data_stored":582730273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477221,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":813360,"kb_used_data":525408,"kb_used_omap":1,"kb_used_meta":287934,"kb_avail":93558480,"statfs":{"total":96636764160,"available":95803883520,"internally_reserved":0,"allocated":538017792,"data_stored":537913727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294844869},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509924,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":692036,"kb_used_data":458228,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":93679804,"statfs":{"total":96636764160,"available":95928119296,"internally_reserved":0,"allocated":469225472,"data_stored":469129543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239401414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509925,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757676,"kb_used_data":487772,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":93614164,"statfs":{"total":96636764160,"available":95860903936,"internally_reserved":0,"allocated":499478528,"data_stored":499539157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509923,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":811432,"kb_used_data":549848,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":93560408,"statfs":{"total":96636764160,"available":95805857792,"internally_reserved":0,"allocated":563044352,"data_stored":563095610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267844037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575332,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":754968,"kb_used_data":480840,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93616872,"statfs":{"total":96636764160,"available":95863676928,"internally_reserved":0,"allocated":492380160,"data_stored":492108227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":314580992,"data_stored":314572856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":201986048,"data_stored":201979578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":113254400,"data_stored":113246880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":284884992,"data_stored":284878487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":243605504,"data_stored":243584755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":226504704,"data_stored":226496878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":138412032,"data_stored":138412032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":138420224,"data_stored":138412156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":222887936,"data_stored":223055872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":379707392,"data_stored":379875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":314523648,"data_stored":314523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":356851712,"data_stored":357019648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":318889984,"data_stored":319225856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":271831040,"data_stored":272166912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":330264576,"data_stored":330432512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":353411072,"data_stored":353411072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:43:55.864 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-31T04:43:55.864 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:43:56.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 -- 172.21.15.89:0/3440594541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a4074e20 msgr2=0x7fa2a4156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 --2- 172.21.15.89:0/3440594541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a4074e20 0x7fa2a4156e10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa2a415a460 tx=0x7fa29401f090 comp rx=0 tx=0).stop 2024-08-31T04:43:56.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 -- 172.21.15.89:0/3440594541 shutdown_connections 2024-08-31T04:43:56.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 --2- 172.21.15.89:0/3440594541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a415d220 0x7fa2a40c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 --2- 172.21.15.89:0/3440594541 >> v2:172.21.15.170:3300/0 conn(0x7fa2a415ce10 0x7fa2a40c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 --2- 172.21.15.89:0/3440594541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a4074e20 0x7fa2a4156e10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 -- 172.21.15.89:0/3440594541 >> 172.21.15.89:0/3440594541 conn(0x7fa2a40ccf20 msgr2=0x7fa2a40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:56.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 -- 172.21.15.89:0/3440594541 shutdown_connections 2024-08-31T04:43:56.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 -- 172.21.15.89:0/3440594541 wait complete. 2024-08-31T04:43:56.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 Processor -- start 2024-08-31T04:43:56.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.051+0000 7fa2aa000640 1 -- start start 2024-08-31T04:43:56.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2aa000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a4074e20 0x7fa2a4157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:56.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2aa000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a415ce10 0x7fa2a415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:56.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2aa000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a415d220 0x7fa2a41522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:56.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2aa000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4159c90 con 0x7fa2a415ce10 2024-08-31T04:43:56.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2aa000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41599b0 con 0x7fa2a415d220 2024-08-31T04:43:56.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2aa000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a4159f70 con 0x7fa2a4074e20 2024-08-31T04:43:56.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a415ce10 0x7fa2a415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:56.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29aa00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a415ce10 0x7fa2a415aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49496/0 (socket says 172.21.15.89:49496) 2024-08-31T04:43:56.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29aa00640 1 -- 172.21.15.89:0/249758680 learned_addr learned my addr 172.21.15.89:0/249758680 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:56.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2a3400640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a4074e20 0x7fa2a4157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:56.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2a3e00640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a415d220 0x7fa2a41522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:56.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29aa00640 1 -- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a4074e20 msgr2=0x7fa2a4157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29aa00640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a4074e20 0x7fa2a4157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29aa00640 1 -- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a415d220 msgr2=0x7fa2a41522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29aa00640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a415d220 0x7fa2a41522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29aa00640 1 -- 172.21.15.89:0/249758680 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a4157c70 con 0x7fa2a415ce10 2024-08-31T04:43:56.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2a3400640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a4074e20 0x7fa2a4157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:56.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29aa00640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a415ce10 0x7fa2a415aef0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00d700 tx=0x7fa28c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:56.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29be00640 1 -- 172.21.15.89:0/249758680 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c017070 con 0x7fa2a415ce10 2024-08-31T04:43:56.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29be00640 1 -- 172.21.15.89:0/249758680 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa28c009b10 con 0x7fa2a415ce10 2024-08-31T04:43:56.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa29be00640 1 -- 172.21.15.89:0/249758680 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c010460 con 0x7fa2a415ce10 2024-08-31T04:43:56.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a40cc620 con 0x7fa2a415ce10 2024-08-31T04:43:56.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a415b9e0 con 0x7fa2a415ce10 2024-08-31T04:43:56.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.055+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a4071e40 con 0x7fa2a415ce10 2024-08-31T04:43:56.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.059+0000 7fa29be00640 1 -- 172.21.15.89:0/249758680 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fa28c01a070 con 0x7fa2a415ce10 2024-08-31T04:43:56.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.059+0000 7fa29be00640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa2800720c0 0x7fa2800745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:56.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.059+0000 7fa29be00640 1 -- 172.21.15.89:0/249758680 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fa28c093170 con 0x7fa2a415ce10 2024-08-31T04:43:56.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.059+0000 7fa2a3400640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa2800720c0 0x7fa2800745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:56.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.059+0000 7fa2a3400640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa2800720c0 0x7fa2800745d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa2940b2000 tx=0x7fa29401d8d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:56.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.063+0000 7fa29be00640 1 -- 172.21.15.89:0/249758680 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa28c05e650 con 0x7fa2a415ce10 2024-08-31T04:43:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.223+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2a40c7b40 con 0x7fa2800720c0 2024-08-31T04:43:56.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.239+0000 7fa29be00640 1 -- 172.21.15.89:0/249758680 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+338116 (secure 0 0 0) 0x7fa2a40c7b40 con 0x7fa2800720c0 2024-08-31T04:43:56.246 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:43:56.248 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:43:56.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa2800720c0 msgr2=0x7fa2800745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa2800720c0 0x7fa2800745d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa2940b2000 tx=0x7fa29401d8d0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a415ce10 msgr2=0x7fa2a415aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a415ce10 0x7fa2a415aef0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00d700 tx=0x7fa28c00dbc0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 shutdown_connections 2024-08-31T04:43:56.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fa2800720c0 0x7fa2800745d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a415ce10 0x7fa2a415aef0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a415d220 0x7fa2a41522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 --2- 172.21.15.89:0/249758680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a4074e20 0x7fa2a4157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 >> 172.21.15.89:0/249758680 conn(0x7fa2a40ccf20 msgr2=0x7fa2a414cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:56.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 shutdown_connections 2024-08-31T04:43:56.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.247+0000 7fa2aa000640 1 -- 172.21.15.89:0/249758680 wait complete. 2024-08-31T04:43:56.268 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1245,"stamp":"2024-08-31T04:43:55.291863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2002428513,"num_objects":43771,"num_object_clones":18986,"num_object_copies":166070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43771,"num_whiteouts":18810,"num_read":8394,"num_read_kb":6751486,"num_write":113772,"num_write_kb":3919722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163298,"ondisk_log_size":163298,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6321912,"kb_used_data":4116792,"kb_used_omap":12,"kb_used_meta":2204979,"kb_avail":748652808,"statfs":{"total":773094113280,"available":766620475392,"internally_reserved":0,"allocated":4215595008,"data_stored":4214755198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":2257899056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2082,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":13015,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005976"},"pg_stats":[{"pgid":"2.1f","version":"48'789","reported_seq":875,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.483441+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:43:41.483441+0000","last_peered":"2024-08-31T04:43:41.483441+0000","last_clean":"2024-08-31T04:43:41.483441+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:43:41.483441+0000","last_undegraded":"2024-08-31T04:43:41.483441+0000","last_fullsized":"2024-08-31T04:43:41.483441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37414551,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":823,"num_write_kb":58134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"48'592","reported_seq":2696,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.303935+0000","last_change":"2024-08-31T04:10:27.645410+0000","last_active":"2024-08-31T04:43:54.303935+0000","last_peered":"2024-08-31T04:43:54.303935+0000","last_clean":"2024-08-31T04:43:54.303935+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:43:54.303935+0000","last_undegraded":"2024-08-31T04:43:54.303935+0000","last_fullsized":"2024-08-31T04:43:54.303935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:46.278499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012836803000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"48'2838","reported_seq":4603,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.098808+0000","last_change":"2024-08-31T04:10:27.668465+0000","last_active":"2024-08-31T04:43:51.098808+0000","last_peered":"2024-08-31T04:43:51.098808+0000","last_clean":"2024-08-31T04:43:51.098808+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:43:51.098808+0000","last_undegraded":"2024-08-31T04:43:51.098808+0000","last_fullsized":"2024-08-31T04:43:51.098808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2838,"log_dups_size":0,"ondisk_log_size":2838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:56:27.977319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058952350000000004,"stat_sum":{"num_bytes":50597461,"num_objects":1198,"num_object_clones":550,"num_object_copies":4792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1198,"num_whiteouts":550,"num_read":212,"num_read_kb":376919,"num_write":2332,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"48'672","reported_seq":758,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.189267+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:41:10.189267+0000","last_peered":"2024-08-31T04:41:10.189267+0000","last_clean":"2024-08-31T04:41:10.189267+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:41:10.189267+0000","last_undegraded":"2024-08-31T04:41:10.189267+0000","last_fullsized":"2024-08-31T04:41:10.189267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":697,"num_write_kb":66604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"48'579","reported_seq":2684,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315803+0000","last_change":"2024-08-31T04:10:27.645689+0000","last_active":"2024-08-31T04:43:54.315803+0000","last_peered":"2024-08-31T04:43:54.315803+0000","last_clean":"2024-08-31T04:43:54.315803+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:43:54.315803+0000","last_undegraded":"2024-08-31T04:43:54.315803+0000","last_fullsized":"2024-08-31T04:43:54.315803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:21.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012881510000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"48'3007","reported_seq":4768,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.337761+0000","last_change":"2024-08-31T04:10:27.629997+0000","last_active":"2024-08-31T04:43:31.337761+0000","last_peered":"2024-08-31T04:43:31.337761+0000","last_clean":"2024-08-31T04:43:31.337761+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:43:31.337761+0000","last_undegraded":"2024-08-31T04:43:31.337761+0000","last_fullsized":"2024-08-31T04:43:31.337761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:34:13.962324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059980260000000001,"stat_sum":{"num_bytes":71770879,"num_objects":1258,"num_object_clones":586,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":586,"num_read":244,"num_read_kb":407504,"num_write":2470,"num_write_kb":85232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"48'1251","reported_seq":1333,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.959569+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:40:51.959569+0000","last_peered":"2024-08-31T04:40:51.959569+0000","last_clean":"2024-08-31T04:40:51.959569+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:40:51.959569+0000","last_undegraded":"2024-08-31T04:40:51.959569+0000","last_fullsized":"2024-08-31T04:40:51.959569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1251,"log_dups_size":0,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:13.479523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1281,"num_write_kb":120075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"48'616","reported_seq":2715,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.968852+0000","last_change":"2024-08-31T04:10:27.626701+0000","last_active":"2024-08-31T04:40:56.968852+0000","last_peered":"2024-08-31T04:40:56.968852+0000","last_clean":"2024-08-31T04:40:56.968852+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:40:56.968852+0000","last_undegraded":"2024-08-31T04:40:56.968852+0000","last_fullsized":"2024-08-31T04:40:56.968852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:11:39.748424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032840360000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"48'3005","reported_seq":4694,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.758723+0000","last_change":"2024-08-31T04:10:27.632736+0000","last_active":"2024-08-31T04:43:41.758723+0000","last_peered":"2024-08-31T04:43:41.758723+0000","last_clean":"2024-08-31T04:43:41.758723+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:43:41.758723+0000","last_undegraded":"2024-08-31T04:43:41.758723+0000","last_fullsized":"2024-08-31T04:43:41.758723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:27.569361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058445240000000002,"stat_sum":{"num_bytes":38693415,"num_objects":1292,"num_object_clones":602,"num_object_copies":5168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":602,"num_read":189,"num_read_kb":291224,"num_write":2458,"num_write_kb":41612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"48'400","reported_seq":482,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.971895+0000","last_change":"2024-08-31T04:03:59.850344+0000","last_active":"2024-08-31T04:41:01.971895+0000","last_peered":"2024-08-31T04:41:01.971895+0000","last_clean":"2024-08-31T04:41:01.971895+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:41:01.971895+0000","last_undegraded":"2024-08-31T04:41:01.971895+0000","last_fullsized":"2024-08-31T04:41:01.971895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:03.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":451,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"48'585","reported_seq":2687,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.968477+0000","last_change":"2024-08-31T04:10:27.683387+0000","last_active":"2024-08-31T04:40:51.968477+0000","last_peered":"2024-08-31T04:40:51.968477+0000","last_clean":"2024-08-31T04:40:51.968477+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:40:51.968477+0000","last_undegraded":"2024-08-31T04:40:51.968477+0000","last_fullsized":"2024-08-31T04:40:51.968477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:29:21.522834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070378919999999996,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"48'2845","reported_seq":4609,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:07.038822+0000","last_change":"2024-08-31T04:10:27.629946+0000","last_active":"2024-08-31T04:43:07.038822+0000","last_peered":"2024-08-31T04:43:07.038822+0000","last_clean":"2024-08-31T04:43:07.038822+0000","last_became_active":"2024-08-31T04:04:41.418200+0000","last_became_peered":"2024-08-31T04:04:41.418200+0000","last_unstale":"2024-08-31T04:43:07.038822+0000","last_undegraded":"2024-08-31T04:43:07.038822+0000","last_fullsized":"2024-08-31T04:43:07.038822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:27.685667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059467970000000002,"stat_sum":{"num_bytes":46428419,"num_objects":1209,"num_object_clones":554,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":554,"num_read":208,"num_read_kb":267627,"num_write":2344,"num_write_kb":53603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"48'611","reported_seq":2711,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:55.950255+0000","last_change":"2024-08-31T04:10:27.682710+0000","last_active":"2024-08-31T04:40:55.950255+0000","last_peered":"2024-08-31T04:40:55.950255+0000","last_clean":"2024-08-31T04:40:55.950255+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:40:55.950255+0000","last_undegraded":"2024-08-31T04:40:55.950255+0000","last_fullsized":"2024-08-31T04:40:55.950255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.550862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068528089999999996,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"48'1182","reported_seq":1266,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.979593+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:41:10.979593+0000","last_peered":"2024-08-31T04:41:10.979593+0000","last_clean":"2024-08-31T04:41:10.979593+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:41:10.979593+0000","last_undegraded":"2024-08-31T04:41:10.979593+0000","last_fullsized":"2024-08-31T04:41:10.979593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1278,"num_write_kb":83819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"48'2943","reported_seq":4739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.900700+0000","last_change":"2024-08-31T04:10:27.682154+0000","last_active":"2024-08-31T04:43:31.900700+0000","last_peered":"2024-08-31T04:43:31.900700+0000","last_clean":"2024-08-31T04:43:31.900700+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:43:31.900700+0000","last_undegraded":"2024-08-31T04:43:31.900700+0000","last_fullsized":"2024-08-31T04:43:31.900700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:43.247408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066428290000000003,"stat_sum":{"num_bytes":56765051,"num_objects":1275,"num_object_clones":585,"num_object_copies":5100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1275,"num_whiteouts":585,"num_read":277,"num_read_kb":424079,"num_write":2416,"num_write_kb":67833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"48'620","reported_seq":2720,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.100428+0000","last_change":"2024-08-31T04:10:27.670686+0000","last_active":"2024-08-31T04:40:43.100428+0000","last_peered":"2024-08-31T04:40:43.100428+0000","last_clean":"2024-08-31T04:40:43.100428+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:40:43.100428+0000","last_undegraded":"2024-08-31T04:40:43.100428+0000","last_fullsized":"2024-08-31T04:40:43.100428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:35.821184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066355329999999999,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"48'686","reported_seq":771,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.978927+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:41:10.978927+0000","last_peered":"2024-08-31T04:41:10.978927+0000","last_clean":"2024-08-31T04:41:10.978927+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:41:10.978927+0000","last_undegraded":"2024-08-31T04:41:10.978927+0000","last_fullsized":"2024-08-31T04:41:10.978927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":738,"num_write_kb":87340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"48'2909","reported_seq":4540,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:07.042576+0000","last_change":"2024-08-31T04:10:27.799102+0000","last_active":"2024-08-31T04:43:07.042576+0000","last_peered":"2024-08-31T04:43:07.042576+0000","last_clean":"2024-08-31T04:43:07.042576+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:43:07.042576+0000","last_undegraded":"2024-08-31T04:43:07.042576+0000","last_fullsized":"2024-08-31T04:43:07.042576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2909,"log_dups_size":0,"ondisk_log_size":2909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:44:32.822098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043859299999999997,"stat_sum":{"num_bytes":16936662,"num_objects":1190,"num_object_clones":558,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":558,"num_read":85,"num_read_kb":9403,"num_write":2392,"num_write_kb":37720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"48'650","reported_seq":2747,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:50.444732+0000","last_change":"2024-08-31T04:10:27.821258+0000","last_active":"2024-08-31T04:40:50.444732+0000","last_peered":"2024-08-31T04:40:50.444732+0000","last_clean":"2024-08-31T04:40:50.444732+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:40:50.444732+0000","last_undegraded":"2024-08-31T04:40:50.444732+0000","last_fullsized":"2024-08-31T04:40:50.444732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:06.689884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018377836000000002,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":14,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"48'562","reported_seq":647,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.856125+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:40:56.856125+0000","last_peered":"2024-08-31T04:40:56.856125+0000","last_clean":"2024-08-31T04:40:56.856125+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:40:56.856125+0000","last_undegraded":"2024-08-31T04:40:56.856125+0000","last_fullsized":"2024-08-31T04:40:56.856125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":615,"num_write_kb":58408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"48'2896","reported_seq":4576,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.040546+0000","last_change":"2024-08-31T04:10:27.671256+0000","last_active":"2024-08-31T04:43:51.040546+0000","last_peered":"2024-08-31T04:43:51.040546+0000","last_clean":"2024-08-31T04:43:51.040546+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:43:51.040546+0000","last_undegraded":"2024-08-31T04:43:51.040546+0000","last_fullsized":"2024-08-31T04:43:51.040546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2896,"log_dups_size":0,"ondisk_log_size":2896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:44.158201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070696559999999997,"stat_sum":{"num_bytes":20275415,"num_objects":1227,"num_object_clones":567,"num_object_copies":4908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1227,"num_whiteouts":567,"num_read":143,"num_read_kb":118630,"num_write":2381,"num_write_kb":31494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'627","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:50.949382+0000","last_change":"2024-08-31T04:10:27.681396+0000","last_active":"2024-08-31T04:40:50.949382+0000","last_peered":"2024-08-31T04:40:50.949382+0000","last_clean":"2024-08-31T04:40:50.949382+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:40:50.949382+0000","last_undegraded":"2024-08-31T04:40:50.949382+0000","last_fullsized":"2024-08-31T04:40:50.949382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:59:06.965998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060537480000000003,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"48'371","reported_seq":456,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.972445+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:41:01.972445+0000","last_peered":"2024-08-31T04:41:01.972445+0000","last_clean":"2024-08-31T04:41:01.972445+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:41:01.972445+0000","last_undegraded":"2024-08-31T04:41:01.972445+0000","last_fullsized":"2024-08-31T04:41:01.972445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":417,"num_write_kb":42100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"48'2828","reported_seq":4501,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.825205+0000","last_change":"2024-08-31T04:10:27.634238+0000","last_active":"2024-08-31T04:43:41.825205+0000","last_peered":"2024-08-31T04:43:41.825205+0000","last_clean":"2024-08-31T04:43:41.825205+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:43:41.825205+0000","last_undegraded":"2024-08-31T04:43:41.825205+0000","last_fullsized":"2024-08-31T04:43:41.825205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2828,"log_dups_size":0,"ondisk_log_size":2828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:01:42.230553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062106380000000001,"stat_sum":{"num_bytes":38082532,"num_objects":1243,"num_object_clones":581,"num_object_copies":4972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1243,"num_whiteouts":581,"num_read":150,"num_read_kb":116527,"num_write":2283,"num_write_kb":45420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"48'601","reported_seq":2701,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:50.444879+0000","last_change":"2024-08-31T04:10:27.824154+0000","last_active":"2024-08-31T04:40:50.444879+0000","last_peered":"2024-08-31T04:40:50.444879+0000","last_clean":"2024-08-31T04:40:50.444879+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:40:50.444879+0000","last_undegraded":"2024-08-31T04:40:50.444879+0000","last_fullsized":"2024-08-31T04:40:50.444879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:58.773731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018455160000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"48'542","reported_seq":627,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.979531+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:41:10.979531+0000","last_peered":"2024-08-31T04:41:10.979531+0000","last_clean":"2024-08-31T04:41:10.979531+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:41:10.979531+0000","last_undegraded":"2024-08-31T04:41:10.979531+0000","last_fullsized":"2024-08-31T04:41:10.979531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":604,"num_write_kb":70753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"48'2858","reported_seq":4620,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.781881+0000","last_change":"2024-08-31T04:10:27.632339+0000","last_active":"2024-08-31T04:43:41.781881+0000","last_peered":"2024-08-31T04:43:41.781881+0000","last_clean":"2024-08-31T04:43:41.781881+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:43:41.781881+0000","last_undegraded":"2024-08-31T04:43:41.781881+0000","last_fullsized":"2024-08-31T04:43:41.781881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:58.968159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076718680000000001,"stat_sum":{"num_bytes":46058979,"num_objects":1175,"num_object_clones":539,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":539,"num_read":195,"num_read_kb":329230,"num_write":2367,"num_write_kb":53816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"48'571","reported_seq":2669,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.995777+0000","last_change":"2024-08-31T04:10:27.825042+0000","last_active":"2024-08-31T04:40:51.995777+0000","last_peered":"2024-08-31T04:40:51.995777+0000","last_clean":"2024-08-31T04:40:51.995777+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:40:51.995777+0000","last_undegraded":"2024-08-31T04:40:51.995777+0000","last_fullsized":"2024-08-31T04:40:51.995777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:27.395562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019117552999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":13,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"48'1959","reported_seq":2044,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:01.067325+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:43:01.067325+0000","last_peered":"2024-08-31T04:43:01.067325+0000","last_clean":"2024-08-31T04:43:01.067325+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:43:01.067325+0000","last_undegraded":"2024-08-31T04:43:01.067325+0000","last_fullsized":"2024-08-31T04:43:01.067325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":4153,"num_write_kb":64616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"48'2942","reported_seq":4706,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:37.314647+0000","last_change":"2024-08-31T04:10:27.820585+0000","last_active":"2024-08-31T04:43:37.314647+0000","last_peered":"2024-08-31T04:43:37.314647+0000","last_clean":"2024-08-31T04:43:37.314647+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:43:37.314647+0000","last_undegraded":"2024-08-31T04:43:37.314647+0000","last_fullsized":"2024-08-31T04:43:37.314647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2942,"log_dups_size":0,"ondisk_log_size":2942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:41:28.078827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018717636999999999,"stat_sum":{"num_bytes":43745379,"num_objects":1223,"num_object_clones":566,"num_object_copies":4892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1223,"num_whiteouts":566,"num_read":224,"num_read_kb":327563,"num_write":2430,"num_write_kb":52706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"48'636","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.295540+0000","last_change":"2024-08-31T04:10:27.827955+0000","last_active":"2024-08-31T04:43:54.295540+0000","last_peered":"2024-08-31T04:43:54.295540+0000","last_clean":"2024-08-31T04:43:54.295540+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:43:54.295540+0000","last_undegraded":"2024-08-31T04:43:54.295540+0000","last_fullsized":"2024-08-31T04:43:54.295540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:49.670904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024325223999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":20,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"48'1150","reported_seq":1236,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:35.955058+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:41:35.955058+0000","last_peered":"2024-08-31T04:41:35.955058+0000","last_clean":"2024-08-31T04:41:35.955058+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:41:35.955058+0000","last_undegraded":"2024-08-31T04:41:35.955058+0000","last_fullsized":"2024-08-31T04:41:35.955058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":1214,"num_write_kb":79665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"48'3005","reported_seq":4719,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.066272+0000","last_change":"2024-08-31T04:10:27.828574+0000","last_active":"2024-08-31T04:43:51.066272+0000","last_peered":"2024-08-31T04:43:51.066272+0000","last_clean":"2024-08-31T04:43:51.066272+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:43:51.066272+0000","last_undegraded":"2024-08-31T04:43:51.066272+0000","last_fullsized":"2024-08-31T04:43:51.066272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:42:38.219220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025625698999999998,"stat_sum":{"num_bytes":43095232,"num_objects":1282,"num_object_clones":604,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":604,"num_read":212,"num_read_kb":287774,"num_write":2444,"num_write_kb":46619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"48'628","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:40.955698+0000","last_change":"2024-08-31T04:10:27.633137+0000","last_active":"2024-08-31T04:41:40.955698+0000","last_peered":"2024-08-31T04:41:40.955698+0000","last_clean":"2024-08-31T04:41:40.955698+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:41:40.955698+0000","last_undegraded":"2024-08-31T04:41:40.955698+0000","last_fullsized":"2024-08-31T04:41:40.955698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:41.923099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058084670000000003,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"48'804","reported_seq":890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.152652+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:41:30.152652+0000","last_peered":"2024-08-31T04:41:30.152652+0000","last_clean":"2024-08-31T04:41:30.152652+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:41:30.152652+0000","last_undegraded":"2024-08-31T04:41:30.152652+0000","last_fullsized":"2024-08-31T04:41:30.152652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":843,"num_write_kb":95373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"48'2913","reported_seq":4551,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.071323+0000","last_change":"2024-08-31T04:10:27.828980+0000","last_active":"2024-08-31T04:43:51.071323+0000","last_peered":"2024-08-31T04:43:51.071323+0000","last_clean":"2024-08-31T04:43:51.071323+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:43:51.071323+0000","last_undegraded":"2024-08-31T04:43:51.071323+0000","last_fullsized":"2024-08-31T04:43:51.071323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:55.109838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024539147000000001,"stat_sum":{"num_bytes":16912754,"num_objects":1252,"num_object_clones":571,"num_object_copies":5008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1252,"num_whiteouts":571,"num_read":103,"num_read_kb":5348,"num_write":2409,"num_write_kb":25816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"48'612","reported_seq":2718,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954146+0000","last_change":"2024-08-31T04:10:27.797983+0000","last_active":"2024-08-31T04:41:30.954146+0000","last_peered":"2024-08-31T04:41:30.954146+0000","last_clean":"2024-08-31T04:41:30.954146+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:41:30.954146+0000","last_undegraded":"2024-08-31T04:41:30.954146+0000","last_fullsized":"2024-08-31T04:41:30.954146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:34.286214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00335798,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"48'348","reported_seq":434,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954530+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:41:30.954530+0000","last_peered":"2024-08-31T04:41:30.954530+0000","last_clean":"2024-08-31T04:41:30.954530+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:41:30.954530+0000","last_undegraded":"2024-08-31T04:41:30.954530+0000","last_fullsized":"2024-08-31T04:41:30.954530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":379,"num_write_kb":74722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"48'2860","reported_seq":4522,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.779031+0000","last_change":"2024-08-31T04:10:27.826301+0000","last_active":"2024-08-31T04:43:41.779031+0000","last_peered":"2024-08-31T04:43:41.779031+0000","last_clean":"2024-08-31T04:43:41.779031+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:43:41.779031+0000","last_undegraded":"2024-08-31T04:43:41.779031+0000","last_fullsized":"2024-08-31T04:43:41.779031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:16:10.628373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024774918,"stat_sum":{"num_bytes":28766340,"num_objects":1202,"num_object_clones":562,"num_object_copies":4808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":562,"num_read":118,"num_read_kb":82244,"num_write":2340,"num_write_kb":38944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"48'646","reported_seq":2744,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315747+0000","last_change":"2024-08-31T04:10:27.638464+0000","last_active":"2024-08-31T04:43:54.315747+0000","last_peered":"2024-08-31T04:43:54.315747+0000","last_clean":"2024-08-31T04:43:54.315747+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:43:54.315747+0000","last_undegraded":"2024-08-31T04:43:54.315747+0000","last_fullsized":"2024-08-31T04:43:54.315747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:56:21.122785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011184838000000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"48'1718","reported_seq":2844,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:32.140583+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:41:32.140583+0000","last_peered":"2024-08-31T04:41:32.140583+0000","last_clean":"2024-08-31T04:41:32.140583+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:41:32.140583+0000","last_undegraded":"2024-08-31T04:41:32.140583+0000","last_fullsized":"2024-08-31T04:41:32.140583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1718,"log_dups_size":0,"ondisk_log_size":1718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1088,"num_read_kb":4789,"num_write":1771,"num_write_kb":92200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"48'2769","reported_seq":4518,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.169748+0000","last_change":"2024-08-31T04:10:27.824008+0000","last_active":"2024-08-31T04:43:51.169748+0000","last_peered":"2024-08-31T04:43:51.169748+0000","last_clean":"2024-08-31T04:43:51.169748+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:43:51.169748+0000","last_undegraded":"2024-08-31T04:43:51.169748+0000","last_fullsized":"2024-08-31T04:43:51.169748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2769,"log_dups_size":0,"ondisk_log_size":2769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:59.789550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024776765999999999,"stat_sum":{"num_bytes":32718964,"num_objects":1190,"num_object_clones":545,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":545,"num_read":189,"num_read_kb":237912,"num_write":2280,"num_write_kb":50056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"48'588","reported_seq":2690,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.291011+0000","last_change":"2024-08-31T04:10:27.830527+0000","last_active":"2024-08-31T04:43:54.291011+0000","last_peered":"2024-08-31T04:43:54.291011+0000","last_clean":"2024-08-31T04:43:54.291011+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:43:54.291011+0000","last_undegraded":"2024-08-31T04:43:54.291011+0000","last_fullsized":"2024-08-31T04:43:54.291011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:25:35.143895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023142859000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"48'735","reported_seq":821,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.340061+0000","last_change":"2024-08-31T04:03:59.848836+0000","last_active":"2024-08-31T04:40:56.340061+0000","last_peered":"2024-08-31T04:40:56.340061+0000","last_clean":"2024-08-31T04:40:56.340061+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:40:56.340061+0000","last_undegraded":"2024-08-31T04:40:56.340061+0000","last_fullsized":"2024-08-31T04:40:56.340061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:58:01.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":805,"num_write_kb":79377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"48'2886","reported_seq":4556,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.755282+0000","last_change":"2024-08-31T04:10:27.643289+0000","last_active":"2024-08-31T04:43:41.755282+0000","last_peered":"2024-08-31T04:43:41.755282+0000","last_clean":"2024-08-31T04:43:41.755282+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:43:41.755282+0000","last_undegraded":"2024-08-31T04:43:41.755282+0000","last_fullsized":"2024-08-31T04:43:41.755282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:02.372383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014346418999999999,"stat_sum":{"num_bytes":16814987,"num_objects":1183,"num_object_clones":546,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":546,"num_read":112,"num_read_kb":15010,"num_write":2390,"num_write_kb":22596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'618","reported_seq":2713,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.451571+0000","last_change":"2024-08-31T04:10:27.815323+0000","last_active":"2024-08-31T04:41:30.451571+0000","last_peered":"2024-08-31T04:41:30.451571+0000","last_clean":"2024-08-31T04:41:30.451571+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:41:30.451571+0000","last_undegraded":"2024-08-31T04:41:30.451571+0000","last_fullsized":"2024-08-31T04:41:30.451571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:27:36.200935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013467437000000001,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"48'775","reported_seq":861,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954543+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:41:30.954543+0000","last_peered":"2024-08-31T04:41:30.954543+0000","last_clean":"2024-08-31T04:41:30.954543+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:41:30.954543+0000","last_undegraded":"2024-08-31T04:41:30.954543+0000","last_fullsized":"2024-08-31T04:41:30.954543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":842,"num_write_kb":66986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":182,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:00.942030+0000","last_change":"2024-08-31T04:03:52.137606+0000","last_active":"2024-08-31T04:40:00.942030+0000","last_peered":"2024-08-31T04:40:00.942030+0000","last_clean":"2024-08-31T04:40:00.942030+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:40:00.942030+0000","last_undegraded":"2024-08-31T04:40:00.942030+0000","last_fullsized":"2024-08-31T04:40:00.942030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:50.309883+0000","last_clean_scrub_stamp":"2024-08-31T04:03:50.309883+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:43.147564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"48'2855","reported_seq":4681,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:45.973319+0000","last_change":"2024-08-31T04:10:27.683701+0000","last_active":"2024-08-31T04:43:45.973319+0000","last_peered":"2024-08-31T04:43:45.973319+0000","last_clean":"2024-08-31T04:43:45.973319+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:43:45.973319+0000","last_undegraded":"2024-08-31T04:43:45.973319+0000","last_fullsized":"2024-08-31T04:43:45.973319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:57.102473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069147610000000002,"stat_sum":{"num_bytes":57940200,"num_objects":1195,"num_object_clones":554,"num_object_copies":4780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":554,"num_read":274,"num_read_kb":360546,"num_write":2343,"num_write_kb":69963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"48'613","reported_seq":2709,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.063279+0000","last_change":"2024-08-31T04:10:27.683489+0000","last_active":"2024-08-31T04:40:43.063279+0000","last_peered":"2024-08-31T04:40:43.063279+0000","last_clean":"2024-08-31T04:40:43.063279+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:40:43.063279+0000","last_undegraded":"2024-08-31T04:40:43.063279+0000","last_fullsized":"2024-08-31T04:40:43.063279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:13.850189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067171050000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"48'1620","reported_seq":1704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.978440+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:40:56.978440+0000","last_peered":"2024-08-31T04:40:56.978440+0000","last_clean":"2024-08-31T04:40:56.978440+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:40:56.978440+0000","last_undegraded":"2024-08-31T04:40:56.978440+0000","last_fullsized":"2024-08-31T04:40:56.978440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":1668,"num_write_kb":75070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"48'2903","reported_seq":4558,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.810585+0000","last_change":"2024-08-31T04:10:27.630304+0000","last_active":"2024-08-31T04:43:41.810585+0000","last_peered":"2024-08-31T04:43:41.810585+0000","last_clean":"2024-08-31T04:43:41.810585+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:43:41.810585+0000","last_undegraded":"2024-08-31T04:43:41.810585+0000","last_fullsized":"2024-08-31T04:43:41.810585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:39.898341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059273310000000001,"stat_sum":{"num_bytes":26554957,"num_objects":1237,"num_object_clones":582,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":582,"num_read":132,"num_read_kb":127199,"num_write":2367,"num_write_kb":33368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"48'631","reported_seq":2729,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.971994+0000","last_change":"2024-08-31T04:10:27.801079+0000","last_active":"2024-08-31T04:40:56.971994+0000","last_peered":"2024-08-31T04:40:56.971994+0000","last_clean":"2024-08-31T04:40:56.971994+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:40:56.971994+0000","last_undegraded":"2024-08-31T04:40:56.971994+0000","last_fullsized":"2024-08-31T04:40:56.971994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:07.707273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055968709999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"48'1164","reported_seq":1248,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.931281+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:41:10.931281+0000","last_peered":"2024-08-31T04:41:10.931281+0000","last_clean":"2024-08-31T04:41:10.931281+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:41:10.931281+0000","last_undegraded":"2024-08-31T04:41:10.931281+0000","last_fullsized":"2024-08-31T04:41:10.931281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37753176,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":1208,"num_write_kb":91501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"48'2868","reported_seq":4560,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.821138+0000","last_change":"2024-08-31T04:10:27.642551+0000","last_active":"2024-08-31T04:43:41.821138+0000","last_peered":"2024-08-31T04:43:41.821138+0000","last_clean":"2024-08-31T04:43:41.821138+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:43:41.821138+0000","last_undegraded":"2024-08-31T04:43:41.821138+0000","last_fullsized":"2024-08-31T04:43:41.821138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:40.314782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013964779,"stat_sum":{"num_bytes":24232544,"num_objects":1215,"num_object_clones":563,"num_object_copies":4860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":563,"num_read":151,"num_read_kb":172254,"num_write":2354,"num_write_kb":29314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"48'600","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.967674+0000","last_change":"2024-08-31T04:10:27.800767+0000","last_active":"2024-08-31T04:40:51.967674+0000","last_peered":"2024-08-31T04:40:51.967674+0000","last_clean":"2024-08-31T04:40:51.967674+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:40:51.967674+0000","last_undegraded":"2024-08-31T04:40:51.967674+0000","last_fullsized":"2024-08-31T04:40:51.967674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:19.279530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052273500000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"48'547","reported_seq":631,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.928718+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:41:01.928718+0000","last_peered":"2024-08-31T04:41:01.928718+0000","last_clean":"2024-08-31T04:41:01.928718+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:41:01.928718+0000","last_undegraded":"2024-08-31T04:41:01.928718+0000","last_fullsized":"2024-08-31T04:41:01.928718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":607,"num_write_kb":87317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"48'2923","reported_seq":4623,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:37.318589+0000","last_change":"2024-08-31T04:10:27.681554+0000","last_active":"2024-08-31T04:43:37.318589+0000","last_peered":"2024-08-31T04:43:37.318589+0000","last_clean":"2024-08-31T04:43:37.318589+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:43:37.318589+0000","last_undegraded":"2024-08-31T04:43:37.318589+0000","last_fullsized":"2024-08-31T04:43:37.318589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2923,"log_dups_size":0,"ondisk_log_size":2923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:39:43.060510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065855360000000003,"stat_sum":{"num_bytes":30081699,"num_objects":1235,"num_object_clones":576,"num_object_copies":4940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1235,"num_whiteouts":576,"num_read":171,"num_read_kb":189059,"num_write":2389,"num_write_kb":43568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"48'612","reported_seq":2712,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.024856+0000","last_change":"2024-08-31T04:10:27.634646+0000","last_active":"2024-08-31T04:40:43.024856+0000","last_peered":"2024-08-31T04:40:43.024856+0000","last_clean":"2024-08-31T04:40:43.024856+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:40:43.024856+0000","last_undegraded":"2024-08-31T04:40:43.024856+0000","last_fullsized":"2024-08-31T04:40:43.024856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:43.424732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057184189999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"48'535","reported_seq":619,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.615251+0000","last_change":"2024-08-31T04:03:59.863315+0000","last_active":"2024-08-31T04:40:56.615251+0000","last_peered":"2024-08-31T04:40:56.615251+0000","last_clean":"2024-08-31T04:40:56.615251+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:40:56.615251+0000","last_undegraded":"2024-08-31T04:40:56.615251+0000","last_fullsized":"2024-08-31T04:40:56.615251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:59:45.414050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971542,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":585,"num_write_kb":62565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"48'2832","reported_seq":4602,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.910403+0000","last_change":"2024-08-31T04:10:27.624180+0000","last_active":"2024-08-31T04:43:31.910403+0000","last_peered":"2024-08-31T04:43:31.910403+0000","last_clean":"2024-08-31T04:43:31.910403+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:43:31.910403+0000","last_undegraded":"2024-08-31T04:43:31.910403+0000","last_fullsized":"2024-08-31T04:43:31.910403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:14:38.588901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001644726,"stat_sum":{"num_bytes":45550886,"num_objects":1209,"num_object_clones":562,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":562,"num_read":227,"num_read_kb":373101,"num_write":2312,"num_write_kb":56902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"48'624","reported_seq":2727,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953246+0000","last_change":"2024-08-31T04:10:27.680074+0000","last_active":"2024-08-31T04:41:20.953246+0000","last_peered":"2024-08-31T04:41:20.953246+0000","last_clean":"2024-08-31T04:41:20.953246+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:41:20.953246+0000","last_undegraded":"2024-08-31T04:41:20.953246+0000","last_fullsized":"2024-08-31T04:41:20.953246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:52:30.799187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051653649999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":7,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"48'681","reported_seq":765,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.449539+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:41:20.449539+0000","last_peered":"2024-08-31T04:41:20.449539+0000","last_clean":"2024-08-31T04:41:20.449539+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:41:20.449539+0000","last_undegraded":"2024-08-31T04:41:20.449539+0000","last_fullsized":"2024-08-31T04:41:20.449539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":760,"num_write_kb":71301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"48'2735","reported_seq":4393,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.739755+0000","last_change":"2024-08-31T04:10:27.644231+0000","last_active":"2024-08-31T04:43:41.739755+0000","last_peered":"2024-08-31T04:43:41.739755+0000","last_clean":"2024-08-31T04:43:41.739755+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:43:41.739755+0000","last_undegraded":"2024-08-31T04:43:41.739755+0000","last_fullsized":"2024-08-31T04:43:41.739755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:17.265946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012604237000000001,"stat_sum":{"num_bytes":16809799,"num_objects":1152,"num_object_clones":538,"num_object_copies":4608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":538,"num_read":93,"num_read_kb":855,"num_write":2242,"num_write_kb":21215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"48'606","reported_seq":2704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.952763+0000","last_change":"2024-08-31T04:10:27.626377+0000","last_active":"2024-08-31T04:41:20.952763+0000","last_peered":"2024-08-31T04:41:20.952763+0000","last_clean":"2024-08-31T04:41:20.952763+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:41:20.952763+0000","last_undegraded":"2024-08-31T04:41:20.952763+0000","last_fullsized":"2024-08-31T04:41:20.952763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:54:33.315553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036328670000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":12,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"48'358","reported_seq":442,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.952862+0000","last_change":"2024-08-31T04:03:59.839627+0000","last_active":"2024-08-31T04:41:20.952862+0000","last_peered":"2024-08-31T04:41:20.952862+0000","last_clean":"2024-08-31T04:41:20.952862+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:41:20.952862+0000","last_undegraded":"2024-08-31T04:41:20.952862+0000","last_fullsized":"2024-08-31T04:41:20.952862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:47:03.962083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":374,"num_write_kb":62134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"48'3078","reported_seq":4700,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.753103+0000","last_change":"2024-08-31T04:10:27.644984+0000","last_active":"2024-08-31T04:43:41.753103+0000","last_peered":"2024-08-31T04:43:41.753103+0000","last_clean":"2024-08-31T04:43:41.753103+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:43:41.753103+0000","last_undegraded":"2024-08-31T04:43:41.753103+0000","last_fullsized":"2024-08-31T04:43:41.753103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3078,"log_dups_size":0,"ondisk_log_size":3078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:59.996448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012777844,"stat_sum":{"num_bytes":35172120,"num_objects":1354,"num_object_clones":682,"num_object_copies":5416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1354,"num_whiteouts":594,"num_read":201,"num_read_kb":245482,"num_write":2432,"num_write_kb":44882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'605","reported_seq":2709,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953294+0000","last_change":"2024-08-31T04:10:27.682802+0000","last_active":"2024-08-31T04:41:20.953294+0000","last_peered":"2024-08-31T04:41:20.953294+0000","last_clean":"2024-08-31T04:41:20.953294+0000","last_became_active":"2024-08-31T04:04:41.425024+0000","last_became_peered":"2024-08-31T04:04:41.425024+0000","last_unstale":"2024-08-31T04:41:20.953294+0000","last_undegraded":"2024-08-31T04:41:20.953294+0000","last_fullsized":"2024-08-31T04:41:20.953294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:00.707504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006804175,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"48'514","reported_seq":598,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953275+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:41:20.953275+0000","last_peered":"2024-08-31T04:41:20.953275+0000","last_clean":"2024-08-31T04:41:20.953275+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:41:20.953275+0000","last_undegraded":"2024-08-31T04:41:20.953275+0000","last_fullsized":"2024-08-31T04:41:20.953275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":556,"num_write_kb":54279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"48'2880","reported_seq":4600,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.215076+0000","last_change":"2024-08-31T04:10:27.825912+0000","last_active":"2024-08-31T04:43:51.215076+0000","last_peered":"2024-08-31T04:43:51.215076+0000","last_clean":"2024-08-31T04:43:51.215076+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:43:51.215076+0000","last_undegraded":"2024-08-31T04:43:51.215076+0000","last_fullsized":"2024-08-31T04:43:51.215076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2880,"log_dups_size":0,"ondisk_log_size":2880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:02.879075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025415436,"stat_sum":{"num_bytes":43622224,"num_objects":1251,"num_object_clones":583,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1251,"num_whiteouts":583,"num_read":199,"num_read_kb":207126,"num_write":2328,"num_write_kb":56286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"48'585","reported_seq":2686,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.279324+0000","last_change":"2024-08-31T04:10:27.830297+0000","last_active":"2024-08-31T04:43:54.279324+0000","last_peered":"2024-08-31T04:43:54.279324+0000","last_clean":"2024-08-31T04:43:54.279324+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:43:54.279324+0000","last_undegraded":"2024-08-31T04:43:54.279324+0000","last_fullsized":"2024-08-31T04:43:54.279324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:11.469305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023919682000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"48'1257","reported_seq":1341,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:22.138550+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:41:22.138550+0000","last_peered":"2024-08-31T04:41:22.138550+0000","last_clean":"2024-08-31T04:41:22.138550+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:41:22.138550+0000","last_undegraded":"2024-08-31T04:41:22.138550+0000","last_fullsized":"2024-08-31T04:41:22.138550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1306,"num_write_kb":67222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"48'2891","reported_seq":4581,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.953320+0000","last_change":"2024-08-31T04:10:27.683052+0000","last_active":"2024-08-31T04:43:31.953320+0000","last_peered":"2024-08-31T04:43:31.953320+0000","last_clean":"2024-08-31T04:43:31.953320+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:43:31.953320+0000","last_undegraded":"2024-08-31T04:43:31.953320+0000","last_fullsized":"2024-08-31T04:43:31.953320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.116451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069575569999999996,"stat_sum":{"num_bytes":34789039,"num_objects":1260,"num_object_clones":583,"num_object_copies":5040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1260,"num_whiteouts":583,"num_read":170,"num_read_kb":170411,"num_write":2360,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"48'603","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.051596+0000","last_change":"2024-08-31T04:10:27.799884+0000","last_active":"2024-08-31T04:40:43.051596+0000","last_peered":"2024-08-31T04:40:43.051596+0000","last_clean":"2024-08-31T04:40:43.051596+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:40:43.051596+0000","last_undegraded":"2024-08-31T04:40:43.051596+0000","last_fullsized":"2024-08-31T04:40:43.051596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:43.034574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047916210000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"48'1156","reported_seq":1240,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:46.484670+0000","last_change":"2024-08-31T04:03:59.849161+0000","last_active":"2024-08-31T04:43:46.484670+0000","last_peered":"2024-08-31T04:43:46.484670+0000","last_clean":"2024-08-31T04:43:46.484670+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:43:46.484670+0000","last_undegraded":"2024-08-31T04:43:46.484670+0000","last_fullsized":"2024-08-31T04:43:46.484670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1156,"log_dups_size":0,"ondisk_log_size":1156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:10:11.548945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555104,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1203,"num_write_kb":103869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"48'2948","reported_seq":4614,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.831104+0000","last_change":"2024-08-31T04:10:27.802246+0000","last_active":"2024-08-31T04:43:41.831104+0000","last_peered":"2024-08-31T04:43:41.831104+0000","last_clean":"2024-08-31T04:43:41.831104+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:43:41.831104+0000","last_undegraded":"2024-08-31T04:43:41.831104+0000","last_fullsized":"2024-08-31T04:43:41.831104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2948,"log_dups_size":0,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:12:15.664092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046964119999999996,"stat_sum":{"num_bytes":37035283,"num_objects":1250,"num_object_clones":626,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":538,"num_read":188,"num_read_kb":159531,"num_write":2363,"num_write_kb":48541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"48'617","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:25.953944+0000","last_change":"2024-08-31T04:10:27.682269+0000","last_active":"2024-08-31T04:41:25.953944+0000","last_peered":"2024-08-31T04:41:25.953944+0000","last_clean":"2024-08-31T04:41:25.953944+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:41:25.953944+0000","last_undegraded":"2024-08-31T04:41:25.953944+0000","last_fullsized":"2024-08-31T04:41:25.953944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:25.121383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006690306,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"48'1380","reported_seq":1463,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:57.021975+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:40:57.021975+0000","last_peered":"2024-08-31T04:40:57.021975+0000","last_clean":"2024-08-31T04:40:57.021975+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:40:57.021975+0000","last_undegraded":"2024-08-31T04:40:57.021975+0000","last_fullsized":"2024-08-31T04:40:57.021975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1380,"log_dups_size":0,"ondisk_log_size":1380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554522,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1433,"num_write_kb":71604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"48'2822","reported_seq":4502,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.815516+0000","last_change":"2024-08-31T04:10:27.633146+0000","last_active":"2024-08-31T04:43:41.815516+0000","last_peered":"2024-08-31T04:43:41.815516+0000","last_clean":"2024-08-31T04:43:41.815516+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:43:41.815516+0000","last_undegraded":"2024-08-31T04:43:41.815516+0000","last_fullsized":"2024-08-31T04:43:41.815516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2822,"log_dups_size":0,"ondisk_log_size":2822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:44.513348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060660929999999998,"stat_sum":{"num_bytes":30139631,"num_objects":1254,"num_object_clones":586,"num_object_copies":5016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1254,"num_whiteouts":586,"num_read":162,"num_read_kb":134523,"num_write":2263,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"48'602","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315538+0000","last_change":"2024-08-31T04:10:27.646230+0000","last_active":"2024-08-31T04:43:54.315538+0000","last_peered":"2024-08-31T04:43:54.315538+0000","last_clean":"2024-08-31T04:43:54.315538+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:43:54.315538+0000","last_undegraded":"2024-08-31T04:43:54.315538+0000","last_fullsized":"2024-08-31T04:43:54.315538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:50.268225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012319801999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"48'1612","reported_seq":1695,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.961246+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:40:51.961246+0000","last_peered":"2024-08-31T04:40:51.961246+0000","last_clean":"2024-08-31T04:40:51.961246+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:40:51.961246+0000","last_undegraded":"2024-08-31T04:40:51.961246+0000","last_fullsized":"2024-08-31T04:40:51.961246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1665,"num_write_kb":95716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"48'2860","reported_seq":4648,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:47.167374+0000","last_change":"2024-08-31T04:10:27.670280+0000","last_active":"2024-08-31T04:43:47.167374+0000","last_peered":"2024-08-31T04:43:47.167374+0000","last_clean":"2024-08-31T04:43:47.167374+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:43:47.167374+0000","last_undegraded":"2024-08-31T04:43:47.167374+0000","last_fullsized":"2024-08-31T04:43:47.167374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:45.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006760248,"stat_sum":{"num_bytes":54090295,"num_objects":1208,"num_object_clones":563,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":563,"num_read":248,"num_read_kb":382949,"num_write":2323,"num_write_kb":60670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"48'606","reported_seq":2705,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.981507+0000","last_change":"2024-08-31T04:10:27.634493+0000","last_active":"2024-08-31T04:40:56.981507+0000","last_peered":"2024-08-31T04:40:56.981507+0000","last_clean":"2024-08-31T04:40:56.981507+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:40:56.981507+0000","last_undegraded":"2024-08-31T04:40:56.981507+0000","last_fullsized":"2024-08-31T04:40:56.981507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:55:26.933384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058567369999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":10,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"48'954","reported_seq":1208,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:57.015780+0000","last_change":"2024-08-31T04:03:59.858118+0000","last_active":"2024-08-31T04:40:57.015780+0000","last_peered":"2024-08-31T04:40:57.015780+0000","last_clean":"2024-08-31T04:40:57.015780+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:40:57.015780+0000","last_undegraded":"2024-08-31T04:40:57.015780+0000","last_fullsized":"2024-08-31T04:40:57.015780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:02:42.246257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21620066,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":215,"num_read_kb":746,"num_write":1006,"num_write_kb":67606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"48'2946","reported_seq":4665,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.798172+0000","last_change":"2024-08-31T04:10:27.822236+0000","last_active":"2024-08-31T04:43:41.798172+0000","last_peered":"2024-08-31T04:43:41.798172+0000","last_clean":"2024-08-31T04:43:41.798172+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:43:41.798172+0000","last_undegraded":"2024-08-31T04:43:41.798172+0000","last_fullsized":"2024-08-31T04:43:41.798172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:33.068422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017565338,"stat_sum":{"num_bytes":42002217,"num_objects":1219,"num_object_clones":563,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1219,"num_whiteouts":563,"num_read":178,"num_read_kb":306206,"num_write":2428,"num_write_kb":54614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"48'2738","reported_seq":4469,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.742397+0000","last_change":"2024-08-31T04:10:27.822515+0000","last_active":"2024-08-31T04:43:41.742397+0000","last_peered":"2024-08-31T04:43:41.742397+0000","last_clean":"2024-08-31T04:43:41.742397+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:43:41.742397+0000","last_undegraded":"2024-08-31T04:43:41.742397+0000","last_fullsized":"2024-08-31T04:43:41.742397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2738,"log_dups_size":0,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:20.225606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017721323000000001,"stat_sum":{"num_bytes":29550305,"num_objects":1162,"num_object_clones":544,"num_object_copies":4648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":544,"num_read":169,"num_read_kb":167515,"num_write":2228,"num_write_kb":37428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"48'591","reported_seq":2694,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.996085+0000","last_change":"2024-08-31T04:10:27.823888+0000","last_active":"2024-08-31T04:40:51.996085+0000","last_peered":"2024-08-31T04:40:51.996085+0000","last_clean":"2024-08-31T04:40:51.996085+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:40:51.996085+0000","last_undegraded":"2024-08-31T04:40:51.996085+0000","last_fullsized":"2024-08-31T04:40:51.996085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:08:01.933323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018675580000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"48'1868","reported_seq":1951,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.980531+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:41:10.980531+0000","last_peered":"2024-08-31T04:41:10.980531+0000","last_clean":"2024-08-31T04:41:10.980531+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:41:10.980531+0000","last_undegraded":"2024-08-31T04:41:10.980531+0000","last_fullsized":"2024-08-31T04:41:10.980531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1868,"log_dups_size":0,"ondisk_log_size":1868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1929,"num_write_kb":92217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"48'2766","reported_seq":4481,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.955819+0000","last_change":"2024-08-31T04:10:27.800227+0000","last_active":"2024-08-31T04:43:31.955819+0000","last_peered":"2024-08-31T04:43:31.955819+0000","last_clean":"2024-08-31T04:43:31.955819+0000","last_became_active":"2024-08-31T04:04:41.417946+0000","last_became_peered":"2024-08-31T04:04:41.417946+0000","last_unstale":"2024-08-31T04:43:31.955819+0000","last_undegraded":"2024-08-31T04:43:31.955819+0000","last_fullsized":"2024-08-31T04:43:31.955819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:41:51.661343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00503113,"stat_sum":{"num_bytes":35643591,"num_objects":1177,"num_object_clones":542,"num_object_copies":4708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1177,"num_whiteouts":542,"num_read":158,"num_read_kb":132473,"num_write":2281,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'704","reported_seq":2801,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.317201+0000","last_change":"2024-08-31T04:10:27.641968+0000","last_active":"2024-08-31T04:43:54.317201+0000","last_peered":"2024-08-31T04:43:54.317201+0000","last_clean":"2024-08-31T04:43:54.317201+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:43:54.317201+0000","last_undegraded":"2024-08-31T04:43:54.317201+0000","last_fullsized":"2024-08-31T04:43:54.317201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:11.260535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014046813,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"48'645","reported_seq":728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.924988+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:41:01.924988+0000","last_peered":"2024-08-31T04:41:01.924988+0000","last_clean":"2024-08-31T04:41:01.924988+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:41:01.924988+0000","last_undegraded":"2024-08-31T04:41:01.924988+0000","last_fullsized":"2024-08-31T04:41:01.924988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":715,"num_write_kb":62992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"48'2252","reported_seq":2334,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.602123+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:40:43.602123+0000","last_peered":"2024-08-31T04:40:43.602123+0000","last_clean":"2024-08-31T04:40:43.602123+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:40:43.602123+0000","last_undegraded":"2024-08-31T04:40:43.602123+0000","last_fullsized":"2024-08-31T04:40:43.602123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:13.419347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2298,"num_write_kb":79805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'604","reported_seq":2701,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.096310+0000","last_change":"2024-08-31T04:10:27.814455+0000","last_active":"2024-08-31T04:40:43.096310+0000","last_peered":"2024-08-31T04:40:43.096310+0000","last_clean":"2024-08-31T04:40:43.096310+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:40:43.096310+0000","last_undegraded":"2024-08-31T04:40:43.096310+0000","last_fullsized":"2024-08-31T04:40:43.096310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:14.250771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013275207000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":11,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"48'2940","reported_seq":4625,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.843891+0000","last_change":"2024-08-31T04:10:27.821490+0000","last_active":"2024-08-31T04:43:41.843891+0000","last_peered":"2024-08-31T04:43:41.843891+0000","last_clean":"2024-08-31T04:43:41.843891+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:43:41.843891+0000","last_undegraded":"2024-08-31T04:43:41.843891+0000","last_fullsized":"2024-08-31T04:43:41.843891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2940,"log_dups_size":0,"ondisk_log_size":2940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:50.331472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016882483,"stat_sum":{"num_bytes":22283462,"num_objects":1259,"num_object_clones":585,"num_object_copies":5036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1259,"num_whiteouts":585,"num_read":168,"num_read_kb":61698,"num_write":2408,"num_write_kb":31485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"48'1130","reported_seq":1212,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.973278+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:41:01.973278+0000","last_peered":"2024-08-31T04:41:01.973278+0000","last_clean":"2024-08-31T04:41:01.973278+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:41:01.973278+0000","last_undegraded":"2024-08-31T04:41:01.973278+0000","last_fullsized":"2024-08-31T04:41:01.973278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1166,"num_write_kb":91251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"48'627","reported_seq":2724,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.107384+0000","last_change":"2024-08-31T04:10:27.627749+0000","last_active":"2024-08-31T04:40:43.107384+0000","last_peered":"2024-08-31T04:40:43.107384+0000","last_clean":"2024-08-31T04:40:43.107384+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:40:43.107384+0000","last_undegraded":"2024-08-31T04:40:43.107384+0000","last_fullsized":"2024-08-31T04:40:43.107384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:05.454693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038995560000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"48'2848","reported_seq":4571,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.786083+0000","last_change":"2024-08-31T04:10:27.669930+0000","last_active":"2024-08-31T04:43:41.786083+0000","last_peered":"2024-08-31T04:43:41.786083+0000","last_clean":"2024-08-31T04:43:41.786083+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:43:41.786083+0000","last_undegraded":"2024-08-31T04:43:41.786083+0000","last_fullsized":"2024-08-31T04:43:41.786083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:44.356566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065935439999999998,"stat_sum":{"num_bytes":37885613,"num_objects":1228,"num_object_clones":569,"num_object_copies":4912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1228,"num_whiteouts":569,"num_read":190,"num_read_kb":257974,"num_write":2324,"num_write_kb":54067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"48'628","reported_seq":2725,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954633+0000","last_change":"2024-08-31T04:10:27.632258+0000","last_active":"2024-08-31T04:41:30.954633+0000","last_peered":"2024-08-31T04:41:30.954633+0000","last_clean":"2024-08-31T04:41:30.954633+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:41:30.954633+0000","last_undegraded":"2024-08-31T04:41:30.954633+0000","last_fullsized":"2024-08-31T04:41:30.954633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:17:04.382806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078040410000000003,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":15,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"48'646","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:32.140522+0000","last_change":"2024-08-31T04:10:27.668912+0000","last_active":"2024-08-31T04:41:32.140522+0000","last_peered":"2024-08-31T04:41:32.140522+0000","last_clean":"2024-08-31T04:41:32.140522+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:41:32.140522+0000","last_undegraded":"2024-08-31T04:41:32.140522+0000","last_fullsized":"2024-08-31T04:41:32.140522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:32.767357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060576730000000004,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":9,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"48'618","reported_seq":2722,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954479+0000","last_change":"2024-08-31T04:10:27.682416+0000","last_active":"2024-08-31T04:41:30.954479+0000","last_peered":"2024-08-31T04:41:30.954479+0000","last_clean":"2024-08-31T04:41:30.954479+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:41:30.954479+0000","last_undegraded":"2024-08-31T04:41:30.954479+0000","last_fullsized":"2024-08-31T04:41:30.954479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:37.569659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067294099999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":8,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"48'662","reported_seq":2760,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.307324+0000","last_change":"2024-08-31T04:10:27.643926+0000","last_active":"2024-08-31T04:43:54.307324+0000","last_peered":"2024-08-31T04:43:54.307324+0000","last_clean":"2024-08-31T04:43:54.307324+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:43:54.307324+0000","last_undegraded":"2024-08-31T04:43:54.307324+0000","last_fullsized":"2024-08-31T04:43:54.307324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:22:41.496309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01443145,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"48'614","reported_seq":2713,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.282781+0000","last_change":"2024-08-31T04:10:27.827546+0000","last_active":"2024-08-31T04:43:54.282781+0000","last_peered":"2024-08-31T04:43:54.282781+0000","last_clean":"2024-08-31T04:43:54.282781+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:43:54.282781+0000","last_undegraded":"2024-08-31T04:43:54.282781+0000","last_fullsized":"2024-08-31T04:43:54.282781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:51.784003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024833572000000002,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'595","reported_seq":2699,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.276230+0000","last_change":"2024-08-31T04:10:27.824141+0000","last_active":"2024-08-31T04:43:54.276230+0000","last_peered":"2024-08-31T04:43:54.276230+0000","last_clean":"2024-08-31T04:43:54.276230+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:43:54.276230+0000","last_undegraded":"2024-08-31T04:43:54.276230+0000","last_fullsized":"2024-08-31T04:43:54.276230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:33:51.196460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024839776000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"48'636","reported_seq":2739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.981571+0000","last_change":"2024-08-31T04:10:27.634372+0000","last_active":"2024-08-31T04:40:56.981571+0000","last_peered":"2024-08-31T04:40:56.981571+0000","last_clean":"2024-08-31T04:40:56.981571+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:40:56.981571+0000","last_undegraded":"2024-08-31T04:40:56.981571+0000","last_fullsized":"2024-08-31T04:40:56.981571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:59.694688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060308059999999997,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"48'593","reported_seq":2698,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.307572+0000","last_change":"2024-08-31T04:10:27.644765+0000","last_active":"2024-08-31T04:43:54.307572+0000","last_peered":"2024-08-31T04:43:54.307572+0000","last_clean":"2024-08-31T04:43:54.307572+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:43:54.307572+0000","last_undegraded":"2024-08-31T04:43:54.307572+0000","last_fullsized":"2024-08-31T04:43:54.307572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:50.112615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012931465,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":6,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"48'617","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:55.950214+0000","last_change":"2024-08-31T04:10:27.681657+0000","last_active":"2024-08-31T04:40:55.950214+0000","last_peered":"2024-08-31T04:40:55.950214+0000","last_clean":"2024-08-31T04:40:55.950214+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:40:55.950214+0000","last_undegraded":"2024-08-31T04:40:55.950214+0000","last_fullsized":"2024-08-31T04:40:55.950214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:16.233374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062469689999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"48'592","reported_seq":2696,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.314417+0000","last_change":"2024-08-31T04:10:27.638483+0000","last_active":"2024-08-31T04:43:54.314417+0000","last_peered":"2024-08-31T04:43:54.314417+0000","last_clean":"2024-08-31T04:43:54.314417+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:43:54.314417+0000","last_undegraded":"2024-08-31T04:43:54.314417+0000","last_fullsized":"2024-08-31T04:43:54.314417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:09.181389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011311599,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"48'641","reported_seq":2739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:39.009032+0000","last_change":"2024-08-31T04:10:27.626932+0000","last_active":"2024-08-31T04:40:39.009032+0000","last_peered":"2024-08-31T04:40:39.009032+0000","last_clean":"2024-08-31T04:40:39.009032+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:40:39.009032+0000","last_undegraded":"2024-08-31T04:40:39.009032+0000","last_fullsized":"2024-08-31T04:40:39.009032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:29.687132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035095819999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"48'602","reported_seq":2704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.096155+0000","last_change":"2024-08-31T04:10:27.806718+0000","last_active":"2024-08-31T04:40:43.096155+0000","last_peered":"2024-08-31T04:40:43.096155+0000","last_clean":"2024-08-31T04:40:43.096155+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:40:43.096155+0000","last_undegraded":"2024-08-31T04:40:43.096155+0000","last_fullsized":"2024-08-31T04:40:43.096155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:40.726314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055677180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"48'635","reported_seq":2733,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:38.729639+0000","last_change":"2024-08-31T04:10:27.799928+0000","last_active":"2024-08-31T04:40:38.729639+0000","last_peered":"2024-08-31T04:40:38.729639+0000","last_clean":"2024-08-31T04:40:38.729639+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:40:38.729639+0000","last_undegraded":"2024-08-31T04:40:38.729639+0000","last_fullsized":"2024-08-31T04:40:38.729639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:49.971542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047976060000000003,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"48'637","reported_seq":2737,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:38.731595+0000","last_change":"2024-08-31T04:10:27.683751+0000","last_active":"2024-08-31T04:40:38.731595+0000","last_peered":"2024-08-31T04:40:38.731595+0000","last_clean":"2024-08-31T04:40:38.731595+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:40:38.731595+0000","last_undegraded":"2024-08-31T04:40:38.731595+0000","last_fullsized":"2024-08-31T04:40:38.731595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:15:51.447225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066178469999999996,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"48'584","reported_seq":2683,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:22.138621+0000","last_change":"2024-08-31T04:10:27.671492+0000","last_active":"2024-08-31T04:41:22.138621+0000","last_peered":"2024-08-31T04:41:22.138621+0000","last_clean":"2024-08-31T04:41:22.138621+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:41:22.138621+0000","last_undegraded":"2024-08-31T04:41:22.138621+0000","last_fullsized":"2024-08-31T04:41:22.138621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:08:25.848770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050893520000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"48'629","reported_seq":2733,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953329+0000","last_change":"2024-08-31T04:10:27.683243+0000","last_active":"2024-08-31T04:41:20.953329+0000","last_peered":"2024-08-31T04:41:20.953329+0000","last_clean":"2024-08-31T04:41:20.953329+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:41:20.953329+0000","last_undegraded":"2024-08-31T04:41:20.953329+0000","last_fullsized":"2024-08-31T04:41:20.953329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:05:34.589760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068720639999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":6,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"48'604","reported_seq":2707,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953215+0000","last_change":"2024-08-31T04:10:27.680920+0000","last_active":"2024-08-31T04:41:20.953215+0000","last_peered":"2024-08-31T04:41:20.953215+0000","last_clean":"2024-08-31T04:41:20.953215+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:41:20.953215+0000","last_undegraded":"2024-08-31T04:41:20.953215+0000","last_fullsized":"2024-08-31T04:41:20.953215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:22.809894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059141749999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":7,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"48'651","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.308059+0000","last_change":"2024-08-31T04:10:27.636678+0000","last_active":"2024-08-31T04:43:54.308059+0000","last_peered":"2024-08-31T04:43:54.308059+0000","last_clean":"2024-08-31T04:43:54.308059+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:43:54.308059+0000","last_undegraded":"2024-08-31T04:43:54.308059+0000","last_fullsized":"2024-08-31T04:43:54.308059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:48:32.668716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098583990000000003,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"48'622","reported_seq":2720,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.290857+0000","last_change":"2024-08-31T04:10:27.829545+0000","last_active":"2024-08-31T04:43:54.290857+0000","last_peered":"2024-08-31T04:43:54.290857+0000","last_clean":"2024-08-31T04:43:54.290857+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:43:54.290857+0000","last_undegraded":"2024-08-31T04:43:54.290857+0000","last_fullsized":"2024-08-31T04:43:54.290857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:56:41.550447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023950035000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":12,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"48'599","reported_seq":2699,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.281814+0000","last_change":"2024-08-31T04:10:27.827114+0000","last_active":"2024-08-31T04:43:54.281814+0000","last_peered":"2024-08-31T04:43:54.281814+0000","last_clean":"2024-08-31T04:43:54.281814+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:43:54.281814+0000","last_undegraded":"2024-08-31T04:43:54.281814+0000","last_fullsized":"2024-08-31T04:43:54.281814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:28.164149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025118893999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'592","reported_seq":2693,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.033771+0000","last_change":"2024-08-31T04:10:27.800501+0000","last_active":"2024-08-31T04:40:43.033771+0000","last_peered":"2024-08-31T04:40:43.033771+0000","last_clean":"2024-08-31T04:40:43.033771+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:40:43.033771+0000","last_undegraded":"2024-08-31T04:40:43.033771+0000","last_fullsized":"2024-08-31T04:40:43.033771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:19.639843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051269660000000002,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"48'621","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:39.022887+0000","last_change":"2024-08-31T04:10:27.799550+0000","last_active":"2024-08-31T04:40:39.022887+0000","last_peered":"2024-08-31T04:40:39.022887+0000","last_clean":"2024-08-31T04:40:39.022887+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:40:39.022887+0000","last_undegraded":"2024-08-31T04:40:39.022887+0000","last_fullsized":"2024-08-31T04:40:39.022887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:56:52.315777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045307300000000002,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"48'570","reported_seq":2668,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:39.013045+0000","last_change":"2024-08-31T04:10:27.801153+0000","last_active":"2024-08-31T04:40:39.013045+0000","last_peered":"2024-08-31T04:40:39.013045+0000","last_clean":"2024-08-31T04:40:39.013045+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:40:39.013045+0000","last_undegraded":"2024-08-31T04:40:39.013045+0000","last_fullsized":"2024-08-31T04:40:39.013045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:49:14.674631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053663419999999996,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"48'620","reported_seq":2719,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.053543+0000","last_change":"2024-08-31T04:10:27.627028+0000","last_active":"2024-08-31T04:40:43.053543+0000","last_peered":"2024-08-31T04:40:43.053543+0000","last_clean":"2024-08-31T04:40:43.053543+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:40:43.053543+0000","last_undegraded":"2024-08-31T04:40:43.053543+0000","last_fullsized":"2024-08-31T04:40:43.053543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:14:52.550351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003298704,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"48'581","reported_seq":2681,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.317590+0000","last_change":"2024-08-31T04:10:27.635962+0000","last_active":"2024-08-31T04:43:54.317590+0000","last_peered":"2024-08-31T04:43:54.317590+0000","last_clean":"2024-08-31T04:43:54.317590+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:43:54.317590+0000","last_undegraded":"2024-08-31T04:43:54.317590+0000","last_fullsized":"2024-08-31T04:43:54.317590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:43:12.087921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0091212849999999998,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'607","reported_seq":2703,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.052964+0000","last_change":"2024-08-31T04:10:27.796436+0000","last_active":"2024-08-31T04:40:43.052964+0000","last_peered":"2024-08-31T04:40:43.052964+0000","last_clean":"2024-08-31T04:40:43.052964+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:40:43.052964+0000","last_undegraded":"2024-08-31T04:40:43.052964+0000","last_fullsized":"2024-08-31T04:40:43.052964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:45.563958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020846939999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"48'587","reported_seq":2682,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.976350+0000","last_change":"2024-08-31T04:10:27.632700+0000","last_active":"2024-08-31T04:40:56.976350+0000","last_peered":"2024-08-31T04:40:56.976350+0000","last_clean":"2024-08-31T04:40:56.976350+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:40:56.976350+0000","last_undegraded":"2024-08-31T04:40:56.976350+0000","last_fullsized":"2024-08-31T04:40:56.976350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:47.487017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079797440000000004,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":13,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"48'662","reported_seq":2751,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.108705+0000","last_change":"2024-08-31T04:10:27.799557+0000","last_active":"2024-08-31T04:40:43.108705+0000","last_peered":"2024-08-31T04:40:43.108705+0000","last_clean":"2024-08-31T04:40:43.108705+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:40:43.108705+0000","last_undegraded":"2024-08-31T04:40:43.108705+0000","last_fullsized":"2024-08-31T04:40:43.108705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:41.279910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047669089999999997,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":19,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":19,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"48'616","reported_seq":2723,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:43.052569+0000","last_change":"2024-08-31T04:10:27.633848+0000","last_active":"2024-08-31T04:40:43.052569+0000","last_peered":"2024-08-31T04:40:43.052569+0000","last_clean":"2024-08-31T04:40:43.052569+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:40:43.052569+0000","last_undegraded":"2024-08-31T04:40:43.052569+0000","last_fullsized":"2024-08-31T04:40:43.052569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:19:00.071541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063128230000000004,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":5,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":5,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"48'624","reported_seq":2726,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.304567+0000","last_change":"2024-08-31T04:10:27.643240+0000","last_active":"2024-08-31T04:43:54.304567+0000","last_peered":"2024-08-31T04:43:54.304567+0000","last_clean":"2024-08-31T04:43:54.304567+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:43:54.304567+0000","last_undegraded":"2024-08-31T04:43:54.304567+0000","last_fullsized":"2024-08-31T04:43:54.304567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:28:05.502942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013845079999999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"48'584","reported_seq":2687,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.304120+0000","last_change":"2024-08-31T04:10:27.645944+0000","last_active":"2024-08-31T04:43:54.304120+0000","last_peered":"2024-08-31T04:43:54.304120+0000","last_clean":"2024-08-31T04:43:54.304120+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:43:54.304120+0000","last_undegraded":"2024-08-31T04:43:54.304120+0000","last_fullsized":"2024-08-31T04:43:54.304120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:47:36.656806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012861716,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"48'593","reported_seq":2690,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954204+0000","last_change":"2024-08-31T04:10:27.800212+0000","last_active":"2024-08-31T04:41:30.954204+0000","last_peered":"2024-08-31T04:41:30.954204+0000","last_clean":"2024-08-31T04:41:30.954204+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:41:30.954204+0000","last_undegraded":"2024-08-31T04:41:30.954204+0000","last_fullsized":"2024-08-31T04:41:30.954204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:06.926644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048876299999999996,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1171046334,"num_objects":39264,"num_object_clones":18317,"num_object_copies":157056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39264,"num_whiteouts":18141,"num_read":5740,"num_read_kb":6745896,"num_write":75481,"num_write_kb":1474785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2548367360,"data_stored":2549710848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92337,"ondisk_log_size":92337,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":2792,"num_object_clones":669,"num_object_copies":5584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2792,"num_whiteouts":669,"num_read":0,"num_read_kb":0,"num_write":2800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39272,"ondisk_log_size":39272,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":830791811,"num_objects":1713,"num_object_clones":0,"num_object_copies":3426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1713,"num_whiteouts":0,"num_read":2588,"num_read_kb":5535,"num_write":35390,"num_write_kb":2443309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1661648896,"data_stored":1661583622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31617,"ondisk_log_size":31617,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477220,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":996976,"kb_used_data":627232,"kb_used_omap":1,"kb_used_meta":369726,"kb_avail":93374864,"statfs":{"total":96636764160,"available":95615860736,"internally_reserved":0,"allocated":642285568,"data_stored":642183134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":378599879},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477220,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":638272,"kb_used_data":418288,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93733568,"statfs":{"total":96636764160,"available":95983173632,"internally_reserved":0,"allocated":428326912,"data_stored":428055527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477221,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":857192,"kb_used_data":569176,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93514648,"statfs":{"total":96636764160,"available":95758999552,"internally_reserved":0,"allocated":582836224,"data_stored":582730273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477221,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":813360,"kb_used_data":525408,"kb_used_omap":1,"kb_used_meta":287934,"kb_avail":93558480,"statfs":{"total":96636764160,"available":95803883520,"internally_reserved":0,"allocated":538017792,"data_stored":537913727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294844869},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509924,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":692036,"kb_used_data":458228,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":93679804,"statfs":{"total":96636764160,"available":95928119296,"internally_reserved":0,"allocated":469225472,"data_stored":469129543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239401414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509925,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757676,"kb_used_data":487772,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":93614164,"statfs":{"total":96636764160,"available":95860903936,"internally_reserved":0,"allocated":499478528,"data_stored":499539157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509923,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":811432,"kb_used_data":549848,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":93560408,"statfs":{"total":96636764160,"available":95805857792,"internally_reserved":0,"allocated":563044352,"data_stored":563095610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267844037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575332,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":754968,"kb_used_data":480840,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93616872,"statfs":{"total":96636764160,"available":95863676928,"internally_reserved":0,"allocated":492380160,"data_stored":492108227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":314580992,"data_stored":314572856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":201986048,"data_stored":201979578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":113254400,"data_stored":113246880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":284884992,"data_stored":284878487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":243605504,"data_stored":243584755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":226504704,"data_stored":226496878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":138412032,"data_stored":138412032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":138420224,"data_stored":138412156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":222887936,"data_stored":223055872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":379707392,"data_stored":379875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":314523648,"data_stored":314523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":356851712,"data_stored":357019648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":318889984,"data_stored":319225856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":271831040,"data_stored":272166912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":330264576,"data_stored":330432512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":353411072,"data_stored":353411072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:43:56.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:43:56.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.467+0000 7f5ea3800640 1 -- 172.21.15.89:0/1340742606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e80003a60 msgr2=0x7f5e80003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.467+0000 7f5ea3800640 1 --2- 172.21.15.89:0/1340742606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e80003a60 0x7f5e80003ef0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00c310 tx=0x7f5e8c01cf60 comp rx=0 tx=0).stop 2024-08-31T04:43:56.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.467+0000 7f5ea3800640 1 -- 172.21.15.89:0/1340742606 shutdown_connections 2024-08-31T04:43:56.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.467+0000 7f5ea3800640 1 --2- 172.21.15.89:0/1340742606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e80003a60 0x7f5e80003ef0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.467+0000 7f5ea3800640 1 -- 172.21.15.89:0/1340742606 >> 172.21.15.89:0/1340742606 conn(0x7f5e9c0ca9c0 msgr2=0x7f5e9c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:56.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.467+0000 7f5ea3800640 1 -- 172.21.15.89:0/1340742606 shutdown_connections 2024-08-31T04:43:56.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.467+0000 7f5ea3800640 1 -- 172.21.15.89:0/1340742606 wait complete. 2024-08-31T04:43:56.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.467+0000 7f5ea3800640 1 Processor -- start 2024-08-31T04:43:56.470 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.467+0000 7f5ea3800640 1 -- start start 2024-08-31T04:43:56.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea3800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e80003a60 0x7f5e9c155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:56.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea3800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e9c162980 0x7f5e9c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:56.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea3800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e9c162d90 0x7f5e9c152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:56.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea3800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c0c53c0 con 0x7f5e9c162d90 2024-08-31T04:43:56.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea3800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c0ca7c0 con 0x7f5e9c162980 2024-08-31T04:43:56.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea3800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9c070de0 con 0x7f5e80003a60 2024-08-31T04:43:56.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e9c162d90 0x7f5e9c152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:56.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea1800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e9c162d90 0x7f5e9c152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49520/0 (socket says 172.21.15.89:49520) 2024-08-31T04:43:56.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea1800640 1 -- 172.21.15.89:0/2740248941 learned_addr learned my addr 172.21.15.89:0/2740248941 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:56.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea0e00640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e80003a60 0x7f5e9c155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:56.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5e93e00640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e9c162980 0x7f5e9c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:56.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea1800640 1 -- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e80003a60 msgr2=0x7f5e9c155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea1800640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e80003a60 0x7f5e9c155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea1800640 1 -- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e9c162980 msgr2=0x7f5e9c151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea1800640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e9c162980 0x7f5e9c151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea1800640 1 -- 172.21.15.89:0/2740248941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c156020 con 0x7f5e9c162d90 2024-08-31T04:43:56.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea1800640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e9c162d90 0x7f5e9c152350 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c072f80 tx=0x7f5e9400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:56.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5e99600640 1 -- 172.21.15.89:0/2740248941 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e94004b30 con 0x7f5e9c162d90 2024-08-31T04:43:56.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5e99600640 1 -- 172.21.15.89:0/2740248941 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e94004dc0 con 0x7f5e9c162d90 2024-08-31T04:43:56.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5e99600640 1 -- 172.21.15.89:0/2740248941 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400cdc0 con 0x7f5e9c162d90 2024-08-31T04:43:56.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9c159560 con 0x7f5e9c162d90 2024-08-31T04:43:56.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9c1532c0 con 0x7f5e9c162d90 2024-08-31T04:43:56.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.471+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e9c150720 con 0x7f5e9c162d90 2024-08-31T04:43:56.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.475+0000 7f5e99600640 1 -- 172.21.15.89:0/2740248941 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f5e9401b020 con 0x7f5e9c162d90 2024-08-31T04:43:56.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.475+0000 7f5e99600640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e780720c0 0x7f5e780745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:56.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.475+0000 7f5e99600640 1 -- 172.21.15.89:0/2740248941 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f5e94092dd0 con 0x7f5e9c162d90 2024-08-31T04:43:56.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.475+0000 7f5ea0e00640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e780720c0 0x7f5e780745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:56.478 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.475+0000 7f5ea0e00640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e780720c0 0x7f5e780745d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0ab000 tx=0x7f5e8c019da0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:56.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.479+0000 7f5e99600640 1 -- 172.21.15.89:0/2740248941 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5e9405e2b0 con 0x7f5e9c162d90 2024-08-31T04:43:56.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.643+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e9c151930 con 0x7f5e9c162d90 2024-08-31T04:43:56.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5e99600640 1 -- 172.21.15.89:0/2740248941 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+18886 (secure 0 0 0) 0x7f5e9405dbb0 con 0x7f5e9c162d90 2024-08-31T04:43:56.648 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:43:56.648 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":48,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:10:34.915666+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":46,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":46,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":492,"length":14}]},{"pool":4,"snaps":[{"begin":492,"length":14}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:43:56.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e780720c0 msgr2=0x7f5e780745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e780720c0 0x7f5e780745d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0ab000 tx=0x7f5e8c019da0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e9c162d90 msgr2=0x7f5e9c152350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:56.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e9c162d90 0x7f5e9c152350 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c072f80 tx=0x7f5e9400eec0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 shutdown_connections 2024-08-31T04:43:56.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f5e780720c0 0x7f5e780745d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e9c162d90 0x7f5e9c152350 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e9c162980 0x7f5e9c151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 --2- 172.21.15.89:0/2740248941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5e80003a60 0x7f5e9c155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:56.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 >> 172.21.15.89:0/2740248941 conn(0x7f5e9c0ca9c0 msgr2=0x7f5e9c0c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:56.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 shutdown_connections 2024-08-31T04:43:56.652 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:56.647+0000 7f5ea3800640 1 -- 172.21.15.89:0/2740248941 wait complete. 2024-08-31T04:43:57.672 INFO:tasks.ceph:Scrubbing osd.0 2024-08-31T04:43:57.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-31T04:43:57.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.839+0000 7f17c5400640 1 -- 172.21.15.89:0/473023057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c0074fb0 msgr2=0x7f17c00c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:57.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.839+0000 7f17c5400640 1 --2- 172.21.15.89:0/473023057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c0074fb0 0x7f17c00c3d80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f17c006ed80 tx=0x7f17b001cd80 comp rx=0 tx=0).stop 2024-08-31T04:43:57.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.839+0000 7f17c5400640 1 -- 172.21.15.89:0/473023057 shutdown_connections 2024-08-31T04:43:57.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.839+0000 7f17c5400640 1 --2- 172.21.15.89:0/473023057 >> v2:172.21.15.170:3300/0 conn(0x7f17c00c8560 0x7f17c00c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:57.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.839+0000 7f17c5400640 1 --2- 172.21.15.89:0/473023057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17c00c94a0 0x7f17c01527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:57.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.839+0000 7f17c5400640 1 --2- 172.21.15.89:0/473023057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c0074fb0 0x7f17c00c3d80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:57.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.839+0000 7f17c5400640 1 -- 172.21.15.89:0/473023057 >> 172.21.15.89:0/473023057 conn(0x7f17c00ccf20 msgr2=0x7f17c00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:57.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.839+0000 7f17c5400640 1 -- 172.21.15.89:0/473023057 shutdown_connections 2024-08-31T04:43:57.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.839+0000 7f17c5400640 1 -- 172.21.15.89:0/473023057 wait complete. 2024-08-31T04:43:57.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17c5400640 1 Processor -- start 2024-08-31T04:43:57.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17c5400640 1 -- start start 2024-08-31T04:43:57.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17c5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17c0074fb0 0x7f17c00c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:57.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17c5400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17c00c8560 0x7f17c014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:57.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17c5400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c00c94a0 0x7f17c013e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:57.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17c5400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f17c0073a10 con 0x7f17c00c94a0 2024-08-31T04:43:57.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17c5400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f17c0073890 con 0x7f17c0074fb0 2024-08-31T04:43:57.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17c5400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f17c0073b90 con 0x7f17c00c8560 2024-08-31T04:43:57.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17bf200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c00c94a0 0x7f17c013e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:57.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17bf200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c00c94a0 0x7f17c013e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49544/0 (socket says 172.21.15.89:49544) 2024-08-31T04:43:57.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17bf200640 1 -- 172.21.15.89:0/1362705613 learned_addr learned my addr 172.21.15.89:0/1362705613 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:57.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17bde00640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17c00c8560 0x7f17c014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:57.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.843+0000 7f17be800640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17c0074fb0 0x7f17c00c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:57.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17bf200640 1 -- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17c00c8560 msgr2=0x7f17c014dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:57.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17bf200640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17c00c8560 0x7f17c014dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:57.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17bf200640 1 -- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17c0074fb0 msgr2=0x7f17c00c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:57.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17bf200640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17c0074fb0 0x7f17c00c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:57.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17bf200640 1 -- 172.21.15.89:0/1362705613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c00c43a0 con 0x7f17c00c94a0 2024-08-31T04:43:57.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17bde00640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17c00c8560 0x7f17c014dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:57.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17bf200640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c00c94a0 0x7f17c013e570 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f17b800bfd0 tx=0x7f17b800da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:57.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17b6a00640 1 -- 172.21.15.89:0/1362705613 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8017070 con 0x7f17c00c94a0 2024-08-31T04:43:57.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17b6a00640 1 -- 172.21.15.89:0/1362705613 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17b8005310 con 0x7f17c00c94a0 2024-08-31T04:43:57.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17b6a00640 1 -- 172.21.15.89:0/1362705613 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b80047b0 con 0x7f17c00c94a0 2024-08-31T04:43:57.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c00c4610 con 0x7f17c00c94a0 2024-08-31T04:43:57.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c00c5500 con 0x7f17c00c94a0 2024-08-31T04:43:57.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17c00c3d80 con 0x7f17c00c94a0 2024-08-31T04:43:57.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17b6a00640 1 -- 172.21.15.89:0/1362705613 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f17b8004950 con 0x7f17c00c94a0 2024-08-31T04:43:57.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17b6a00640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17a00720f0 0x7f17a0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:57.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.847+0000 7f17b6a00640 1 -- 172.21.15.89:0/1362705613 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f17b8093510 con 0x7f17c00c94a0 2024-08-31T04:43:57.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.851+0000 7f17b6a00640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f17a007ba50 0x7f17a007df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:57.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.851+0000 7f17b6a00640 1 -- 172.21.15.89:0/1362705613 --> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17b8021e50 con 0x7f17a007ba50 2024-08-31T04:43:57.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.851+0000 7f17b6a00640 1 -- 172.21.15.89:0/1362705613 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f17b80938c0 con 0x7f17c00c94a0 2024-08-31T04:43:57.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.851+0000 7f17be800640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17a00720f0 0x7f17a0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:57.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.851+0000 7f17bde00640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f17a007ba50 0x7f17a007df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:57.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.851+0000 7f17bde00640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f17a007ba50 0x7f17a007df40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:57.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.851+0000 7f17be800640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17a00720f0 0x7f17a0074600 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f17b00af000 tx=0x7f17b001b5c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:57.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.851+0000 7f17b6a00640 1 -- 172.21.15.89:0/1362705613 <== osd.0 v2:172.21.15.89:6800/1617233830 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f17b8021e50 con 0x7f17a007ba50 2024-08-31T04:43:57.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 --> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f17c00cd4d0 con 0x7f17a007ba50 2024-08-31T04:43:57.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17b6a00640 1 -- 172.21.15.89:0/1362705613 <== osd.0 v2:172.21.15.89:6800/1617233830 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f17c00cd4d0 con 0x7f17a007ba50 2024-08-31T04:43:57.866 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:43:57.867 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T04:43:57.867 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:43:57.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f17a007ba50 msgr2=0x7f17a007df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:57.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.89:6800/1617233830,v1:172.21.15.89:6801/1617233830] conn(0x7f17a007ba50 0x7f17a007df40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:57.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17a00720f0 msgr2=0x7f17a0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:57.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f17a00720f0 0x7f17a0074600 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f17b00af000 tx=0x7f17b001b5c0 comp rx=0 tx=0).stop 2024-08-31T04:43:57.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c00c94a0 msgr2=0x7f17c013e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:57.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 --2- 172.21.15.89:0/1362705613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c00c94a0 0x7f17c013e570 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f17b800bfd0 tx=0x7f17b800da70 comp rx=0 tx=0).stop 2024-08-31T04:43:57.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17bf200640 1 -- 172.21.15.89:0/1362705613 reap_dead start 2024-08-31T04:43:57.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 shutdown_connections 2024-08-31T04:43:57.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 >> 172.21.15.89:0/1362705613 conn(0x7f17c00ccf20 msgr2=0x7f17c00c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:57.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 shutdown_connections 2024-08-31T04:43:57.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:57.863+0000 7f17c5400640 1 -- 172.21.15.89:0/1362705613 wait complete. 2024-08-31T04:43:57.886 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-31T04:43:58.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.039+0000 7f3dc5600640 1 -- 172.21.15.89:0/564174971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3da4004d50 msgr2=0x7f3da4005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.039+0000 7f3dc5600640 1 --2- 172.21.15.89:0/564174971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3da4004d50 0x7f3da4005160 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009ee0 tx=0x7f3db801d630 comp rx=0 tx=0).stop 2024-08-31T04:43:58.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.039+0000 7f3dbf400640 1 -- 172.21.15.89:0/564174971 reap_dead start 2024-08-31T04:43:58.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.039+0000 7f3dc5600640 1 -- 172.21.15.89:0/564174971 shutdown_connections 2024-08-31T04:43:58.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.039+0000 7f3dc5600640 1 -- 172.21.15.89:0/564174971 >> 172.21.15.89:0/564174971 conn(0x7f3dc00ccf20 msgr2=0x7f3dc00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:58.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.039+0000 7f3dc5600640 1 -- 172.21.15.89:0/564174971 shutdown_connections 2024-08-31T04:43:58.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.039+0000 7f3dc5600640 1 -- 172.21.15.89:0/564174971 wait complete. 2024-08-31T04:43:58.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 Processor -- start 2024-08-31T04:43:58.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 -- start start 2024-08-31T04:43:58.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da4004d50 0x7f3dc01f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc01580f0 0x7f3dc00b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dc015c8d0 0x7f3dc00c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc0159c90 con 0x7f3dc01580f0 2024-08-31T04:43:58.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01599b0 con 0x7f3da4004d50 2024-08-31T04:43:58.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc0159f70 con 0x7f3dc015c8d0 2024-08-31T04:43:58.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbe000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc01580f0 0x7f3dc00b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbe000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc01580f0 0x7f3dc00b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49564/0 (socket says 172.21.15.89:49564) 2024-08-31T04:43:58.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbe000640 1 -- 172.21.15.89:0/4254644449 learned_addr learned my addr 172.21.15.89:0/4254644449 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:58.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbea00640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da4004d50 0x7f3dc01f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbf400640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dc015c8d0 0x7f3dc00c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbe000640 1 -- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dc015c8d0 msgr2=0x7f3dc00c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbe000640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dc015c8d0 0x7f3dc00c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbe000640 1 -- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da4004d50 msgr2=0x7f3dc01f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbe000640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da4004d50 0x7f3dc01f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbe000640 1 -- 172.21.15.89:0/4254644449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc00c3110 con 0x7f3dc01580f0 2024-08-31T04:43:58.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dbe000640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc01580f0 0x7f3dc00b2a20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f3dac001a90 tx=0x7f3dac00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3db6a00640 1 -- 172.21.15.89:0/4254644449 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac015070 con 0x7f3dc01580f0 2024-08-31T04:43:58.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3db6a00640 1 -- 172.21.15.89:0/4254644449 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dac010980 con 0x7f3dc01580f0 2024-08-31T04:43:58.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc00c33f0 con 0x7f3dc01580f0 2024-08-31T04:43:58.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3db6a00640 1 -- 172.21.15.89:0/4254644449 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac010db0 con 0x7f3dc01580f0 2024-08-31T04:43:58.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.043+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc00c3b20 con 0x7f3dc01580f0 2024-08-31T04:43:58.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.047+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc0157d30 con 0x7f3dc01580f0 2024-08-31T04:43:58.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.047+0000 7f3db6a00640 1 -- 172.21.15.89:0/4254644449 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3dac018070 con 0x7f3dc01580f0 2024-08-31T04:43:58.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.047+0000 7f3db6a00640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3da00720f0 0x7f3da0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.047+0000 7f3db6a00640 1 -- 172.21.15.89:0/4254644449 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3dac093320 con 0x7f3dc01580f0 2024-08-31T04:43:58.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.047+0000 7f3dbea00640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3da00720f0 0x7f3da0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.047+0000 7f3dbea00640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3da00720f0 0x7f3da0074600 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009b60 tx=0x7f3db00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.051+0000 7f3db6a00640 1 -- 172.21.15.89:0/4254644449 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3dac05e120 con 0x7f3dc01580f0 2024-08-31T04:43:58.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.215+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f3dc0071e90 con 0x7f3da00720f0 2024-08-31T04:43:58.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3db6a00640 1 -- 172.21.15.89:0/4254644449 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3dc0071e90 con 0x7f3da00720f0 2024-08-31T04:43:58.219 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 0 to deep-scrub 2024-08-31T04:43:58.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3da00720f0 msgr2=0x7f3da0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3da00720f0 0x7f3da0074600 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009b60 tx=0x7f3db00091e0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc01580f0 msgr2=0x7f3dc00b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc01580f0 0x7f3dc00b2a20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f3dac001a90 tx=0x7f3dac00ea20 comp rx=0 tx=0).stop 2024-08-31T04:43:58.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 shutdown_connections 2024-08-31T04:43:58.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3da00720f0 0x7f3da0074600 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc01580f0 0x7f3dc00b2a20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3dc015c8d0 0x7f3dc00c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 --2- 172.21.15.89:0/4254644449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da4004d50 0x7f3dc01f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 >> 172.21.15.89:0/4254644449 conn(0x7f3dc00ccf20 msgr2=0x7f3dc00c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:58.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 shutdown_connections 2024-08-31T04:43:58.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.219+0000 7f3dc5600640 1 -- 172.21.15.89:0/4254644449 wait complete. 2024-08-31T04:43:58.242 INFO:tasks.ceph:Scrubbing osd.1 2024-08-31T04:43:58.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-31T04:43:58.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 -- 172.21.15.89:0/2863961297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c100c94a0 msgr2=0x7f3c100c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 --2- 172.21.15.89:0/2863961297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c100c94a0 0x7f3c100c3d80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3c100c6b60 tx=0x7f3bf801c8c0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 -- 172.21.15.89:0/2863961297 shutdown_connections 2024-08-31T04:43:58.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 --2- 172.21.15.89:0/2863961297 >> v2:172.21.15.170:3300/0 conn(0x7f3c100c8560 0x7f3c100c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 --2- 172.21.15.89:0/2863961297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c100c94a0 0x7f3c100c3d80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 -- 172.21.15.89:0/2863961297 >> 172.21.15.89:0/2863961297 conn(0x7f3c100ccf20 msgr2=0x7f3c100cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:58.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 -- 172.21.15.89:0/2863961297 shutdown_connections 2024-08-31T04:43:58.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 -- 172.21.15.89:0/2863961297 wait complete. 2024-08-31T04:43:58.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 Processor -- start 2024-08-31T04:43:58.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.399+0000 7f3c14c00640 1 -- start start 2024-08-31T04:43:58.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c14c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c10074fb0 0x7f3c10147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c14c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c100c8560 0x7f3c101f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c14c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c100c94a0 0x7f3c101574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c14c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10165b30 con 0x7f3c100c94a0 2024-08-31T04:43:58.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c14c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101659b0 con 0x7f3c10074fb0 2024-08-31T04:43:58.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c14c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3c10165cb0 con 0x7f3c100c8560 2024-08-31T04:43:58.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c100c94a0 0x7f3c101574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0e800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c100c94a0 0x7f3c101574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49582/0 (socket says 172.21.15.89:49582) 2024-08-31T04:43:58.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0e800640 1 -- 172.21.15.89:0/3235240781 learned_addr learned my addr 172.21.15.89:0/3235240781 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:58.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0de00640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c10074fb0 0x7f3c10147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c05400640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c100c8560 0x7f3c101f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0e800640 1 -- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c100c8560 msgr2=0x7f3c101f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0e800640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c100c8560 0x7f3c101f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0e800640 1 -- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c10074fb0 msgr2=0x7f3c10147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0e800640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c10074fb0 0x7f3c10147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0e800640 1 -- 172.21.15.89:0/3235240781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c10148560 con 0x7f3c100c94a0 2024-08-31T04:43:58.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0de00640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c10074fb0 0x7f3c10147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:58.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c0e800640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c100c94a0 0x7f3c101574c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800d690 tx=0x7f3c0800db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c06a00640 1 -- 172.21.15.89:0/3235240781 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08017070 con 0x7f3c100c94a0 2024-08-31T04:43:58.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c10150290 con 0x7f3c100c94a0 2024-08-31T04:43:58.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c06a00640 1 -- 172.21.15.89:0/3235240781 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c08005310 con 0x7f3c100c94a0 2024-08-31T04:43:58.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c06a00640 1 -- 172.21.15.89:0/3235240781 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08009820 con 0x7f3c100c94a0 2024-08-31T04:43:58.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c100c6730 con 0x7f3c100c94a0 2024-08-31T04:43:58.408 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.403+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c100ccbf0 con 0x7f3c100c94a0 2024-08-31T04:43:58.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c06a00640 1 -- 172.21.15.89:0/3235240781 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3c080099c0 con 0x7f3c100c94a0 2024-08-31T04:43:58.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c06a00640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3bec0720c0 0x7f3bec0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c06a00640 1 -- 172.21.15.89:0/3235240781 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3c08093690 con 0x7f3c100c94a0 2024-08-31T04:43:58.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c06a00640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7f3bec07b9b0 0x7f3bec07dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c0de00640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3bec0720c0 0x7f3bec0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c06a00640 1 -- 172.21.15.89:0/3235240781 --> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c08021e50 con 0x7f3bec07b9b0 2024-08-31T04:43:58.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c06a00640 1 -- 172.21.15.89:0/3235240781 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f3c08093a40 con 0x7f3c100c94a0 2024-08-31T04:43:58.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c05400640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7f3bec07b9b0 0x7f3bec07dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c05400640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7f3bec07b9b0 0x7f3bec07dea0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c0de00640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3bec0720c0 0x7f3bec0745d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009fc0 tx=0x7f3c00009550 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.407+0000 7f3c06a00640 1 -- 172.21.15.89:0/3235240781 <== osd.1 v2:172.21.15.89:6808/2972667834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c08021e50 con 0x7f3bec07b9b0 2024-08-31T04:43:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 --> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3c100c3d80 con 0x7f3bec07b9b0 2024-08-31T04:43:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c06a00640 1 -- 172.21.15.89:0/3235240781 <== osd.1 v2:172.21.15.89:6808/2972667834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3c100c3d80 con 0x7f3bec07b9b0 2024-08-31T04:43:58.424 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:43:58.425 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T04:43:58.425 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:43:58.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7f3bec07b9b0 msgr2=0x7f3bec07dea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.89:6808/2972667834,v1:172.21.15.89:6809/2972667834] conn(0x7f3bec07b9b0 0x7f3bec07dea0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3bec0720c0 msgr2=0x7f3bec0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3bec0720c0 0x7f3bec0745d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009fc0 tx=0x7f3c00009550 comp rx=0 tx=0).stop 2024-08-31T04:43:58.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c100c94a0 msgr2=0x7f3c101574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 --2- 172.21.15.89:0/3235240781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c100c94a0 0x7f3c101574c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800d690 tx=0x7f3c0800db50 comp rx=0 tx=0).stop 2024-08-31T04:43:58.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c0e800640 1 -- 172.21.15.89:0/3235240781 reap_dead start 2024-08-31T04:43:58.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 shutdown_connections 2024-08-31T04:43:58.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 >> 172.21.15.89:0/3235240781 conn(0x7f3c100ccf20 msgr2=0x7f3c101527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:58.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 shutdown_connections 2024-08-31T04:43:58.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.423+0000 7f3c14c00640 1 -- 172.21.15.89:0/3235240781 wait complete. 2024-08-31T04:43:58.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-31T04:43:58.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.595+0000 7f6ae1200640 1 -- 172.21.15.89:0/462595996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 msgr2=0x7f6adc1655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.595+0000 7f6ae1200640 1 --2- 172.21.15.89:0/462595996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 0x7f6adc1655a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009900 tx=0x7f6ad401f0d0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.595+0000 7f6ae1200640 1 -- 172.21.15.89:0/462595996 shutdown_connections 2024-08-31T04:43:58.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.595+0000 7f6ae1200640 1 --2- 172.21.15.89:0/462595996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 0x7f6adc1655a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.595+0000 7f6ae1200640 1 -- 172.21.15.89:0/462595996 >> 172.21.15.89:0/462595996 conn(0x7f6adc0ccf20 msgr2=0x7f6adc0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:58.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.595+0000 7f6ae1200640 1 -- 172.21.15.89:0/462595996 shutdown_connections 2024-08-31T04:43:58.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.595+0000 7f6ae1200640 1 -- 172.21.15.89:0/462595996 wait complete. 2024-08-31T04:43:58.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 Processor -- start 2024-08-31T04:43:58.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 -- start start 2024-08-31T04:43:58.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6adc074e20 0x7f6adc0767a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6adc156e10 0x7f6adc14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 0x7f6adc14ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc1599b0 con 0x7f6adc163180 2024-08-31T04:43:58.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc15a2e0 con 0x7f6adc074e20 2024-08-31T04:43:58.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6adc159c90 con 0x7f6adc156e10 2024-08-31T04:43:58.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ada800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 0x7f6adc14ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ada800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 0x7f6adc14ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49600/0 (socket says 172.21.15.89:49600) 2024-08-31T04:43:58.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ada800640 1 -- 172.21.15.89:0/198645803 learned_addr learned my addr 172.21.15.89:0/198645803 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:58.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ad9e00640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6adc074e20 0x7f6adc0767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ad1400640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6adc156e10 0x7f6adc14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ada800640 1 -- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6adc156e10 msgr2=0x7f6adc14c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ada800640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6adc156e10 0x7f6adc14c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ada800640 1 -- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6adc074e20 msgr2=0x7f6adc0767a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ada800640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6adc074e20 0x7f6adc0767a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ada800640 1 -- 172.21.15.89:0/198645803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc156480 con 0x7f6adc163180 2024-08-31T04:43:58.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ad1400640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6adc156e10 0x7f6adc14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:43:58.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ada800640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 0x7f6adc14ce30 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40b3040 tx=0x7f6ad40a8ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ad2a00640 1 -- 172.21.15.89:0/198645803 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40be070 con 0x7f6adc163180 2024-08-31T04:43:58.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ad2a00640 1 -- 172.21.15.89:0/198645803 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ad4003970 con 0x7f6adc163180 2024-08-31T04:43:58.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6adc0c3010 con 0x7f6adc163180 2024-08-31T04:43:58.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ad2a00640 1 -- 172.21.15.89:0/198645803 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40b5040 con 0x7f6adc163180 2024-08-31T04:43:58.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.599+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6adc0cc9e0 con 0x7f6adc163180 2024-08-31T04:43:58.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.603+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6adc071e40 con 0x7f6adc163180 2024-08-31T04:43:58.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.603+0000 7f6ad2a00640 1 -- 172.21.15.89:0/198645803 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6ad40c1070 con 0x7f6adc163180 2024-08-31T04:43:58.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.603+0000 7f6ad2a00640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ab80720f0 0x7f6ab8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.603+0000 7f6ad2a00640 1 -- 172.21.15.89:0/198645803 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f6ad412fe90 con 0x7f6adc163180 2024-08-31T04:43:58.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.603+0000 7f6ad9e00640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ab80720f0 0x7f6ab8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.603+0000 7f6ad9e00640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ab80720f0 0x7f6ab8074600 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6acc001e40 tx=0x7f6acc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.607+0000 7f6ad2a00640 1 -- 172.21.15.89:0/198645803 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6ad4018c30 con 0x7f6adc163180 2024-08-31T04:43:58.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.791+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6adc074580 con 0x7f6ab80720f0 2024-08-31T04:43:58.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ad2a00640 1 -- 172.21.15.89:0/198645803 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6adc074580 con 0x7f6ab80720f0 2024-08-31T04:43:58.796 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 1 to deep-scrub 2024-08-31T04:43:58.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ab80720f0 msgr2=0x7f6ab8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ab80720f0 0x7f6ab8074600 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6acc001e40 tx=0x7f6acc009040 comp rx=0 tx=0).stop 2024-08-31T04:43:58.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 msgr2=0x7f6adc14ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 0x7f6adc14ce30 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40b3040 tx=0x7f6ad40a8ce0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 shutdown_connections 2024-08-31T04:43:58.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6ab80720f0 0x7f6ab8074600 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6adc163180 0x7f6adc14ce30 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6adc156e10 0x7f6adc14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 --2- 172.21.15.89:0/198645803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6adc074e20 0x7f6adc0767a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 >> 172.21.15.89:0/198645803 conn(0x7f6adc0ccf20 msgr2=0x7f6adc0b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:58.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 shutdown_connections 2024-08-31T04:43:58.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.795+0000 7f6ae1200640 1 -- 172.21.15.89:0/198645803 wait complete. 2024-08-31T04:43:58.819 INFO:tasks.ceph:Scrubbing osd.2 2024-08-31T04:43:58.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-31T04:43:58.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.979+0000 7f2a78a00640 1 -- 172.21.15.89:0/573839663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a58004da0 msgr2=0x7f2a58005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.979+0000 7f2a78a00640 1 --2- 172.21.15.89:0/573839663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a58004da0 0x7f2a58005230 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2a740b26a0 tx=0x7f2a6c01f610 comp rx=0 tx=0).stop 2024-08-31T04:43:58.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.979+0000 7f2a72800640 1 -- 172.21.15.89:0/573839663 reap_dead start 2024-08-31T04:43:58.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.979+0000 7f2a78a00640 1 -- 172.21.15.89:0/573839663 shutdown_connections 2024-08-31T04:43:58.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.979+0000 7f2a78a00640 1 -- 172.21.15.89:0/573839663 >> 172.21.15.89:0/573839663 conn(0x7f2a740ccf20 msgr2=0x7f2a740cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:58.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.979+0000 7f2a78a00640 1 -- 172.21.15.89:0/573839663 shutdown_connections 2024-08-31T04:43:58.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.979+0000 7f2a78a00640 1 -- 172.21.15.89:0/573839663 wait complete. 2024-08-31T04:43:58.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.979+0000 7f2a78a00640 1 Processor -- start 2024-08-31T04:43:58.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.979+0000 7f2a78a00640 1 -- start start 2024-08-31T04:43:58.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a78a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a741e4610 0x7f2a741587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a78a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a74148df0 0x7f2a741e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a78a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a74149200 0x7f2a741f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a78a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2a740743b0 con 0x7f2a74149200 2024-08-31T04:43:58.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a78a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74074b10 con 0x7f2a74148df0 2024-08-31T04:43:58.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a78a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2a740c9680 con 0x7f2a741e4610 2024-08-31T04:43:58.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a72800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a74149200 0x7f2a741f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a71e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a741e4610 0x7f2a741587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a72800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a74149200 0x7f2a741f0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49618/0 (socket says 172.21.15.89:49618) 2024-08-31T04:43:58.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a72800640 1 -- 172.21.15.89:0/1441772591 learned_addr learned my addr 172.21.15.89:0/1441772591 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:58.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a69400640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a74148df0 0x7f2a741e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a72800640 1 -- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a741e4610 msgr2=0x7f2a741587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a72800640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a741e4610 0x7f2a741587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a72800640 1 -- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a74148df0 msgr2=0x7f2a741e31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:58.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a72800640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a74148df0 0x7f2a741e31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:58.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a72800640 1 -- 172.21.15.89:0/1441772591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a74159560 con 0x7f2a74149200 2024-08-31T04:43:58.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a72800640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a74149200 0x7f2a741f0140 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c001250 tx=0x7f2a6c000e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a6aa00640 1 -- 172.21.15.89:0/1441772591 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c006bc0 con 0x7f2a74149200 2024-08-31T04:43:58.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a6aa00640 1 -- 172.21.15.89:0/1441772591 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a6c006420 con 0x7f2a74149200 2024-08-31T04:43:58.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a6aa00640 1 -- 172.21.15.89:0/1441772591 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c001760 con 0x7f2a74149200 2024-08-31T04:43:58.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a74158020 con 0x7f2a74149200 2024-08-31T04:43:58.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a74159280 con 0x7f2a74149200 2024-08-31T04:43:58.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.983+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a741efbc0 con 0x7f2a74149200 2024-08-31T04:43:58.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a6aa00640 1 -- 172.21.15.89:0/1441772591 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2a6c003600 con 0x7f2a74149200 2024-08-31T04:43:58.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a6aa00640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a500720c0 0x7f2a500745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a6aa00640 1 -- 172.21.15.89:0/1441772591 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2a6c12ffb0 con 0x7f2a74149200 2024-08-31T04:43:58.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a6aa00640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f2a5007ba20 0x7f2a5007df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:58.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a6aa00640 1 -- 172.21.15.89:0/1441772591 --> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a6c0bee70 con 0x7f2a5007ba20 2024-08-31T04:43:58.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a6aa00640 1 -- 172.21.15.89:0/1441772591 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f2a6c1325d0 con 0x7f2a74149200 2024-08-31T04:43:58.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a71e00640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a500720c0 0x7f2a500745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a69400640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f2a5007ba20 0x7f2a5007df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:58.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a69400640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f2a5007ba20 0x7f2a5007df10 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a71e00640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a500720c0 0x7f2a500745d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a64012450 tx=0x7f2a64009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:58.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:58.987+0000 7f2a6aa00640 1 -- 172.21.15.89:0/1441772591 <== osd.2 v2:172.21.15.89:6824/208143917 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a6c0bee70 con 0x7f2a5007ba20 2024-08-31T04:43:59.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 --> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2a740c8cd0 con 0x7f2a5007ba20 2024-08-31T04:43:59.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a6aa00640 1 -- 172.21.15.89:0/1441772591 <== osd.2 v2:172.21.15.89:6824/208143917 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2a740c8cd0 con 0x7f2a5007ba20 2024-08-31T04:43:59.005 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:43:59.005 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T04:43:59.006 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:43:59.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f2a5007ba20 msgr2=0x7f2a5007df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.89:6824/208143917,v1:172.21.15.89:6825/208143917] conn(0x7f2a5007ba20 0x7f2a5007df10 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a500720c0 msgr2=0x7f2a500745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2a500720c0 0x7f2a500745d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a64012450 tx=0x7f2a64009500 comp rx=0 tx=0).stop 2024-08-31T04:43:59.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a74149200 msgr2=0x7f2a741f0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 --2- 172.21.15.89:0/1441772591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a74149200 0x7f2a741f0140 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c001250 tx=0x7f2a6c000e50 comp rx=0 tx=0).stop 2024-08-31T04:43:59.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a72800640 1 -- 172.21.15.89:0/1441772591 reap_dead start 2024-08-31T04:43:59.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 shutdown_connections 2024-08-31T04:43:59.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 >> 172.21.15.89:0/1441772591 conn(0x7f2a740ccf20 msgr2=0x7f2a74070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:59.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 shutdown_connections 2024-08-31T04:43:59.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.003+0000 7f2a78a00640 1 -- 172.21.15.89:0/1441772591 wait complete. 2024-08-31T04:43:59.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-31T04:43:59.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 -- 172.21.15.89:0/355987961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b80c9330 msgr2=0x7ff9b8074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 --2- 172.21.15.89:0/355987961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b80c9330 0x7ff9b8074720 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8070b70 tx=0x7ff9b001f0b0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 -- 172.21.15.89:0/355987961 shutdown_connections 2024-08-31T04:43:59.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 --2- 172.21.15.89:0/355987961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b80c9330 0x7ff9b8074720 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 --2- 172.21.15.89:0/355987961 >> v2:172.21.15.170:3300/0 conn(0x7ff9b80c1f40 0x7ff9b8152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 -- 172.21.15.89:0/355987961 >> 172.21.15.89:0/355987961 conn(0x7ff9b80ccf20 msgr2=0x7ff9b80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:59.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 -- 172.21.15.89:0/355987961 shutdown_connections 2024-08-31T04:43:59.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 -- 172.21.15.89:0/355987961 wait complete. 2024-08-31T04:43:59.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 Processor -- start 2024-08-31T04:43:59.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.183+0000 7ff9bdc00640 1 -- start start 2024-08-31T04:43:59.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9bdc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9b80c1f40 0x7ff9b8155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9bdc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80c9330 0x7ff9b8153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9bdc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b815bc70 0x7ff9b80c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9bdc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b80c8030 con 0x7ff9b815bc70 2024-08-31T04:43:59.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9bdc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b80c3150 con 0x7ff9b80c9330 2024-08-31T04:43:59.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9bdc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b8074c60 con 0x7ff9b80c1f40 2024-08-31T04:43:59.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b7400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b815bc70 0x7ff9b80c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b7400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b815bc70 0x7ff9b80c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49640/0 (socket says 172.21.15.89:49640) 2024-08-31T04:43:59.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b7400640 1 -- 172.21.15.89:0/361872532 learned_addr learned my addr 172.21.15.89:0/361872532 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:59.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b6000640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80c9330 0x7ff9b8153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b6a00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9b80c1f40 0x7ff9b8155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b7400640 1 -- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9b80c1f40 msgr2=0x7ff9b8155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b7400640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9b80c1f40 0x7ff9b8155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b7400640 1 -- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80c9330 msgr2=0x7ff9b8153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b7400640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80c9330 0x7ff9b8153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b7400640 1 -- 172.21.15.89:0/361872532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b8154d70 con 0x7ff9b815bc70 2024-08-31T04:43:59.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b6a00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9b80c1f40 0x7ff9b8155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:43:59.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9b7400640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b815bc70 0x7ff9b80c66e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009850 tx=0x7ff9b0005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:59.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9aea00640 1 -- 172.21.15.89:0/361872532 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00be070 con 0x7ff9b815bc70 2024-08-31T04:43:59.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9aea00640 1 -- 172.21.15.89:0/361872532 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9b00053e0 con 0x7ff9b815bc70 2024-08-31T04:43:59.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b81f0930 con 0x7ff9b815bc70 2024-08-31T04:43:59.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9aea00640 1 -- 172.21.15.89:0/361872532 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00b5040 con 0x7ff9b815bc70 2024-08-31T04:43:59.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b8152f70 con 0x7ff9b815bc70 2024-08-31T04:43:59.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.187+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b8152a10 con 0x7ff9b815bc70 2024-08-31T04:43:59.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.191+0000 7ff9aea00640 1 -- 172.21.15.89:0/361872532 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff9b00c1070 con 0x7ff9b815bc70 2024-08-31T04:43:59.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.191+0000 7ff9aea00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff9980720c0 0x7ff9980745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.191+0000 7ff9aea00640 1 -- 172.21.15.89:0/361872532 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff9b0130070 con 0x7ff9b815bc70 2024-08-31T04:43:59.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.191+0000 7ff9b6a00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff9980720c0 0x7ff9980745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.191+0000 7ff9b6a00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff9980720c0 0x7ff9980745d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8007fd0 tx=0x7ff9a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:59.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.195+0000 7ff9aea00640 1 -- 172.21.15.89:0/361872532 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff9b0018c10 con 0x7ff9b815bc70 2024-08-31T04:43:59.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.363+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ff9b81e4f30 con 0x7ff9980720c0 2024-08-31T04:43:59.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.363+0000 7ff9aea00640 1 -- 172.21.15.89:0/361872532 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff9b81e4f30 con 0x7ff9980720c0 2024-08-31T04:43:59.365 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 2 to deep-scrub 2024-08-31T04:43:59.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff9980720c0 msgr2=0x7ff9980745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff9980720c0 0x7ff9980745d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8007fd0 tx=0x7ff9a8009040 comp rx=0 tx=0).stop 2024-08-31T04:43:59.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b815bc70 msgr2=0x7ff9b80c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b815bc70 0x7ff9b80c66e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009850 tx=0x7ff9b0005e50 comp rx=0 tx=0).stop 2024-08-31T04:43:59.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 shutdown_connections 2024-08-31T04:43:59.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff9980720c0 0x7ff9980745d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b815bc70 0x7ff9b80c66e0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80c9330 0x7ff9b8153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 --2- 172.21.15.89:0/361872532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9b80c1f40 0x7ff9b8155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 >> 172.21.15.89:0/361872532 conn(0x7ff9b80ccf20 msgr2=0x7ff9b8150000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:59.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 shutdown_connections 2024-08-31T04:43:59.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.367+0000 7ff9bdc00640 1 -- 172.21.15.89:0/361872532 wait complete. 2024-08-31T04:43:59.389 INFO:tasks.ceph:Scrubbing osd.3 2024-08-31T04:43:59.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-31T04:43:59.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.543+0000 7ff1f4a00640 1 -- 172.21.15.89:0/4193691182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1f015d560 msgr2=0x7ff1f0156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.543+0000 7ff1f4a00640 1 --2- 172.21.15.89:0/4193691182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1f015d560 0x7ff1f0156d90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00752e0 tx=0x7ff1e801f5a0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.543+0000 7ff1f4a00640 1 -- 172.21.15.89:0/4193691182 shutdown_connections 2024-08-31T04:43:59.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.543+0000 7ff1f4a00640 1 --2- 172.21.15.89:0/4193691182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1f015d560 0x7ff1f0156d90 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.543+0000 7ff1f4a00640 1 -- 172.21.15.89:0/4193691182 >> 172.21.15.89:0/4193691182 conn(0x7ff1f0071410 msgr2=0x7ff1f0071820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:59.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.543+0000 7ff1f4a00640 1 -- 172.21.15.89:0/4193691182 shutdown_connections 2024-08-31T04:43:59.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.543+0000 7ff1f4a00640 1 -- 172.21.15.89:0/4193691182 wait complete. 2024-08-31T04:43:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1f4a00640 1 Processor -- start 2024-08-31T04:43:59.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1f4a00640 1 -- start start 2024-08-31T04:43:59.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1f4a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1f0073910 0x7ff1f01f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1f4a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1f00c38c0 0x7ff1f00c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1f4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f015d560 0x7ff1f014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1f4a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f00c7570 con 0x7ff1f0073910 2024-08-31T04:43:59.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1f4a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0073d20 con 0x7ff1f015d560 2024-08-31T04:43:59.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1f4a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f00735a0 con 0x7ff1f00c38c0 2024-08-31T04:43:59.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1ef400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1f0073910 0x7ff1f01f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1ef400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1f0073910 0x7ff1f01f1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49668/0 (socket says 172.21.15.89:49668) 2024-08-31T04:43:59.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1ef400640 1 -- 172.21.15.89:0/3161831396 learned_addr learned my addr 172.21.15.89:0/3161831396 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:59.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1efe00640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f015d560 0x7ff1f014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1eea00640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1f00c38c0 0x7ff1f00c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1ef400640 1 -- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1f00c38c0 msgr2=0x7ff1f00c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1ef400640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1f00c38c0 0x7ff1f00c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1ef400640 1 -- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f015d560 msgr2=0x7ff1f014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1ef400640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f015d560 0x7ff1f014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1ef400640 1 -- 172.21.15.89:0/3161831396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f01f5710 con 0x7ff1f0073910 2024-08-31T04:43:59.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1ef400640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1f0073910 0x7ff1f01f1f50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c430 tx=0x7ff1e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:59.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1e7400640 1 -- 172.21.15.89:0/3161831396 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0017070 con 0x7ff1f0073910 2024-08-31T04:43:59.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.547+0000 7ff1e7400640 1 -- 172.21.15.89:0/3161831396 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1e00053c0 con 0x7ff1f0073910 2024-08-31T04:43:59.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f01f59f0 con 0x7ff1f0073910 2024-08-31T04:43:59.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1e7400640 1 -- 172.21.15.89:0/3161831396 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00038b0 con 0x7ff1f0073910 2024-08-31T04:43:59.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f00c4e40 con 0x7ff1f0073910 2024-08-31T04:43:59.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1f01f54c0 con 0x7ff1f0073910 2024-08-31T04:43:59.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1e7400640 1 -- 172.21.15.89:0/3161831396 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7ff1e001a070 con 0x7ff1f0073910 2024-08-31T04:43:59.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1e7400640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1d00720c0 0x7ff1d00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1e7400640 1 -- 172.21.15.89:0/3161831396 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7ff1e00926a0 con 0x7ff1f0073910 2024-08-31T04:43:59.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1e7400640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7ff1d007ba20 0x7ff1d007df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1e7400640 1 -- 172.21.15.89:0/3161831396 --> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1e0004e70 con 0x7ff1d007ba20 2024-08-31T04:43:59.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1e7400640 1 -- 172.21.15.89:0/3161831396 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff1e0092a50 con 0x7ff1f0073910 2024-08-31T04:43:59.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1eea00640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1d00720c0 0x7ff1d00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.551+0000 7ff1efe00640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7ff1d007ba20 0x7ff1d007df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.555+0000 7ff1efe00640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7ff1d007ba20 0x7ff1d007df10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:59.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.555+0000 7ff1eea00640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1d00720c0 0x7ff1d00745d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00c8140 tx=0x7ff1dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:59.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.555+0000 7ff1e7400640 1 -- 172.21.15.89:0/3161831396 <== osd.3 v2:172.21.15.89:6816/208411581 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1e0004e70 con 0x7ff1d007ba20 2024-08-31T04:43:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 --> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff1f0156d90 con 0x7ff1d007ba20 2024-08-31T04:43:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1e7400640 1 -- 172.21.15.89:0/3161831396 <== osd.3 v2:172.21.15.89:6816/208411581 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff1f0156d90 con 0x7ff1d007ba20 2024-08-31T04:43:59.569 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:43:59.570 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T04:43:59.570 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:43:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7ff1d007ba20 msgr2=0x7ff1d007df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.89:6816/208411581,v1:172.21.15.89:6817/208411581] conn(0x7ff1d007ba20 0x7ff1d007df10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1d00720c0 msgr2=0x7ff1d00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7ff1d00720c0 0x7ff1d00745d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00c8140 tx=0x7ff1dc009040 comp rx=0 tx=0).stop 2024-08-31T04:43:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1f0073910 msgr2=0x7ff1f01f1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 --2- 172.21.15.89:0/3161831396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1f0073910 0x7ff1f01f1f50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c430 tx=0x7ff1e000c8f0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1efe00640 1 -- 172.21.15.89:0/3161831396 reap_dead start 2024-08-31T04:43:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 shutdown_connections 2024-08-31T04:43:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 >> 172.21.15.89:0/3161831396 conn(0x7ff1f0071410 msgr2=0x7ff1f0153690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 shutdown_connections 2024-08-31T04:43:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.567+0000 7ff1f4a00640 1 -- 172.21.15.89:0/3161831396 wait complete. 2024-08-31T04:43:59.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-31T04:43:59.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.751+0000 7f57d3200640 1 -- 172.21.15.89:0/2302917296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 msgr2=0x7f57d41585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.751+0000 7f57d3200640 1 --2- 172.21.15.89:0/2302917296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 0x7f57d41585e0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f57d40736e0 tx=0x7f57c401f0b0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.751+0000 7f57d3200640 1 -- 172.21.15.89:0/2302917296 shutdown_connections 2024-08-31T04:43:59.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.751+0000 7f57d3200640 1 --2- 172.21.15.89:0/2302917296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57d40ca680 0x7f57d40caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.751+0000 7f57d3200640 1 --2- 172.21.15.89:0/2302917296 >> v2:172.21.15.170:3300/0 conn(0x7f57d40c3cf0 0x7f57d41559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.751+0000 7f57d3200640 1 --2- 172.21.15.89:0/2302917296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 0x7f57d41585e0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.751+0000 7f57d3200640 1 -- 172.21.15.89:0/2302917296 >> 172.21.15.89:0/2302917296 conn(0x7f57d4070da0 msgr2=0x7f57d40cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:59.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.751+0000 7f57d3200640 1 -- 172.21.15.89:0/2302917296 shutdown_connections 2024-08-31T04:43:59.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.751+0000 7f57d3200640 1 -- 172.21.15.89:0/2302917296 wait complete. 2024-08-31T04:43:59.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d3200640 1 Processor -- start 2024-08-31T04:43:59.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d3200640 1 -- start start 2024-08-31T04:43:59.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d3200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57d40c3cf0 0x7f57d41f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d3200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 0x7f57d41e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d40ca680 0x7f57d41e8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d3200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57d40ca3d0 con 0x7f57d40c85f0 2024-08-31T04:43:59.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f57d40ca250 con 0x7f57d40ca680 2024-08-31T04:43:59.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d3200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f57d40ce900 con 0x7f57d40c3cf0 2024-08-31T04:43:59.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 0x7f57d41e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d1400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 0x7f57d41e7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49676/0 (socket says 172.21.15.89:49676) 2024-08-31T04:43:59.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d1400640 1 -- 172.21.15.89:0/2503490777 learned_addr learned my addr 172.21.15.89:0/2503490777 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:43:59.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d2800640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d40ca680 0x7f57d41e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.755+0000 7f57d1e00640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57d40c3cf0 0x7f57d41f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57d1400640 1 -- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57d40c3cf0 msgr2=0x7f57d41f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57d1400640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57d40c3cf0 0x7f57d41f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57d1400640 1 -- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d40ca680 msgr2=0x7f57d41e8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57d1400640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d40ca680 0x7f57d41e8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57d1400640 1 -- 172.21.15.89:0/2503490777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d41f2960 con 0x7f57d40c85f0 2024-08-31T04:43:59.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57d1400640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 0x7f57d41e7ee0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d700 tx=0x7f57c000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:59.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57ca000640 1 -- 172.21.15.89:0/2503490777 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0017070 con 0x7f57d40c85f0 2024-08-31T04:43:59.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57ca000640 1 -- 172.21.15.89:0/2503490777 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57c0009ab0 con 0x7f57d40c85f0 2024-08-31T04:43:59.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d41e0e90 con 0x7f57d40c85f0 2024-08-31T04:43:59.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57ca000640 1 -- 172.21.15.89:0/2503490777 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0010460 con 0x7f57d40c85f0 2024-08-31T04:43:59.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d41e1170 con 0x7f57d40c85f0 2024-08-31T04:43:59.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d40c7a00 con 0x7f57d40c85f0 2024-08-31T04:43:59.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57ca000640 1 -- 172.21.15.89:0/2503490777 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f57c001a070 con 0x7f57d40c85f0 2024-08-31T04:43:59.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.759+0000 7f57ca000640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f57b40720f0 0x7f57b4074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:43:59.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.763+0000 7f57ca000640 1 -- 172.21.15.89:0/2503490777 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f57c0092fe0 con 0x7f57d40c85f0 2024-08-31T04:43:59.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.763+0000 7f57d1e00640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f57b40720f0 0x7f57b4074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:43:59.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.763+0000 7f57d1e00640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f57b40720f0 0x7f57b4074600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f57c40b2000 tx=0x7f57c401d8f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:43:59.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.767+0000 7f57ca000640 1 -- 172.21.15.89:0/2503490777 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f57c005e520 con 0x7f57d40c85f0 2024-08-31T04:43:59.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.943+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f57d41e8b20 con 0x7f57b40720f0 2024-08-31T04:43:59.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.943+0000 7f57ca000640 1 -- 172.21.15.89:0/2503490777 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f57d41e8b20 con 0x7f57b40720f0 2024-08-31T04:43:59.945 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 3 to deep-scrub 2024-08-31T04:43:59.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f57b40720f0 msgr2=0x7f57b4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f57b40720f0 0x7f57b4074600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f57c40b2000 tx=0x7f57c401d8f0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 msgr2=0x7f57d41e7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:43:59.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 0x7f57d41e7ee0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d700 tx=0x7f57c000dbc0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 shutdown_connections 2024-08-31T04:43:59.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f57b40720f0 0x7f57b4074600 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d40c85f0 0x7f57d41e7ee0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d40ca680 0x7f57d41e8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 --2- 172.21.15.89:0/2503490777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57d40c3cf0 0x7f57d41f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:43:59.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 >> 172.21.15.89:0/2503490777 conn(0x7f57d4070da0 msgr2=0x7f57d40c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:43:59.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 shutdown_connections 2024-08-31T04:43:59.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:43:59.947+0000 7f57d3200640 1 -- 172.21.15.89:0/2503490777 wait complete. 2024-08-31T04:43:59.968 INFO:tasks.ceph:Scrubbing osd.4 2024-08-31T04:43:59.968 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-31T04:44:00.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 -- 172.21.15.89:0/1856340414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4070fe0 msgr2=0x7f59c40713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 --2- 172.21.15.89:0/1856340414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4070fe0 0x7f59c40713f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f59c40cdfe0 tx=0x7f59bc01c8c0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 -- 172.21.15.89:0/1856340414 shutdown_connections 2024-08-31T04:44:00.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 --2- 172.21.15.89:0/1856340414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4070fe0 0x7f59c40713f0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 --2- 172.21.15.89:0/1856340414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59c41597c0 0x7f59c4074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 --2- 172.21.15.89:0/1856340414 >> v2:172.21.15.170:3300/0 conn(0x7f59c4073680 0x7f59c4153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 -- 172.21.15.89:0/1856340414 >> 172.21.15.89:0/1856340414 conn(0x7f59c40ccf20 msgr2=0x7f59c40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 -- 172.21.15.89:0/1856340414 shutdown_connections 2024-08-31T04:44:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 -- 172.21.15.89:0/1856340414 wait complete. 2024-08-31T04:44:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 Processor -- start 2024-08-31T04:44:00.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.127+0000 7f59c9400640 1 -- start start 2024-08-31T04:44:00.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c9400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59c4070fe0 0x7f59c40c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4073680 0x7f59c4147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c41597c0 0x7f59c41498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c9400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40c9800 con 0x7f59c4073680 2024-08-31T04:44:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c9400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40c9680 con 0x7f59c41597c0 2024-08-31T04:44:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c9400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f59c40c8cd0 con 0x7f59c4070fe0 2024-08-31T04:44:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59b9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4073680 0x7f59c4147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59b9e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4073680 0x7f59c4147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49696/0 (socket says 172.21.15.89:49696) 2024-08-31T04:44:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59b9e00640 1 -- 172.21.15.89:0/3727323214 learned_addr learned my addr 172.21.15.89:0/3727323214 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:00.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c2800640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59c4070fe0 0x7f59c40c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c3200640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c41597c0 0x7f59c41498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59b9e00640 1 -- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59c4070fe0 msgr2=0x7f59c40c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59b9e00640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59c4070fe0 0x7f59c40c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59b9e00640 1 -- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c41597c0 msgr2=0x7f59c41498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59b9e00640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c41597c0 0x7f59c41498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59b9e00640 1 -- 172.21.15.89:0/3727323214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c40c1f40 con 0x7f59c4073680 2024-08-31T04:44:00.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c3200640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59c41597c0 0x7f59c41498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:44:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59b9e00640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4073680 0x7f59c4147c90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e960 tx=0x7f59ac00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59bb400640 1 -- 172.21.15.89:0/3727323214 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac004d30 con 0x7f59c4073680 2024-08-31T04:44:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59bb400640 1 -- 172.21.15.89:0/3727323214 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59ac00cb20 con 0x7f59c4073680 2024-08-31T04:44:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c4157de0 con 0x7f59c4073680 2024-08-31T04:44:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59bb400640 1 -- 172.21.15.89:0/3727323214 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac005020 con 0x7f59c4073680 2024-08-31T04:44:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c40c3130 con 0x7f59c4073680 2024-08-31T04:44:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.131+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59c40c34a0 con 0x7f59c4073680 2024-08-31T04:44:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59bb400640 1 -- 172.21.15.89:0/3727323214 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f59ac0051c0 con 0x7f59c4073680 2024-08-31T04:44:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59bb400640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59a00720c0 0x7f59a00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59bb400640 1 -- 172.21.15.89:0/3727323214 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f59ac093df0 con 0x7f59c4073680 2024-08-31T04:44:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59bb400640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7f59a007ba20 0x7f59a007df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59bb400640 1 -- 172.21.15.89:0/3727323214 --> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59a007e5e0 con 0x7f59a007ba20 2024-08-31T04:44:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59bb400640 1 -- 172.21.15.89:0/3727323214 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f59ac0941a0 con 0x7f59c4073680 2024-08-31T04:44:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59c2800640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59a00720c0 0x7f59a00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59c3200640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7f59a007ba20 0x7f59a007df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59c2800640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59a00720c0 0x7f59a00745d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f59b40098f0 tx=0x7f59b4006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.135+0000 7f59c3200640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7f59a007ba20 0x7f59a007df10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.139+0000 7f59bb400640 1 -- 172.21.15.89:0/3727323214 <== osd.4 v2:172.21.15.170:6826/3130076970 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59a007e5e0 con 0x7f59a007ba20 2024-08-31T04:44:00.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 --> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f59c40713f0 con 0x7f59a007ba20 2024-08-31T04:44:00.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59bb400640 1 -- 172.21.15.89:0/3727323214 <== osd.4 v2:172.21.15.170:6826/3130076970 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f59c40713f0 con 0x7f59a007ba20 2024-08-31T04:44:00.154 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:44:00.154 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T04:44:00.154 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:44:00.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7f59a007ba20 msgr2=0x7f59a007df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6826/3130076970,v1:172.21.15.170:6827/3130076970] conn(0x7f59a007ba20 0x7f59a007df10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59a00720c0 msgr2=0x7f59a00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f59a00720c0 0x7f59a00745d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f59b40098f0 tx=0x7f59b4006f90 comp rx=0 tx=0).stop 2024-08-31T04:44:00.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4073680 msgr2=0x7f59c4147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 --2- 172.21.15.89:0/3727323214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4073680 0x7f59c4147c90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e960 tx=0x7f59ac00ee20 comp rx=0 tx=0).stop 2024-08-31T04:44:00.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c3200640 1 -- 172.21.15.89:0/3727323214 reap_dead start 2024-08-31T04:44:00.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 shutdown_connections 2024-08-31T04:44:00.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 >> 172.21.15.89:0/3727323214 conn(0x7f59c40ccf20 msgr2=0x7f59c4163970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:00.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 shutdown_connections 2024-08-31T04:44:00.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.151+0000 7f59c9400640 1 -- 172.21.15.89:0/3727323214 wait complete. 2024-08-31T04:44:00.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-31T04:44:00.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.327+0000 7fe77dc00640 1 -- 172.21.15.89:0/1722309061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe75c003a10 msgr2=0x7fe75c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.327+0000 7fe77dc00640 1 --2- 172.21.15.89:0/1722309061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe75c003a10 0x7fe75c003e80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe76800c290 tx=0x7fe76801f790 comp rx=0 tx=0).stop 2024-08-31T04:44:00.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.327+0000 7fe777400640 1 -- 172.21.15.89:0/1722309061 reap_dead start 2024-08-31T04:44:00.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.327+0000 7fe77dc00640 1 -- 172.21.15.89:0/1722309061 shutdown_connections 2024-08-31T04:44:00.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.327+0000 7fe77dc00640 1 -- 172.21.15.89:0/1722309061 >> 172.21.15.89:0/1722309061 conn(0x7fe7780ccf20 msgr2=0x7fe7780cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:00.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.327+0000 7fe77dc00640 1 -- 172.21.15.89:0/1722309061 shutdown_connections 2024-08-31T04:44:00.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.327+0000 7fe77dc00640 1 -- 172.21.15.89:0/1722309061 wait complete. 2024-08-31T04:44:00.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 Processor -- start 2024-08-31T04:44:00.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 -- start start 2024-08-31T04:44:00.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c003a10 0x7fe7781f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe778155b90 0x7fe7780b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7780c5fd0 0x7fe7780c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe7780c8030 con 0x7fe7780c5fd0 2024-08-31T04:44:00.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7780c3150 con 0x7fe75c003a10 2024-08-31T04:44:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe778152a10 con 0x7fe778155b90 2024-08-31T04:44:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe777400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7780c5fd0 0x7fe7780c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe777400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7780c5fd0 0x7fe7780c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49722/0 (socket says 172.21.15.89:49722) 2024-08-31T04:44:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe777400640 1 -- 172.21.15.89:0/1384421713 learned_addr learned my addr 172.21.15.89:0/1384421713 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe76e000640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe778155b90 0x7fe7780b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe776a00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c003a10 0x7fe7781f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe777400640 1 -- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe778155b90 msgr2=0x7fe7780b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe777400640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe778155b90 0x7fe7780b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe777400640 1 -- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c003a10 msgr2=0x7fe7781f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe777400640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c003a10 0x7fe7781f2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe777400640 1 -- 172.21.15.89:0/1384421713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7781f2770 con 0x7fe7780c5fd0 2024-08-31T04:44:00.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe776a00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c003a10 0x7fe7781f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:44:00.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe777400640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7780c5fd0 0x7fe7780c63e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe7780735c0 tx=0x7fe770010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe76f400640 1 -- 172.21.15.89:0/1384421713 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770003980 con 0x7fe7780c5fd0 2024-08-31T04:44:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe76f400640 1 -- 172.21.15.89:0/1384421713 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe770015070 con 0x7fe7780c5fd0 2024-08-31T04:44:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe778159270 con 0x7fe7780c5fd0 2024-08-31T04:44:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe76f400640 1 -- 172.21.15.89:0/1384421713 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770004030 con 0x7fe7780c5fd0 2024-08-31T04:44:00.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.331+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe778154f80 con 0x7fe7780c5fd0 2024-08-31T04:44:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.335+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7781f5140 con 0x7fe7780c5fd0 2024-08-31T04:44:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.335+0000 7fe76f400640 1 -- 172.21.15.89:0/1384421713 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe7700041d0 con 0x7fe7780c5fd0 2024-08-31T04:44:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.335+0000 7fe76f400640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7540720f0 0x7fe754074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.335+0000 7fe76f400640 1 -- 172.21.15.89:0/1384421713 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fe770093960 con 0x7fe7780c5fd0 2024-08-31T04:44:00.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.335+0000 7fe776a00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7540720f0 0x7fe754074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.339+0000 7fe776a00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7540720f0 0x7fe754074600 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7680b0000 tx=0x7fe76801c5d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.339+0000 7fe76f400640 1 -- 172.21.15.89:0/1384421713 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe77005e880 con 0x7fe7780c5fd0 2024-08-31T04:44:00.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.523+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fe7780c7920 con 0x7fe7540720f0 2024-08-31T04:44:00.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe76f400640 1 -- 172.21.15.89:0/1384421713 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe7780c7920 con 0x7fe7540720f0 2024-08-31T04:44:00.528 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 4 to deep-scrub 2024-08-31T04:44:00.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7540720f0 msgr2=0x7fe754074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7540720f0 0x7fe754074600 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7680b0000 tx=0x7fe76801c5d0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7780c5fd0 msgr2=0x7fe7780c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7780c5fd0 0x7fe7780c63e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe7780735c0 tx=0x7fe770010f40 comp rx=0 tx=0).stop 2024-08-31T04:44:00.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 shutdown_connections 2024-08-31T04:44:00.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7540720f0 0x7fe754074600 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7780c5fd0 0x7fe7780c63e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe778155b90 0x7fe7780b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 --2- 172.21.15.89:0/1384421713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c003a10 0x7fe7781f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 >> 172.21.15.89:0/1384421713 conn(0x7fe7780ccf20 msgr2=0x7fe7780b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:00.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 shutdown_connections 2024-08-31T04:44:00.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.527+0000 7fe77dc00640 1 -- 172.21.15.89:0/1384421713 wait complete. 2024-08-31T04:44:00.551 INFO:tasks.ceph:Scrubbing osd.5 2024-08-31T04:44:00.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-31T04:44:00.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.711+0000 7f6ff7c00640 1 -- 172.21.15.89:0/3520738350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8003a40 msgr2=0x7f6fd8003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.711+0000 7f6ff7c00640 1 --2- 172.21.15.89:0/3520738350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8003a40 0x7f6fd8003ed0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400c310 tx=0x7f6fe401cf50 comp rx=0 tx=0).stop 2024-08-31T04:44:00.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.711+0000 7f6ff5c00640 1 -- 172.21.15.89:0/3520738350 reap_dead start 2024-08-31T04:44:00.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.711+0000 7f6ff7c00640 1 -- 172.21.15.89:0/3520738350 shutdown_connections 2024-08-31T04:44:00.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.711+0000 7f6ff7c00640 1 -- 172.21.15.89:0/3520738350 >> 172.21.15.89:0/3520738350 conn(0x7f6ff0073e80 msgr2=0x7f6ff0074290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:00.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.711+0000 7f6ff7c00640 1 -- 172.21.15.89:0/3520738350 shutdown_connections 2024-08-31T04:44:00.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.711+0000 7f6ff7c00640 1 -- 172.21.15.89:0/3520738350 wait complete. 2024-08-31T04:44:00.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.711+0000 7f6ff7c00640 1 Processor -- start 2024-08-31T04:44:00.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff7c00640 1 -- start start 2024-08-31T04:44:00.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff7c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8003a40 0x7f6ff0147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff7c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ff0160fb0 0x7f6ff014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff7c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ff01438f0 0x7f6ff0142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff7c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff0072450 con 0x7f6fd8003a40 2024-08-31T04:44:00.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff7c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff00750b0 con 0x7f6ff01438f0 2024-08-31T04:44:00.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff7c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff0163010 con 0x7f6ff0160fb0 2024-08-31T04:44:00.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8003a40 0x7f6ff0147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8003a40 0x7f6ff0147960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49736/0 (socket says 172.21.15.89:49736) 2024-08-31T04:44:00.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5200640 1 -- 172.21.15.89:0/2157149736 learned_addr learned my addr 172.21.15.89:0/2157149736 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:00.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5c00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ff01438f0 0x7f6ff0142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6fefe00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ff0160fb0 0x7f6ff014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5200640 1 -- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ff0160fb0 msgr2=0x7f6ff014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5200640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ff0160fb0 0x7f6ff014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5200640 1 -- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ff01438f0 msgr2=0x7f6ff0142e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5200640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ff01438f0 0x7f6ff0142e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5200640 1 -- 172.21.15.89:0/2157149736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff0147ea0 con 0x7f6fd8003a40 2024-08-31T04:44:00.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff5200640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8003a40 0x7f6ff0147960 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4007010 tx=0x7f6fe4001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6fecc00640 1 -- 172.21.15.89:0/2157149736 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40014c0 con 0x7f6fd8003a40 2024-08-31T04:44:00.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6fecc00640 1 -- 172.21.15.89:0/2157149736 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fe4001680 con 0x7f6fd8003a40 2024-08-31T04:44:00.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6fecc00640 1 -- 172.21.15.89:0/2157149736 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4006330 con 0x7f6fd8003a40 2024-08-31T04:44:00.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff0162d50 con 0x7f6fd8003a40 2024-08-31T04:44:00.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.715+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff0158170 con 0x7f6fd8003a40 2024-08-31T04:44:00.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.719+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ff0147530 con 0x7f6fd8003a40 2024-08-31T04:44:00.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.719+0000 7f6fecc00640 1 -- 172.21.15.89:0/2157149736 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6fe40a5c60 con 0x7f6fd8003a40 2024-08-31T04:44:00.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.719+0000 7f6fecc00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6fd00720f0 0x7f6fd0074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.719+0000 7f6fecc00640 1 -- 172.21.15.89:0/2157149736 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f6fe412cbf0 con 0x7f6fd8003a40 2024-08-31T04:44:00.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.719+0000 7f6fecc00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f6fd007ba50 0x7f6fd007df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.719+0000 7f6fecc00640 1 -- 172.21.15.89:0/2157149736 --> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fd007e610 con 0x7f6fd007ba50 2024-08-31T04:44:00.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.719+0000 7f6fecc00640 1 -- 172.21.15.89:0/2157149736 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6fe412cfa0 con 0x7f6fd8003a40 2024-08-31T04:44:00.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.719+0000 7f6fefe00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6fd00720f0 0x7f6fd0074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.719+0000 7f6ff5c00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f6fd007ba50 0x7f6fd007df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.723+0000 7f6fefe00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6fd00720f0 0x7f6fd0074600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0162c60 tx=0x7f6fdc0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.723+0000 7f6ff5c00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f6fd007ba50 0x7f6fd007df40 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.723+0000 7f6fecc00640 1 -- 172.21.15.89:0/2157149736 <== osd.5 v2:172.21.15.170:6810/3687562268 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fd007e610 con 0x7f6fd007ba50 2024-08-31T04:44:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 --> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ff0152ac0 con 0x7f6fd007ba50 2024-08-31T04:44:00.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6fecc00640 1 -- 172.21.15.89:0/2157149736 <== osd.5 v2:172.21.15.170:6810/3687562268 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6ff0152ac0 con 0x7f6fd007ba50 2024-08-31T04:44:00.741 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:44:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T04:44:00.741 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:44:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f6fd007ba50 msgr2=0x7f6fd007df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6810/3687562268,v1:172.21.15.170:6811/3687562268] conn(0x7f6fd007ba50 0x7f6fd007df40 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6fd00720f0 msgr2=0x7f6fd0074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6fd00720f0 0x7f6fd0074600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0162c60 tx=0x7f6fdc0091e0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8003a40 msgr2=0x7f6ff0147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 --2- 172.21.15.89:0/2157149736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8003a40 0x7f6ff0147960 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4007010 tx=0x7f6fe4001d20 comp rx=0 tx=0).stop 2024-08-31T04:44:00.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff5c00640 1 -- 172.21.15.89:0/2157149736 reap_dead start 2024-08-31T04:44:00.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 shutdown_connections 2024-08-31T04:44:00.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 >> 172.21.15.89:0/2157149736 conn(0x7f6ff0073e80 msgr2=0x7f6ff0074290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:00.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 shutdown_connections 2024-08-31T04:44:00.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.739+0000 7f6ff7c00640 1 -- 172.21.15.89:0/2157149736 wait complete. 2024-08-31T04:44:00.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-31T04:44:00.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.939+0000 7f94c0800640 1 -- 172.21.15.89:0/3942956860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b80c1f40 msgr2=0x7f94b80c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.939+0000 7f94c0800640 1 --2- 172.21.15.89:0/3942956860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b80c1f40 0x7f94b80c9330 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f94b80c9020 tx=0x7f94a801f010 comp rx=0 tx=0).stop 2024-08-31T04:44:00.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.939+0000 7f94c0800640 1 -- 172.21.15.89:0/3942956860 shutdown_connections 2024-08-31T04:44:00.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.939+0000 7f94c0800640 1 --2- 172.21.15.89:0/3942956860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b80c1f40 0x7f94b80c9330 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.939+0000 7f94c0800640 1 --2- 172.21.15.89:0/3942956860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b815bc70 0x7f94b8152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.939+0000 7f94c0800640 1 -- 172.21.15.89:0/3942956860 >> 172.21.15.89:0/3942956860 conn(0x7f94b80ccf20 msgr2=0x7f94b80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:00.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 -- 172.21.15.89:0/3942956860 shutdown_connections 2024-08-31T04:44:00.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 -- 172.21.15.89:0/3942956860 wait complete. 2024-08-31T04:44:00.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 Processor -- start 2024-08-31T04:44:00.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 -- start start 2024-08-31T04:44:00.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80c1f40 0x7f94b81e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80c7920 0x7f94b80c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b815bc70 0x7f94b81e3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8074fb0 con 0x7f94b815bc70 2024-08-31T04:44:00.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8074e30 con 0x7f94b80c7920 2024-08-31T04:44:00.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.943+0000 7f94c0800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f94b80c7d30 con 0x7f94b80c1f40 2024-08-31T04:44:00.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94be800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b815bc70 0x7f94b81e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94be800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b815bc70 0x7f94b81e3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49752/0 (socket says 172.21.15.89:49752) 2024-08-31T04:44:00.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94be800640 1 -- 172.21.15.89:0/1147084093 learned_addr learned my addr 172.21.15.89:0/1147084093 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:00.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94bde00640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80c1f40 0x7f94b81e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94bd400640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80c7920 0x7f94b80c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94be800640 1 -- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80c1f40 msgr2=0x7f94b81e2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94be800640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80c1f40 0x7f94b81e2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94be800640 1 -- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80c7920 msgr2=0x7f94b80c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:00.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94be800640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80c7920 0x7f94b80c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:00.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94be800640 1 -- 172.21.15.89:0/1147084093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b815abb0 con 0x7f94b815bc70 2024-08-31T04:44:00.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94bd400640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80c7920 0x7f94b80c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:44:00.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94be800640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b815bc70 0x7f94b81e3980 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f94b400cab0 tx=0x7f94b400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94b2000640 1 -- 172.21.15.89:0/1147084093 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4016020 con 0x7f94b815bc70 2024-08-31T04:44:00.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94b2000640 1 -- 172.21.15.89:0/1147084093 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94b400a930 con 0x7f94b815bc70 2024-08-31T04:44:00.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b815ae90 con 0x7f94b815bc70 2024-08-31T04:44:00.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94b2000640 1 -- 172.21.15.89:0/1147084093 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b400ad60 con 0x7f94b815bc70 2024-08-31T04:44:00.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b8150810 con 0x7f94b815bc70 2024-08-31T04:44:00.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b80c9330 con 0x7f94b815bc70 2024-08-31T04:44:00.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.947+0000 7f94b2000640 1 -- 172.21.15.89:0/1147084093 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f94b4019020 con 0x7f94b815bc70 2024-08-31T04:44:00.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.951+0000 7f94b2000640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f949c0720c0 0x7f949c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:00.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.951+0000 7f94b2000640 1 -- 172.21.15.89:0/1147084093 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f94b4093170 con 0x7f94b815bc70 2024-08-31T04:44:00.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.951+0000 7f94bde00640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f949c0720c0 0x7f949c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:00.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.951+0000 7f94bde00640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f949c0720c0 0x7f949c0745d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00ab40 tx=0x7f94ac00a250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:00.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:00.955+0000 7f94b2000640 1 -- 172.21.15.89:0/1147084093 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f94b4020020 con 0x7f94b815bc70 2024-08-31T04:44:01.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.139+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f94b80b3040 con 0x7f949c0720c0 2024-08-31T04:44:01.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.139+0000 7f94b2000640 1 -- 172.21.15.89:0/1147084093 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f94b80b3040 con 0x7f949c0720c0 2024-08-31T04:44:01.142 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 5 to deep-scrub 2024-08-31T04:44:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f949c0720c0 msgr2=0x7f949c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f949c0720c0 0x7f949c0745d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00ab40 tx=0x7f94ac00a250 comp rx=0 tx=0).stop 2024-08-31T04:44:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b815bc70 msgr2=0x7f94b81e3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b815bc70 0x7f94b81e3980 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f94b400cab0 tx=0x7f94b400cba0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 shutdown_connections 2024-08-31T04:44:01.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f949c0720c0 0x7f949c0745d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b815bc70 0x7f94b81e3980 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80c7920 0x7f94b80c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 --2- 172.21.15.89:0/1147084093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80c1f40 0x7f94b81e2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 >> 172.21.15.89:0/1147084093 conn(0x7f94b80ccf20 msgr2=0x7f94b8146890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:01.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 shutdown_connections 2024-08-31T04:44:01.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.143+0000 7f94c0800640 1 -- 172.21.15.89:0/1147084093 wait complete. 2024-08-31T04:44:01.167 INFO:tasks.ceph:Scrubbing osd.6 2024-08-31T04:44:01.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-31T04:44:01.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.323+0000 7f8574400640 1 -- 172.21.15.89:0/3062561764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0c94a0 msgr2=0x7f856c1527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.323+0000 7f8574400640 1 --2- 172.21.15.89:0/3062561764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0c94a0 0x7f856c1527d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8558009840 tx=0x7f855801c820 comp rx=0 tx=0).stop 2024-08-31T04:44:01.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.323+0000 7f8574400640 1 -- 172.21.15.89:0/3062561764 shutdown_connections 2024-08-31T04:44:01.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.323+0000 7f8574400640 1 --2- 172.21.15.89:0/3062561764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0c94a0 0x7f856c1527d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.323+0000 7f8574400640 1 --2- 172.21.15.89:0/3062561764 >> v2:172.21.15.170:3300/0 conn(0x7f856c074fb0 0x7f856c0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.323+0000 7f8574400640 1 -- 172.21.15.89:0/3062561764 >> 172.21.15.89:0/3062561764 conn(0x7f856c0ccf20 msgr2=0x7f856c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:01.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.323+0000 7f8574400640 1 -- 172.21.15.89:0/3062561764 shutdown_connections 2024-08-31T04:44:01.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.323+0000 7f8574400640 1 -- 172.21.15.89:0/3062561764 wait complete. 2024-08-31T04:44:01.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8574400640 1 Processor -- start 2024-08-31T04:44:01.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8574400640 1 -- start start 2024-08-31T04:44:01.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8574400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f856c074fb0 0x7f856c1f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8574400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0c8560 0x7f856c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8574400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f856c0c94a0 0x7f856c1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8574400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f856c0c81b0 con 0x7f856c074fb0 2024-08-31T04:44:01.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8574400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f856c0c8030 con 0x7f856c0c94a0 2024-08-31T04:44:01.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8574400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f856c1657a0 con 0x7f856c0c8560 2024-08-31T04:44:01.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f856c074fb0 0x7f856c1f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f856c074fb0 0x7f856c1f5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49766/0 (socket says 172.21.15.89:49766) 2024-08-31T04:44:01.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571a00640 1 -- 172.21.15.89:0/3047088618 learned_addr learned my addr 172.21.15.89:0/3047088618 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:01.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571000640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0c8560 0x7f856c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8572400640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f856c0c94a0 0x7f856c1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571a00640 1 -- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0c8560 msgr2=0x7f856c153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571a00640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0c8560 0x7f856c153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571a00640 1 -- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f856c0c94a0 msgr2=0x7f856c1488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571a00640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f856c0c94a0 0x7f856c1488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571a00640 1 -- 172.21.15.89:0/3047088618 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c1f5670 con 0x7f856c074fb0 2024-08-31T04:44:01.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.327+0000 7f8571000640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f856c0c8560 0x7f856c153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:44:01.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8571a00640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f856c074fb0 0x7f856c1f5130 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f856000edb0 tx=0x7f856000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:01.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8569600640 1 -- 172.21.15.89:0/3047088618 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856000ce50 con 0x7f856c074fb0 2024-08-31T04:44:01.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8569600640 1 -- 172.21.15.89:0/3047088618 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8560004c40 con 0x7f856c074fb0 2024-08-31T04:44:01.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c157100 con 0x7f856c074fb0 2024-08-31T04:44:01.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8569600640 1 -- 172.21.15.89:0/3047088618 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856000b7d0 con 0x7f856c074fb0 2024-08-31T04:44:01.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c1f5880 con 0x7f856c074fb0 2024-08-31T04:44:01.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f856c156eb0 con 0x7f856c074fb0 2024-08-31T04:44:01.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8569600640 1 -- 172.21.15.89:0/3047088618 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f856000b970 con 0x7f856c074fb0 2024-08-31T04:44:01.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8569600640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f854c072260 0x7f854c074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8569600640 1 -- 172.21.15.89:0/3047088618 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f8560094240 con 0x7f856c074fb0 2024-08-31T04:44:01.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.331+0000 7f8569600640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f854c07bbc0 0x7f854c07e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.335+0000 7f8569600640 1 -- 172.21.15.89:0/3047088618 --> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8560014ec0 con 0x7f854c07bbc0 2024-08-31T04:44:01.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.335+0000 7f8569600640 1 -- 172.21.15.89:0/3047088618 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f85600946d0 con 0x7f856c074fb0 2024-08-31T04:44:01.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.335+0000 7f8571000640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f854c072260 0x7f854c074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.335+0000 7f8572400640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f854c07bbc0 0x7f854c07e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.335+0000 7f8571000640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f854c072260 0x7f854c074770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f85580af000 tx=0x7f855801b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:01.337 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.335+0000 7f8572400640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f854c07bbc0 0x7f854c07e0b0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:01.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.335+0000 7f8569600640 1 -- 172.21.15.89:0/3047088618 <== osd.6 v2:172.21.15.170:6818/4213050289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8560014ec0 con 0x7f854c07bbc0 2024-08-31T04:44:01.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 --> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f856c1f4f40 con 0x7f854c07bbc0 2024-08-31T04:44:01.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8569600640 1 -- 172.21.15.89:0/3047088618 <== osd.6 v2:172.21.15.170:6818/4213050289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f856c1f4f40 con 0x7f854c07bbc0 2024-08-31T04:44:01.353 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:44:01.353 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T04:44:01.353 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:44:01.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f854c07bbc0 msgr2=0x7f854c07e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6818/4213050289,v1:172.21.15.170:6819/4213050289] conn(0x7f854c07bbc0 0x7f854c07e0b0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f854c072260 msgr2=0x7f854c074770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f854c072260 0x7f854c074770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f85580af000 tx=0x7f855801b060 comp rx=0 tx=0).stop 2024-08-31T04:44:01.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f856c074fb0 msgr2=0x7f856c1f5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 --2- 172.21.15.89:0/3047088618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f856c074fb0 0x7f856c1f5130 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f856000edb0 tx=0x7f856000c740 comp rx=0 tx=0).stop 2024-08-31T04:44:01.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8572400640 1 -- 172.21.15.89:0/3047088618 reap_dead start 2024-08-31T04:44:01.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 shutdown_connections 2024-08-31T04:44:01.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 >> 172.21.15.89:0/3047088618 conn(0x7f856c0ccf20 msgr2=0x7f856c14f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:01.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 shutdown_connections 2024-08-31T04:44:01.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.351+0000 7f8574400640 1 -- 172.21.15.89:0/3047088618 wait complete. 2024-08-31T04:44:01.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-31T04:44:01.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.547+0000 7f208b200640 1 -- 172.21.15.89:0/3205191811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2070004d50 msgr2=0x7f2070005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.547+0000 7f208b200640 1 --2- 172.21.15.89:0/3205191811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2070004d50 0x7f2070005160 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f208400c640 tx=0x7f208401faf0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.547+0000 7f208a800640 1 -- 172.21.15.89:0/3205191811 reap_dead start 2024-08-31T04:44:01.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.547+0000 7f208b200640 1 -- 172.21.15.89:0/3205191811 shutdown_connections 2024-08-31T04:44:01.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.547+0000 7f208b200640 1 -- 172.21.15.89:0/3205191811 >> 172.21.15.89:0/3205191811 conn(0x7f208c0cd4a0 msgr2=0x7f208c0cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:01.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.547+0000 7f208b200640 1 -- 172.21.15.89:0/3205191811 shutdown_connections 2024-08-31T04:44:01.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.547+0000 7f208b200640 1 -- 172.21.15.89:0/3205191811 wait complete. 2024-08-31T04:44:01.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f208b200640 1 Processor -- start 2024-08-31T04:44:01.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f208b200640 1 -- start start 2024-08-31T04:44:01.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f208b200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2070004d50 0x7f208c151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f208b200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f208c0c54f0 0x7f208c14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f208b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f208c0c5900 0x7f208c14c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f208b200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f208c153c20 con 0x7f2070004d50 2024-08-31T04:44:01.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f208b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f208c06e1f0 con 0x7f208c0c5900 2024-08-31T04:44:01.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f208b200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f208c153da0 con 0x7f208c0c54f0 2024-08-31T04:44:01.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f2089e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2070004d50 0x7f208c151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f2089e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2070004d50 0x7f208c151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49796/0 (socket says 172.21.15.89:49796) 2024-08-31T04:44:01.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.551+0000 7f2089e00640 1 -- 172.21.15.89:0/5786325 learned_addr learned my addr 172.21.15.89:0/5786325 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:01.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f208a800640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f208c0c5900 0x7f208c14c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2083e00640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f208c0c54f0 0x7f208c14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2089e00640 1 -- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f208c0c54f0 msgr2=0x7f208c14bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2089e00640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f208c0c54f0 0x7f208c14bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2089e00640 1 -- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f208c0c5900 msgr2=0x7f208c14c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2089e00640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f208c0c5900 0x7f208c14c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2089e00640 1 -- 172.21.15.89:0/5786325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c0c4b30 con 0x7f2070004d50 2024-08-31T04:44:01.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2089e00640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2070004d50 0x7f208c151f20 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f207c011a80 tx=0x7f207c011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:01.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2082000640 1 -- 172.21.15.89:0/5786325 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c00fe10 con 0x7f2070004d50 2024-08-31T04:44:01.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2082000640 1 -- 172.21.15.89:0/5786325 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f207c016070 con 0x7f2070004d50 2024-08-31T04:44:01.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208c157590 con 0x7f2070004d50 2024-08-31T04:44:01.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2082000640 1 -- 172.21.15.89:0/5786325 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c012690 con 0x7f2070004d50 2024-08-31T04:44:01.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208c157b50 con 0x7f2070004d50 2024-08-31T04:44:01.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f208c0c7e80 con 0x7f2070004d50 2024-08-31T04:44:01.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2082000640 1 -- 172.21.15.89:0/5786325 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f207c018030 con 0x7f2070004d50 2024-08-31T04:44:01.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.555+0000 7f2082000640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f20680720f0 0x7f2068074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.559+0000 7f2082000640 1 -- 172.21.15.89:0/5786325 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f207c093940 con 0x7f2070004d50 2024-08-31T04:44:01.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.559+0000 7f2083e00640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f20680720f0 0x7f2068074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.559+0000 7f2083e00640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f20680720f0 0x7f2068074600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f208c0ccae0 tx=0x7f20740091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:01.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.563+0000 7f2082000640 1 -- 172.21.15.89:0/5786325 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f207c05ee20 con 0x7f2070004d50 2024-08-31T04:44:01.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.739+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f208c158960 con 0x7f20680720f0 2024-08-31T04:44:01.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.739+0000 7f2082000640 1 -- 172.21.15.89:0/5786325 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f208c158960 con 0x7f20680720f0 2024-08-31T04:44:01.742 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 6 to deep-scrub 2024-08-31T04:44:01.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f20680720f0 msgr2=0x7f2068074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f20680720f0 0x7f2068074600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f208c0ccae0 tx=0x7f20740091e0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2070004d50 msgr2=0x7f208c151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2070004d50 0x7f208c151f20 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f207c011a80 tx=0x7f207c011f40 comp rx=0 tx=0).stop 2024-08-31T04:44:01.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 shutdown_connections 2024-08-31T04:44:01.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f20680720f0 0x7f2068074600 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f208c0c5900 0x7f208c14c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f208c0c54f0 0x7f208c14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 --2- 172.21.15.89:0/5786325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2070004d50 0x7f208c151f20 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 >> 172.21.15.89:0/5786325 conn(0x7f208c0cd4a0 msgr2=0x7f208c152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:01.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 shutdown_connections 2024-08-31T04:44:01.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.743+0000 7f208b200640 1 -- 172.21.15.89:0/5786325 wait complete. 2024-08-31T04:44:01.765 INFO:tasks.ceph:Scrubbing osd.7 2024-08-31T04:44:01.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-31T04:44:01.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 -- 172.21.15.89:0/2979611913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3880159a70 msgr2=0x7f3880159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 --2- 172.21.15.89:0/2979611913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3880159a70 0x7f3880159e80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3878009c80 tx=0x7f387801cda0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 -- 172.21.15.89:0/2979611913 shutdown_connections 2024-08-31T04:44:01.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 --2- 172.21.15.89:0/2979611913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3880159a70 0x7f3880159e80 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 --2- 172.21.15.89:0/2979611913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38800c4760 0x7f38800c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 -- 172.21.15.89:0/2979611913 >> 172.21.15.89:0/2979611913 conn(0x7f38800717b0 msgr2=0x7f3880071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:01.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 -- 172.21.15.89:0/2979611913 shutdown_connections 2024-08-31T04:44:01.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 -- 172.21.15.89:0/2979611913 wait complete. 2024-08-31T04:44:01.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 Processor -- start 2024-08-31T04:44:01.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.951+0000 7f3886c00640 1 -- start start 2024-08-31T04:44:01.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3886c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38800c4760 0x7f388015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3886c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38800ca930 0x7f388014ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3886c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3880159a70 0x7f388013eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3886c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f38800b2c20 con 0x7f38800c4760 2024-08-31T04:44:01.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3886c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f38800b2aa0 con 0x7f3880159a70 2024-08-31T04:44:01.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3886c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3880153d60 con 0x7f38800ca930 2024-08-31T04:44:01.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38800c4760 0x7f388015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387fe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38800c4760 0x7f388015bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35288/0 (socket says 172.21.15.89:35288) 2024-08-31T04:44:01.958 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387fe00640 1 -- 172.21.15.89:0/10506311 learned_addr learned my addr 172.21.15.89:0/10506311 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:01.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387f400640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38800ca930 0x7f388014ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3884c00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3880159a70 0x7f388013eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387fe00640 1 -- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38800ca930 msgr2=0x7f388014ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387fe00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38800ca930 0x7f388014ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387fe00640 1 -- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3880159a70 msgr2=0x7f388013eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387fe00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3880159a70 0x7f388013eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387fe00640 1 -- 172.21.15.89:0/10506311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38800b4790 con 0x7f38800c4760 2024-08-31T04:44:01.959 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387f400640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f38800ca930 0x7f388014ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:44:01.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f387fe00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38800c4760 0x7f388015bad0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f38700058d0 tx=0x7f387000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:01.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3877e00640 1 -- 172.21.15.89:0/10506311 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870017070 con 0x7f38800c4760 2024-08-31T04:44:01.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3877e00640 1 -- 172.21.15.89:0/10506311 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3870009cc0 con 0x7f38800c4760 2024-08-31T04:44:01.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3877e00640 1 -- 172.21.15.89:0/10506311 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38700106c0 con 0x7f38800c4760 2024-08-31T04:44:01.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38801f6d80 con 0x7f38800c4760 2024-08-31T04:44:01.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38801f4e40 con 0x7f38800c4760 2024-08-31T04:44:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.955+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38800cad40 con 0x7f38800c4760 2024-08-31T04:44:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f3877e00640 1 -- 172.21.15.89:0/10506311 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f387001a070 con 0x7f38800c4760 2024-08-31T04:44:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f3877e00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38600720c0 0x7f38600745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f3877e00640 1 -- 172.21.15.89:0/10506311 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f3870093600 con 0x7f38800c4760 2024-08-31T04:44:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f3877e00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f386007ba20 0x7f386007df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f3877e00640 1 -- 172.21.15.89:0/10506311 --> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f386007e5e0 con 0x7f386007ba20 2024-08-31T04:44:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f3877e00640 1 -- 172.21.15.89:0/10506311 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f3870093a60 con 0x7f38800c4760 2024-08-31T04:44:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f387f400640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38600720c0 0x7f38600745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f3884c00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f386007ba20 0x7f386007df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:01.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f387f400640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38600720c0 0x7f38600745d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f38800c54c0 tx=0x7f386c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.959+0000 7f3884c00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f386007ba20 0x7f386007df10 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.963+0000 7f3877e00640 1 -- 172.21.15.89:0/10506311 <== osd.7 v2:172.21.15.170:6802/2770203152 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f386007e5e0 con 0x7f386007ba20 2024-08-31T04:44:01.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.975+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 --> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f38801f50a0 con 0x7f386007ba20 2024-08-31T04:44:01.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.975+0000 7f3877e00640 1 -- 172.21.15.89:0/10506311 <== osd.7 v2:172.21.15.170:6802/2770203152 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f38801f50a0 con 0x7f386007ba20 2024-08-31T04:44:01.978 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-08-31T04:44:01.979 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-31T04:44:01.979 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-08-31T04:44:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.975+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f386007ba20 msgr2=0x7f386007df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.975+0000 7f3886c00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6802/2770203152,v1:172.21.15.170:6803/2770203152] conn(0x7f386007ba20 0x7f386007df10 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.979+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38600720c0 msgr2=0x7f38600745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.979+0000 7f3886c00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f38600720c0 0x7f38600745d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f38800c54c0 tx=0x7f386c009040 comp rx=0 tx=0).stop 2024-08-31T04:44:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.979+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38800c4760 msgr2=0x7f388015bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.979+0000 7f3886c00640 1 --2- 172.21.15.89:0/10506311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38800c4760 0x7f388015bad0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f38700058d0 tx=0x7f387000dde0 comp rx=0 tx=0).stop 2024-08-31T04:44:01.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.979+0000 7f3884c00640 1 -- 172.21.15.89:0/10506311 reap_dead start 2024-08-31T04:44:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.979+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 shutdown_connections 2024-08-31T04:44:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.979+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 >> 172.21.15.89:0/10506311 conn(0x7f38800717b0 msgr2=0x7f3880157490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.979+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 shutdown_connections 2024-08-31T04:44:01.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:01.979+0000 7f3886c00640 1 -- 172.21.15.89:0/10506311 wait complete. 2024-08-31T04:44:01.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-31T04:44:02.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 -- 172.21.15.89:0/2183600359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c9330 msgr2=0x7fe758074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 --2- 172.21.15.89:0/2183600359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c9330 0x7fe758074720 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe758072540 tx=0x7fe75001f370 comp rx=0 tx=0).stop 2024-08-31T04:44:02.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 -- 172.21.15.89:0/2183600359 shutdown_connections 2024-08-31T04:44:02.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 --2- 172.21.15.89:0/2183600359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c9330 0x7fe758074720 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 --2- 172.21.15.89:0/2183600359 >> v2:172.21.15.170:3300/0 conn(0x7fe75815bc70 0x7fe758152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 -- 172.21.15.89:0/2183600359 >> 172.21.15.89:0/2183600359 conn(0x7fe7580ccf20 msgr2=0x7fe7580cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:02.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 -- 172.21.15.89:0/2183600359 shutdown_connections 2024-08-31T04:44:02.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 -- 172.21.15.89:0/2183600359 wait complete. 2024-08-31T04:44:02.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 Processor -- start 2024-08-31T04:44:02.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.171+0000 7fe75cc00640 1 -- start start 2024-08-31T04:44:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe75cc00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c1f40 0x7fe7581583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe75cc00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7580c9330 0x7fe7581f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe75cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75815bc70 0x7fe758154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe75cc00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe7580c8030 con 0x7fe7580c1f40 2024-08-31T04:44:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe75cc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7580c3150 con 0x7fe75815bc70 2024-08-31T04:44:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe75cc00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe758074c60 con 0x7fe7580c9330 2024-08-31T04:44:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c1f40 0x7fe7581583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c1f40 0x7fe7581583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35316/0 (socket says 172.21.15.89:35316) 2024-08-31T04:44:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755e00640 1 -- 172.21.15.89:0/1160863652 learned_addr learned my addr 172.21.15.89:0/1160863652 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755400640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7580c9330 0x7fe7581f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe756800640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75815bc70 0x7fe758154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755e00640 1 -- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7580c9330 msgr2=0x7fe7581f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755e00640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7580c9330 0x7fe7581f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755e00640 1 -- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75815bc70 msgr2=0x7fe758154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755e00640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75815bc70 0x7fe758154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755e00640 1 -- 172.21.15.89:0/1160863652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7581f2a10 con 0x7fe7580c1f40 2024-08-31T04:44:02.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe755e00640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c1f40 0x7fe7581583e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe74800d750 tx=0x7fe74800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:02.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe74e000640 1 -- 172.21.15.89:0/1160863652 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748017070 con 0x7fe7580c1f40 2024-08-31T04:44:02.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe74e000640 1 -- 172.21.15.89:0/1160863652 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe748004310 con 0x7fe7580c1f40 2024-08-31T04:44:02.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe758155880 con 0x7fe7580c1f40 2024-08-31T04:44:02.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe74e000640 1 -- 172.21.15.89:0/1160863652 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74800de60 con 0x7fe7580c1f40 2024-08-31T04:44:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7581f1fb0 con 0x7fe7580c1f40 2024-08-31T04:44:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe758074720 con 0x7fe7580c1f40 2024-08-31T04:44:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.175+0000 7fe74e000640 1 -- 172.21.15.89:0/1160863652 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fe748009c30 con 0x7fe7580c1f40 2024-08-31T04:44:02.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.179+0000 7fe74e000640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7380720f0 0x7fe738074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:02.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.179+0000 7fe74e000640 1 -- 172.21.15.89:0/1160863652 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fe7480934d0 con 0x7fe7580c1f40 2024-08-31T04:44:02.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.179+0000 7fe755400640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7380720f0 0x7fe738074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:02.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.179+0000 7fe755400640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7380720f0 0x7fe738074600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe75814fd10 tx=0x7fe744009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:02.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.183+0000 7fe74e000640 1 -- 172.21.15.89:0/1160863652 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe748020020 con 0x7fe7580c1f40 2024-08-31T04:44:02.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.347+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fe7581560a0 con 0x7fe7380720f0 2024-08-31T04:44:02.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.347+0000 7fe74e000640 1 -- 172.21.15.89:0/1160863652 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe7581560a0 con 0x7fe7380720f0 2024-08-31T04:44:02.354 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 7 to deep-scrub 2024-08-31T04:44:02.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7380720f0 msgr2=0x7fe738074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7380720f0 0x7fe738074600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe75814fd10 tx=0x7fe744009040 comp rx=0 tx=0).stop 2024-08-31T04:44:02.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c1f40 msgr2=0x7fe7581583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c1f40 0x7fe7581583e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe74800d750 tx=0x7fe74800dc10 comp rx=0 tx=0).stop 2024-08-31T04:44:02.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 shutdown_connections 2024-08-31T04:44:02.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fe7380720f0 0x7fe738074600 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75815bc70 0x7fe758154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7580c9330 0x7fe7581f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 --2- 172.21.15.89:0/1160863652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7580c1f40 0x7fe7581583e0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 >> 172.21.15.89:0/1160863652 conn(0x7fe7580ccf20 msgr2=0x7fe758151d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:02.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 shutdown_connections 2024-08-31T04:44:02.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.351+0000 7fe75cc00640 1 -- 172.21.15.89:0/1160863652 wait complete. 2024-08-31T04:44:02.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:44:02.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 -- 172.21.15.89:0/670710101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c1537e0 msgr2=0x7f451c0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 --2- 172.21.15.89:0/670710101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c1537e0 0x7f451c0ca210 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4514009c80 tx=0x7f451401cda0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 -- 172.21.15.89:0/670710101 shutdown_connections 2024-08-31T04:44:02.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 --2- 172.21.15.89:0/670710101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c1537e0 0x7f451c0ca210 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 --2- 172.21.15.89:0/670710101 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f451c0c59e0 0x7f451c0cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 -- 172.21.15.89:0/670710101 >> 172.21.15.89:0/670710101 conn(0x7f451c073380 msgr2=0x7f451c073790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:02.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 -- 172.21.15.89:0/670710101 shutdown_connections 2024-08-31T04:44:02.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 -- 172.21.15.89:0/670710101 wait complete. 2024-08-31T04:44:02.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 Processor -- start 2024-08-31T04:44:02.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.547+0000 7f4521c00640 1 -- start start 2024-08-31T04:44:02.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f451c0c59e0 0x7f451c1f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:02.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521c00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f451c1533d0 0x7f451c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:02.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521c00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c153e30 0x7f451c1eb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:02.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521c00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f451c15a3d0 con 0x7f451c153e30 2024-08-31T04:44:02.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0cb4c0 con 0x7f451c0c59e0 2024-08-31T04:44:02.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521c00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f451c1f8ce0 con 0x7f451c1533d0 2024-08-31T04:44:02.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c153e30 0x7f451c1eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:02.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c153e30 0x7f451c1eb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35340/0 (socket says 172.21.15.89:35340) 2024-08-31T04:44:02.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521200640 1 -- 172.21.15.89:0/1356111115 learned_addr learned my addr 172.21.15.89:0/1356111115 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:02.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f451be00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f451c0c59e0 0x7f451c1f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:02.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f451b400640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f451c1533d0 0x7f451c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:02.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521200640 1 -- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f451c1533d0 msgr2=0x7f451c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521200640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f451c1533d0 0x7f451c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521200640 1 -- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f451c0c59e0 msgr2=0x7f451c1f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521200640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f451c0c59e0 0x7f451c1f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521200640 1 -- 172.21.15.89:0/1356111115 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c1f4b30 con 0x7f451c153e30 2024-08-31T04:44:02.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f451b400640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f451c1533d0 0x7f451c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:44:02.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521200640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c153e30 0x7f451c1eb510 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4514009bd0 tx=0x7f4514009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:02.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4513e00640 1 -- 172.21.15.89:0/1356111115 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45140bb070 con 0x7f451c153e30 2024-08-31T04:44:02.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4513e00640 1 -- 172.21.15.89:0/1356111115 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4514004c50 con 0x7f451c153e30 2024-08-31T04:44:02.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4513e00640 1 -- 172.21.15.89:0/1356111115 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45140b2040 con 0x7f451c153e30 2024-08-31T04:44:02.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451c0ccc10 con 0x7f451c153e30 2024-08-31T04:44:02.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451c0cd230 con 0x7f451c153e30 2024-08-31T04:44:02.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f451c1537e0 con 0x7f451c153e30 2024-08-31T04:44:02.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.551+0000 7f4513e00640 1 -- 172.21.15.89:0/1356111115 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f45140be070 con 0x7f451c153e30 2024-08-31T04:44:02.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.555+0000 7f4513e00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f44fc0720c0 0x7f44fc0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:02.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.555+0000 7f4513e00640 1 -- 172.21.15.89:0/1356111115 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f451412cc10 con 0x7f451c153e30 2024-08-31T04:44:02.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.555+0000 7f451be00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f44fc0720c0 0x7f44fc0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:02.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.555+0000 7f451be00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f44fc0720c0 0x7f44fc0745d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f450c0058d0 tx=0x7f450c005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:02.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.559+0000 7f4513e00640 1 -- 172.21.15.89:0/1356111115 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4514016990 con 0x7f451c153e30 2024-08-31T04:44:02.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.727+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f451c0c5760 con 0x7f44fc0720c0 2024-08-31T04:44:02.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.735+0000 7f4513e00640 1 -- 172.21.15.89:0/1356111115 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+337977 (secure 0 0 0) 0x7f451c0c5760 con 0x7f44fc0720c0 2024-08-31T04:44:02.739 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:44:02.741 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:44:02.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f44fc0720c0 msgr2=0x7f44fc0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f44fc0720c0 0x7f44fc0745d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f450c0058d0 tx=0x7f450c005860 comp rx=0 tx=0).stop 2024-08-31T04:44:02.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c153e30 msgr2=0x7f451c1eb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:02.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c153e30 0x7f451c1eb510 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4514009bd0 tx=0x7f4514009350 comp rx=0 tx=0).stop 2024-08-31T04:44:02.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 shutdown_connections 2024-08-31T04:44:02.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f44fc0720c0 0x7f44fc0745d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451c153e30 0x7f451c1eb510 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f451c1533d0 0x7f451c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 --2- 172.21.15.89:0/1356111115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f451c0c59e0 0x7f451c1f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 >> 172.21.15.89:0/1356111115 conn(0x7f451c073380 msgr2=0x7f451c163630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 shutdown_connections 2024-08-31T04:44:02.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:02.739+0000 7f4521c00640 1 -- 172.21.15.89:0/1356111115 wait complete. 2024-08-31T04:44:02.762 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1248,"stamp":"2024-08-31T04:44:01.294525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2002433759,"num_objects":43771,"num_object_clones":18986,"num_object_copies":166070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43771,"num_whiteouts":18810,"num_read":8428,"num_read_kb":6783984,"num_write":113777,"num_write_kb":3919729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3384141,"num_omap_keys":5737,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164022,"ondisk_log_size":164022,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6326080,"kb_used_data":4116800,"kb_used_omap":12,"kb_used_meta":2209139,"kb_avail":748648640,"statfs":{"total":773094113280,"available":766616207360,"internally_reserved":0,"allocated":4215603200,"data_stored":4214765690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":2262158896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6287,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":44840,"num_write":7,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3384141,"num_omap_keys":5737,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005434"},"pg_stats":[{"pgid":"2.1f","version":"48'792","reported_seq":878,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.201731+0000","last_change":"2024-08-31T04:03:59.847786+0000","last_active":"2024-08-31T04:43:54.201731+0000","last_peered":"2024-08-31T04:43:54.201731+0000","last_clean":"2024-08-31T04:43:54.201731+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:43:54.201731+0000","last_undegraded":"2024-08-31T04:43:54.201731+0000","last_fullsized":"2024-08-31T04:43:54.201731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:38:05.052685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37419797,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":826,"num_write_kb":58141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"48'592","reported_seq":2696,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.303935+0000","last_change":"2024-08-31T04:10:27.645410+0000","last_active":"2024-08-31T04:43:54.303935+0000","last_peered":"2024-08-31T04:43:54.303935+0000","last_clean":"2024-08-31T04:43:54.303935+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:43:54.303935+0000","last_undegraded":"2024-08-31T04:43:54.303935+0000","last_fullsized":"2024-08-31T04:43:54.303935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:46.278499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012836803000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"48'2838","reported_seq":4603,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.098808+0000","last_change":"2024-08-31T04:10:27.668465+0000","last_active":"2024-08-31T04:43:51.098808+0000","last_peered":"2024-08-31T04:43:51.098808+0000","last_clean":"2024-08-31T04:43:51.098808+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:43:51.098808+0000","last_undegraded":"2024-08-31T04:43:51.098808+0000","last_fullsized":"2024-08-31T04:43:51.098808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2838,"log_dups_size":0,"ondisk_log_size":2838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:56:27.977319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058952350000000004,"stat_sum":{"num_bytes":50597461,"num_objects":1198,"num_object_clones":550,"num_object_copies":4792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1198,"num_whiteouts":550,"num_read":212,"num_read_kb":376919,"num_write":2332,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"48'672","reported_seq":758,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.189267+0000","last_change":"2024-08-31T04:03:59.871810+0000","last_active":"2024-08-31T04:41:10.189267+0000","last_peered":"2024-08-31T04:41:10.189267+0000","last_clean":"2024-08-31T04:41:10.189267+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:41:10.189267+0000","last_undegraded":"2024-08-31T04:41:10.189267+0000","last_fullsized":"2024-08-31T04:41:10.189267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:25.099927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":697,"num_write_kb":66604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"48'579","reported_seq":2684,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315803+0000","last_change":"2024-08-31T04:10:27.645689+0000","last_active":"2024-08-31T04:43:54.315803+0000","last_peered":"2024-08-31T04:43:54.315803+0000","last_clean":"2024-08-31T04:43:54.315803+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:43:54.315803+0000","last_undegraded":"2024-08-31T04:43:54.315803+0000","last_fullsized":"2024-08-31T04:43:54.315803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:34:21.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012881510000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"48'3007","reported_seq":4771,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.047084+0000","last_change":"2024-08-31T04:10:27.629997+0000","last_active":"2024-08-31T04:43:51.047084+0000","last_peered":"2024-08-31T04:43:51.047084+0000","last_clean":"2024-08-31T04:43:51.047084+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:43:51.047084+0000","last_undegraded":"2024-08-31T04:43:51.047084+0000","last_fullsized":"2024-08-31T04:43:51.047084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:34:13.962324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059980260000000001,"stat_sum":{"num_bytes":71770879,"num_objects":1258,"num_object_clones":586,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":586,"num_read":247,"num_read_kb":407586,"num_write":2470,"num_write_kb":85232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"48'1251","reported_seq":1334,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954189+0000","last_change":"2024-08-31T04:03:59.848105+0000","last_active":"2024-08-31T04:41:30.954189+0000","last_peered":"2024-08-31T04:41:30.954189+0000","last_clean":"2024-08-31T04:41:30.954189+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:41:30.954189+0000","last_undegraded":"2024-08-31T04:41:30.954189+0000","last_fullsized":"2024-08-31T04:41:30.954189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1251,"log_dups_size":0,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1281,"num_write_kb":120075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"48'625","reported_seq":2725,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.280380+0000","last_change":"2024-08-31T04:10:27.626701+0000","last_active":"2024-08-31T04:43:54.280380+0000","last_peered":"2024-08-31T04:43:54.280380+0000","last_clean":"2024-08-31T04:43:54.280380+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:43:54.280380+0000","last_undegraded":"2024-08-31T04:43:54.280380+0000","last_fullsized":"2024-08-31T04:43:54.280380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032840360000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"48'3005","reported_seq":4696,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.085356+0000","last_change":"2024-08-31T04:10:27.632736+0000","last_active":"2024-08-31T04:43:51.085356+0000","last_peered":"2024-08-31T04:43:51.085356+0000","last_clean":"2024-08-31T04:43:51.085356+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:43:51.085356+0000","last_undegraded":"2024-08-31T04:43:51.085356+0000","last_fullsized":"2024-08-31T04:43:51.085356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:27.569361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058445240000000002,"stat_sum":{"num_bytes":38693415,"num_objects":1292,"num_object_clones":602,"num_object_copies":5168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":602,"num_read":191,"num_read_kb":293900,"num_write":2458,"num_write_kb":41612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"48'455","reported_seq":548,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.842853+0000","last_change":"2024-08-31T04:44:00.842796+0000","last_active":"2024-08-31T04:44:00.842853+0000","last_peered":"2024-08-31T04:44:00.842853+0000","last_clean":"2024-08-31T04:44:00.842853+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:44:00.842853+0000","last_undegraded":"2024-08-31T04:44:00.842853+0000","last_fullsized":"2024-08-31T04:44:00.842853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'455","last_scrub_stamp":"2024-08-31T04:44:00.842723+0000","last_deep_scrub":"48'455","last_deep_scrub_stamp":"2024-08-31T04:44:00.842723+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.842723+0000","objects_scrubbed":55,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:37.463986+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":451,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684010,"num_omap_keys":1149,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"48'600","reported_seq":2703,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.280795+0000","last_change":"2024-08-31T04:10:27.683387+0000","last_active":"2024-08-31T04:43:54.280795+0000","last_peered":"2024-08-31T04:43:54.280795+0000","last_clean":"2024-08-31T04:43:54.280795+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:43:54.280795+0000","last_undegraded":"2024-08-31T04:43:54.280795+0000","last_fullsized":"2024-08-31T04:43:54.280795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070378919999999996,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"48'2845","reported_seq":4611,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:50.990146+0000","last_change":"2024-08-31T04:10:27.629946+0000","last_active":"2024-08-31T04:43:50.990146+0000","last_peered":"2024-08-31T04:43:50.990146+0000","last_clean":"2024-08-31T04:43:50.990146+0000","last_became_active":"2024-08-31T04:04:41.418200+0000","last_became_peered":"2024-08-31T04:04:41.418200+0000","last_unstale":"2024-08-31T04:43:50.990146+0000","last_undegraded":"2024-08-31T04:43:50.990146+0000","last_fullsized":"2024-08-31T04:43:50.990146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:27.685667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059467970000000002,"stat_sum":{"num_bytes":46428419,"num_objects":1209,"num_object_clones":554,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":554,"num_read":210,"num_read_kb":267629,"num_write":2344,"num_write_kb":53603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"48'616","reported_seq":2716,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.274881+0000","last_change":"2024-08-31T04:10:27.682710+0000","last_active":"2024-08-31T04:43:54.274881+0000","last_peered":"2024-08-31T04:43:54.274881+0000","last_clean":"2024-08-31T04:43:54.274881+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:43:54.274881+0000","last_undegraded":"2024-08-31T04:43:54.274881+0000","last_fullsized":"2024-08-31T04:43:54.274881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.550862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068528089999999996,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"48'1182","reported_seq":1266,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.979593+0000","last_change":"2024-08-31T04:03:59.838003+0000","last_active":"2024-08-31T04:41:10.979593+0000","last_peered":"2024-08-31T04:41:10.979593+0000","last_clean":"2024-08-31T04:41:10.979593+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:41:10.979593+0000","last_undegraded":"2024-08-31T04:41:10.979593+0000","last_fullsized":"2024-08-31T04:41:10.979593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:03:02.928575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1278,"num_write_kb":83819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"48'2943","reported_seq":4741,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.026204+0000","last_change":"2024-08-31T04:10:27.682154+0000","last_active":"2024-08-31T04:43:51.026204+0000","last_peered":"2024-08-31T04:43:51.026204+0000","last_clean":"2024-08-31T04:43:51.026204+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:43:51.026204+0000","last_undegraded":"2024-08-31T04:43:51.026204+0000","last_fullsized":"2024-08-31T04:43:51.026204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:43.247408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066428290000000003,"stat_sum":{"num_bytes":56765051,"num_objects":1275,"num_object_clones":585,"num_object_copies":5100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1275,"num_whiteouts":585,"num_read":279,"num_read_kb":424140,"num_write":2416,"num_write_kb":67833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"48'628","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.287054+0000","last_change":"2024-08-31T04:10:27.670686+0000","last_active":"2024-08-31T04:43:54.287054+0000","last_peered":"2024-08-31T04:43:54.287054+0000","last_clean":"2024-08-31T04:43:54.287054+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:43:54.287054+0000","last_undegraded":"2024-08-31T04:43:54.287054+0000","last_fullsized":"2024-08-31T04:43:54.287054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:35.821184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066355329999999999,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"48'686","reported_seq":771,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.978927+0000","last_change":"2024-08-31T04:03:59.849687+0000","last_active":"2024-08-31T04:41:10.978927+0000","last_peered":"2024-08-31T04:41:10.978927+0000","last_clean":"2024-08-31T04:41:10.978927+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:41:10.978927+0000","last_undegraded":"2024-08-31T04:41:10.978927+0000","last_fullsized":"2024-08-31T04:41:10.978927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:34:23.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":738,"num_write_kb":87340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"48'2909","reported_seq":4542,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.089592+0000","last_change":"2024-08-31T04:10:27.799102+0000","last_active":"2024-08-31T04:43:51.089592+0000","last_peered":"2024-08-31T04:43:51.089592+0000","last_clean":"2024-08-31T04:43:51.089592+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:43:51.089592+0000","last_undegraded":"2024-08-31T04:43:51.089592+0000","last_fullsized":"2024-08-31T04:43:51.089592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2909,"log_dups_size":0,"ondisk_log_size":2909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:44:32.822098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043859299999999997,"stat_sum":{"num_bytes":16936662,"num_objects":1190,"num_object_clones":558,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":558,"num_read":87,"num_read_kb":9431,"num_write":2392,"num_write_kb":37720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"48'659","reported_seq":2756,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.293563+0000","last_change":"2024-08-31T04:10:27.821258+0000","last_active":"2024-08-31T04:43:54.293563+0000","last_peered":"2024-08-31T04:43:54.293563+0000","last_clean":"2024-08-31T04:43:54.293563+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:43:54.293563+0000","last_undegraded":"2024-08-31T04:43:54.293563+0000","last_fullsized":"2024-08-31T04:43:54.293563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:06.689884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018377836000000002,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":14,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"48'562","reported_seq":647,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.856125+0000","last_change":"2024-08-31T04:03:59.850433+0000","last_active":"2024-08-31T04:40:56.856125+0000","last_peered":"2024-08-31T04:40:56.856125+0000","last_clean":"2024-08-31T04:40:56.856125+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:40:56.856125+0000","last_undegraded":"2024-08-31T04:40:56.856125+0000","last_fullsized":"2024-08-31T04:40:56.856125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":615,"num_write_kb":58408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"48'2896","reported_seq":4576,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.040546+0000","last_change":"2024-08-31T04:10:27.671256+0000","last_active":"2024-08-31T04:43:51.040546+0000","last_peered":"2024-08-31T04:43:51.040546+0000","last_clean":"2024-08-31T04:43:51.040546+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:43:51.040546+0000","last_undegraded":"2024-08-31T04:43:51.040546+0000","last_fullsized":"2024-08-31T04:43:51.040546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2896,"log_dups_size":0,"ondisk_log_size":2896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:44.158201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070696559999999997,"stat_sum":{"num_bytes":20275415,"num_objects":1227,"num_object_clones":567,"num_object_copies":4908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1227,"num_whiteouts":567,"num_read":143,"num_read_kb":118630,"num_write":2381,"num_write_kb":31494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'629","reported_seq":2730,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.278748+0000","last_change":"2024-08-31T04:10:27.681396+0000","last_active":"2024-08-31T04:43:54.278748+0000","last_peered":"2024-08-31T04:43:54.278748+0000","last_clean":"2024-08-31T04:43:54.278748+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:43:54.278748+0000","last_undegraded":"2024-08-31T04:43:54.278748+0000","last_fullsized":"2024-08-31T04:43:54.278748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:59:06.965998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060537480000000003,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"48'371","reported_seq":456,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.972445+0000","last_change":"2024-08-31T04:03:59.840305+0000","last_active":"2024-08-31T04:41:01.972445+0000","last_peered":"2024-08-31T04:41:01.972445+0000","last_clean":"2024-08-31T04:41:01.972445+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:41:01.972445+0000","last_undegraded":"2024-08-31T04:41:01.972445+0000","last_fullsized":"2024-08-31T04:41:01.972445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:54.895355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":417,"num_write_kb":42100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"48'2828","reported_seq":4502,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.856913+0000","last_change":"2024-08-31T04:10:27.634238+0000","last_active":"2024-08-31T04:43:41.856913+0000","last_peered":"2024-08-31T04:43:41.856913+0000","last_clean":"2024-08-31T04:43:41.856913+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:43:41.856913+0000","last_undegraded":"2024-08-31T04:43:41.856913+0000","last_fullsized":"2024-08-31T04:43:41.856913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2828,"log_dups_size":0,"ondisk_log_size":2828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:01:42.230553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062106380000000001,"stat_sum":{"num_bytes":38082532,"num_objects":1243,"num_object_clones":581,"num_object_copies":4972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1243,"num_whiteouts":581,"num_read":151,"num_read_kb":116541,"num_write":2283,"num_write_kb":45420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"48'608","reported_seq":2708,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.289046+0000","last_change":"2024-08-31T04:10:27.824154+0000","last_active":"2024-08-31T04:43:54.289046+0000","last_peered":"2024-08-31T04:43:54.289046+0000","last_clean":"2024-08-31T04:43:54.289046+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:43:54.289046+0000","last_undegraded":"2024-08-31T04:43:54.289046+0000","last_fullsized":"2024-08-31T04:43:54.289046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:58.773731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018455160000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"48'542","reported_seq":627,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.979531+0000","last_change":"2024-08-31T04:03:59.845657+0000","last_active":"2024-08-31T04:41:10.979531+0000","last_peered":"2024-08-31T04:41:10.979531+0000","last_clean":"2024-08-31T04:41:10.979531+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:41:10.979531+0000","last_undegraded":"2024-08-31T04:41:10.979531+0000","last_fullsized":"2024-08-31T04:41:10.979531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:05:05.561665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":604,"num_write_kb":70753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"48'2858","reported_seq":4622,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.154025+0000","last_change":"2024-08-31T04:10:27.632339+0000","last_active":"2024-08-31T04:43:51.154025+0000","last_peered":"2024-08-31T04:43:51.154025+0000","last_clean":"2024-08-31T04:43:51.154025+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:43:51.154025+0000","last_undegraded":"2024-08-31T04:43:51.154025+0000","last_fullsized":"2024-08-31T04:43:51.154025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:11:58.968159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076718680000000001,"stat_sum":{"num_bytes":46058979,"num_objects":1175,"num_object_clones":539,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":539,"num_read":197,"num_read_kb":336982,"num_write":2367,"num_write_kb":53816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"48'576","reported_seq":2674,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.273728+0000","last_change":"2024-08-31T04:10:27.825042+0000","last_active":"2024-08-31T04:43:54.273728+0000","last_peered":"2024-08-31T04:43:54.273728+0000","last_clean":"2024-08-31T04:43:54.273728+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:43:54.273728+0000","last_undegraded":"2024-08-31T04:43:54.273728+0000","last_fullsized":"2024-08-31T04:43:54.273728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:27.395562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019117552999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":13,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"48'1960","reported_seq":2045,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:25.076116+0000","last_change":"2024-08-31T04:03:59.852142+0000","last_active":"2024-08-31T04:43:25.076116+0000","last_peered":"2024-08-31T04:43:25.076116+0000","last_clean":"2024-08-31T04:43:25.076116+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:43:25.076116+0000","last_undegraded":"2024-08-31T04:43:25.076116+0000","last_fullsized":"2024-08-31T04:43:25.076116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1960,"log_dups_size":0,"ondisk_log_size":1960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:35:08.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":4155,"num_write_kb":64616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"48'2942","reported_seq":4707,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.792478+0000","last_change":"2024-08-31T04:10:27.820585+0000","last_active":"2024-08-31T04:43:41.792478+0000","last_peered":"2024-08-31T04:43:41.792478+0000","last_clean":"2024-08-31T04:43:41.792478+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:43:41.792478+0000","last_undegraded":"2024-08-31T04:43:41.792478+0000","last_fullsized":"2024-08-31T04:43:41.792478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2942,"log_dups_size":0,"ondisk_log_size":2942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:41:28.078827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018717636999999999,"stat_sum":{"num_bytes":43745379,"num_objects":1223,"num_object_clones":566,"num_object_copies":4892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1223,"num_whiteouts":566,"num_read":225,"num_read_kb":330819,"num_write":2430,"num_write_kb":52706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"48'636","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.295540+0000","last_change":"2024-08-31T04:10:27.827955+0000","last_active":"2024-08-31T04:43:54.295540+0000","last_peered":"2024-08-31T04:43:54.295540+0000","last_clean":"2024-08-31T04:43:54.295540+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:43:54.295540+0000","last_undegraded":"2024-08-31T04:43:54.295540+0000","last_fullsized":"2024-08-31T04:43:54.295540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:14:49.670904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024325223999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":20,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"48'1150","reported_seq":1236,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:35.955058+0000","last_change":"2024-08-31T04:03:59.850166+0000","last_active":"2024-08-31T04:41:35.955058+0000","last_peered":"2024-08-31T04:41:35.955058+0000","last_clean":"2024-08-31T04:41:35.955058+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:41:35.955058+0000","last_undegraded":"2024-08-31T04:41:35.955058+0000","last_fullsized":"2024-08-31T04:41:35.955058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:10.611479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":1214,"num_write_kb":79665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"48'3005","reported_seq":4719,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.066272+0000","last_change":"2024-08-31T04:10:27.828574+0000","last_active":"2024-08-31T04:43:51.066272+0000","last_peered":"2024-08-31T04:43:51.066272+0000","last_clean":"2024-08-31T04:43:51.066272+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:43:51.066272+0000","last_undegraded":"2024-08-31T04:43:51.066272+0000","last_fullsized":"2024-08-31T04:43:51.066272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:42:38.219220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025625698999999998,"stat_sum":{"num_bytes":43095232,"num_objects":1282,"num_object_clones":604,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":604,"num_read":212,"num_read_kb":287774,"num_write":2444,"num_write_kb":46619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"48'678","reported_seq":2787,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:59.708191+0000","last_change":"2024-08-31T04:43:59.708191+0000","last_active":"2024-08-31T04:43:59.708191+0000","last_peered":"2024-08-31T04:43:59.708191+0000","last_clean":"2024-08-31T04:43:59.708191+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:43:59.708191+0000","last_undegraded":"2024-08-31T04:43:59.708191+0000","last_fullsized":"2024-08-31T04:43:59.708191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'678","last_scrub_stamp":"2024-08-31T04:43:59.708058+0000","last_deep_scrub":"48'678","last_deep_scrub_stamp":"2024-08-31T04:43:59.708058+0000","last_clean_scrub_stamp":"2024-08-31T04:43:59.708058+0000","objects_scrubbed":45,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:25.302149+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0058084670000000003,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"48'804","reported_seq":890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.152652+0000","last_change":"2024-08-31T04:03:59.863781+0000","last_active":"2024-08-31T04:41:30.152652+0000","last_peered":"2024-08-31T04:41:30.152652+0000","last_clean":"2024-08-31T04:41:30.152652+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:41:30.152652+0000","last_undegraded":"2024-08-31T04:41:30.152652+0000","last_fullsized":"2024-08-31T04:41:30.152652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:51:52.751433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":843,"num_write_kb":95373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"48'2913","reported_seq":4551,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.071323+0000","last_change":"2024-08-31T04:10:27.828980+0000","last_active":"2024-08-31T04:43:51.071323+0000","last_peered":"2024-08-31T04:43:51.071323+0000","last_clean":"2024-08-31T04:43:51.071323+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:43:51.071323+0000","last_undegraded":"2024-08-31T04:43:51.071323+0000","last_fullsized":"2024-08-31T04:43:51.071323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:55.109838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024539147000000001,"stat_sum":{"num_bytes":16912754,"num_objects":1252,"num_object_clones":571,"num_object_copies":5008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1252,"num_whiteouts":571,"num_read":103,"num_read_kb":5348,"num_write":2409,"num_write_kb":25816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"48'619","reported_seq":2725,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.269353+0000","last_change":"2024-08-31T04:10:27.797983+0000","last_active":"2024-08-31T04:43:54.269353+0000","last_peered":"2024-08-31T04:43:54.269353+0000","last_clean":"2024-08-31T04:43:54.269353+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:43:54.269353+0000","last_undegraded":"2024-08-31T04:43:54.269353+0000","last_fullsized":"2024-08-31T04:43:54.269353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:34.286214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00335798,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"48'348","reported_seq":434,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954530+0000","last_change":"2024-08-31T04:03:59.847974+0000","last_active":"2024-08-31T04:41:30.954530+0000","last_peered":"2024-08-31T04:41:30.954530+0000","last_clean":"2024-08-31T04:41:30.954530+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:41:30.954530+0000","last_undegraded":"2024-08-31T04:41:30.954530+0000","last_fullsized":"2024-08-31T04:41:30.954530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:40.777688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":379,"num_write_kb":74722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"48'2860","reported_seq":4522,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.779031+0000","last_change":"2024-08-31T04:10:27.826301+0000","last_active":"2024-08-31T04:43:41.779031+0000","last_peered":"2024-08-31T04:43:41.779031+0000","last_clean":"2024-08-31T04:43:41.779031+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:43:41.779031+0000","last_undegraded":"2024-08-31T04:43:41.779031+0000","last_fullsized":"2024-08-31T04:43:41.779031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:16:10.628373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024774918,"stat_sum":{"num_bytes":28766340,"num_objects":1202,"num_object_clones":562,"num_object_copies":4808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":562,"num_read":118,"num_read_kb":82244,"num_write":2340,"num_write_kb":38944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"48'646","reported_seq":2744,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315747+0000","last_change":"2024-08-31T04:10:27.638464+0000","last_active":"2024-08-31T04:43:54.315747+0000","last_peered":"2024-08-31T04:43:54.315747+0000","last_clean":"2024-08-31T04:43:54.315747+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:43:54.315747+0000","last_undegraded":"2024-08-31T04:43:54.315747+0000","last_fullsized":"2024-08-31T04:43:54.315747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:56:21.122785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011184838000000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"48'1718","reported_seq":2844,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:32.140583+0000","last_change":"2024-08-31T04:03:59.875233+0000","last_active":"2024-08-31T04:41:32.140583+0000","last_peered":"2024-08-31T04:41:32.140583+0000","last_clean":"2024-08-31T04:41:32.140583+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:41:32.140583+0000","last_undegraded":"2024-08-31T04:41:32.140583+0000","last_fullsized":"2024-08-31T04:41:32.140583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1718,"log_dups_size":0,"ondisk_log_size":1718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:38:25.441250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1088,"num_read_kb":4789,"num_write":1771,"num_write_kb":92200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"48'2769","reported_seq":4518,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.169748+0000","last_change":"2024-08-31T04:10:27.824008+0000","last_active":"2024-08-31T04:43:51.169748+0000","last_peered":"2024-08-31T04:43:51.169748+0000","last_clean":"2024-08-31T04:43:51.169748+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:43:51.169748+0000","last_undegraded":"2024-08-31T04:43:51.169748+0000","last_fullsized":"2024-08-31T04:43:51.169748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2769,"log_dups_size":0,"ondisk_log_size":2769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:58:59.789550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024776765999999999,"stat_sum":{"num_bytes":32718964,"num_objects":1190,"num_object_clones":545,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":545,"num_read":189,"num_read_kb":237912,"num_write":2280,"num_write_kb":50056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"48'588","reported_seq":2690,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.291011+0000","last_change":"2024-08-31T04:10:27.830527+0000","last_active":"2024-08-31T04:43:54.291011+0000","last_peered":"2024-08-31T04:43:54.291011+0000","last_clean":"2024-08-31T04:43:54.291011+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:43:54.291011+0000","last_undegraded":"2024-08-31T04:43:54.291011+0000","last_fullsized":"2024-08-31T04:43:54.291011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:25:35.143895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023142859000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"48'790","reported_seq":886,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.511159+0000","last_change":"2024-08-31T04:44:00.511159+0000","last_active":"2024-08-31T04:44:00.511159+0000","last_peered":"2024-08-31T04:44:00.511159+0000","last_clean":"2024-08-31T04:44:00.511159+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:44:00.511159+0000","last_undegraded":"2024-08-31T04:44:00.511159+0000","last_fullsized":"2024-08-31T04:44:00.511159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'790","last_scrub_stamp":"2024-08-31T04:44:00.511065+0000","last_deep_scrub":"48'790","last_deep_scrub_stamp":"2024-08-31T04:44:00.511065+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.511065+0000","objects_scrubbed":55,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:06.757563+0000","scrub_duration":135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":805,"num_write_kb":79377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":727793,"num_omap_keys":1211,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"48'2886","reported_seq":4556,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.755282+0000","last_change":"2024-08-31T04:10:27.643289+0000","last_active":"2024-08-31T04:43:41.755282+0000","last_peered":"2024-08-31T04:43:41.755282+0000","last_clean":"2024-08-31T04:43:41.755282+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:43:41.755282+0000","last_undegraded":"2024-08-31T04:43:41.755282+0000","last_fullsized":"2024-08-31T04:43:41.755282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:02.372383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014346418999999999,"stat_sum":{"num_bytes":16814987,"num_objects":1183,"num_object_clones":546,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":546,"num_read":112,"num_read_kb":15010,"num_write":2390,"num_write_kb":22596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'626","reported_seq":2721,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.273380+0000","last_change":"2024-08-31T04:10:27.815323+0000","last_active":"2024-08-31T04:43:54.273380+0000","last_peered":"2024-08-31T04:43:54.273380+0000","last_clean":"2024-08-31T04:43:54.273380+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:43:54.273380+0000","last_undegraded":"2024-08-31T04:43:54.273380+0000","last_fullsized":"2024-08-31T04:43:54.273380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:27:36.200935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013467437000000001,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"48'775","reported_seq":861,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954543+0000","last_change":"2024-08-31T04:03:59.835465+0000","last_active":"2024-08-31T04:41:30.954543+0000","last_peered":"2024-08-31T04:41:30.954543+0000","last_clean":"2024-08-31T04:41:30.954543+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:41:30.954543+0000","last_undegraded":"2024-08-31T04:41:30.954543+0000","last_fullsized":"2024-08-31T04:41:30.954543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:42:59.587124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":842,"num_write_kb":66986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"48'74","reported_seq":193,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.004740+0000","last_change":"2024-08-31T04:44:00.004619+0000","last_active":"2024-08-31T04:44:00.004740+0000","last_peered":"2024-08-31T04:44:00.004740+0000","last_clean":"2024-08-31T04:44:00.004740+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:44:00.004740+0000","last_undegraded":"2024-08-31T04:44:00.004740+0000","last_fullsized":"2024-08-31T04:44:00.004740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'74","last_scrub_stamp":"2024-08-31T04:44:00.004510+0000","last_deep_scrub":"48'74","last_deep_scrub_stamp":"2024-08-31T04:44:00.004510+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.004510+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:48.929118+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"48'2855","reported_seq":4683,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.038418+0000","last_change":"2024-08-31T04:10:27.683701+0000","last_active":"2024-08-31T04:43:51.038418+0000","last_peered":"2024-08-31T04:43:51.038418+0000","last_clean":"2024-08-31T04:43:51.038418+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:43:51.038418+0000","last_undegraded":"2024-08-31T04:43:51.038418+0000","last_fullsized":"2024-08-31T04:43:51.038418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:57.102473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069147610000000002,"stat_sum":{"num_bytes":57940200,"num_objects":1195,"num_object_clones":554,"num_object_copies":4780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":554,"num_read":276,"num_read_kb":364684,"num_write":2343,"num_write_kb":69963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"48'620","reported_seq":2716,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.266552+0000","last_change":"2024-08-31T04:10:27.683489+0000","last_active":"2024-08-31T04:43:54.266552+0000","last_peered":"2024-08-31T04:43:54.266552+0000","last_clean":"2024-08-31T04:43:54.266552+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:43:54.266552+0000","last_undegraded":"2024-08-31T04:43:54.266552+0000","last_fullsized":"2024-08-31T04:43:54.266552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:13.850189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067171050000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"48'1620","reported_seq":1704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:56.978440+0000","last_change":"2024-08-31T04:03:59.847988+0000","last_active":"2024-08-31T04:40:56.978440+0000","last_peered":"2024-08-31T04:40:56.978440+0000","last_clean":"2024-08-31T04:40:56.978440+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:40:56.978440+0000","last_undegraded":"2024-08-31T04:40:56.978440+0000","last_fullsized":"2024-08-31T04:40:56.978440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:23.368509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":1668,"num_write_kb":75070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"48'2903","reported_seq":4558,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.810585+0000","last_change":"2024-08-31T04:10:27.630304+0000","last_active":"2024-08-31T04:43:41.810585+0000","last_peered":"2024-08-31T04:43:41.810585+0000","last_clean":"2024-08-31T04:43:41.810585+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:43:41.810585+0000","last_undegraded":"2024-08-31T04:43:41.810585+0000","last_fullsized":"2024-08-31T04:43:41.810585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:17:39.898341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059273310000000001,"stat_sum":{"num_bytes":26554957,"num_objects":1237,"num_object_clones":582,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":582,"num_read":132,"num_read_kb":127199,"num_write":2367,"num_write_kb":33368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"48'637","reported_seq":2735,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.275319+0000","last_change":"2024-08-31T04:10:27.801079+0000","last_active":"2024-08-31T04:43:54.275319+0000","last_peered":"2024-08-31T04:43:54.275319+0000","last_clean":"2024-08-31T04:43:54.275319+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:43:54.275319+0000","last_undegraded":"2024-08-31T04:43:54.275319+0000","last_fullsized":"2024-08-31T04:43:54.275319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:04:07.707273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055968709999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"48'1164","reported_seq":1248,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.931281+0000","last_change":"2024-08-31T04:03:59.845732+0000","last_active":"2024-08-31T04:41:10.931281+0000","last_peered":"2024-08-31T04:41:10.931281+0000","last_clean":"2024-08-31T04:41:10.931281+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:41:10.931281+0000","last_undegraded":"2024-08-31T04:41:10.931281+0000","last_fullsized":"2024-08-31T04:41:10.931281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:53.584714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37753176,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":1208,"num_write_kb":91501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"48'2868","reported_seq":4560,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.821138+0000","last_change":"2024-08-31T04:10:27.642551+0000","last_active":"2024-08-31T04:43:41.821138+0000","last_peered":"2024-08-31T04:43:41.821138+0000","last_clean":"2024-08-31T04:43:41.821138+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:43:41.821138+0000","last_undegraded":"2024-08-31T04:43:41.821138+0000","last_fullsized":"2024-08-31T04:43:41.821138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:40.314782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013964779,"stat_sum":{"num_bytes":24232544,"num_objects":1215,"num_object_clones":563,"num_object_copies":4860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":563,"num_read":151,"num_read_kb":172254,"num_write":2354,"num_write_kb":29314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"48'609","reported_seq":2711,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.272819+0000","last_change":"2024-08-31T04:10:27.800767+0000","last_active":"2024-08-31T04:43:54.272819+0000","last_peered":"2024-08-31T04:43:54.272819+0000","last_clean":"2024-08-31T04:43:54.272819+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:43:54.272819+0000","last_undegraded":"2024-08-31T04:43:54.272819+0000","last_fullsized":"2024-08-31T04:43:54.272819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:19.279530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052273500000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"48'547","reported_seq":631,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.928718+0000","last_change":"2024-08-31T04:03:59.854084+0000","last_active":"2024-08-31T04:41:01.928718+0000","last_peered":"2024-08-31T04:41:01.928718+0000","last_clean":"2024-08-31T04:41:01.928718+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:41:01.928718+0000","last_undegraded":"2024-08-31T04:41:01.928718+0000","last_fullsized":"2024-08-31T04:41:01.928718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":607,"num_write_kb":87317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"48'2923","reported_seq":4625,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.021190+0000","last_change":"2024-08-31T04:10:27.681554+0000","last_active":"2024-08-31T04:43:51.021190+0000","last_peered":"2024-08-31T04:43:51.021190+0000","last_clean":"2024-08-31T04:43:51.021190+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:43:51.021190+0000","last_undegraded":"2024-08-31T04:43:51.021190+0000","last_fullsized":"2024-08-31T04:43:51.021190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2923,"log_dups_size":0,"ondisk_log_size":2923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:39:43.060510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065855360000000003,"stat_sum":{"num_bytes":30081699,"num_objects":1235,"num_object_clones":576,"num_object_copies":4940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1235,"num_whiteouts":576,"num_read":173,"num_read_kb":193208,"num_write":2389,"num_write_kb":43568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"48'617","reported_seq":2717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.271814+0000","last_change":"2024-08-31T04:10:27.634646+0000","last_active":"2024-08-31T04:43:54.271814+0000","last_peered":"2024-08-31T04:43:54.271814+0000","last_clean":"2024-08-31T04:43:54.271814+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:43:54.271814+0000","last_undegraded":"2024-08-31T04:43:54.271814+0000","last_fullsized":"2024-08-31T04:43:54.271814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:43.424732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057184189999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"48'587","reported_seq":681,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:59.813232+0000","last_change":"2024-08-31T04:43:59.813232+0000","last_active":"2024-08-31T04:43:59.813232+0000","last_peered":"2024-08-31T04:43:59.813232+0000","last_clean":"2024-08-31T04:43:59.813232+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:43:59.813232+0000","last_undegraded":"2024-08-31T04:43:59.813232+0000","last_fullsized":"2024-08-31T04:43:59.813232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'587","last_scrub_stamp":"2024-08-31T04:43:59.813158+0000","last_deep_scrub":"48'587","last_deep_scrub_stamp":"2024-08-31T04:43:59.813158+0000","last_clean_scrub_stamp":"2024-08-31T04:43:59.813158+0000","objects_scrubbed":52,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:17.188105+0000","scrub_duration":119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971542,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":585,"num_write_kb":62565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":413993,"num_omap_keys":698,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"48'2832","reported_seq":4602,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:31.910403+0000","last_change":"2024-08-31T04:10:27.624180+0000","last_active":"2024-08-31T04:43:31.910403+0000","last_peered":"2024-08-31T04:43:31.910403+0000","last_clean":"2024-08-31T04:43:31.910403+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:43:31.910403+0000","last_undegraded":"2024-08-31T04:43:31.910403+0000","last_fullsized":"2024-08-31T04:43:31.910403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:14:38.588901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001644726,"stat_sum":{"num_bytes":45550886,"num_objects":1209,"num_object_clones":562,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":562,"num_read":227,"num_read_kb":373101,"num_write":2312,"num_write_kb":56902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"48'630","reported_seq":2733,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.264962+0000","last_change":"2024-08-31T04:10:27.680074+0000","last_active":"2024-08-31T04:43:54.264962+0000","last_peered":"2024-08-31T04:43:54.264962+0000","last_clean":"2024-08-31T04:43:54.264962+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:43:54.264962+0000","last_undegraded":"2024-08-31T04:43:54.264962+0000","last_fullsized":"2024-08-31T04:43:54.264962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:52:30.799187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051653649999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":7,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"48'681","reported_seq":765,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.449539+0000","last_change":"2024-08-31T04:03:59.855943+0000","last_active":"2024-08-31T04:41:20.449539+0000","last_peered":"2024-08-31T04:41:20.449539+0000","last_clean":"2024-08-31T04:41:20.449539+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:41:20.449539+0000","last_undegraded":"2024-08-31T04:41:20.449539+0000","last_fullsized":"2024-08-31T04:41:20.449539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:41.915700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":760,"num_write_kb":71301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"48'2735","reported_seq":4393,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.739755+0000","last_change":"2024-08-31T04:10:27.644231+0000","last_active":"2024-08-31T04:43:41.739755+0000","last_peered":"2024-08-31T04:43:41.739755+0000","last_clean":"2024-08-31T04:43:41.739755+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:43:41.739755+0000","last_undegraded":"2024-08-31T04:43:41.739755+0000","last_fullsized":"2024-08-31T04:43:41.739755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:17.265946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012604237000000001,"stat_sum":{"num_bytes":16809799,"num_objects":1152,"num_object_clones":538,"num_object_copies":4608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":538,"num_read":93,"num_read_kb":855,"num_write":2242,"num_write_kb":21215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"48'612","reported_seq":2710,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.254624+0000","last_change":"2024-08-31T04:10:27.626377+0000","last_active":"2024-08-31T04:43:54.254624+0000","last_peered":"2024-08-31T04:43:54.254624+0000","last_clean":"2024-08-31T04:43:54.254624+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:43:54.254624+0000","last_undegraded":"2024-08-31T04:43:54.254624+0000","last_fullsized":"2024-08-31T04:43:54.254624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:54:33.315553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036328670000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":12,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"48'397","reported_seq":490,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:58.788531+0000","last_change":"2024-08-31T04:43:58.788531+0000","last_active":"2024-08-31T04:43:58.788531+0000","last_peered":"2024-08-31T04:43:58.788531+0000","last_clean":"2024-08-31T04:43:58.788531+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:43:58.788531+0000","last_undegraded":"2024-08-31T04:43:58.788531+0000","last_fullsized":"2024-08-31T04:43:58.788531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'397","last_scrub_stamp":"2024-08-31T04:43:58.788449+0000","last_deep_scrub":"48'397","last_deep_scrub_stamp":"2024-08-31T04:43:58.788449+0000","last_clean_scrub_stamp":"2024-08-31T04:43:58.788449+0000","objects_scrubbed":39,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:15.834647+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":374,"num_write_kb":62134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":425438,"num_omap_keys":783,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"48'3078","reported_seq":4700,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.753103+0000","last_change":"2024-08-31T04:10:27.644984+0000","last_active":"2024-08-31T04:43:41.753103+0000","last_peered":"2024-08-31T04:43:41.753103+0000","last_clean":"2024-08-31T04:43:41.753103+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:43:41.753103+0000","last_undegraded":"2024-08-31T04:43:41.753103+0000","last_fullsized":"2024-08-31T04:43:41.753103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":3078,"log_dups_size":0,"ondisk_log_size":3078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:43:59.996448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012777844,"stat_sum":{"num_bytes":35172120,"num_objects":1354,"num_object_clones":682,"num_object_copies":5416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1354,"num_whiteouts":594,"num_read":201,"num_read_kb":245482,"num_write":2432,"num_write_kb":44882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'620","reported_seq":2724,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.275697+0000","last_change":"2024-08-31T04:10:27.682802+0000","last_active":"2024-08-31T04:43:54.275697+0000","last_peered":"2024-08-31T04:43:54.275697+0000","last_clean":"2024-08-31T04:43:54.275697+0000","last_became_active":"2024-08-31T04:04:41.425024+0000","last_became_peered":"2024-08-31T04:04:41.425024+0000","last_unstale":"2024-08-31T04:43:54.275697+0000","last_undegraded":"2024-08-31T04:43:54.275697+0000","last_fullsized":"2024-08-31T04:43:54.275697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:04:00.707504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006804175,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"48'514","reported_seq":598,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:20.953275+0000","last_change":"2024-08-31T04:03:59.855080+0000","last_active":"2024-08-31T04:41:20.953275+0000","last_peered":"2024-08-31T04:41:20.953275+0000","last_clean":"2024-08-31T04:41:20.953275+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:41:20.953275+0000","last_undegraded":"2024-08-31T04:41:20.953275+0000","last_fullsized":"2024-08-31T04:41:20.953275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:41:34.087687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":556,"num_write_kb":54279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"48'2880","reported_seq":4600,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.215076+0000","last_change":"2024-08-31T04:10:27.825912+0000","last_active":"2024-08-31T04:43:51.215076+0000","last_peered":"2024-08-31T04:43:51.215076+0000","last_clean":"2024-08-31T04:43:51.215076+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:43:51.215076+0000","last_undegraded":"2024-08-31T04:43:51.215076+0000","last_fullsized":"2024-08-31T04:43:51.215076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2880,"log_dups_size":0,"ondisk_log_size":2880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:02.879075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025415436,"stat_sum":{"num_bytes":43622224,"num_objects":1251,"num_object_clones":583,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1251,"num_whiteouts":583,"num_read":199,"num_read_kb":207126,"num_write":2328,"num_write_kb":56286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"48'585","reported_seq":2686,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.279324+0000","last_change":"2024-08-31T04:10:27.830297+0000","last_active":"2024-08-31T04:43:54.279324+0000","last_peered":"2024-08-31T04:43:54.279324+0000","last_clean":"2024-08-31T04:43:54.279324+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:43:54.279324+0000","last_undegraded":"2024-08-31T04:43:54.279324+0000","last_fullsized":"2024-08-31T04:43:54.279324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:00:11.469305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023919682000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"48'1257","reported_seq":1341,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:22.138550+0000","last_change":"2024-08-31T04:03:59.870357+0000","last_active":"2024-08-31T04:41:22.138550+0000","last_peered":"2024-08-31T04:41:22.138550+0000","last_clean":"2024-08-31T04:41:22.138550+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:41:22.138550+0000","last_undegraded":"2024-08-31T04:41:22.138550+0000","last_fullsized":"2024-08-31T04:41:22.138550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:36:34.406502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1306,"num_write_kb":67222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"48'2891","reported_seq":4583,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.059570+0000","last_change":"2024-08-31T04:10:27.683052+0000","last_active":"2024-08-31T04:43:51.059570+0000","last_peered":"2024-08-31T04:43:51.059570+0000","last_clean":"2024-08-31T04:43:51.059570+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:43:51.059570+0000","last_undegraded":"2024-08-31T04:43:51.059570+0000","last_fullsized":"2024-08-31T04:43:51.059570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.116451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069575569999999996,"stat_sum":{"num_bytes":34789039,"num_objects":1260,"num_object_clones":583,"num_object_copies":5040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1260,"num_whiteouts":583,"num_read":172,"num_read_kb":170440,"num_write":2360,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"48'609","reported_seq":2708,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.273178+0000","last_change":"2024-08-31T04:10:27.799884+0000","last_active":"2024-08-31T04:43:54.273178+0000","last_peered":"2024-08-31T04:43:54.273178+0000","last_clean":"2024-08-31T04:43:54.273178+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:43:54.273178+0000","last_undegraded":"2024-08-31T04:43:54.273178+0000","last_fullsized":"2024-08-31T04:43:54.273178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:43.034574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047916210000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"48'1203","reported_seq":1296,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.839328+0000","last_change":"2024-08-31T04:44:00.839328+0000","last_active":"2024-08-31T04:44:00.839328+0000","last_peered":"2024-08-31T04:44:00.839328+0000","last_clean":"2024-08-31T04:44:00.839328+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:44:00.839328+0000","last_undegraded":"2024-08-31T04:44:00.839328+0000","last_fullsized":"2024-08-31T04:44:00.839328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1203","last_scrub_stamp":"2024-08-31T04:44:00.839183+0000","last_deep_scrub":"48'1203","last_deep_scrub_stamp":"2024-08-31T04:44:00.839183+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.839183+0000","objects_scrubbed":48,"log_size":1203,"log_dups_size":0,"ondisk_log_size":1203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:05:01.631410+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555104,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1203,"num_write_kb":103869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":503248,"num_omap_keys":844,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"48'2948","reported_seq":4616,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.101050+0000","last_change":"2024-08-31T04:10:27.802246+0000","last_active":"2024-08-31T04:43:51.101050+0000","last_peered":"2024-08-31T04:43:51.101050+0000","last_clean":"2024-08-31T04:43:51.101050+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:43:51.101050+0000","last_undegraded":"2024-08-31T04:43:51.101050+0000","last_fullsized":"2024-08-31T04:43:51.101050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2948,"log_dups_size":0,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:12:15.664092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046964119999999996,"stat_sum":{"num_bytes":37035283,"num_objects":1250,"num_object_clones":626,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":538,"num_read":190,"num_read_kb":163631,"num_write":2363,"num_write_kb":48541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"48'628","reported_seq":2728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.277659+0000","last_change":"2024-08-31T04:10:27.682269+0000","last_active":"2024-08-31T04:43:54.277659+0000","last_peered":"2024-08-31T04:43:54.277659+0000","last_clean":"2024-08-31T04:43:54.277659+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:43:54.277659+0000","last_undegraded":"2024-08-31T04:43:54.277659+0000","last_fullsized":"2024-08-31T04:43:54.277659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:25.121383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006690306,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"48'1380","reported_seq":1463,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:57.021975+0000","last_change":"2024-08-31T04:03:59.869242+0000","last_active":"2024-08-31T04:40:57.021975+0000","last_peered":"2024-08-31T04:40:57.021975+0000","last_clean":"2024-08-31T04:40:57.021975+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:40:57.021975+0000","last_undegraded":"2024-08-31T04:40:57.021975+0000","last_fullsized":"2024-08-31T04:40:57.021975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1380,"log_dups_size":0,"ondisk_log_size":1380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:47.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554522,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1433,"num_write_kb":71604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"48'2822","reported_seq":4503,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:45.972914+0000","last_change":"2024-08-31T04:10:27.633146+0000","last_active":"2024-08-31T04:43:45.972914+0000","last_peered":"2024-08-31T04:43:45.972914+0000","last_clean":"2024-08-31T04:43:45.972914+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:43:45.972914+0000","last_undegraded":"2024-08-31T04:43:45.972914+0000","last_fullsized":"2024-08-31T04:43:45.972914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2822,"log_dups_size":0,"ondisk_log_size":2822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:44.513348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060660929999999998,"stat_sum":{"num_bytes":30139631,"num_objects":1254,"num_object_clones":586,"num_object_copies":5016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1254,"num_whiteouts":586,"num_read":163,"num_read_kb":134524,"num_write":2263,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"48'602","reported_seq":2702,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.315538+0000","last_change":"2024-08-31T04:10:27.646230+0000","last_active":"2024-08-31T04:43:54.315538+0000","last_peered":"2024-08-31T04:43:54.315538+0000","last_clean":"2024-08-31T04:43:54.315538+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:43:54.315538+0000","last_undegraded":"2024-08-31T04:43:54.315538+0000","last_fullsized":"2024-08-31T04:43:54.315538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:50.268225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012319801999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"48'1612","reported_seq":1695,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:40:51.961246+0000","last_change":"2024-08-31T04:03:59.853018+0000","last_active":"2024-08-31T04:40:51.961246+0000","last_peered":"2024-08-31T04:40:51.961246+0000","last_clean":"2024-08-31T04:40:51.961246+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:40:51.961246+0000","last_undegraded":"2024-08-31T04:40:51.961246+0000","last_fullsized":"2024-08-31T04:40:51.961246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1612,"log_dups_size":0,"ondisk_log_size":1612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:35:38.291781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1665,"num_write_kb":95716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"48'2860","reported_seq":4648,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:47.167374+0000","last_change":"2024-08-31T04:10:27.670280+0000","last_active":"2024-08-31T04:43:47.167374+0000","last_peered":"2024-08-31T04:43:47.167374+0000","last_clean":"2024-08-31T04:43:47.167374+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:43:47.167374+0000","last_undegraded":"2024-08-31T04:43:47.167374+0000","last_fullsized":"2024-08-31T04:43:47.167374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:45.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006760248,"stat_sum":{"num_bytes":54090295,"num_objects":1208,"num_object_clones":563,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":563,"num_read":248,"num_read_kb":382949,"num_write":2323,"num_write_kb":60670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"48'616","reported_seq":2715,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.271586+0000","last_change":"2024-08-31T04:10:27.634493+0000","last_active":"2024-08-31T04:43:54.271586+0000","last_peered":"2024-08-31T04:43:54.271586+0000","last_clean":"2024-08-31T04:43:54.271586+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:43:54.271586+0000","last_undegraded":"2024-08-31T04:43:54.271586+0000","last_fullsized":"2024-08-31T04:43:54.271586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:55:26.933384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058567369999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":10,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"48'1010","reported_seq":1274,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:59.126332+0000","last_change":"2024-08-31T04:43:59.126332+0000","last_active":"2024-08-31T04:43:59.126332+0000","last_peered":"2024-08-31T04:43:59.126332+0000","last_clean":"2024-08-31T04:43:59.126332+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:43:59.126332+0000","last_undegraded":"2024-08-31T04:43:59.126332+0000","last_fullsized":"2024-08-31T04:43:59.126332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1010","last_scrub_stamp":"2024-08-31T04:43:59.126230+0000","last_deep_scrub":"48'1010","last_deep_scrub_stamp":"2024-08-31T04:43:59.126230+0000","last_clean_scrub_stamp":"2024-08-31T04:43:59.126230+0000","objects_scrubbed":56,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:24:05.247379+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21620066,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":215,"num_read_kb":746,"num_write":1006,"num_write_kb":67606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":629659,"num_omap_keys":1052,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"48'2946","reported_seq":4667,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.074988+0000","last_change":"2024-08-31T04:10:27.822236+0000","last_active":"2024-08-31T04:43:51.074988+0000","last_peered":"2024-08-31T04:43:51.074988+0000","last_clean":"2024-08-31T04:43:51.074988+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:43:51.074988+0000","last_undegraded":"2024-08-31T04:43:51.074988+0000","last_fullsized":"2024-08-31T04:43:51.074988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:28:33.068422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017565338,"stat_sum":{"num_bytes":42002217,"num_objects":1219,"num_object_clones":563,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1219,"num_whiteouts":563,"num_read":180,"num_read_kb":308227,"num_write":2428,"num_write_kb":54614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"48'2738","reported_seq":4474,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.192921+0000","last_change":"2024-08-31T04:10:27.822515+0000","last_active":"2024-08-31T04:43:51.192921+0000","last_peered":"2024-08-31T04:43:51.192921+0000","last_clean":"2024-08-31T04:43:51.192921+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:43:51.192921+0000","last_undegraded":"2024-08-31T04:43:51.192921+0000","last_fullsized":"2024-08-31T04:43:51.192921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2738,"log_dups_size":0,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:20.225606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017721323000000001,"stat_sum":{"num_bytes":29550305,"num_objects":1162,"num_object_clones":544,"num_object_copies":4648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":544,"num_read":174,"num_read_kb":171691,"num_write":2228,"num_write_kb":37428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"48'601","reported_seq":2704,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.287747+0000","last_change":"2024-08-31T04:10:27.823888+0000","last_active":"2024-08-31T04:43:54.287747+0000","last_peered":"2024-08-31T04:43:54.287747+0000","last_clean":"2024-08-31T04:43:54.287747+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:43:54.287747+0000","last_undegraded":"2024-08-31T04:43:54.287747+0000","last_fullsized":"2024-08-31T04:43:54.287747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:08:01.933323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018675580000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"48'1868","reported_seq":1951,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:10.980531+0000","last_change":"2024-08-31T04:03:59.833513+0000","last_active":"2024-08-31T04:41:10.980531+0000","last_peered":"2024-08-31T04:41:10.980531+0000","last_clean":"2024-08-31T04:41:10.980531+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:41:10.980531+0000","last_undegraded":"2024-08-31T04:41:10.980531+0000","last_fullsized":"2024-08-31T04:41:10.980531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1868,"log_dups_size":0,"ondisk_log_size":1868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:15.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1929,"num_write_kb":92217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"48'2766","reported_seq":4482,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:37.305371+0000","last_change":"2024-08-31T04:10:27.800227+0000","last_active":"2024-08-31T04:43:37.305371+0000","last_peered":"2024-08-31T04:43:37.305371+0000","last_clean":"2024-08-31T04:43:37.305371+0000","last_became_active":"2024-08-31T04:04:41.417946+0000","last_became_peered":"2024-08-31T04:04:41.417946+0000","last_unstale":"2024-08-31T04:43:37.305371+0000","last_undegraded":"2024-08-31T04:43:37.305371+0000","last_fullsized":"2024-08-31T04:43:37.305371+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:41:51.661343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00503113,"stat_sum":{"num_bytes":35643591,"num_objects":1177,"num_object_clones":542,"num_object_copies":4708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1177,"num_whiteouts":542,"num_read":159,"num_read_kb":132474,"num_write":2281,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'704","reported_seq":2801,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.317201+0000","last_change":"2024-08-31T04:10:27.641968+0000","last_active":"2024-08-31T04:43:54.317201+0000","last_peered":"2024-08-31T04:43:54.317201+0000","last_clean":"2024-08-31T04:43:54.317201+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:43:54.317201+0000","last_undegraded":"2024-08-31T04:43:54.317201+0000","last_fullsized":"2024-08-31T04:43:54.317201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:11:11.260535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014046813,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"48'645","reported_seq":728,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:01.924988+0000","last_change":"2024-08-31T04:03:59.852690+0000","last_active":"2024-08-31T04:41:01.924988+0000","last_peered":"2024-08-31T04:41:01.924988+0000","last_clean":"2024-08-31T04:41:01.924988+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:41:01.924988+0000","last_undegraded":"2024-08-31T04:41:01.924988+0000","last_fullsized":"2024-08-31T04:41:01.924988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:13.605997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":715,"num_write_kb":62992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"48'2252","reported_seq":2335,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.954513+0000","last_change":"2024-08-31T04:03:59.839995+0000","last_active":"2024-08-31T04:41:30.954513+0000","last_peered":"2024-08-31T04:41:30.954513+0000","last_clean":"2024-08-31T04:41:30.954513+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:41:30.954513+0000","last_undegraded":"2024-08-31T04:41:30.954513+0000","last_fullsized":"2024-08-31T04:41:30.954513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2298,"num_write_kb":79805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'612","reported_seq":2710,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.284818+0000","last_change":"2024-08-31T04:10:27.814455+0000","last_active":"2024-08-31T04:43:54.284818+0000","last_peered":"2024-08-31T04:43:54.284818+0000","last_clean":"2024-08-31T04:43:54.284818+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:43:54.284818+0000","last_undegraded":"2024-08-31T04:43:54.284818+0000","last_fullsized":"2024-08-31T04:43:54.284818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:14.250771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013275207000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":11,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"48'2940","reported_seq":4627,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.069321+0000","last_change":"2024-08-31T04:10:27.821490+0000","last_active":"2024-08-31T04:43:51.069321+0000","last_peered":"2024-08-31T04:43:51.069321+0000","last_clean":"2024-08-31T04:43:51.069321+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:43:51.069321+0000","last_undegraded":"2024-08-31T04:43:51.069321+0000","last_fullsized":"2024-08-31T04:43:51.069321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2940,"log_dups_size":0,"ondisk_log_size":2940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:50.331472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016882483,"stat_sum":{"num_bytes":22283462,"num_objects":1259,"num_object_clones":585,"num_object_copies":5036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1259,"num_whiteouts":585,"num_read":170,"num_read_kb":61710,"num_write":2408,"num_write_kb":31485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"48'1130","reported_seq":1213,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:41:30.152624+0000","last_change":"2024-08-31T04:03:59.862069+0000","last_active":"2024-08-31T04:41:30.152624+0000","last_peered":"2024-08-31T04:41:30.152624+0000","last_clean":"2024-08-31T04:41:30.152624+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:41:30.152624+0000","last_undegraded":"2024-08-31T04:41:30.152624+0000","last_fullsized":"2024-08-31T04:41:30.152624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:58.799790+0000","last_clean_scrub_stamp":"2024-08-31T04:03:58.799790+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:59:42.462779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1166,"num_write_kb":91251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"48'634","reported_seq":2732,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.267726+0000","last_change":"2024-08-31T04:10:27.627749+0000","last_active":"2024-08-31T04:43:54.267726+0000","last_peered":"2024-08-31T04:43:54.267726+0000","last_clean":"2024-08-31T04:43:54.267726+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:43:54.267726+0000","last_undegraded":"2024-08-31T04:43:54.267726+0000","last_fullsized":"2024-08-31T04:43:54.267726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038995560000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"48'2848","reported_seq":4571,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.786083+0000","last_change":"2024-08-31T04:10:27.669930+0000","last_active":"2024-08-31T04:43:41.786083+0000","last_peered":"2024-08-31T04:43:41.786083+0000","last_clean":"2024-08-31T04:43:41.786083+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:43:41.786083+0000","last_undegraded":"2024-08-31T04:43:41.786083+0000","last_fullsized":"2024-08-31T04:43:41.786083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:44.356566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065935439999999998,"stat_sum":{"num_bytes":37885613,"num_objects":1228,"num_object_clones":569,"num_object_copies":4912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1228,"num_whiteouts":569,"num_read":190,"num_read_kb":257974,"num_write":2324,"num_write_kb":54067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"48'637","reported_seq":2734,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.292182+0000","last_change":"2024-08-31T04:10:27.632258+0000","last_active":"2024-08-31T04:43:54.292182+0000","last_peered":"2024-08-31T04:43:54.292182+0000","last_clean":"2024-08-31T04:43:54.292182+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:43:54.292182+0000","last_undegraded":"2024-08-31T04:43:54.292182+0000","last_fullsized":"2024-08-31T04:43:54.292182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:17:04.382806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078040410000000003,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":15,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"48'658","reported_seq":2761,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.261528+0000","last_change":"2024-08-31T04:10:27.668912+0000","last_active":"2024-08-31T04:43:54.261528+0000","last_peered":"2024-08-31T04:43:54.261528+0000","last_clean":"2024-08-31T04:43:54.261528+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:43:54.261528+0000","last_undegraded":"2024-08-31T04:43:54.261528+0000","last_fullsized":"2024-08-31T04:43:54.261528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:32.767357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060576730000000004,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":9,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"48'626","reported_seq":2730,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.295342+0000","last_change":"2024-08-31T04:10:27.682416+0000","last_active":"2024-08-31T04:43:54.295342+0000","last_peered":"2024-08-31T04:43:54.295342+0000","last_clean":"2024-08-31T04:43:54.295342+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:43:54.295342+0000","last_undegraded":"2024-08-31T04:43:54.295342+0000","last_fullsized":"2024-08-31T04:43:54.295342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:28:37.569659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067294099999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":8,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"48'662","reported_seq":2760,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.307324+0000","last_change":"2024-08-31T04:10:27.643926+0000","last_active":"2024-08-31T04:43:54.307324+0000","last_peered":"2024-08-31T04:43:54.307324+0000","last_clean":"2024-08-31T04:43:54.307324+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:43:54.307324+0000","last_undegraded":"2024-08-31T04:43:54.307324+0000","last_fullsized":"2024-08-31T04:43:54.307324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:22:41.496309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01443145,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"48'614","reported_seq":2713,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.282781+0000","last_change":"2024-08-31T04:10:27.827546+0000","last_active":"2024-08-31T04:43:54.282781+0000","last_peered":"2024-08-31T04:43:54.282781+0000","last_clean":"2024-08-31T04:43:54.282781+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:43:54.282781+0000","last_undegraded":"2024-08-31T04:43:54.282781+0000","last_fullsized":"2024-08-31T04:43:54.282781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:52:51.784003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024833572000000002,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'595","reported_seq":2699,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.276230+0000","last_change":"2024-08-31T04:10:27.824141+0000","last_active":"2024-08-31T04:43:54.276230+0000","last_peered":"2024-08-31T04:43:54.276230+0000","last_clean":"2024-08-31T04:43:54.276230+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:43:54.276230+0000","last_undegraded":"2024-08-31T04:43:54.276230+0000","last_fullsized":"2024-08-31T04:43:54.276230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:33:51.196460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024839776000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"48'651","reported_seq":2754,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.263649+0000","last_change":"2024-08-31T04:10:27.634372+0000","last_active":"2024-08-31T04:43:54.263649+0000","last_peered":"2024-08-31T04:43:54.263649+0000","last_clean":"2024-08-31T04:43:54.263649+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:43:54.263649+0000","last_undegraded":"2024-08-31T04:43:54.263649+0000","last_fullsized":"2024-08-31T04:43:54.263649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:05:59.694688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060308059999999997,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"48'593","reported_seq":2698,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.307572+0000","last_change":"2024-08-31T04:10:27.644765+0000","last_active":"2024-08-31T04:43:54.307572+0000","last_peered":"2024-08-31T04:43:54.307572+0000","last_clean":"2024-08-31T04:43:54.307572+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:43:54.307572+0000","last_undegraded":"2024-08-31T04:43:54.307572+0000","last_fullsized":"2024-08-31T04:43:54.307572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:50.112615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012931465,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":6,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"48'623","reported_seq":2723,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.295724+0000","last_change":"2024-08-31T04:10:27.681657+0000","last_active":"2024-08-31T04:43:54.295724+0000","last_peered":"2024-08-31T04:43:54.295724+0000","last_clean":"2024-08-31T04:43:54.295724+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:43:54.295724+0000","last_undegraded":"2024-08-31T04:43:54.295724+0000","last_fullsized":"2024-08-31T04:43:54.295724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:16:16.233374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062469689999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"48'592","reported_seq":2696,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.314417+0000","last_change":"2024-08-31T04:10:27.638483+0000","last_active":"2024-08-31T04:43:54.314417+0000","last_peered":"2024-08-31T04:43:54.314417+0000","last_clean":"2024-08-31T04:43:54.314417+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:43:54.314417+0000","last_undegraded":"2024-08-31T04:43:54.314417+0000","last_fullsized":"2024-08-31T04:43:54.314417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:09.181389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011311599,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"48'651","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.280078+0000","last_change":"2024-08-31T04:10:27.626932+0000","last_active":"2024-08-31T04:43:54.280078+0000","last_peered":"2024-08-31T04:43:54.280078+0000","last_clean":"2024-08-31T04:43:54.280078+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:43:54.280078+0000","last_undegraded":"2024-08-31T04:43:54.280078+0000","last_fullsized":"2024-08-31T04:43:54.280078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:25:29.687132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035095819999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"48'613","reported_seq":2715,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.284539+0000","last_change":"2024-08-31T04:10:27.806718+0000","last_active":"2024-08-31T04:43:54.284539+0000","last_peered":"2024-08-31T04:43:54.284539+0000","last_clean":"2024-08-31T04:43:54.284539+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:43:54.284539+0000","last_undegraded":"2024-08-31T04:43:54.284539+0000","last_fullsized":"2024-08-31T04:43:54.284539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:40.726314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055677180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"48'643","reported_seq":2741,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.278401+0000","last_change":"2024-08-31T04:10:27.799928+0000","last_active":"2024-08-31T04:43:54.278401+0000","last_peered":"2024-08-31T04:43:54.278401+0000","last_clean":"2024-08-31T04:43:54.278401+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:43:54.278401+0000","last_undegraded":"2024-08-31T04:43:54.278401+0000","last_fullsized":"2024-08-31T04:43:54.278401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:17:49.971542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047976060000000003,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"48'644","reported_seq":2744,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.283855+0000","last_change":"2024-08-31T04:10:27.683751+0000","last_active":"2024-08-31T04:43:54.283855+0000","last_peered":"2024-08-31T04:43:54.283855+0000","last_clean":"2024-08-31T04:43:54.283855+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:43:54.283855+0000","last_undegraded":"2024-08-31T04:43:54.283855+0000","last_fullsized":"2024-08-31T04:43:54.283855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:15:51.447225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066178469999999996,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"48'594","reported_seq":2693,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.278219+0000","last_change":"2024-08-31T04:10:27.671492+0000","last_active":"2024-08-31T04:43:54.278219+0000","last_peered":"2024-08-31T04:43:54.278219+0000","last_clean":"2024-08-31T04:43:54.278219+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:43:54.278219+0000","last_undegraded":"2024-08-31T04:43:54.278219+0000","last_fullsized":"2024-08-31T04:43:54.278219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:08:25.848770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050893520000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"48'637","reported_seq":2741,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.279698+0000","last_change":"2024-08-31T04:10:27.683243+0000","last_active":"2024-08-31T04:43:54.279698+0000","last_peered":"2024-08-31T04:43:54.279698+0000","last_clean":"2024-08-31T04:43:54.279698+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:43:54.279698+0000","last_undegraded":"2024-08-31T04:43:54.279698+0000","last_fullsized":"2024-08-31T04:43:54.279698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:05:34.589760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068720639999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":6,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"48'613","reported_seq":2716,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.265093+0000","last_change":"2024-08-31T04:10:27.680920+0000","last_active":"2024-08-31T04:43:54.265093+0000","last_peered":"2024-08-31T04:43:54.265093+0000","last_clean":"2024-08-31T04:43:54.265093+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:43:54.265093+0000","last_undegraded":"2024-08-31T04:43:54.265093+0000","last_fullsized":"2024-08-31T04:43:54.265093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:22.809894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059141749999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":7,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"48'651","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.308059+0000","last_change":"2024-08-31T04:10:27.636678+0000","last_active":"2024-08-31T04:43:54.308059+0000","last_peered":"2024-08-31T04:43:54.308059+0000","last_clean":"2024-08-31T04:43:54.308059+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:43:54.308059+0000","last_undegraded":"2024-08-31T04:43:54.308059+0000","last_fullsized":"2024-08-31T04:43:54.308059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:48:32.668716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098583990000000003,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"48'622","reported_seq":2720,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.290857+0000","last_change":"2024-08-31T04:10:27.829545+0000","last_active":"2024-08-31T04:43:54.290857+0000","last_peered":"2024-08-31T04:43:54.290857+0000","last_clean":"2024-08-31T04:43:54.290857+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:43:54.290857+0000","last_undegraded":"2024-08-31T04:43:54.290857+0000","last_fullsized":"2024-08-31T04:43:54.290857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:56:41.550447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023950035000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":12,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"48'599","reported_seq":2699,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.281814+0000","last_change":"2024-08-31T04:10:27.827114+0000","last_active":"2024-08-31T04:43:54.281814+0000","last_peered":"2024-08-31T04:43:54.281814+0000","last_clean":"2024-08-31T04:43:54.281814+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:43:54.281814+0000","last_undegraded":"2024-08-31T04:43:54.281814+0000","last_fullsized":"2024-08-31T04:43:54.281814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:28.164149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025118893999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'599","reported_seq":2700,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.279571+0000","last_change":"2024-08-31T04:10:27.800501+0000","last_active":"2024-08-31T04:43:54.279571+0000","last_peered":"2024-08-31T04:43:54.279571+0000","last_clean":"2024-08-31T04:43:54.279571+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:43:54.279571+0000","last_undegraded":"2024-08-31T04:43:54.279571+0000","last_fullsized":"2024-08-31T04:43:54.279571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:19.639843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051269660000000002,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"48'627","reported_seq":2723,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.278649+0000","last_change":"2024-08-31T04:10:27.799550+0000","last_active":"2024-08-31T04:43:54.278649+0000","last_peered":"2024-08-31T04:43:54.278649+0000","last_clean":"2024-08-31T04:43:54.278649+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:43:54.278649+0000","last_undegraded":"2024-08-31T04:43:54.278649+0000","last_fullsized":"2024-08-31T04:43:54.278649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:56:52.315777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045307300000000002,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"48'585","reported_seq":2683,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.269911+0000","last_change":"2024-08-31T04:10:27.801153+0000","last_active":"2024-08-31T04:43:54.269911+0000","last_peered":"2024-08-31T04:43:54.269911+0000","last_clean":"2024-08-31T04:43:54.269911+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:43:54.269911+0000","last_undegraded":"2024-08-31T04:43:54.269911+0000","last_fullsized":"2024-08-31T04:43:54.269911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:49:14.674631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053663419999999996,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"48'631","reported_seq":2730,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.264630+0000","last_change":"2024-08-31T04:10:27.627028+0000","last_active":"2024-08-31T04:43:54.264630+0000","last_peered":"2024-08-31T04:43:54.264630+0000","last_clean":"2024-08-31T04:43:54.264630+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:43:54.264630+0000","last_undegraded":"2024-08-31T04:43:54.264630+0000","last_fullsized":"2024-08-31T04:43:54.264630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:14:52.550351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003298704,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"48'581","reported_seq":2682,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.834809+0000","last_change":"2024-08-31T04:10:27.635962+0000","last_active":"2024-08-31T04:43:54.834809+0000","last_peered":"2024-08-31T04:43:54.834809+0000","last_clean":"2024-08-31T04:43:54.834809+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:43:54.834809+0000","last_undegraded":"2024-08-31T04:43:54.834809+0000","last_fullsized":"2024-08-31T04:43:54.834809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:43:12.087921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0091212849999999998,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'612","reported_seq":2709,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.283666+0000","last_change":"2024-08-31T04:10:27.796436+0000","last_active":"2024-08-31T04:43:54.283666+0000","last_peered":"2024-08-31T04:43:54.283666+0000","last_clean":"2024-08-31T04:43:54.283666+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:43:54.283666+0000","last_undegraded":"2024-08-31T04:43:54.283666+0000","last_fullsized":"2024-08-31T04:43:54.283666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020846939999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"48'593","reported_seq":2689,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.279842+0000","last_change":"2024-08-31T04:10:27.632700+0000","last_active":"2024-08-31T04:43:54.279842+0000","last_peered":"2024-08-31T04:43:54.279842+0000","last_clean":"2024-08-31T04:43:54.279842+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:43:54.279842+0000","last_undegraded":"2024-08-31T04:43:54.279842+0000","last_fullsized":"2024-08-31T04:43:54.279842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079797440000000004,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":13,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"48'666","reported_seq":2756,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.270567+0000","last_change":"2024-08-31T04:10:27.799557+0000","last_active":"2024-08-31T04:43:54.270567+0000","last_peered":"2024-08-31T04:43:54.270567+0000","last_clean":"2024-08-31T04:43:54.270567+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:43:54.270567+0000","last_undegraded":"2024-08-31T04:43:54.270567+0000","last_fullsized":"2024-08-31T04:43:54.270567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047669089999999997,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":19,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":19,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"48'624","reported_seq":2731,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.279332+0000","last_change":"2024-08-31T04:10:27.633848+0000","last_active":"2024-08-31T04:43:54.279332+0000","last_peered":"2024-08-31T04:43:54.279332+0000","last_clean":"2024-08-31T04:43:54.279332+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:43:54.279332+0000","last_undegraded":"2024-08-31T04:43:54.279332+0000","last_fullsized":"2024-08-31T04:43:54.279332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:19:00.071541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063128230000000004,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":5,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":5,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"48'624","reported_seq":2726,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.304567+0000","last_change":"2024-08-31T04:10:27.643240+0000","last_active":"2024-08-31T04:43:54.304567+0000","last_peered":"2024-08-31T04:43:54.304567+0000","last_clean":"2024-08-31T04:43:54.304567+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:43:54.304567+0000","last_undegraded":"2024-08-31T04:43:54.304567+0000","last_fullsized":"2024-08-31T04:43:54.304567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:28:05.502942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013845079999999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"48'584","reported_seq":2687,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.304120+0000","last_change":"2024-08-31T04:10:27.645944+0000","last_active":"2024-08-31T04:43:54.304120+0000","last_peered":"2024-08-31T04:43:54.304120+0000","last_clean":"2024-08-31T04:43:54.304120+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:43:54.304120+0000","last_undegraded":"2024-08-31T04:43:54.304120+0000","last_fullsized":"2024-08-31T04:43:54.304120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:47:36.656806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012861716,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"48'601","reported_seq":2698,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:54.270820+0000","last_change":"2024-08-31T04:10:27.800212+0000","last_active":"2024-08-31T04:43:54.270820+0000","last_peered":"2024-08-31T04:43:54.270820+0000","last_clean":"2024-08-31T04:43:54.270820+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:43:54.270820+0000","last_undegraded":"2024-08-31T04:43:54.270820+0000","last_fullsized":"2024-08-31T04:43:54.270820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:03:59.808226+0000","last_clean_scrub_stamp":"2024-08-31T04:03:59.808226+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:06.926644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048876299999999996,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1171046334,"num_objects":39264,"num_object_clones":18317,"num_object_copies":157056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39264,"num_whiteouts":18141,"num_read":5774,"num_read_kb":6778394,"num_write":75481,"num_write_kb":1474785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2548367360,"data_stored":2549710848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92337,"ondisk_log_size":92337,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":2792,"num_object_clones":669,"num_object_copies":5584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2792,"num_whiteouts":669,"num_read":0,"num_read_kb":0,"num_write":2800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39686,"ondisk_log_size":39686,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":830797057,"num_objects":1713,"num_object_clones":0,"num_object_copies":3426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1713,"num_whiteouts":0,"num_read":2588,"num_read_kb":5535,"num_write":35395,"num_write_kb":2443316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3384141,"num_omap_keys":5737,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1661657088,"data_stored":1661594114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31925,"ondisk_log_size":31925,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477222,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1001140,"kb_used_data":627236,"kb_used_omap":1,"kb_used_meta":373886,"kb_avail":93370700,"statfs":{"total":96636764160,"available":95611596800,"internally_reserved":0,"allocated":642289664,"data_stored":642188380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":382859719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477222,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":638272,"kb_used_data":418288,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93733568,"statfs":{"total":96636764160,"available":95983173632,"internally_reserved":0,"allocated":428326912,"data_stored":428055527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477223,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":857192,"kb_used_data":569176,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93514648,"statfs":{"total":96636764160,"available":95758999552,"internally_reserved":0,"allocated":582836224,"data_stored":582730273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477223,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":813360,"kb_used_data":525408,"kb_used_omap":1,"kb_used_meta":287934,"kb_avail":93558480,"statfs":{"total":96636764160,"available":95803883520,"internally_reserved":0,"allocated":538017792,"data_stored":537913727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294844869},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509925,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":692036,"kb_used_data":458228,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":93679804,"statfs":{"total":96636764160,"available":95928119296,"internally_reserved":0,"allocated":469225472,"data_stored":469129543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239401414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509926,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757676,"kb_used_data":487772,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":93614164,"statfs":{"total":96636764160,"available":95860903936,"internally_reserved":0,"allocated":499478528,"data_stored":499539157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509925,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":811436,"kb_used_data":549852,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":93560404,"statfs":{"total":96636764160,"available":95805853696,"internally_reserved":0,"allocated":563048448,"data_stored":563100856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267844037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575333,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":754968,"kb_used_data":480840,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93616872,"statfs":{"total":96636764160,"available":95863676928,"internally_reserved":0,"allocated":492380160,"data_stored":492108227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":314580992,"data_stored":314572856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":201986048,"data_stored":201979578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":113254400,"data_stored":113246880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":284889088,"data_stored":284883733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":243609600,"data_stored":243590001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":226504704,"data_stored":226496878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":138412032,"data_stored":138412032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":138420224,"data_stored":138412156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":222887936,"data_stored":223055872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":379707392,"data_stored":379875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":314523648,"data_stored":314523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":356851712,"data_stored":357019648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":318889984,"data_stored":319225856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":271831040,"data_stored":272166912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":330264576,"data_stored":330432512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":353411072,"data_stored":353411072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:44:02.770 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.770 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.771 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.771 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.771 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.771 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.771 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.771 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.772 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.772 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.772 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.772 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.772 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.773 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.773 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.773 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.773 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.773 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.773 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.774 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.774 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.774 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.774 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.774 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.775 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.775 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.775 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.775 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.775 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.775 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.776 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.776 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.776 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.776 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.776 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.777 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.777 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.777 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.777 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.777 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.778 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.778 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.778 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.778 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.778 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.779 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.779 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.779 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.779 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.779 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.779 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.780 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.780 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.780 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.780 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.780 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.780 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.781 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.781 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.781 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.781 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.781 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.781 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.782 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.782 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.782 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.782 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.782 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.783 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.783 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.783 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.783 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.783 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.783 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.784 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.784 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.784 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.784 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.784 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.784 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.785 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.785 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.785 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.785 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.785 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.785 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.786 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-08-31T04:03:58.799790+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=58, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.786 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.786 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.786 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.786 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.786 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.787 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.787 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.787 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.787 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.787 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.787 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.788 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.788 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.788 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.788 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.788 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.789 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.789 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.789 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.789 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.789 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.789 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.790 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.790 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.790 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.790 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.790 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.790 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.791 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.791 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.791 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.791 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.791 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.791 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-08-31T04:03:59.808226+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=3, tm_sec=59, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:02.791 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-31T04:44:22.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:44:22.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.975+0000 7f7092200640 1 -- 172.21.15.89:0/519752535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 msgr2=0x7f708c0c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:22.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.975+0000 7f7092200640 1 --2- 172.21.15.89:0/519752535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 0x7f708c0c1f40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7078009900 tx=0x7f707801c850 comp rx=0 tx=0).stop 2024-08-31T04:44:22.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.975+0000 7f7092200640 1 -- 172.21.15.89:0/519752535 shutdown_connections 2024-08-31T04:44:22.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.975+0000 7f7092200640 1 --2- 172.21.15.89:0/519752535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 0x7f708c0c1f40 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:22.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.975+0000 7f7092200640 1 --2- 172.21.15.89:0/519752535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f708c0b2fe0 0x7f708c1520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:22.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.975+0000 7f7092200640 1 -- 172.21.15.89:0/519752535 >> 172.21.15.89:0/519752535 conn(0x7f708c0ccf20 msgr2=0x7f708c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.975+0000 7f7092200640 1 -- 172.21.15.89:0/519752535 shutdown_connections 2024-08-31T04:44:22.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.975+0000 7f7092200640 1 -- 172.21.15.89:0/519752535 wait complete. 2024-08-31T04:44:22.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f7092200640 1 Processor -- start 2024-08-31T04:44:22.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f7092200640 1 -- start start 2024-08-31T04:44:22.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f7092200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 0x7f708c0c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:22.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f7092200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f708c0b2fe0 0x7f708c14bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:22.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f7092200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c0c2480 0x7f708c1617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:22.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f7092200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f708c0c8f20 con 0x7f708c0b2900 2024-08-31T04:44:22.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f7092200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f708c158a10 con 0x7f708c0c2480 2024-08-31T04:44:22.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f7092200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f708c0c90a0 con 0x7f708c0b2fe0 2024-08-31T04:44:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 0x7f708c0c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 0x7f708c0c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:55814/0 (socket says 172.21.15.89:55814) 2024-08-31T04:44:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708b400640 1 -- 172.21.15.89:0/3967456932 learned_addr learned my addr 172.21.15.89:0/3967456932 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708aa00640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f708c0b2fe0 0x7f708c14bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:22.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708be00640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c0c2480 0x7f708c1617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:22.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708b400640 1 -- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f708c0b2fe0 msgr2=0x7f708c14bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:22.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708b400640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f708c0b2fe0 0x7f708c14bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:22.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708b400640 1 -- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c0c2480 msgr2=0x7f708c1617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:22.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708b400640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c0c2480 0x7f708c1617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:22.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708b400640 1 -- 172.21.15.89:0/3967456932 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c0c5300 con 0x7f708c0b2900 2024-08-31T04:44:22.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.979+0000 7f708b400640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 0x7f708c0c4dc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f707c00d780 tx=0x7f707c00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:22.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.983+0000 7f7083400640 1 -- 172.21.15.89:0/3967456932 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c017070 con 0x7f708c0b2900 2024-08-31T04:44:22.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.983+0000 7f7083400640 1 -- 172.21.15.89:0/3967456932 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f707c005310 con 0x7f708c0b2900 2024-08-31T04:44:22.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.983+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708c154330 con 0x7f708c0b2900 2024-08-31T04:44:22.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.983+0000 7f7083400640 1 -- 172.21.15.89:0/3967456932 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c0097c0 con 0x7f708c0b2900 2024-08-31T04:44:22.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.983+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708c0c42e0 con 0x7f708c0b2900 2024-08-31T04:44:22.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.983+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708c0c1f40 con 0x7f708c0b2900 2024-08-31T04:44:22.986 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.983+0000 7f7083400640 1 -- 172.21.15.89:0/3967456932 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f707c009960 con 0x7f708c0b2900 2024-08-31T04:44:22.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.987+0000 7f7083400640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f706c0720c0 0x7f706c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:22.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.987+0000 7f7083400640 1 -- 172.21.15.89:0/3967456932 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f707c092eb0 con 0x7f708c0b2900 2024-08-31T04:44:22.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.987+0000 7f708aa00640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f706c0720c0 0x7f706c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:22.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.987+0000 7f708aa00640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f706c0720c0 0x7f706c0745d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f70780af000 tx=0x7f707801b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:22.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:22.991+0000 7f7083400640 1 -- 172.21.15.89:0/3967456932 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f707c05ddd0 con 0x7f708c0b2900 2024-08-31T04:44:23.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.155+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f708c1557f0 con 0x7f706c0720c0 2024-08-31T04:44:23.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.171+0000 7f7083400640 1 -- 172.21.15.89:0/3967456932 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339542 (secure 0 0 0) 0x7f708c1557f0 con 0x7f706c0720c0 2024-08-31T04:44:23.176 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:44:23.179 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:44:23.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f706c0720c0 msgr2=0x7f706c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:23.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f706c0720c0 0x7f706c0745d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f70780af000 tx=0x7f707801b090 comp rx=0 tx=0).stop 2024-08-31T04:44:23.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 msgr2=0x7f708c0c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:23.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 0x7f708c0c4dc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f707c00d780 tx=0x7f707c00dc40 comp rx=0 tx=0).stop 2024-08-31T04:44:23.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 shutdown_connections 2024-08-31T04:44:23.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f706c0720c0 0x7f706c0745d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:23.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f708c0c2480 0x7f708c1617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:23.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f708c0b2fe0 0x7f708c14bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:23.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 --2- 172.21.15.89:0/3967456932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f708c0b2900 0x7f708c0c4dc0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:23.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 >> 172.21.15.89:0/3967456932 conn(0x7f708c0ccf20 msgr2=0x7f708c0c9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:23.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 shutdown_connections 2024-08-31T04:44:23.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:23.175+0000 7f7092200640 1 -- 172.21.15.89:0/3967456932 wait complete. 2024-08-31T04:44:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1258,"stamp":"2024-08-31T04:44:21.303497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2002433759,"num_objects":43771,"num_object_clones":18986,"num_object_copies":166070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43771,"num_whiteouts":18810,"num_read":8428,"num_read_kb":6783984,"num_write":113777,"num_write_kb":3919729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19620823,"num_omap_keys":33909,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168175,"ondisk_log_size":168175,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6334400,"kb_used_data":4116800,"kb_used_omap":12,"kb_used_meta":2217459,"kb_avail":748640320,"statfs":{"total":773094113280,"available":766607687680,"internally_reserved":0,"allocated":4215603200,"data_stored":4214765690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":2270678576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5125698,"num_omap_keys":8575,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003915"},"pg_stats":[{"pgid":"2.1f","version":"48'842","reported_seq":938,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.173613+0000","last_change":"2024-08-31T04:44:02.173613+0000","last_active":"2024-08-31T04:44:02.173613+0000","last_peered":"2024-08-31T04:44:02.173613+0000","last_clean":"2024-08-31T04:44:02.173613+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:44:02.173613+0000","last_undegraded":"2024-08-31T04:44:02.173613+0000","last_fullsized":"2024-08-31T04:44:02.173613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'842","last_scrub_stamp":"2024-08-31T04:44:02.173452+0000","last_deep_scrub":"48'842","last_deep_scrub_stamp":"2024-08-31T04:44:02.173452+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.173452+0000","objects_scrubbed":51,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:18.893618+0000","scrub_duration":171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37419797,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":826,"num_write_kb":58141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":557462,"num_omap_keys":1075,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"48'626","reported_seq":2740,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.296121+0000","last_change":"2024-08-31T04:44:10.296121+0000","last_active":"2024-08-31T04:44:10.296121+0000","last_peered":"2024-08-31T04:44:10.296121+0000","last_clean":"2024-08-31T04:44:10.296121+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:44:10.296121+0000","last_undegraded":"2024-08-31T04:44:10.296121+0000","last_fullsized":"2024-08-31T04:44:10.296121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'626","last_scrub_stamp":"2024-08-31T04:44:10.295890+0000","last_deep_scrub":"48'626","last_deep_scrub_stamp":"2024-08-31T04:44:10.295890+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.295890+0000","objects_scrubbed":34,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:22.348391+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.012836803000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"48'2838","reported_seq":4659,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.196562+0000","last_change":"2024-08-31T04:44:11.196562+0000","last_active":"2024-08-31T04:44:11.196562+0000","last_peered":"2024-08-31T04:44:11.196562+0000","last_clean":"2024-08-31T04:44:11.196562+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:44:11.196562+0000","last_undegraded":"2024-08-31T04:44:11.196562+0000","last_fullsized":"2024-08-31T04:44:11.196562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2838","last_scrub_stamp":"2024-08-31T04:44:11.196410+0000","last_deep_scrub":"48'2838","last_deep_scrub_stamp":"2024-08-31T04:44:11.196410+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.196410+0000","objects_scrubbed":1198,"log_size":2838,"log_dups_size":0,"ondisk_log_size":2838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:06:57.619952+0000","scrub_duration":703,"objects_trimmed":0,"snaptrim_duration":0.0058952350000000004,"stat_sum":{"num_bytes":50597461,"num_objects":1198,"num_object_clones":550,"num_object_copies":4792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1198,"num_whiteouts":550,"num_read":212,"num_read_kb":376919,"num_write":2332,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"48'714","reported_seq":810,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.349815+0000","last_change":"2024-08-31T04:44:04.349613+0000","last_active":"2024-08-31T04:44:04.349815+0000","last_peered":"2024-08-31T04:44:04.349815+0000","last_clean":"2024-08-31T04:44:04.349815+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:44:04.349815+0000","last_undegraded":"2024-08-31T04:44:04.349815+0000","last_fullsized":"2024-08-31T04:44:04.349815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'714","last_scrub_stamp":"2024-08-31T04:44:04.349423+0000","last_deep_scrub":"48'714","last_deep_scrub_stamp":"2024-08-31T04:44:04.349423+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.349423+0000","objects_scrubbed":42,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:45:53.557729+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":697,"num_write_kb":66604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":420359,"num_omap_keys":770,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"48'613","reported_seq":2727,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.294810+0000","last_change":"2024-08-31T04:44:09.294810+0000","last_active":"2024-08-31T04:44:09.294810+0000","last_peered":"2024-08-31T04:44:09.294810+0000","last_clean":"2024-08-31T04:44:09.294810+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:44:09.294810+0000","last_undegraded":"2024-08-31T04:44:09.294810+0000","last_fullsized":"2024-08-31T04:44:09.294810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'613","last_scrub_stamp":"2024-08-31T04:44:09.294657+0000","last_deep_scrub":"48'613","last_deep_scrub_stamp":"2024-08-31T04:44:09.294657+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.294657+0000","objects_scrubbed":34,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:34.068982+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.012881510000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"48'3007","reported_seq":4831,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.297593+0000","last_change":"2024-08-31T04:44:11.297593+0000","last_active":"2024-08-31T04:44:11.297593+0000","last_peered":"2024-08-31T04:44:11.297593+0000","last_clean":"2024-08-31T04:44:11.297593+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:44:11.297593+0000","last_undegraded":"2024-08-31T04:44:11.297593+0000","last_fullsized":"2024-08-31T04:44:11.297593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3007","last_scrub_stamp":"2024-08-31T04:44:11.297442+0000","last_deep_scrub":"48'3007","last_deep_scrub_stamp":"2024-08-31T04:44:11.297442+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.297442+0000","objects_scrubbed":1258,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:01.718442+0000","scrub_duration":599,"objects_trimmed":0,"snaptrim_duration":0.0059980260000000001,"stat_sum":{"num_bytes":71770879,"num_objects":1258,"num_object_clones":586,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":586,"num_read":247,"num_read_kb":407586,"num_write":2470,"num_write_kb":85232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"48'1302","reported_seq":1395,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.966567+0000","last_change":"2024-08-31T04:44:02.966567+0000","last_active":"2024-08-31T04:44:02.966567+0000","last_peered":"2024-08-31T04:44:02.966567+0000","last_clean":"2024-08-31T04:44:02.966567+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:44:02.966567+0000","last_undegraded":"2024-08-31T04:44:02.966567+0000","last_fullsized":"2024-08-31T04:44:02.966567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1302","last_scrub_stamp":"2024-08-31T04:44:02.966503+0000","last_deep_scrub":"48'1302","last_deep_scrub_stamp":"2024-08-31T04:44:02.966503+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.966503+0000","objects_scrubbed":51,"log_size":1302,"log_dups_size":0,"ondisk_log_size":1302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:30.935679+0000","scrub_duration":175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1281,"num_write_kb":120075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508856,"num_omap_keys":955,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"48'667","reported_seq":2776,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.049948+0000","last_change":"2024-08-31T04:44:04.049948+0000","last_active":"2024-08-31T04:44:04.049948+0000","last_peered":"2024-08-31T04:44:04.049948+0000","last_clean":"2024-08-31T04:44:04.049948+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:44:04.049948+0000","last_undegraded":"2024-08-31T04:44:04.049948+0000","last_fullsized":"2024-08-31T04:44:04.049948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'667","last_scrub_stamp":"2024-08-31T04:44:04.049855+0000","last_deep_scrub":"48'667","last_deep_scrub_stamp":"2024-08-31T04:44:04.049855+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.049855+0000","objects_scrubbed":42,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:32.135720+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0032840360000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"48'3005","reported_seq":4757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.423952+0000","last_change":"2024-08-31T04:44:14.423952+0000","last_active":"2024-08-31T04:44:14.423952+0000","last_peered":"2024-08-31T04:44:14.423952+0000","last_clean":"2024-08-31T04:44:14.423952+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:44:14.423952+0000","last_undegraded":"2024-08-31T04:44:14.423952+0000","last_fullsized":"2024-08-31T04:44:14.423952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3005","last_scrub_stamp":"2024-08-31T04:44:14.423799+0000","last_deep_scrub":"48'3005","last_deep_scrub_stamp":"2024-08-31T04:44:14.423799+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.423799+0000","objects_scrubbed":1292,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:21:25.106649+0000","scrub_duration":647,"objects_trimmed":0,"snaptrim_duration":0.0058445240000000002,"stat_sum":{"num_bytes":38693415,"num_objects":1292,"num_object_clones":602,"num_object_copies":5168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":602,"num_read":191,"num_read_kb":293900,"num_write":2458,"num_write_kb":41612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"48'455","reported_seq":548,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.842853+0000","last_change":"2024-08-31T04:44:00.842796+0000","last_active":"2024-08-31T04:44:00.842853+0000","last_peered":"2024-08-31T04:44:00.842853+0000","last_clean":"2024-08-31T04:44:00.842853+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:44:00.842853+0000","last_undegraded":"2024-08-31T04:44:00.842853+0000","last_fullsized":"2024-08-31T04:44:00.842853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'455","last_scrub_stamp":"2024-08-31T04:44:00.842723+0000","last_deep_scrub":"48'455","last_deep_scrub_stamp":"2024-08-31T04:44:00.842723+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.842723+0000","objects_scrubbed":55,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:37.463986+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":451,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684010,"num_omap_keys":1149,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"48'630","reported_seq":2742,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.399192+0000","last_change":"2024-08-31T04:44:15.399192+0000","last_active":"2024-08-31T04:44:15.399192+0000","last_peered":"2024-08-31T04:44:15.399192+0000","last_clean":"2024-08-31T04:44:15.399192+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:44:15.399192+0000","last_undegraded":"2024-08-31T04:44:15.399192+0000","last_fullsized":"2024-08-31T04:44:15.399192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'630","last_scrub_stamp":"2024-08-31T04:44:15.399109+0000","last_deep_scrub":"48'630","last_deep_scrub_stamp":"2024-08-31T04:44:15.399109+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.399109+0000","objects_scrubbed":30,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:11:37.670608+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0070378919999999996,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"48'2845","reported_seq":4669,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.307393+0000","last_change":"2024-08-31T04:44:13.307393+0000","last_active":"2024-08-31T04:44:13.307393+0000","last_peered":"2024-08-31T04:44:13.307393+0000","last_clean":"2024-08-31T04:44:13.307393+0000","last_became_active":"2024-08-31T04:04:41.418200+0000","last_became_peered":"2024-08-31T04:04:41.418200+0000","last_unstale":"2024-08-31T04:44:13.307393+0000","last_undegraded":"2024-08-31T04:44:13.307393+0000","last_fullsized":"2024-08-31T04:44:13.307393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2845","last_scrub_stamp":"2024-08-31T04:44:13.307278+0000","last_deep_scrub":"48'2845","last_deep_scrub_stamp":"2024-08-31T04:44:13.307278+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.307278+0000","objects_scrubbed":1209,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:57.517465+0000","scrub_duration":579,"objects_trimmed":0,"snaptrim_duration":0.0059467970000000002,"stat_sum":{"num_bytes":46428419,"num_objects":1209,"num_object_clones":554,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":554,"num_read":210,"num_read_kb":267629,"num_write":2344,"num_write_kb":53603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"48'659","reported_seq":2768,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.434620+0000","last_change":"2024-08-31T04:44:09.434620+0000","last_active":"2024-08-31T04:44:09.434620+0000","last_peered":"2024-08-31T04:44:09.434620+0000","last_clean":"2024-08-31T04:44:09.434620+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:44:09.434620+0000","last_undegraded":"2024-08-31T04:44:09.434620+0000","last_fullsized":"2024-08-31T04:44:09.434620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'659","last_scrub_stamp":"2024-08-31T04:44:09.434497+0000","last_deep_scrub":"48'659","last_deep_scrub_stamp":"2024-08-31T04:44:09.434497+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.434497+0000","objects_scrubbed":43,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:08:40.671438+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0068528089999999996,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"48'1243","reported_seq":1337,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.445184+0000","last_change":"2024-08-31T04:44:13.445184+0000","last_active":"2024-08-31T04:44:13.445184+0000","last_peered":"2024-08-31T04:44:13.445184+0000","last_clean":"2024-08-31T04:44:13.445184+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:44:13.445184+0000","last_undegraded":"2024-08-31T04:44:13.445184+0000","last_fullsized":"2024-08-31T04:44:13.445184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1243","last_scrub_stamp":"2024-08-31T04:44:13.445085+0000","last_deep_scrub":"48'1243","last_deep_scrub_stamp":"2024-08-31T04:44:13.445085+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.445085+0000","objects_scrubbed":61,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:50:52.548850+0000","scrub_duration":127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1278,"num_write_kb":83819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":672938,"num_omap_keys":1256,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"48'2943","reported_seq":4741,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.026204+0000","last_change":"2024-08-31T04:10:27.682154+0000","last_active":"2024-08-31T04:43:51.026204+0000","last_peered":"2024-08-31T04:43:51.026204+0000","last_clean":"2024-08-31T04:43:51.026204+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:43:51.026204+0000","last_undegraded":"2024-08-31T04:43:51.026204+0000","last_fullsized":"2024-08-31T04:43:51.026204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:43.247408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066428290000000003,"stat_sum":{"num_bytes":56765051,"num_objects":1275,"num_object_clones":585,"num_object_copies":5100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1275,"num_whiteouts":585,"num_read":279,"num_read_kb":424140,"num_write":2416,"num_write_kb":67833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"48'673","reported_seq":2782,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.663648+0000","last_change":"2024-08-31T04:44:03.663648+0000","last_active":"2024-08-31T04:44:03.663648+0000","last_peered":"2024-08-31T04:44:03.663648+0000","last_clean":"2024-08-31T04:44:03.663648+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:44:03.663648+0000","last_undegraded":"2024-08-31T04:44:03.663648+0000","last_fullsized":"2024-08-31T04:44:03.663648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'673","last_scrub_stamp":"2024-08-31T04:44:03.663436+0000","last_deep_scrub":"48'673","last_deep_scrub_stamp":"2024-08-31T04:44:03.663436+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.663436+0000","objects_scrubbed":45,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:59.160345+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0.0066355329999999999,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"48'747","reported_seq":842,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.975457+0000","last_change":"2024-08-31T04:44:01.975457+0000","last_active":"2024-08-31T04:44:01.975457+0000","last_peered":"2024-08-31T04:44:01.975457+0000","last_clean":"2024-08-31T04:44:01.975457+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:44:01.975457+0000","last_undegraded":"2024-08-31T04:44:01.975457+0000","last_fullsized":"2024-08-31T04:44:01.975457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'747","last_scrub_stamp":"2024-08-31T04:44:01.975299+0000","last_deep_scrub":"48'747","last_deep_scrub_stamp":"2024-08-31T04:44:01.975299+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.975299+0000","objects_scrubbed":61,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:16:12.813818+0000","scrub_duration":179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":738,"num_write_kb":87340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":845775,"num_omap_keys":1615,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"48'2909","reported_seq":4599,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.317804+0000","last_change":"2024-08-31T04:44:16.317804+0000","last_active":"2024-08-31T04:44:16.317804+0000","last_peered":"2024-08-31T04:44:16.317804+0000","last_clean":"2024-08-31T04:44:16.317804+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:44:16.317804+0000","last_undegraded":"2024-08-31T04:44:16.317804+0000","last_fullsized":"2024-08-31T04:44:16.317804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2909","last_scrub_stamp":"2024-08-31T04:44:16.317708+0000","last_deep_scrub":"48'2909","last_deep_scrub_stamp":"2024-08-31T04:44:16.317708+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.317708+0000","objects_scrubbed":1190,"log_size":2909,"log_dups_size":0,"ondisk_log_size":2909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:04:18.188141+0000","scrub_duration":507,"objects_trimmed":0,"snaptrim_duration":0.0043859299999999997,"stat_sum":{"num_bytes":16936662,"num_objects":1190,"num_object_clones":558,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":558,"num_read":87,"num_read_kb":9431,"num_write":2392,"num_write_kb":37720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"48'707","reported_seq":2813,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.992950+0000","last_change":"2024-08-31T04:44:08.992950+0000","last_active":"2024-08-31T04:44:08.992950+0000","last_peered":"2024-08-31T04:44:08.992950+0000","last_clean":"2024-08-31T04:44:08.992950+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:44:08.992950+0000","last_undegraded":"2024-08-31T04:44:08.992950+0000","last_fullsized":"2024-08-31T04:44:08.992950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'707","last_scrub_stamp":"2024-08-31T04:44:08.992828+0000","last_deep_scrub":"48'707","last_deep_scrub_stamp":"2024-08-31T04:44:08.992828+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.992828+0000","objects_scrubbed":48,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:37:08.223324+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.018377836000000002,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":14,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"48'614","reported_seq":709,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.182102+0000","last_change":"2024-08-31T04:44:01.182102+0000","last_active":"2024-08-31T04:44:01.182102+0000","last_peered":"2024-08-31T04:44:01.182102+0000","last_clean":"2024-08-31T04:44:01.182102+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:44:01.182102+0000","last_undegraded":"2024-08-31T04:44:01.182102+0000","last_fullsized":"2024-08-31T04:44:01.182102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'614","last_scrub_stamp":"2024-08-31T04:44:01.181946+0000","last_deep_scrub":"48'614","last_deep_scrub_stamp":"2024-08-31T04:44:01.181946+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.181946+0000","objects_scrubbed":52,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:07.441762+0000","scrub_duration":163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":615,"num_write_kb":58408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":536630,"num_omap_keys":960,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"48'2896","reported_seq":4633,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.247065+0000","last_change":"2024-08-31T04:44:09.247065+0000","last_active":"2024-08-31T04:44:09.247065+0000","last_peered":"2024-08-31T04:44:09.247065+0000","last_clean":"2024-08-31T04:44:09.247065+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:44:09.247065+0000","last_undegraded":"2024-08-31T04:44:09.247065+0000","last_fullsized":"2024-08-31T04:44:09.247065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2896","last_scrub_stamp":"2024-08-31T04:44:09.246791+0000","last_deep_scrub":"48'2896","last_deep_scrub_stamp":"2024-08-31T04:44:09.246791+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.246791+0000","objects_scrubbed":1227,"log_size":2896,"log_dups_size":0,"ondisk_log_size":2896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:46:59.862038+0000","scrub_duration":787,"objects_trimmed":0,"snaptrim_duration":0.0070696559999999997,"stat_sum":{"num_bytes":20275415,"num_objects":1227,"num_object_clones":567,"num_object_copies":4908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1227,"num_whiteouts":567,"num_read":143,"num_read_kb":118630,"num_write":2381,"num_write_kb":31494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'672","reported_seq":2782,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.441802+0000","last_change":"2024-08-31T04:44:05.441802+0000","last_active":"2024-08-31T04:44:05.441802+0000","last_peered":"2024-08-31T04:44:05.441802+0000","last_clean":"2024-08-31T04:44:05.441802+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:44:05.441802+0000","last_undegraded":"2024-08-31T04:44:05.441802+0000","last_fullsized":"2024-08-31T04:44:05.441802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'672","last_scrub_stamp":"2024-08-31T04:44:05.441710+0000","last_deep_scrub":"48'672","last_deep_scrub_stamp":"2024-08-31T04:44:05.441710+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.441710+0000","objects_scrubbed":43,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:51.700384+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.0060537480000000003,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"48'423","reported_seq":518,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.842112+0000","last_change":"2024-08-31T04:44:03.842112+0000","last_active":"2024-08-31T04:44:03.842112+0000","last_peered":"2024-08-31T04:44:03.842112+0000","last_clean":"2024-08-31T04:44:03.842112+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:44:03.842112+0000","last_undegraded":"2024-08-31T04:44:03.842112+0000","last_fullsized":"2024-08-31T04:44:03.842112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'423","last_scrub_stamp":"2024-08-31T04:44:03.842040+0000","last_deep_scrub":"48'423","last_deep_scrub_stamp":"2024-08-31T04:44:03.842040+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.842040+0000","objects_scrubbed":52,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:54:09.328590+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":417,"num_write_kb":42100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":614061,"num_omap_keys":1061,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"48'2828","reported_seq":4560,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.329023+0000","last_change":"2024-08-31T04:44:12.329023+0000","last_active":"2024-08-31T04:44:12.329023+0000","last_peered":"2024-08-31T04:44:12.329023+0000","last_clean":"2024-08-31T04:44:12.329023+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:44:12.329023+0000","last_undegraded":"2024-08-31T04:44:12.329023+0000","last_fullsized":"2024-08-31T04:44:12.329023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2828","last_scrub_stamp":"2024-08-31T04:44:12.328917+0000","last_deep_scrub":"48'2828","last_deep_scrub_stamp":"2024-08-31T04:44:12.328917+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.328917+0000","objects_scrubbed":1243,"log_size":2828,"log_dups_size":0,"ondisk_log_size":2828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:12.706346+0000","scrub_duration":595,"objects_trimmed":0,"snaptrim_duration":0.0062106380000000001,"stat_sum":{"num_bytes":38082532,"num_objects":1243,"num_object_clones":581,"num_object_copies":4972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1243,"num_whiteouts":581,"num_read":151,"num_read_kb":116541,"num_write":2283,"num_write_kb":45420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"48'651","reported_seq":2760,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.011068+0000","last_change":"2024-08-31T04:44:10.011068+0000","last_active":"2024-08-31T04:44:10.011068+0000","last_peered":"2024-08-31T04:44:10.011068+0000","last_clean":"2024-08-31T04:44:10.011068+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:44:10.011068+0000","last_undegraded":"2024-08-31T04:44:10.011068+0000","last_fullsized":"2024-08-31T04:44:10.011068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'651","last_scrub_stamp":"2024-08-31T04:44:10.010948+0000","last_deep_scrub":"48'651","last_deep_scrub_stamp":"2024-08-31T04:44:10.010948+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.010948+0000","objects_scrubbed":43,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:58.492267+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.018455160000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"48'596","reported_seq":691,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.450799+0000","last_change":"2024-08-31T04:44:08.450799+0000","last_active":"2024-08-31T04:44:08.450799+0000","last_peered":"2024-08-31T04:44:08.450799+0000","last_clean":"2024-08-31T04:44:08.450799+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:44:08.450799+0000","last_undegraded":"2024-08-31T04:44:08.450799+0000","last_fullsized":"2024-08-31T04:44:08.450799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'596","last_scrub_stamp":"2024-08-31T04:44:08.450715+0000","last_deep_scrub":"48'596","last_deep_scrub_stamp":"2024-08-31T04:44:08.450715+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.450715+0000","objects_scrubbed":54,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:12:49.593796+0000","scrub_duration":107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":604,"num_write_kb":70753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504741,"num_omap_keys":921,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"48'2858","reported_seq":4677,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.271693+0000","last_change":"2024-08-31T04:44:05.271693+0000","last_active":"2024-08-31T04:44:05.271693+0000","last_peered":"2024-08-31T04:44:05.271693+0000","last_clean":"2024-08-31T04:44:05.271693+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:44:05.271693+0000","last_undegraded":"2024-08-31T04:44:05.271693+0000","last_fullsized":"2024-08-31T04:44:05.271693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2858","last_scrub_stamp":"2024-08-31T04:44:05.271593+0000","last_deep_scrub":"48'2858","last_deep_scrub_stamp":"2024-08-31T04:44:05.271593+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.271593+0000","objects_scrubbed":1175,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:49:07.263280+0000","scrub_duration":615,"objects_trimmed":0,"snaptrim_duration":0.0076718680000000001,"stat_sum":{"num_bytes":46058979,"num_objects":1175,"num_object_clones":539,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":539,"num_read":197,"num_read_kb":336982,"num_write":2367,"num_write_kb":53816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"48'629","reported_seq":2737,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.976476+0000","last_change":"2024-08-31T04:44:06.976476+0000","last_active":"2024-08-31T04:44:06.976476+0000","last_peered":"2024-08-31T04:44:06.976476+0000","last_clean":"2024-08-31T04:44:06.976476+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:44:06.976476+0000","last_undegraded":"2024-08-31T04:44:06.976476+0000","last_fullsized":"2024-08-31T04:44:06.976476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'629","last_scrub_stamp":"2024-08-31T04:44:06.976399+0000","last_deep_scrub":"48'629","last_deep_scrub_stamp":"2024-08-31T04:44:06.976399+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.976399+0000","objects_scrubbed":53,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:07:21.574286+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0.019117552999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":13,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"48'2025","reported_seq":2120,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.197842+0000","last_change":"2024-08-31T04:44:03.197842+0000","last_active":"2024-08-31T04:44:03.197842+0000","last_peered":"2024-08-31T04:44:03.197842+0000","last_clean":"2024-08-31T04:44:03.197842+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:44:03.197842+0000","last_undegraded":"2024-08-31T04:44:03.197842+0000","last_fullsized":"2024-08-31T04:44:03.197842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2025","last_scrub_stamp":"2024-08-31T04:44:03.197619+0000","last_deep_scrub":"48'2025","last_deep_scrub_stamp":"2024-08-31T04:44:03.197619+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.197619+0000","objects_scrubbed":66,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:16.149643+0000","scrub_duration":231,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":4155,"num_write_kb":64616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":776230,"num_omap_keys":1395,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"48'2942","reported_seq":4765,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.558179+0000","last_change":"2024-08-31T04:44:14.558179+0000","last_active":"2024-08-31T04:44:14.558179+0000","last_peered":"2024-08-31T04:44:14.558179+0000","last_clean":"2024-08-31T04:44:14.558179+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:44:14.558179+0000","last_undegraded":"2024-08-31T04:44:14.558179+0000","last_fullsized":"2024-08-31T04:44:14.558179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2942","last_scrub_stamp":"2024-08-31T04:44:14.557886+0000","last_deep_scrub":"48'2942","last_deep_scrub_stamp":"2024-08-31T04:44:14.557886+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.557886+0000","objects_scrubbed":1223,"log_size":2942,"log_dups_size":0,"ondisk_log_size":2942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:37:06.396566+0000","scrub_duration":655,"objects_trimmed":0,"snaptrim_duration":0.018717636999999999,"stat_sum":{"num_bytes":43745379,"num_objects":1223,"num_object_clones":566,"num_object_copies":4892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1223,"num_whiteouts":566,"num_read":225,"num_read_kb":330819,"num_write":2430,"num_write_kb":52706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"48'696","reported_seq":2798,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.901888+0000","last_change":"2024-08-31T04:44:05.901888+0000","last_active":"2024-08-31T04:44:05.901888+0000","last_peered":"2024-08-31T04:44:05.901888+0000","last_clean":"2024-08-31T04:44:05.901888+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:44:05.901888+0000","last_undegraded":"2024-08-31T04:44:05.901888+0000","last_fullsized":"2024-08-31T04:44:05.901888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'696","last_scrub_stamp":"2024-08-31T04:44:05.901756+0000","last_deep_scrub":"48'696","last_deep_scrub_stamp":"2024-08-31T04:44:05.901756+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.901756+0000","objects_scrubbed":60,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:52.526394+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.024325223999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":20,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"48'1199","reported_seq":1294,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.530439+0000","last_change":"2024-08-31T04:44:01.530439+0000","last_active":"2024-08-31T04:44:01.530439+0000","last_peered":"2024-08-31T04:44:01.530439+0000","last_clean":"2024-08-31T04:44:01.530439+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:44:01.530439+0000","last_undegraded":"2024-08-31T04:44:01.530439+0000","last_fullsized":"2024-08-31T04:44:01.530439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1199","last_scrub_stamp":"2024-08-31T04:44:01.530315+0000","last_deep_scrub":"48'1199","last_deep_scrub_stamp":"2024-08-31T04:44:01.530315+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.530315+0000","objects_scrubbed":49,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:38.099017+0000","scrub_duration":135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":1214,"num_write_kb":79665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":624485,"num_omap_keys":1076,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"48'3005","reported_seq":4779,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.547062+0000","last_change":"2024-08-31T04:44:13.547062+0000","last_active":"2024-08-31T04:44:13.547062+0000","last_peered":"2024-08-31T04:44:13.547062+0000","last_clean":"2024-08-31T04:44:13.547062+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:44:13.547062+0000","last_undegraded":"2024-08-31T04:44:13.547062+0000","last_fullsized":"2024-08-31T04:44:13.547062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3005","last_scrub_stamp":"2024-08-31T04:44:13.546839+0000","last_deep_scrub":"48'3005","last_deep_scrub_stamp":"2024-08-31T04:44:13.546839+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.546839+0000","objects_scrubbed":1282,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:43.677541+0000","scrub_duration":715,"objects_trimmed":0,"snaptrim_duration":0.025625698999999998,"stat_sum":{"num_bytes":43095232,"num_objects":1282,"num_object_clones":604,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":604,"num_read":212,"num_read_kb":287774,"num_write":2444,"num_write_kb":46619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"48'678","reported_seq":2787,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:59.708191+0000","last_change":"2024-08-31T04:43:59.708191+0000","last_active":"2024-08-31T04:43:59.708191+0000","last_peered":"2024-08-31T04:43:59.708191+0000","last_clean":"2024-08-31T04:43:59.708191+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:43:59.708191+0000","last_undegraded":"2024-08-31T04:43:59.708191+0000","last_fullsized":"2024-08-31T04:43:59.708191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'678","last_scrub_stamp":"2024-08-31T04:43:59.708058+0000","last_deep_scrub":"48'678","last_deep_scrub_stamp":"2024-08-31T04:43:59.708058+0000","last_clean_scrub_stamp":"2024-08-31T04:43:59.708058+0000","objects_scrubbed":45,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:25.302149+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0058084670000000003,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"48'857","reported_seq":953,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.258097+0000","last_change":"2024-08-31T04:44:02.258097+0000","last_active":"2024-08-31T04:44:02.258097+0000","last_peered":"2024-08-31T04:44:02.258097+0000","last_clean":"2024-08-31T04:44:02.258097+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:44:02.258097+0000","last_undegraded":"2024-08-31T04:44:02.258097+0000","last_fullsized":"2024-08-31T04:44:02.258097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'857","last_scrub_stamp":"2024-08-31T04:44:02.257973+0000","last_deep_scrub":"48'857","last_deep_scrub_stamp":"2024-08-31T04:44:02.257973+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.257973+0000","objects_scrubbed":53,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:21.114892+0000","scrub_duration":111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":843,"num_write_kb":95373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":452599,"num_omap_keys":744,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"48'2913","reported_seq":4609,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.422430+0000","last_change":"2024-08-31T04:44:12.422430+0000","last_active":"2024-08-31T04:44:12.422430+0000","last_peered":"2024-08-31T04:44:12.422430+0000","last_clean":"2024-08-31T04:44:12.422430+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:44:12.422430+0000","last_undegraded":"2024-08-31T04:44:12.422430+0000","last_fullsized":"2024-08-31T04:44:12.422430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2913","last_scrub_stamp":"2024-08-31T04:44:12.422307+0000","last_deep_scrub":"48'2913","last_deep_scrub_stamp":"2024-08-31T04:44:12.422307+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.422307+0000","objects_scrubbed":1252,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:38:44.034564+0000","scrub_duration":563,"objects_trimmed":0,"snaptrim_duration":0.024539147000000001,"stat_sum":{"num_bytes":16912754,"num_objects":1252,"num_object_clones":571,"num_object_copies":5008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1252,"num_whiteouts":571,"num_read":103,"num_read_kb":5348,"num_write":2409,"num_write_kb":25816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"48'646","reported_seq":2761,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.811069+0000","last_change":"2024-08-31T04:44:04.811069+0000","last_active":"2024-08-31T04:44:04.811069+0000","last_peered":"2024-08-31T04:44:04.811069+0000","last_clean":"2024-08-31T04:44:04.811069+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:44:04.811069+0000","last_undegraded":"2024-08-31T04:44:04.811069+0000","last_fullsized":"2024-08-31T04:44:04.811069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'646","last_scrub_stamp":"2024-08-31T04:44:04.810943+0000","last_deep_scrub":"48'646","last_deep_scrub_stamp":"2024-08-31T04:44:04.810943+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.810943+0000","objects_scrubbed":27,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:45.272602+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.00335798,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"48'401","reported_seq":497,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.538210+0000","last_change":"2024-08-31T04:44:03.538210+0000","last_active":"2024-08-31T04:44:03.538210+0000","last_peered":"2024-08-31T04:44:03.538210+0000","last_clean":"2024-08-31T04:44:03.538210+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:44:03.538210+0000","last_undegraded":"2024-08-31T04:44:03.538210+0000","last_fullsized":"2024-08-31T04:44:03.538210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'401","last_scrub_stamp":"2024-08-31T04:44:03.538140+0000","last_deep_scrub":"48'401","last_deep_scrub_stamp":"2024-08-31T04:44:03.538140+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.538140+0000","objects_scrubbed":53,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:00.019696+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":379,"num_write_kb":74722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":617910,"num_omap_keys":1037,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"48'2860","reported_seq":4579,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.477806+0000","last_change":"2024-08-31T04:44:14.477806+0000","last_active":"2024-08-31T04:44:14.477806+0000","last_peered":"2024-08-31T04:44:14.477806+0000","last_clean":"2024-08-31T04:44:14.477806+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:44:14.477806+0000","last_undegraded":"2024-08-31T04:44:14.477806+0000","last_fullsized":"2024-08-31T04:44:14.477806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2860","last_scrub_stamp":"2024-08-31T04:44:14.477672+0000","last_deep_scrub":"48'2860","last_deep_scrub_stamp":"2024-08-31T04:44:14.477672+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.477672+0000","objects_scrubbed":1202,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:33:58.283689+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0.024774918,"stat_sum":{"num_bytes":28766340,"num_objects":1202,"num_object_clones":562,"num_object_copies":4808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":562,"num_read":118,"num_read_kb":82244,"num_write":2340,"num_write_kb":38944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"48'697","reported_seq":2806,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.388560+0000","last_change":"2024-08-31T04:44:05.388424+0000","last_active":"2024-08-31T04:44:05.388560+0000","last_peered":"2024-08-31T04:44:05.388560+0000","last_clean":"2024-08-31T04:44:05.388560+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:44:05.388560+0000","last_undegraded":"2024-08-31T04:44:05.388560+0000","last_fullsized":"2024-08-31T04:44:05.388560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'697","last_scrub_stamp":"2024-08-31T04:44:05.388257+0000","last_deep_scrub":"48'697","last_deep_scrub_stamp":"2024-08-31T04:44:05.388257+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.388257+0000","objects_scrubbed":51,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:52.276604+0000","scrub_duration":127,"objects_trimmed":0,"snaptrim_duration":0.011184838000000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"48'1790","reported_seq":2926,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.725631+0000","last_change":"2024-08-31T04:44:04.725631+0000","last_active":"2024-08-31T04:44:04.725631+0000","last_peered":"2024-08-31T04:44:04.725631+0000","last_clean":"2024-08-31T04:44:04.725631+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:44:04.725631+0000","last_undegraded":"2024-08-31T04:44:04.725631+0000","last_fullsized":"2024-08-31T04:44:04.725631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1790","last_scrub_stamp":"2024-08-31T04:44:04.725449+0000","last_deep_scrub":"48'1790","last_deep_scrub_stamp":"2024-08-31T04:44:04.725449+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.725449+0000","objects_scrubbed":72,"log_size":1790,"log_dups_size":0,"ondisk_log_size":1790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:10.542571+0000","scrub_duration":195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1088,"num_read_kb":4789,"num_write":1771,"num_write_kb":92200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":738098,"num_omap_keys":1268,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"48'2769","reported_seq":4575,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.440552+0000","last_change":"2024-08-31T04:44:15.440552+0000","last_active":"2024-08-31T04:44:15.440552+0000","last_peered":"2024-08-31T04:44:15.440552+0000","last_clean":"2024-08-31T04:44:15.440552+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:44:15.440552+0000","last_undegraded":"2024-08-31T04:44:15.440552+0000","last_fullsized":"2024-08-31T04:44:15.440552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2769","last_scrub_stamp":"2024-08-31T04:44:15.440430+0000","last_deep_scrub":"48'2769","last_deep_scrub_stamp":"2024-08-31T04:44:15.440430+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.440430+0000","objects_scrubbed":1190,"log_size":2769,"log_dups_size":0,"ondisk_log_size":2769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:36:09.691893+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0.024776765999999999,"stat_sum":{"num_bytes":32718964,"num_objects":1190,"num_object_clones":545,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":545,"num_read":189,"num_read_kb":237912,"num_write":2280,"num_write_kb":50056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"48'633","reported_seq":2744,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.819213+0000","last_change":"2024-08-31T04:44:04.819213+0000","last_active":"2024-08-31T04:44:04.819213+0000","last_peered":"2024-08-31T04:44:04.819213+0000","last_clean":"2024-08-31T04:44:04.819213+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:44:04.819213+0000","last_undegraded":"2024-08-31T04:44:04.819213+0000","last_fullsized":"2024-08-31T04:44:04.819213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'633","last_scrub_stamp":"2024-08-31T04:44:04.819079+0000","last_deep_scrub":"48'633","last_deep_scrub_stamp":"2024-08-31T04:44:04.819079+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.819079+0000","objects_scrubbed":45,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:46.550617+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.023142859000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"48'790","reported_seq":887,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.511224+0000","last_change":"2024-08-31T04:44:00.511159+0000","last_active":"2024-08-31T04:44:00.511224+0000","last_peered":"2024-08-31T04:44:00.511224+0000","last_clean":"2024-08-31T04:44:00.511224+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:44:00.511224+0000","last_undegraded":"2024-08-31T04:44:00.511224+0000","last_fullsized":"2024-08-31T04:44:00.511224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'790","last_scrub_stamp":"2024-08-31T04:44:00.511065+0000","last_deep_scrub":"48'790","last_deep_scrub_stamp":"2024-08-31T04:44:00.511065+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.511065+0000","objects_scrubbed":55,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:06.757563+0000","scrub_duration":135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":805,"num_write_kb":79377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":727793,"num_omap_keys":1211,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"48'2886","reported_seq":4556,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.755282+0000","last_change":"2024-08-31T04:10:27.643289+0000","last_active":"2024-08-31T04:43:41.755282+0000","last_peered":"2024-08-31T04:43:41.755282+0000","last_clean":"2024-08-31T04:43:41.755282+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:43:41.755282+0000","last_undegraded":"2024-08-31T04:43:41.755282+0000","last_fullsized":"2024-08-31T04:43:41.755282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:01:02.372383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014346418999999999,"stat_sum":{"num_bytes":16814987,"num_objects":1183,"num_object_clones":546,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":546,"num_read":112,"num_read_kb":15010,"num_write":2390,"num_write_kb":22596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'688","reported_seq":2793,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.094347+0000","last_change":"2024-08-31T04:44:04.094347+0000","last_active":"2024-08-31T04:44:04.094347+0000","last_peered":"2024-08-31T04:44:04.094347+0000","last_clean":"2024-08-31T04:44:04.094347+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:44:04.094347+0000","last_undegraded":"2024-08-31T04:44:04.094347+0000","last_fullsized":"2024-08-31T04:44:04.094347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'688","last_scrub_stamp":"2024-08-31T04:44:04.094101+0000","last_deep_scrub":"48'688","last_deep_scrub_stamp":"2024-08-31T04:44:04.094101+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.094101+0000","objects_scrubbed":62,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:43:31.936830+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0.013467437000000001,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"48'831","reported_seq":927,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.546478+0000","last_change":"2024-08-31T04:44:02.546478+0000","last_active":"2024-08-31T04:44:02.546478+0000","last_peered":"2024-08-31T04:44:02.546478+0000","last_clean":"2024-08-31T04:44:02.546478+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:44:02.546478+0000","last_undegraded":"2024-08-31T04:44:02.546478+0000","last_fullsized":"2024-08-31T04:44:02.546478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'831","last_scrub_stamp":"2024-08-31T04:44:02.546371+0000","last_deep_scrub":"48'831","last_deep_scrub_stamp":"2024-08-31T04:44:02.546371+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.546371+0000","objects_scrubbed":56,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:35:04.179853+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":842,"num_write_kb":66986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":697185,"num_omap_keys":1278,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"48'74","reported_seq":193,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.004740+0000","last_change":"2024-08-31T04:44:00.004619+0000","last_active":"2024-08-31T04:44:00.004740+0000","last_peered":"2024-08-31T04:44:00.004740+0000","last_clean":"2024-08-31T04:44:00.004740+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:44:00.004740+0000","last_undegraded":"2024-08-31T04:44:00.004740+0000","last_fullsized":"2024-08-31T04:44:00.004740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'74","last_scrub_stamp":"2024-08-31T04:44:00.004510+0000","last_deep_scrub":"48'74","last_deep_scrub_stamp":"2024-08-31T04:44:00.004510+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.004510+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:48.929118+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"48'2855","reported_seq":4683,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.038418+0000","last_change":"2024-08-31T04:10:27.683701+0000","last_active":"2024-08-31T04:43:51.038418+0000","last_peered":"2024-08-31T04:43:51.038418+0000","last_clean":"2024-08-31T04:43:51.038418+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:43:51.038418+0000","last_undegraded":"2024-08-31T04:43:51.038418+0000","last_fullsized":"2024-08-31T04:43:51.038418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:45:57.102473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069147610000000002,"stat_sum":{"num_bytes":57940200,"num_objects":1195,"num_object_clones":554,"num_object_copies":4780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":554,"num_read":276,"num_read_kb":364684,"num_write":2343,"num_write_kb":69963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"48'674","reported_seq":2780,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.433704+0000","last_change":"2024-08-31T04:44:11.433704+0000","last_active":"2024-08-31T04:44:11.433704+0000","last_peered":"2024-08-31T04:44:11.433704+0000","last_clean":"2024-08-31T04:44:11.433704+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:44:11.433704+0000","last_undegraded":"2024-08-31T04:44:11.433704+0000","last_fullsized":"2024-08-31T04:44:11.433704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'674","last_scrub_stamp":"2024-08-31T04:44:11.433597+0000","last_deep_scrub":"48'674","last_deep_scrub_stamp":"2024-08-31T04:44:11.433597+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.433597+0000","objects_scrubbed":54,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:14.172176+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.0067171050000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"48'1668","reported_seq":1761,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.891004+0000","last_change":"2024-08-31T04:44:03.891004+0000","last_active":"2024-08-31T04:44:03.891004+0000","last_peered":"2024-08-31T04:44:03.891004+0000","last_clean":"2024-08-31T04:44:03.891004+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:44:03.891004+0000","last_undegraded":"2024-08-31T04:44:03.891004+0000","last_fullsized":"2024-08-31T04:44:03.891004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1668","last_scrub_stamp":"2024-08-31T04:44:03.890781+0000","last_deep_scrub":"48'1668","last_deep_scrub_stamp":"2024-08-31T04:44:03.890781+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.890781+0000","objects_scrubbed":48,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:50.294577+0000","scrub_duration":131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":1668,"num_write_kb":75070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":594210,"num_omap_keys":959,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"48'2903","reported_seq":4616,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.254216+0000","last_change":"2024-08-31T04:44:07.254216+0000","last_active":"2024-08-31T04:44:07.254216+0000","last_peered":"2024-08-31T04:44:07.254216+0000","last_clean":"2024-08-31T04:44:07.254216+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:44:07.254216+0000","last_undegraded":"2024-08-31T04:44:07.254216+0000","last_fullsized":"2024-08-31T04:44:07.254216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2903","last_scrub_stamp":"2024-08-31T04:44:07.254090+0000","last_deep_scrub":"48'2903","last_deep_scrub_stamp":"2024-08-31T04:44:07.254090+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.254090+0000","objects_scrubbed":1237,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:36.475214+0000","scrub_duration":595,"objects_trimmed":0,"snaptrim_duration":0.0059273310000000001,"stat_sum":{"num_bytes":26554957,"num_objects":1237,"num_object_clones":582,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":582,"num_read":132,"num_read_kb":127199,"num_write":2367,"num_write_kb":33368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"48'687","reported_seq":2795,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.881920+0000","last_change":"2024-08-31T04:44:05.881920+0000","last_active":"2024-08-31T04:44:05.881920+0000","last_peered":"2024-08-31T04:44:05.881920+0000","last_clean":"2024-08-31T04:44:05.881920+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:44:05.881920+0000","last_undegraded":"2024-08-31T04:44:05.881920+0000","last_fullsized":"2024-08-31T04:44:05.881920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'687","last_scrub_stamp":"2024-08-31T04:44:05.881817+0000","last_deep_scrub":"48'687","last_deep_scrub_stamp":"2024-08-31T04:44:05.881817+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.881817+0000","objects_scrubbed":50,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:24:48.612658+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0.0055968709999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"48'1211","reported_seq":1304,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.363043+0000","last_change":"2024-08-31T04:44:03.363043+0000","last_active":"2024-08-31T04:44:03.363043+0000","last_peered":"2024-08-31T04:44:03.363043+0000","last_clean":"2024-08-31T04:44:03.363043+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:44:03.363043+0000","last_undegraded":"2024-08-31T04:44:03.363043+0000","last_fullsized":"2024-08-31T04:44:03.363043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1211","last_scrub_stamp":"2024-08-31T04:44:03.362774+0000","last_deep_scrub":"48'1211","last_deep_scrub_stamp":"2024-08-31T04:44:03.362774+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.362774+0000","objects_scrubbed":47,"log_size":1211,"log_dups_size":0,"ondisk_log_size":1211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:24:16.404021+0000","scrub_duration":171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37753176,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":1208,"num_write_kb":91501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449875,"num_omap_keys":723,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"48'2868","reported_seq":4617,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:19.308156+0000","last_change":"2024-08-31T04:44:19.308156+0000","last_active":"2024-08-31T04:44:19.308156+0000","last_peered":"2024-08-31T04:44:19.308156+0000","last_clean":"2024-08-31T04:44:19.308156+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:44:19.308156+0000","last_undegraded":"2024-08-31T04:44:19.308156+0000","last_fullsized":"2024-08-31T04:44:19.308156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2868","last_scrub_stamp":"2024-08-31T04:44:19.307866+0000","last_deep_scrub":"48'2868","last_deep_scrub_stamp":"2024-08-31T04:44:19.307866+0000","last_clean_scrub_stamp":"2024-08-31T04:44:19.307866+0000","objects_scrubbed":1215,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:52.257464+0000","scrub_duration":975,"objects_trimmed":0,"snaptrim_duration":0.013964779,"stat_sum":{"num_bytes":24232544,"num_objects":1215,"num_object_clones":563,"num_object_copies":4860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":563,"num_read":151,"num_read_kb":172254,"num_write":2354,"num_write_kb":29314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"48'650","reported_seq":2761,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.836347+0000","last_change":"2024-08-31T04:44:07.836347+0000","last_active":"2024-08-31T04:44:07.836347+0000","last_peered":"2024-08-31T04:44:07.836347+0000","last_clean":"2024-08-31T04:44:07.836347+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:44:07.836347+0000","last_undegraded":"2024-08-31T04:44:07.836347+0000","last_fullsized":"2024-08-31T04:44:07.836347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'650","last_scrub_stamp":"2024-08-31T04:44:07.836266+0000","last_deep_scrub":"48'650","last_deep_scrub_stamp":"2024-08-31T04:44:07.836266+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.836266+0000","objects_scrubbed":41,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:20.977393+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0052273500000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"48'599","reported_seq":693,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.009846+0000","last_change":"2024-08-31T04:44:08.009846+0000","last_active":"2024-08-31T04:44:08.009846+0000","last_peered":"2024-08-31T04:44:08.009846+0000","last_clean":"2024-08-31T04:44:08.009846+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:44:08.009846+0000","last_undegraded":"2024-08-31T04:44:08.009846+0000","last_fullsized":"2024-08-31T04:44:08.009846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'599","last_scrub_stamp":"2024-08-31T04:44:08.009712+0000","last_deep_scrub":"48'599","last_deep_scrub_stamp":"2024-08-31T04:44:08.009712+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.009712+0000","objects_scrubbed":52,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:12:25.518006+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":607,"num_write_kb":87317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":699385,"num_omap_keys":1095,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"48'2923","reported_seq":4625,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.021190+0000","last_change":"2024-08-31T04:10:27.681554+0000","last_active":"2024-08-31T04:43:51.021190+0000","last_peered":"2024-08-31T04:43:51.021190+0000","last_clean":"2024-08-31T04:43:51.021190+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:43:51.021190+0000","last_undegraded":"2024-08-31T04:43:51.021190+0000","last_fullsized":"2024-08-31T04:43:51.021190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2923,"log_dups_size":0,"ondisk_log_size":2923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:39:43.060510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065855360000000003,"stat_sum":{"num_bytes":30081699,"num_objects":1235,"num_object_clones":576,"num_object_copies":4940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1235,"num_whiteouts":576,"num_read":173,"num_read_kb":193208,"num_write":2389,"num_write_kb":43568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"48'656","reported_seq":2765,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.743436+0000","last_change":"2024-08-31T04:44:07.743436+0000","last_active":"2024-08-31T04:44:07.743436+0000","last_peered":"2024-08-31T04:44:07.743436+0000","last_clean":"2024-08-31T04:44:07.743436+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:44:07.743436+0000","last_undegraded":"2024-08-31T04:44:07.743436+0000","last_fullsized":"2024-08-31T04:44:07.743436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'656","last_scrub_stamp":"2024-08-31T04:44:07.743351+0000","last_deep_scrub":"48'656","last_deep_scrub_stamp":"2024-08-31T04:44:07.743351+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.743351+0000","objects_scrubbed":39,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:25.522336+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0057184189999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"48'587","reported_seq":681,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:59.813232+0000","last_change":"2024-08-31T04:43:59.813232+0000","last_active":"2024-08-31T04:43:59.813232+0000","last_peered":"2024-08-31T04:43:59.813232+0000","last_clean":"2024-08-31T04:43:59.813232+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:43:59.813232+0000","last_undegraded":"2024-08-31T04:43:59.813232+0000","last_fullsized":"2024-08-31T04:43:59.813232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'587","last_scrub_stamp":"2024-08-31T04:43:59.813158+0000","last_deep_scrub":"48'587","last_deep_scrub_stamp":"2024-08-31T04:43:59.813158+0000","last_clean_scrub_stamp":"2024-08-31T04:43:59.813158+0000","objects_scrubbed":52,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:17.188105+0000","scrub_duration":119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971542,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":585,"num_write_kb":62565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":413993,"num_omap_keys":698,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"48'2832","reported_seq":4659,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.568084+0000","last_change":"2024-08-31T04:44:06.568084+0000","last_active":"2024-08-31T04:44:06.568084+0000","last_peered":"2024-08-31T04:44:06.568084+0000","last_clean":"2024-08-31T04:44:06.568084+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:44:06.568084+0000","last_undegraded":"2024-08-31T04:44:06.568084+0000","last_fullsized":"2024-08-31T04:44:06.568084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2832","last_scrub_stamp":"2024-08-31T04:44:06.567992+0000","last_deep_scrub":"48'2832","last_deep_scrub_stamp":"2024-08-31T04:44:06.567992+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.567992+0000","objects_scrubbed":1209,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:58:56.872310+0000","scrub_duration":575,"objects_trimmed":0,"snaptrim_duration":0.001644726,"stat_sum":{"num_bytes":45550886,"num_objects":1209,"num_object_clones":562,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":562,"num_read":227,"num_read_kb":373101,"num_write":2312,"num_write_kb":56902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"48'663","reported_seq":2775,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.378734+0000","last_change":"2024-08-31T04:44:10.378734+0000","last_active":"2024-08-31T04:44:10.378734+0000","last_peered":"2024-08-31T04:44:10.378734+0000","last_clean":"2024-08-31T04:44:10.378734+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:44:10.378734+0000","last_undegraded":"2024-08-31T04:44:10.378734+0000","last_fullsized":"2024-08-31T04:44:10.378734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'663","last_scrub_stamp":"2024-08-31T04:44:10.378648+0000","last_deep_scrub":"48'663","last_deep_scrub_stamp":"2024-08-31T04:44:10.378648+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.378648+0000","objects_scrubbed":33,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:46.222260+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0051653649999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":7,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"48'739","reported_seq":833,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.054463+0000","last_change":"2024-08-31T04:44:13.054463+0000","last_active":"2024-08-31T04:44:13.054463+0000","last_peered":"2024-08-31T04:44:13.054463+0000","last_clean":"2024-08-31T04:44:13.054463+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:44:13.054463+0000","last_undegraded":"2024-08-31T04:44:13.054463+0000","last_fullsized":"2024-08-31T04:44:13.054463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'739","last_scrub_stamp":"2024-08-31T04:44:13.054216+0000","last_deep_scrub":"48'739","last_deep_scrub_stamp":"2024-08-31T04:44:13.054216+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.054216+0000","objects_scrubbed":58,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:53:11.077347+0000","scrub_duration":107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":760,"num_write_kb":71301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":785587,"num_omap_keys":1122,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"48'2735","reported_seq":4393,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:41.739755+0000","last_change":"2024-08-31T04:10:27.644231+0000","last_active":"2024-08-31T04:43:41.739755+0000","last_peered":"2024-08-31T04:43:41.739755+0000","last_clean":"2024-08-31T04:43:41.739755+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:43:41.739755+0000","last_undegraded":"2024-08-31T04:43:41.739755+0000","last_fullsized":"2024-08-31T04:43:41.739755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:17.265946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012604237000000001,"stat_sum":{"num_bytes":16809799,"num_objects":1152,"num_object_clones":538,"num_object_copies":4608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":538,"num_read":93,"num_read_kb":855,"num_write":2242,"num_write_kb":21215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"48'652","reported_seq":2759,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.076481+0000","last_change":"2024-08-31T04:44:01.076481+0000","last_active":"2024-08-31T04:44:01.076481+0000","last_peered":"2024-08-31T04:44:01.076481+0000","last_clean":"2024-08-31T04:44:01.076481+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:44:01.076481+0000","last_undegraded":"2024-08-31T04:44:01.076481+0000","last_fullsized":"2024-08-31T04:44:01.076481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'652","last_scrub_stamp":"2024-08-31T04:44:01.076372+0000","last_deep_scrub":"48'652","last_deep_scrub_stamp":"2024-08-31T04:44:01.076372+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.076372+0000","objects_scrubbed":40,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:37.836214+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0036328670000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":12,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"48'397","reported_seq":490,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:58.788531+0000","last_change":"2024-08-31T04:43:58.788531+0000","last_active":"2024-08-31T04:43:58.788531+0000","last_peered":"2024-08-31T04:43:58.788531+0000","last_clean":"2024-08-31T04:43:58.788531+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:43:58.788531+0000","last_undegraded":"2024-08-31T04:43:58.788531+0000","last_fullsized":"2024-08-31T04:43:58.788531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'397","last_scrub_stamp":"2024-08-31T04:43:58.788449+0000","last_deep_scrub":"48'397","last_deep_scrub_stamp":"2024-08-31T04:43:58.788449+0000","last_clean_scrub_stamp":"2024-08-31T04:43:58.788449+0000","objects_scrubbed":39,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:15.834647+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":374,"num_write_kb":62134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":425438,"num_omap_keys":783,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"48'3078","reported_seq":4763,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:20.011489+0000","last_change":"2024-08-31T04:44:20.011489+0000","last_active":"2024-08-31T04:44:20.011489+0000","last_peered":"2024-08-31T04:44:20.011489+0000","last_clean":"2024-08-31T04:44:20.011489+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:44:20.011489+0000","last_undegraded":"2024-08-31T04:44:20.011489+0000","last_fullsized":"2024-08-31T04:44:20.011489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3078","last_scrub_stamp":"2024-08-31T04:44:20.011370+0000","last_deep_scrub":"48'3078","last_deep_scrub_stamp":"2024-08-31T04:44:20.011370+0000","last_clean_scrub_stamp":"2024-08-31T04:44:20.011370+0000","objects_scrubbed":1354,"log_size":3078,"log_dups_size":0,"ondisk_log_size":3078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:29.393007+0000","scrub_duration":715,"objects_trimmed":0,"snaptrim_duration":0.012777844,"stat_sum":{"num_bytes":35172120,"num_objects":1354,"num_object_clones":682,"num_object_copies":5416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1354,"num_whiteouts":594,"num_read":201,"num_read_kb":245482,"num_write":2432,"num_write_kb":44882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'658","reported_seq":2771,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.367050+0000","last_change":"2024-08-31T04:44:12.367050+0000","last_active":"2024-08-31T04:44:12.367050+0000","last_peered":"2024-08-31T04:44:12.367050+0000","last_clean":"2024-08-31T04:44:12.367050+0000","last_became_active":"2024-08-31T04:04:41.425024+0000","last_became_peered":"2024-08-31T04:04:41.425024+0000","last_unstale":"2024-08-31T04:44:12.367050+0000","last_undegraded":"2024-08-31T04:44:12.367050+0000","last_fullsized":"2024-08-31T04:44:12.367050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'658","last_scrub_stamp":"2024-08-31T04:44:12.366949+0000","last_deep_scrub":"48'658","last_deep_scrub_stamp":"2024-08-31T04:44:12.366949+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.366949+0000","objects_scrubbed":38,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:28.944548+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.006804175,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"48'560","reported_seq":653,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.517252+0000","last_change":"2024-08-31T04:44:04.517252+0000","last_active":"2024-08-31T04:44:04.517252+0000","last_peered":"2024-08-31T04:44:04.517252+0000","last_clean":"2024-08-31T04:44:04.517252+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:44:04.517252+0000","last_undegraded":"2024-08-31T04:44:04.517252+0000","last_fullsized":"2024-08-31T04:44:04.517252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'560","last_scrub_stamp":"2024-08-31T04:44:04.517141+0000","last_deep_scrub":"48'560","last_deep_scrub_stamp":"2024-08-31T04:44:04.517141+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.517141+0000","objects_scrubbed":46,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:05:32.497794+0000","scrub_duration":107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":556,"num_write_kb":54279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":460677,"num_omap_keys":837,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"48'2880","reported_seq":4659,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.674306+0000","last_change":"2024-08-31T04:44:16.674306+0000","last_active":"2024-08-31T04:44:16.674306+0000","last_peered":"2024-08-31T04:44:16.674306+0000","last_clean":"2024-08-31T04:44:16.674306+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:44:16.674306+0000","last_undegraded":"2024-08-31T04:44:16.674306+0000","last_fullsized":"2024-08-31T04:44:16.674306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2880","last_scrub_stamp":"2024-08-31T04:44:16.674065+0000","last_deep_scrub":"48'2880","last_deep_scrub_stamp":"2024-08-31T04:44:16.674065+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.674065+0000","objects_scrubbed":1251,"log_size":2880,"log_dups_size":0,"ondisk_log_size":2880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:14:13.795497+0000","scrub_duration":871,"objects_trimmed":0,"snaptrim_duration":0.025415436,"stat_sum":{"num_bytes":43622224,"num_objects":1251,"num_object_clones":583,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1251,"num_whiteouts":583,"num_read":199,"num_read_kb":207126,"num_write":2328,"num_write_kb":56286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"48'617","reported_seq":2727,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.862896+0000","last_change":"2024-08-31T04:44:06.862896+0000","last_active":"2024-08-31T04:44:06.862896+0000","last_peered":"2024-08-31T04:44:06.862896+0000","last_clean":"2024-08-31T04:44:06.862896+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:44:06.862896+0000","last_undegraded":"2024-08-31T04:44:06.862896+0000","last_fullsized":"2024-08-31T04:44:06.862896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'617","last_scrub_stamp":"2024-08-31T04:44:06.862802+0000","last_deep_scrub":"48'617","last_deep_scrub_stamp":"2024-08-31T04:44:06.862802+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.862802+0000","objects_scrubbed":32,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:08.440446+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.023919682000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"48'1314","reported_seq":1408,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.597343+0000","last_change":"2024-08-31T04:44:07.597343+0000","last_active":"2024-08-31T04:44:07.597343+0000","last_peered":"2024-08-31T04:44:07.597343+0000","last_clean":"2024-08-31T04:44:07.597343+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:44:07.597343+0000","last_undegraded":"2024-08-31T04:44:07.597343+0000","last_fullsized":"2024-08-31T04:44:07.597343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1314","last_scrub_stamp":"2024-08-31T04:44:07.597116+0000","last_deep_scrub":"48'1314","last_deep_scrub_stamp":"2024-08-31T04:44:07.597116+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.597116+0000","objects_scrubbed":57,"log_size":1314,"log_dups_size":0,"ondisk_log_size":1314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:12:22.894549+0000","scrub_duration":131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1306,"num_write_kb":67222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":571475,"num_omap_keys":1097,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"48'2891","reported_seq":4583,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:51.059570+0000","last_change":"2024-08-31T04:10:27.683052+0000","last_active":"2024-08-31T04:43:51.059570+0000","last_peered":"2024-08-31T04:43:51.059570+0000","last_clean":"2024-08-31T04:43:51.059570+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:43:51.059570+0000","last_undegraded":"2024-08-31T04:43:51.059570+0000","last_fullsized":"2024-08-31T04:43:51.059570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:04:03.880244+0000","last_clean_scrub_stamp":"2024-08-31T04:04:03.880244+0000","objects_scrubbed":0,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:41:00.116451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069575569999999996,"stat_sum":{"num_bytes":34789039,"num_objects":1260,"num_object_clones":583,"num_object_copies":5040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1260,"num_whiteouts":583,"num_read":172,"num_read_kb":170440,"num_write":2360,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"48'659","reported_seq":2768,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.878191+0000","last_change":"2024-08-31T04:44:06.878191+0000","last_active":"2024-08-31T04:44:06.878191+0000","last_peered":"2024-08-31T04:44:06.878191+0000","last_clean":"2024-08-31T04:44:06.878191+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:44:06.878191+0000","last_undegraded":"2024-08-31T04:44:06.878191+0000","last_fullsized":"2024-08-31T04:44:06.878191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'659","last_scrub_stamp":"2024-08-31T04:44:06.878102+0000","last_deep_scrub":"48'659","last_deep_scrub_stamp":"2024-08-31T04:44:06.878102+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.878102+0000","objects_scrubbed":50,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:16:14.900927+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0047916210000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"48'1203","reported_seq":1296,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.839328+0000","last_change":"2024-08-31T04:44:00.839328+0000","last_active":"2024-08-31T04:44:00.839328+0000","last_peered":"2024-08-31T04:44:00.839328+0000","last_clean":"2024-08-31T04:44:00.839328+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:44:00.839328+0000","last_undegraded":"2024-08-31T04:44:00.839328+0000","last_fullsized":"2024-08-31T04:44:00.839328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1203","last_scrub_stamp":"2024-08-31T04:44:00.839183+0000","last_deep_scrub":"48'1203","last_deep_scrub_stamp":"2024-08-31T04:44:00.839183+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.839183+0000","objects_scrubbed":48,"log_size":1203,"log_dups_size":0,"ondisk_log_size":1203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:05:01.631410+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555104,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1203,"num_write_kb":103869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":503248,"num_omap_keys":844,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"48'2948","reported_seq":4675,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.562805+0000","last_change":"2024-08-31T04:44:15.562805+0000","last_active":"2024-08-31T04:44:15.562805+0000","last_peered":"2024-08-31T04:44:15.562805+0000","last_clean":"2024-08-31T04:44:15.562805+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:44:15.562805+0000","last_undegraded":"2024-08-31T04:44:15.562805+0000","last_fullsized":"2024-08-31T04:44:15.562805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2948","last_scrub_stamp":"2024-08-31T04:44:15.562648+0000","last_deep_scrub":"48'2948","last_deep_scrub_stamp":"2024-08-31T04:44:15.562648+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.562648+0000","objects_scrubbed":1250,"log_size":2948,"log_dups_size":0,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:20:17.506846+0000","scrub_duration":615,"objects_trimmed":0,"snaptrim_duration":0.0046964119999999996,"stat_sum":{"num_bytes":37035283,"num_objects":1250,"num_object_clones":626,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":538,"num_read":190,"num_read_kb":163631,"num_write":2363,"num_write_kb":48541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"48'664","reported_seq":2773,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.362551+0000","last_change":"2024-08-31T04:44:14.362551+0000","last_active":"2024-08-31T04:44:14.362551+0000","last_peered":"2024-08-31T04:44:14.362551+0000","last_clean":"2024-08-31T04:44:14.362551+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:44:14.362551+0000","last_undegraded":"2024-08-31T04:44:14.362551+0000","last_fullsized":"2024-08-31T04:44:14.362551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'664","last_scrub_stamp":"2024-08-31T04:44:14.362422+0000","last_deep_scrub":"48'664","last_deep_scrub_stamp":"2024-08-31T04:44:14.362422+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.362422+0000","objects_scrubbed":36,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:35:48.129891+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.006690306,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"48'1433","reported_seq":1526,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.722424+0000","last_change":"2024-08-31T04:44:02.722424+0000","last_active":"2024-08-31T04:44:02.722424+0000","last_peered":"2024-08-31T04:44:02.722424+0000","last_clean":"2024-08-31T04:44:02.722424+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:44:02.722424+0000","last_undegraded":"2024-08-31T04:44:02.722424+0000","last_fullsized":"2024-08-31T04:44:02.722424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1433","last_scrub_stamp":"2024-08-31T04:44:02.722333+0000","last_deep_scrub":"48'1433","last_deep_scrub_stamp":"2024-08-31T04:44:02.722333+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.722333+0000","objects_scrubbed":53,"log_size":1433,"log_dups_size":0,"ondisk_log_size":1433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:35:37.297915+0000","scrub_duration":195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554522,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1433,"num_write_kb":71604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":698912,"num_omap_keys":1223,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"48'2822","reported_seq":4562,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.257782+0000","last_change":"2024-08-31T04:44:06.257782+0000","last_active":"2024-08-31T04:44:06.257782+0000","last_peered":"2024-08-31T04:44:06.257782+0000","last_clean":"2024-08-31T04:44:06.257782+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:44:06.257782+0000","last_undegraded":"2024-08-31T04:44:06.257782+0000","last_fullsized":"2024-08-31T04:44:06.257782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2822","last_scrub_stamp":"2024-08-31T04:44:06.257645+0000","last_deep_scrub":"48'2822","last_deep_scrub_stamp":"2024-08-31T04:44:06.257645+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.257645+0000","objects_scrubbed":1254,"log_size":2822,"log_dups_size":0,"ondisk_log_size":2822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:49:51.366948+0000","scrub_duration":587,"objects_trimmed":0,"snaptrim_duration":0.0060660929999999998,"stat_sum":{"num_bytes":30139631,"num_objects":1254,"num_object_clones":586,"num_object_copies":5016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1254,"num_whiteouts":586,"num_read":163,"num_read_kb":134524,"num_write":2263,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"48'639","reported_seq":2748,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.315033+0000","last_change":"2024-08-31T04:44:07.315033+0000","last_active":"2024-08-31T04:44:07.315033+0000","last_peered":"2024-08-31T04:44:07.315033+0000","last_clean":"2024-08-31T04:44:07.315033+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:44:07.315033+0000","last_undegraded":"2024-08-31T04:44:07.315033+0000","last_fullsized":"2024-08-31T04:44:07.315033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'639","last_scrub_stamp":"2024-08-31T04:44:07.314825+0000","last_deep_scrub":"48'639","last_deep_scrub_stamp":"2024-08-31T04:44:07.314825+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.314825+0000","objects_scrubbed":37,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:10.387198+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0.012319801999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"48'1677","reported_seq":1770,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.918816+0000","last_change":"2024-08-31T04:44:01.918816+0000","last_active":"2024-08-31T04:44:01.918816+0000","last_peered":"2024-08-31T04:44:01.918816+0000","last_clean":"2024-08-31T04:44:01.918816+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:44:01.918816+0000","last_undegraded":"2024-08-31T04:44:01.918816+0000","last_fullsized":"2024-08-31T04:44:01.918816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1677","last_scrub_stamp":"2024-08-31T04:44:01.918707+0000","last_deep_scrub":"48'1677","last_deep_scrub_stamp":"2024-08-31T04:44:01.918707+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.918707+0000","objects_scrubbed":65,"log_size":1677,"log_dups_size":0,"ondisk_log_size":1677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:25:16.053642+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1665,"num_write_kb":95716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":642113,"num_omap_keys":1090,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"48'2860","reported_seq":4705,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.251878+0000","last_change":"2024-08-31T04:44:10.251878+0000","last_active":"2024-08-31T04:44:10.251878+0000","last_peered":"2024-08-31T04:44:10.251878+0000","last_clean":"2024-08-31T04:44:10.251878+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:44:10.251878+0000","last_undegraded":"2024-08-31T04:44:10.251878+0000","last_fullsized":"2024-08-31T04:44:10.251878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2860","last_scrub_stamp":"2024-08-31T04:44:10.251666+0000","last_deep_scrub":"48'2860","last_deep_scrub_stamp":"2024-08-31T04:44:10.251666+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.251666+0000","objects_scrubbed":1208,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:00:33.958640+0000","scrub_duration":775,"objects_trimmed":0,"snaptrim_duration":0.006760248,"stat_sum":{"num_bytes":54090295,"num_objects":1208,"num_object_clones":563,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":563,"num_read":248,"num_read_kb":382949,"num_write":2323,"num_write_kb":60670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"48'656","reported_seq":2764,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.738065+0000","last_change":"2024-08-31T04:44:08.738065+0000","last_active":"2024-08-31T04:44:08.738065+0000","last_peered":"2024-08-31T04:44:08.738065+0000","last_clean":"2024-08-31T04:44:08.738065+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:44:08.738065+0000","last_undegraded":"2024-08-31T04:44:08.738065+0000","last_fullsized":"2024-08-31T04:44:08.738065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'656","last_scrub_stamp":"2024-08-31T04:44:08.737953+0000","last_deep_scrub":"48'656","last_deep_scrub_stamp":"2024-08-31T04:44:08.737953+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.737953+0000","objects_scrubbed":40,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:56:38.308269+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0058567369999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":10,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"48'1010","reported_seq":1274,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:59.126332+0000","last_change":"2024-08-31T04:43:59.126332+0000","last_active":"2024-08-31T04:43:59.126332+0000","last_peered":"2024-08-31T04:43:59.126332+0000","last_clean":"2024-08-31T04:43:59.126332+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:43:59.126332+0000","last_undegraded":"2024-08-31T04:43:59.126332+0000","last_fullsized":"2024-08-31T04:43:59.126332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1010","last_scrub_stamp":"2024-08-31T04:43:59.126230+0000","last_deep_scrub":"48'1010","last_deep_scrub_stamp":"2024-08-31T04:43:59.126230+0000","last_clean_scrub_stamp":"2024-08-31T04:43:59.126230+0000","objects_scrubbed":56,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:24:05.247379+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21620066,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":215,"num_read_kb":746,"num_write":1006,"num_write_kb":67606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":629659,"num_omap_keys":1052,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"48'2946","reported_seq":4724,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.579621+0000","last_change":"2024-08-31T04:44:11.579621+0000","last_active":"2024-08-31T04:44:11.579621+0000","last_peered":"2024-08-31T04:44:11.579621+0000","last_clean":"2024-08-31T04:44:11.579621+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:44:11.579621+0000","last_undegraded":"2024-08-31T04:44:11.579621+0000","last_fullsized":"2024-08-31T04:44:11.579621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2946","last_scrub_stamp":"2024-08-31T04:44:11.579447+0000","last_deep_scrub":"48'2946","last_deep_scrub_stamp":"2024-08-31T04:44:11.579447+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.579447+0000","objects_scrubbed":1219,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:04.492693+0000","scrub_duration":671,"objects_trimmed":0,"snaptrim_duration":0.017565338,"stat_sum":{"num_bytes":42002217,"num_objects":1219,"num_object_clones":563,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1219,"num_whiteouts":563,"num_read":180,"num_read_kb":308227,"num_write":2428,"num_write_kb":54614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"48'2738","reported_seq":4530,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.565459+0000","last_change":"2024-08-31T04:44:16.565459+0000","last_active":"2024-08-31T04:44:16.565459+0000","last_peered":"2024-08-31T04:44:16.565459+0000","last_clean":"2024-08-31T04:44:16.565459+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:44:16.565459+0000","last_undegraded":"2024-08-31T04:44:16.565459+0000","last_fullsized":"2024-08-31T04:44:16.565459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2738","last_scrub_stamp":"2024-08-31T04:44:16.565292+0000","last_deep_scrub":"48'2738","last_deep_scrub_stamp":"2024-08-31T04:44:16.565292+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.565292+0000","objects_scrubbed":1162,"log_size":2738,"log_dups_size":0,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:18:32.865249+0000","scrub_duration":611,"objects_trimmed":0,"snaptrim_duration":0.017721323000000001,"stat_sum":{"num_bytes":29550305,"num_objects":1162,"num_object_clones":544,"num_object_copies":4648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":544,"num_read":174,"num_read_kb":171691,"num_write":2228,"num_write_kb":37428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"48'634","reported_seq":2746,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.029410+0000","last_change":"2024-08-31T04:44:05.029410+0000","last_active":"2024-08-31T04:44:05.029410+0000","last_peered":"2024-08-31T04:44:05.029410+0000","last_clean":"2024-08-31T04:44:05.029410+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:44:05.029410+0000","last_undegraded":"2024-08-31T04:44:05.029410+0000","last_fullsized":"2024-08-31T04:44:05.029410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'634","last_scrub_stamp":"2024-08-31T04:44:05.029200+0000","last_deep_scrub":"48'634","last_deep_scrub_stamp":"2024-08-31T04:44:05.029200+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.029200+0000","objects_scrubbed":33,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:31.669864+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.018675580000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"48'1921","reported_seq":2014,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.448873+0000","last_change":"2024-08-31T04:44:07.448873+0000","last_active":"2024-08-31T04:44:07.448873+0000","last_peered":"2024-08-31T04:44:07.448873+0000","last_clean":"2024-08-31T04:44:07.448873+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:44:07.448873+0000","last_undegraded":"2024-08-31T04:44:07.448873+0000","last_fullsized":"2024-08-31T04:44:07.448873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1921","last_scrub_stamp":"2024-08-31T04:44:07.448796+0000","last_deep_scrub":"48'1921","last_deep_scrub_stamp":"2024-08-31T04:44:07.448796+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.448796+0000","objects_scrubbed":53,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:41:15.969625+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1929,"num_write_kb":92217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":951852,"num_omap_keys":1509,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"48'2766","reported_seq":4539,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.371780+0000","last_change":"2024-08-31T04:44:15.371671+0000","last_active":"2024-08-31T04:44:15.371780+0000","last_peered":"2024-08-31T04:44:15.371780+0000","last_clean":"2024-08-31T04:44:15.371780+0000","last_became_active":"2024-08-31T04:04:41.417946+0000","last_became_peered":"2024-08-31T04:04:41.417946+0000","last_unstale":"2024-08-31T04:44:15.371780+0000","last_undegraded":"2024-08-31T04:44:15.371780+0000","last_fullsized":"2024-08-31T04:44:15.371780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2766","last_scrub_stamp":"2024-08-31T04:44:15.371575+0000","last_deep_scrub":"48'2766","last_deep_scrub_stamp":"2024-08-31T04:44:15.371575+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.371575+0000","objects_scrubbed":1177,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:51:27.408515+0000","scrub_duration":571,"objects_trimmed":0,"snaptrim_duration":0.00503113,"stat_sum":{"num_bytes":35643591,"num_objects":1177,"num_object_clones":542,"num_object_copies":4708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1177,"num_whiteouts":542,"num_read":159,"num_read_kb":132474,"num_write":2281,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'745","reported_seq":2851,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.287109+0000","last_change":"2024-08-31T04:44:12.287109+0000","last_active":"2024-08-31T04:44:12.287109+0000","last_peered":"2024-08-31T04:44:12.287109+0000","last_clean":"2024-08-31T04:44:12.287109+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:44:12.287109+0000","last_undegraded":"2024-08-31T04:44:12.287109+0000","last_fullsized":"2024-08-31T04:44:12.287109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'745","last_scrub_stamp":"2024-08-31T04:44:12.286949+0000","last_deep_scrub":"48'745","last_deep_scrub_stamp":"2024-08-31T04:44:12.286949+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.286949+0000","objects_scrubbed":41,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:49:09.153249+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.014046813,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"48'704","reported_seq":797,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.933849+0000","last_change":"2024-08-31T04:44:02.933849+0000","last_active":"2024-08-31T04:44:02.933849+0000","last_peered":"2024-08-31T04:44:02.933849+0000","last_clean":"2024-08-31T04:44:02.933849+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:44:02.933849+0000","last_undegraded":"2024-08-31T04:44:02.933849+0000","last_fullsized":"2024-08-31T04:44:02.933849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'704","last_scrub_stamp":"2024-08-31T04:44:02.933628+0000","last_deep_scrub":"48'704","last_deep_scrub_stamp":"2024-08-31T04:44:02.933628+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.933628+0000","objects_scrubbed":59,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:43:25.369219+0000","scrub_duration":147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":715,"num_write_kb":62992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":875547,"num_omap_keys":1531,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"48'2303","reported_seq":2396,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.457237+0000","last_change":"2024-08-31T04:44:06.457237+0000","last_active":"2024-08-31T04:44:06.457237+0000","last_peered":"2024-08-31T04:44:06.457237+0000","last_clean":"2024-08-31T04:44:06.457237+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:44:06.457237+0000","last_undegraded":"2024-08-31T04:44:06.457237+0000","last_fullsized":"2024-08-31T04:44:06.457237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2303","last_scrub_stamp":"2024-08-31T04:44:06.457084+0000","last_deep_scrub":"48'2303","last_deep_scrub_stamp":"2024-08-31T04:44:06.457084+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.457084+0000","objects_scrubbed":51,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:49.770580+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2298,"num_write_kb":79805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":581696,"num_omap_keys":975,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'652","reported_seq":2759,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.005654+0000","last_change":"2024-08-31T04:44:06.005654+0000","last_active":"2024-08-31T04:44:06.005654+0000","last_peered":"2024-08-31T04:44:06.005654+0000","last_clean":"2024-08-31T04:44:06.005654+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:44:06.005654+0000","last_undegraded":"2024-08-31T04:44:06.005654+0000","last_fullsized":"2024-08-31T04:44:06.005654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'652","last_scrub_stamp":"2024-08-31T04:44:06.005491+0000","last_deep_scrub":"48'652","last_deep_scrub_stamp":"2024-08-31T04:44:06.005491+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.005491+0000","objects_scrubbed":40,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:09.157917+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.013275207000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":11,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"48'2940","reported_seq":4687,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:17.459626+0000","last_change":"2024-08-31T04:44:17.459626+0000","last_active":"2024-08-31T04:44:17.459626+0000","last_peered":"2024-08-31T04:44:17.459626+0000","last_clean":"2024-08-31T04:44:17.459626+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:44:17.459626+0000","last_undegraded":"2024-08-31T04:44:17.459626+0000","last_fullsized":"2024-08-31T04:44:17.459626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2940","last_scrub_stamp":"2024-08-31T04:44:17.459517+0000","last_deep_scrub":"48'2940","last_deep_scrub_stamp":"2024-08-31T04:44:17.459517+0000","last_clean_scrub_stamp":"2024-08-31T04:44:17.459517+0000","objects_scrubbed":1259,"log_size":2940,"log_dups_size":0,"ondisk_log_size":2940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:49.023301+0000","scrub_duration":555,"objects_trimmed":0,"snaptrim_duration":0.016882483,"stat_sum":{"num_bytes":22283462,"num_objects":1259,"num_object_clones":585,"num_object_copies":5036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1259,"num_whiteouts":585,"num_read":170,"num_read_kb":61710,"num_write":2408,"num_write_kb":31485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"48'1176","reported_seq":1268,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.349149+0000","last_change":"2024-08-31T04:44:06.349149+0000","last_active":"2024-08-31T04:44:06.349149+0000","last_peered":"2024-08-31T04:44:06.349149+0000","last_clean":"2024-08-31T04:44:06.349149+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:44:06.349149+0000","last_undegraded":"2024-08-31T04:44:06.349149+0000","last_fullsized":"2024-08-31T04:44:06.349149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1176","last_scrub_stamp":"2024-08-31T04:44:06.349029+0000","last_deep_scrub":"48'1176","last_deep_scrub_stamp":"2024-08-31T04:44:06.349029+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.349029+0000","objects_scrubbed":46,"log_size":1176,"log_dups_size":0,"ondisk_log_size":1176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:27.884469+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1166,"num_write_kb":91251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":358024,"num_omap_keys":600,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"48'684","reported_seq":2792,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.047048+0000","last_change":"2024-08-31T04:44:02.047048+0000","last_active":"2024-08-31T04:44:02.047048+0000","last_peered":"2024-08-31T04:44:02.047048+0000","last_clean":"2024-08-31T04:44:02.047048+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:44:02.047048+0000","last_undegraded":"2024-08-31T04:44:02.047048+0000","last_fullsized":"2024-08-31T04:44:02.047048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'684","last_scrub_stamp":"2024-08-31T04:44:02.046977+0000","last_deep_scrub":"48'684","last_deep_scrub_stamp":"2024-08-31T04:44:02.046977+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.046977+0000","objects_scrubbed":50,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:02.397018+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0038995560000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"48'2848","reported_seq":4629,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.222550+0000","last_change":"2024-08-31T04:44:12.222550+0000","last_active":"2024-08-31T04:44:12.222550+0000","last_peered":"2024-08-31T04:44:12.222550+0000","last_clean":"2024-08-31T04:44:12.222550+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:44:12.222550+0000","last_undegraded":"2024-08-31T04:44:12.222550+0000","last_fullsized":"2024-08-31T04:44:12.222550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2848","last_scrub_stamp":"2024-08-31T04:44:12.222418+0000","last_deep_scrub":"48'2848","last_deep_scrub_stamp":"2024-08-31T04:44:12.222418+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.222418+0000","objects_scrubbed":1228,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:11:03.580339+0000","scrub_duration":699,"objects_trimmed":0,"snaptrim_duration":0.0065935439999999998,"stat_sum":{"num_bytes":37885613,"num_objects":1228,"num_object_clones":569,"num_object_copies":4912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1228,"num_whiteouts":569,"num_read":190,"num_read_kb":257974,"num_write":2324,"num_write_kb":54067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"48'687","reported_seq":2794,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.725904+0000","last_change":"2024-08-31T04:44:01.725904+0000","last_active":"2024-08-31T04:44:01.725904+0000","last_peered":"2024-08-31T04:44:01.725904+0000","last_clean":"2024-08-31T04:44:01.725904+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:44:01.725904+0000","last_undegraded":"2024-08-31T04:44:01.725904+0000","last_fullsized":"2024-08-31T04:44:01.725904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'687","last_scrub_stamp":"2024-08-31T04:44:01.725836+0000","last_deep_scrub":"48'687","last_deep_scrub_stamp":"2024-08-31T04:44:01.725836+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.725836+0000","objects_scrubbed":50,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:43:03.505141+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0.0078040410000000003,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":15,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"48'705","reported_seq":2817,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.624556+0000","last_change":"2024-08-31T04:44:05.624556+0000","last_active":"2024-08-31T04:44:05.624556+0000","last_peered":"2024-08-31T04:44:05.624556+0000","last_clean":"2024-08-31T04:44:05.624556+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:44:05.624556+0000","last_undegraded":"2024-08-31T04:44:05.624556+0000","last_fullsized":"2024-08-31T04:44:05.624556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'705","last_scrub_stamp":"2024-08-31T04:44:05.624284+0000","last_deep_scrub":"48'705","last_deep_scrub_stamp":"2024-08-31T04:44:05.624284+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.624284+0000","objects_scrubbed":47,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:09:18.409305+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0.0060576730000000004,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":9,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"48'669","reported_seq":2782,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.410804+0000","last_change":"2024-08-31T04:44:16.410804+0000","last_active":"2024-08-31T04:44:16.410804+0000","last_peered":"2024-08-31T04:44:16.410804+0000","last_clean":"2024-08-31T04:44:16.410804+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:44:16.410804+0000","last_undegraded":"2024-08-31T04:44:16.410804+0000","last_fullsized":"2024-08-31T04:44:16.410804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'669","last_scrub_stamp":"2024-08-31T04:44:16.410685+0000","last_deep_scrub":"48'669","last_deep_scrub_stamp":"2024-08-31T04:44:16.410685+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.410685+0000","objects_scrubbed":43,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:49.699642+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0067294099999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":8,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"48'712","reported_seq":2820,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.363283+0000","last_change":"2024-08-31T04:44:08.363283+0000","last_active":"2024-08-31T04:44:08.363283+0000","last_peered":"2024-08-31T04:44:08.363283+0000","last_clean":"2024-08-31T04:44:08.363283+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:44:08.363283+0000","last_undegraded":"2024-08-31T04:44:08.363283+0000","last_fullsized":"2024-08-31T04:44:08.363283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'712","last_scrub_stamp":"2024-08-31T04:44:08.363144+0000","last_deep_scrub":"48'712","last_deep_scrub_stamp":"2024-08-31T04:44:08.363144+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.363144+0000","objects_scrubbed":50,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:16.974434+0000","scrub_duration":131,"objects_trimmed":0,"snaptrim_duration":0.01443145,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"48'660","reported_seq":2768,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.933735+0000","last_change":"2024-08-31T04:44:07.933735+0000","last_active":"2024-08-31T04:44:07.933735+0000","last_peered":"2024-08-31T04:44:07.933735+0000","last_clean":"2024-08-31T04:44:07.933735+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:44:07.933735+0000","last_undegraded":"2024-08-31T04:44:07.933735+0000","last_fullsized":"2024-08-31T04:44:07.933735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'660","last_scrub_stamp":"2024-08-31T04:44:07.933459+0000","last_deep_scrub":"48'660","last_deep_scrub_stamp":"2024-08-31T04:44:07.933459+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.933459+0000","objects_scrubbed":46,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:37.450965+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.024833572000000002,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'632","reported_seq":2745,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.871118+0000","last_change":"2024-08-31T04:44:08.871118+0000","last_active":"2024-08-31T04:44:08.871118+0000","last_peered":"2024-08-31T04:44:08.871118+0000","last_clean":"2024-08-31T04:44:08.871118+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:44:08.871118+0000","last_undegraded":"2024-08-31T04:44:08.871118+0000","last_fullsized":"2024-08-31T04:44:08.871118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'632","last_scrub_stamp":"2024-08-31T04:44:08.870999+0000","last_deep_scrub":"48'632","last_deep_scrub_stamp":"2024-08-31T04:44:08.870999+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.870999+0000","objects_scrubbed":37,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:05.076239+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0.024839776000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"48'697","reported_seq":2809,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.754758+0000","last_change":"2024-08-31T04:44:09.754758+0000","last_active":"2024-08-31T04:44:09.754758+0000","last_peered":"2024-08-31T04:44:09.754758+0000","last_clean":"2024-08-31T04:44:09.754758+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:44:09.754758+0000","last_undegraded":"2024-08-31T04:44:09.754758+0000","last_fullsized":"2024-08-31T04:44:09.754758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'697","last_scrub_stamp":"2024-08-31T04:44:09.754616+0000","last_deep_scrub":"48'697","last_deep_scrub_stamp":"2024-08-31T04:44:09.754616+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.754616+0000","objects_scrubbed":46,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:23.112793+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0060308059999999997,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"48'634","reported_seq":2748,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.262101+0000","last_change":"2024-08-31T04:44:11.262101+0000","last_active":"2024-08-31T04:44:11.262101+0000","last_peered":"2024-08-31T04:44:11.262101+0000","last_clean":"2024-08-31T04:44:11.262101+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:44:11.262101+0000","last_undegraded":"2024-08-31T04:44:11.262101+0000","last_fullsized":"2024-08-31T04:44:11.262101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'634","last_scrub_stamp":"2024-08-31T04:44:11.261975+0000","last_deep_scrub":"48'634","last_deep_scrub_stamp":"2024-08-31T04:44:11.261975+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.261975+0000","objects_scrubbed":41,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:33:19.363836+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.012931465,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":6,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"48'665","reported_seq":2774,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:17.438996+0000","last_change":"2024-08-31T04:44:17.438996+0000","last_active":"2024-08-31T04:44:17.438996+0000","last_peered":"2024-08-31T04:44:17.438996+0000","last_clean":"2024-08-31T04:44:17.438996+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:44:17.438996+0000","last_undegraded":"2024-08-31T04:44:17.438996+0000","last_fullsized":"2024-08-31T04:44:17.438996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'665","last_scrub_stamp":"2024-08-31T04:44:17.438904+0000","last_deep_scrub":"48'665","last_deep_scrub_stamp":"2024-08-31T04:44:17.438904+0000","last_clean_scrub_stamp":"2024-08-31T04:44:17.438904+0000","objects_scrubbed":42,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:09:00.418951+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0062469689999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"48'623","reported_seq":2736,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:17.339994+0000","last_change":"2024-08-31T04:44:17.339994+0000","last_active":"2024-08-31T04:44:17.339994+0000","last_peered":"2024-08-31T04:44:17.339994+0000","last_clean":"2024-08-31T04:44:17.339994+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:44:17.339994+0000","last_undegraded":"2024-08-31T04:44:17.339994+0000","last_fullsized":"2024-08-31T04:44:17.339994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'623","last_scrub_stamp":"2024-08-31T04:44:17.339868+0000","last_deep_scrub":"48'623","last_deep_scrub_stamp":"2024-08-31T04:44:17.339868+0000","last_clean_scrub_stamp":"2024-08-31T04:44:17.339868+0000","objects_scrubbed":31,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:51.959756+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.011311599,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"48'696","reported_seq":2803,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.032967+0000","last_change":"2024-08-31T04:44:05.032967+0000","last_active":"2024-08-31T04:44:05.032967+0000","last_peered":"2024-08-31T04:44:05.032967+0000","last_clean":"2024-08-31T04:44:05.032967+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:44:05.032967+0000","last_undegraded":"2024-08-31T04:44:05.032967+0000","last_fullsized":"2024-08-31T04:44:05.032967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'696","last_scrub_stamp":"2024-08-31T04:44:05.032875+0000","last_deep_scrub":"48'696","last_deep_scrub_stamp":"2024-08-31T04:44:05.032875+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.032875+0000","objects_scrubbed":45,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:25.676913+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0035095819999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"48'655","reported_seq":2766,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.007998+0000","last_change":"2024-08-31T04:44:12.007998+0000","last_active":"2024-08-31T04:44:12.007998+0000","last_peered":"2024-08-31T04:44:12.007998+0000","last_clean":"2024-08-31T04:44:12.007998+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:44:12.007998+0000","last_undegraded":"2024-08-31T04:44:12.007998+0000","last_fullsized":"2024-08-31T04:44:12.007998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'655","last_scrub_stamp":"2024-08-31T04:44:12.007886+0000","last_deep_scrub":"48'655","last_deep_scrub_stamp":"2024-08-31T04:44:12.007886+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.007886+0000","objects_scrubbed":42,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:22.376497+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0055677180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"48'685","reported_seq":2792,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.850785+0000","last_change":"2024-08-31T04:44:09.850785+0000","last_active":"2024-08-31T04:44:09.850785+0000","last_peered":"2024-08-31T04:44:09.850785+0000","last_clean":"2024-08-31T04:44:09.850785+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:44:09.850785+0000","last_undegraded":"2024-08-31T04:44:09.850785+0000","last_fullsized":"2024-08-31T04:44:09.850785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'685","last_scrub_stamp":"2024-08-31T04:44:09.850685+0000","last_deep_scrub":"48'685","last_deep_scrub_stamp":"2024-08-31T04:44:09.850685+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.850685+0000","objects_scrubbed":42,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:15.355476+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0047976060000000003,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"48'694","reported_seq":2804,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:18.432919+0000","last_change":"2024-08-31T04:44:18.432919+0000","last_active":"2024-08-31T04:44:18.432919+0000","last_peered":"2024-08-31T04:44:18.432919+0000","last_clean":"2024-08-31T04:44:18.432919+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:44:18.432919+0000","last_undegraded":"2024-08-31T04:44:18.432919+0000","last_fullsized":"2024-08-31T04:44:18.432919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'694","last_scrub_stamp":"2024-08-31T04:44:18.432853+0000","last_deep_scrub":"48'694","last_deep_scrub_stamp":"2024-08-31T04:44:18.432853+0000","last_clean_scrub_stamp":"2024-08-31T04:44:18.432853+0000","objects_scrubbed":50,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:48.770758+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0.0066178469999999996,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"48'635","reported_seq":2743,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.558741+0000","last_change":"2024-08-31T04:44:06.558741+0000","last_active":"2024-08-31T04:44:06.558741+0000","last_peered":"2024-08-31T04:44:06.558741+0000","last_clean":"2024-08-31T04:44:06.558741+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:44:06.558741+0000","last_undegraded":"2024-08-31T04:44:06.558741+0000","last_fullsized":"2024-08-31T04:44:06.558741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'635","last_scrub_stamp":"2024-08-31T04:44:06.558583+0000","last_deep_scrub":"48'635","last_deep_scrub_stamp":"2024-08-31T04:44:06.558583+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.558583+0000","objects_scrubbed":41,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:47.605266+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.0050893520000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"48'682","reported_seq":2795,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:19.426287+0000","last_change":"2024-08-31T04:44:19.426287+0000","last_active":"2024-08-31T04:44:19.426287+0000","last_peered":"2024-08-31T04:44:19.426287+0000","last_clean":"2024-08-31T04:44:19.426287+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:44:19.426287+0000","last_undegraded":"2024-08-31T04:44:19.426287+0000","last_fullsized":"2024-08-31T04:44:19.426287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'682","last_scrub_stamp":"2024-08-31T04:44:19.426165+0000","last_deep_scrub":"48'682","last_deep_scrub_stamp":"2024-08-31T04:44:19.426165+0000","last_clean_scrub_stamp":"2024-08-31T04:44:19.426165+0000","objects_scrubbed":45,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:19:39.438129+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0068720639999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":6,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"48'645","reported_seq":2757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:20.392557+0000","last_change":"2024-08-31T04:44:20.392557+0000","last_active":"2024-08-31T04:44:20.392557+0000","last_peered":"2024-08-31T04:44:20.392557+0000","last_clean":"2024-08-31T04:44:20.392557+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:44:20.392557+0000","last_undegraded":"2024-08-31T04:44:20.392557+0000","last_fullsized":"2024-08-31T04:44:20.392557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'645","last_scrub_stamp":"2024-08-31T04:44:20.392462+0000","last_deep_scrub":"48'645","last_deep_scrub_stamp":"2024-08-31T04:44:20.392462+0000","last_clean_scrub_stamp":"2024-08-31T04:44:20.392462+0000","objects_scrubbed":32,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:24:21.149306+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0059141749999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":7,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"48'703","reported_seq":2811,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.306586+0000","last_change":"2024-08-31T04:44:13.306586+0000","last_active":"2024-08-31T04:44:13.306586+0000","last_peered":"2024-08-31T04:44:13.306586+0000","last_clean":"2024-08-31T04:44:13.306586+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:44:13.306586+0000","last_undegraded":"2024-08-31T04:44:13.306586+0000","last_fullsized":"2024-08-31T04:44:13.306586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'703","last_scrub_stamp":"2024-08-31T04:44:13.306485+0000","last_deep_scrub":"48'703","last_deep_scrub_stamp":"2024-08-31T04:44:13.306485+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.306485+0000","objects_scrubbed":52,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:38.445717+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0098583990000000003,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"48'675","reported_seq":2783,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.934441+0000","last_change":"2024-08-31T04:44:09.934441+0000","last_active":"2024-08-31T04:44:09.934441+0000","last_peered":"2024-08-31T04:44:09.934441+0000","last_clean":"2024-08-31T04:44:09.934441+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:44:09.934441+0000","last_undegraded":"2024-08-31T04:44:09.934441+0000","last_fullsized":"2024-08-31T04:44:09.934441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'675","last_scrub_stamp":"2024-08-31T04:44:09.934271+0000","last_deep_scrub":"48'675","last_deep_scrub_stamp":"2024-08-31T04:44:09.934271+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.934271+0000","objects_scrubbed":53,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:05.286963+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0.023950035000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":12,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"48'639","reported_seq":2748,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.909998+0000","last_change":"2024-08-31T04:44:10.909998+0000","last_active":"2024-08-31T04:44:10.909998+0000","last_peered":"2024-08-31T04:44:10.909998+0000","last_clean":"2024-08-31T04:44:10.909998+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:44:10.909998+0000","last_undegraded":"2024-08-31T04:44:10.909998+0000","last_fullsized":"2024-08-31T04:44:10.909998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'639","last_scrub_stamp":"2024-08-31T04:44:10.909854+0000","last_deep_scrub":"48'639","last_deep_scrub_stamp":"2024-08-31T04:44:10.909854+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.909854+0000","objects_scrubbed":40,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:55:03.007424+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.025118893999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'639","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.853881+0000","last_change":"2024-08-31T04:44:13.853881+0000","last_active":"2024-08-31T04:44:13.853881+0000","last_peered":"2024-08-31T04:44:13.853881+0000","last_clean":"2024-08-31T04:44:13.853881+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:44:13.853881+0000","last_undegraded":"2024-08-31T04:44:13.853881+0000","last_fullsized":"2024-08-31T04:44:13.853881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'639","last_scrub_stamp":"2024-08-31T04:44:13.853741+0000","last_deep_scrub":"48'639","last_deep_scrub_stamp":"2024-08-31T04:44:13.853741+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.853741+0000","objects_scrubbed":40,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:26.326387+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0051269660000000002,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"48'674","reported_seq":2779,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.902115+0000","last_change":"2024-08-31T04:44:08.902115+0000","last_active":"2024-08-31T04:44:08.902115+0000","last_peered":"2024-08-31T04:44:08.902115+0000","last_clean":"2024-08-31T04:44:08.902115+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:44:08.902115+0000","last_undegraded":"2024-08-31T04:44:08.902115+0000","last_fullsized":"2024-08-31T04:44:08.902115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'674","last_scrub_stamp":"2024-08-31T04:44:08.902014+0000","last_deep_scrub":"48'674","last_deep_scrub_stamp":"2024-08-31T04:44:08.902014+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.902014+0000","objects_scrubbed":47,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:21.876412+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.0045307300000000002,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"48'630","reported_seq":2737,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.840078+0000","last_change":"2024-08-31T04:44:10.840078+0000","last_active":"2024-08-31T04:44:10.840078+0000","last_peered":"2024-08-31T04:44:10.840078+0000","last_clean":"2024-08-31T04:44:10.840078+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:44:10.840078+0000","last_undegraded":"2024-08-31T04:44:10.840078+0000","last_fullsized":"2024-08-31T04:44:10.840078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'630","last_scrub_stamp":"2024-08-31T04:44:10.839976+0000","last_deep_scrub":"48'630","last_deep_scrub_stamp":"2024-08-31T04:44:10.839976+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.839976+0000","objects_scrubbed":45,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:42:29.058949+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0053663419999999996,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"48'675","reported_seq":2783,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.026083+0000","last_change":"2024-08-31T04:44:03.026083+0000","last_active":"2024-08-31T04:44:03.026083+0000","last_peered":"2024-08-31T04:44:03.026083+0000","last_clean":"2024-08-31T04:44:03.026083+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:44:03.026083+0000","last_undegraded":"2024-08-31T04:44:03.026083+0000","last_fullsized":"2024-08-31T04:44:03.026083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'675","last_scrub_stamp":"2024-08-31T04:44:03.025958+0000","last_deep_scrub":"48'675","last_deep_scrub_stamp":"2024-08-31T04:44:03.025958+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.025958+0000","objects_scrubbed":44,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:43.460581+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.003298704,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"48'621","reported_seq":2731,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.291553+0000","last_change":"2024-08-31T04:44:14.291553+0000","last_active":"2024-08-31T04:44:14.291553+0000","last_peered":"2024-08-31T04:44:14.291553+0000","last_clean":"2024-08-31T04:44:14.291553+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:44:14.291553+0000","last_undegraded":"2024-08-31T04:44:14.291553+0000","last_fullsized":"2024-08-31T04:44:14.291553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'621","last_scrub_stamp":"2024-08-31T04:44:14.291447+0000","last_deep_scrub":"48'621","last_deep_scrub_stamp":"2024-08-31T04:44:14.291447+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.291447+0000","objects_scrubbed":40,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:23.904155+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.0091212849999999998,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'662","reported_seq":2769,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.846368+0000","last_change":"2024-08-31T04:44:16.846368+0000","last_active":"2024-08-31T04:44:16.846368+0000","last_peered":"2024-08-31T04:44:16.846368+0000","last_clean":"2024-08-31T04:44:16.846368+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:44:16.846368+0000","last_undegraded":"2024-08-31T04:44:16.846368+0000","last_fullsized":"2024-08-31T04:44:16.846368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'662","last_scrub_stamp":"2024-08-31T04:44:16.846296+0000","last_deep_scrub":"48'662","last_deep_scrub_stamp":"2024-08-31T04:44:16.846296+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.846296+0000","objects_scrubbed":50,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:48.980036+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0.0020846939999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"48'638","reported_seq":2743,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.718446+0000","last_change":"2024-08-31T04:44:02.718446+0000","last_active":"2024-08-31T04:44:02.718446+0000","last_peered":"2024-08-31T04:44:02.718446+0000","last_clean":"2024-08-31T04:44:02.718446+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:44:02.718446+0000","last_undegraded":"2024-08-31T04:44:02.718446+0000","last_fullsized":"2024-08-31T04:44:02.718446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'638","last_scrub_stamp":"2024-08-31T04:44:02.718335+0000","last_deep_scrub":"48'638","last_deep_scrub_stamp":"2024-08-31T04:44:02.718335+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.718335+0000","objects_scrubbed":45,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:02.390529+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.0079797440000000004,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":13,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"48'729","reported_seq":2829,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.862359+0000","last_change":"2024-08-31T04:44:11.862359+0000","last_active":"2024-08-31T04:44:11.862359+0000","last_peered":"2024-08-31T04:44:11.862359+0000","last_clean":"2024-08-31T04:44:11.862359+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:44:11.862359+0000","last_undegraded":"2024-08-31T04:44:11.862359+0000","last_fullsized":"2024-08-31T04:44:11.862359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'729","last_scrub_stamp":"2024-08-31T04:44:11.862271+0000","last_deep_scrub":"48'729","last_deep_scrub_stamp":"2024-08-31T04:44:11.862271+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.862271+0000","objects_scrubbed":63,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:16.766331+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0.0047669089999999997,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":19,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":19,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"48'662","reported_seq":2779,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.734665+0000","last_change":"2024-08-31T04:44:03.734605+0000","last_active":"2024-08-31T04:44:03.734665+0000","last_peered":"2024-08-31T04:44:03.734665+0000","last_clean":"2024-08-31T04:44:03.734665+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:44:03.734665+0000","last_undegraded":"2024-08-31T04:44:03.734665+0000","last_fullsized":"2024-08-31T04:44:03.734665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'662","last_scrub_stamp":"2024-08-31T04:44:03.734529+0000","last_deep_scrub":"48'662","last_deep_scrub_stamp":"2024-08-31T04:44:03.734529+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.734529+0000","objects_scrubbed":38,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:41:38.888910+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0063128230000000004,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":5,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":5,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"48'674","reported_seq":2786,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.305191+0000","last_change":"2024-08-31T04:44:15.305191+0000","last_active":"2024-08-31T04:44:15.305191+0000","last_peered":"2024-08-31T04:44:15.305191+0000","last_clean":"2024-08-31T04:44:15.305191+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:44:15.305191+0000","last_undegraded":"2024-08-31T04:44:15.305191+0000","last_fullsized":"2024-08-31T04:44:15.305191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'674","last_scrub_stamp":"2024-08-31T04:44:15.305078+0000","last_deep_scrub":"48'674","last_deep_scrub_stamp":"2024-08-31T04:44:15.305078+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.305078+0000","objects_scrubbed":50,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:06:27.562700+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.013845079999999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"48'622","reported_seq":2734,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.316665+0000","last_change":"2024-08-31T04:44:16.316665+0000","last_active":"2024-08-31T04:44:16.316665+0000","last_peered":"2024-08-31T04:44:16.316665+0000","last_clean":"2024-08-31T04:44:16.316665+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:44:16.316665+0000","last_undegraded":"2024-08-31T04:44:16.316665+0000","last_fullsized":"2024-08-31T04:44:16.316665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'622","last_scrub_stamp":"2024-08-31T04:44:16.316513+0000","last_deep_scrub":"48'622","last_deep_scrub_stamp":"2024-08-31T04:44:16.316513+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.316513+0000","objects_scrubbed":38,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:46:10.952487+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.012861716,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"48'659","reported_seq":2766,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.887396+0000","last_change":"2024-08-31T04:44:12.887396+0000","last_active":"2024-08-31T04:44:12.887396+0000","last_peered":"2024-08-31T04:44:12.887396+0000","last_clean":"2024-08-31T04:44:12.887396+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:44:12.887396+0000","last_undegraded":"2024-08-31T04:44:12.887396+0000","last_fullsized":"2024-08-31T04:44:12.887396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'659","last_scrub_stamp":"2024-08-31T04:44:12.887281+0000","last_deep_scrub":"48'659","last_deep_scrub_stamp":"2024-08-31T04:44:12.887281+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.887281+0000","objects_scrubbed":58,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:59.457891+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0048876299999999996,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1171046334,"num_objects":39264,"num_object_clones":18317,"num_object_copies":157056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39264,"num_whiteouts":18141,"num_read":5774,"num_read_kb":6778394,"num_write":75481,"num_write_kb":1474785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2548367360,"data_stored":2549710848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92337,"ondisk_log_size":92337,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":2792,"num_object_clones":669,"num_object_copies":5584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2792,"num_whiteouts":669,"num_read":0,"num_read_kb":0,"num_write":2800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42433,"ondisk_log_size":42433,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":830797057,"num_objects":1713,"num_object_clones":0,"num_object_copies":3426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1713,"num_whiteouts":0,"num_read":2588,"num_read_kb":5535,"num_write":35395,"num_write_kb":2443316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19620823,"num_omap_keys":33909,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1661657088,"data_stored":1661594114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33331,"ondisk_log_size":33331,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477226,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1001140,"kb_used_data":627236,"kb_used_omap":1,"kb_used_meta":373886,"kb_avail":93370700,"statfs":{"total":96636764160,"available":95611596800,"internally_reserved":0,"allocated":642289664,"data_stored":642188380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":382859719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477226,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":638272,"kb_used_data":418288,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93733568,"statfs":{"total":96636764160,"available":95983173632,"internally_reserved":0,"allocated":428326912,"data_stored":428055527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477227,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":861352,"kb_used_data":569176,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93510488,"statfs":{"total":96636764160,"available":95754739712,"internally_reserved":0,"allocated":582836224,"data_stored":582730273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299170245},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477227,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":817520,"kb_used_data":525408,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93554320,"statfs":{"total":96636764160,"available":95799623680,"internally_reserved":0,"allocated":538017792,"data_stored":537913727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509929,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":696196,"kb_used_data":458228,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":93675644,"statfs":{"total":96636764160,"available":95923859456,"internally_reserved":0,"allocated":469225472,"data_stored":469129543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243661254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509930,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":761836,"kb_used_data":487772,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93610004,"statfs":{"total":96636764160,"available":95856644096,"internally_reserved":0,"allocated":499478528,"data_stored":499539157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509929,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":815596,"kb_used_data":549852,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":93556244,"statfs":{"total":96636764160,"available":95801593856,"internally_reserved":0,"allocated":563048448,"data_stored":563100856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272103877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575337,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":742488,"kb_used_data":480840,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93629352,"statfs":{"total":96636764160,"available":95876456448,"internally_reserved":0,"allocated":492380160,"data_stored":492108227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":314580992,"data_stored":314572856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":201986048,"data_stored":201979578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":113254400,"data_stored":113246880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":284889088,"data_stored":284883733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":243609600,"data_stored":243590001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":226504704,"data_stored":226496878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":138412032,"data_stored":138412032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":138420224,"data_stored":138412156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":222887936,"data_stored":223055872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":379707392,"data_stored":379875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":314523648,"data_stored":314523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":356851712,"data_stored":357019648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":318889984,"data_stored":319225856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":271831040,"data_stored":272166912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":330264576,"data_stored":330432512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":353411072,"data_stored":353411072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:44:23.202 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:23.203 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:23.203 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:23.203 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:23.203 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:23.204 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-08-31T04:04:03.880244+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=4, tm_sec=3, tm_wday=5, tm_yday=244, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=31, tm_hour=4, tm_min=43, tm_sec=56, tm_wday=5, tm_yday=244, tm_isdst=0) 2024-08-31T04:44:23.204 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-31T04:44:24.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:44:24.971 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:44:43.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T04:44:43.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.370+0000 7f2fb6000640 1 -- 172.21.15.89:0/1420551478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f94004810 msgr2=0x7f2f94004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.370+0000 7f2fb6000640 1 --2- 172.21.15.89:0/1420551478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f94004810 0x7f2f94004c20 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009b60 tx=0x7f2f9801d340 comp rx=0 tx=0).stop 2024-08-31T04:44:43.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.370+0000 7f2fafe00640 1 -- 172.21.15.89:0/1420551478 reap_dead start 2024-08-31T04:44:43.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.370+0000 7f2fb6000640 1 -- 172.21.15.89:0/1420551478 shutdown_connections 2024-08-31T04:44:43.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.370+0000 7f2fb6000640 1 -- 172.21.15.89:0/1420551478 >> 172.21.15.89:0/1420551478 conn(0x7f2fb00ccf20 msgr2=0x7f2fb00cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:43.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.370+0000 7f2fb6000640 1 -- 172.21.15.89:0/1420551478 shutdown_connections 2024-08-31T04:44:43.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.370+0000 7f2fb6000640 1 -- 172.21.15.89:0/1420551478 wait complete. 2024-08-31T04:44:43.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 Processor -- start 2024-08-31T04:44:43.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 -- start start 2024-08-31T04:44:43.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f94004810 0x7f2fb01f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:43.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb014fb80 0x7f2fb00b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:43.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb014ff90 0x7f2fb0157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:43.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00c8030 con 0x7f2f94004810 2024-08-31T04:44:43.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00c3150 con 0x7f2fb014ff90 2024-08-31T04:44:43.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb0073610 con 0x7f2fb014fb80 2024-08-31T04:44:43.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2faf400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f94004810 0x7f2fb01f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:43.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2faf400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f94004810 0x7f2fb01f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40554/0 (socket says 172.21.15.89:40554) 2024-08-31T04:44:43.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2faf400640 1 -- 172.21.15.89:0/2013335005 learned_addr learned my addr 172.21.15.89:0/2013335005 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:43.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fa6a00640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb014fb80 0x7f2fb00b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:43.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fafe00640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb014ff90 0x7f2fb0157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:43.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2faf400640 1 -- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb014fb80 msgr2=0x7f2fb00b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2faf400640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb014fb80 0x7f2fb00b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2faf400640 1 -- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb014ff90 msgr2=0x7f2fb0157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2faf400640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb014ff90 0x7f2fb0157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2faf400640 1 -- 172.21.15.89:0/2013335005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb01f5a70 con 0x7f2f94004810 2024-08-31T04:44:43.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2faf400640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f94004810 0x7f2fb01f5530 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0001410 tx=0x7f2fa00039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:43.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fa7e00640 1 -- 172.21.15.89:0/2013335005 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0015070 con 0x7f2f94004810 2024-08-31T04:44:43.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fa7e00640 1 -- 172.21.15.89:0/2013335005 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fa0011840 con 0x7f2f94004810 2024-08-31T04:44:43.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb015b800 con 0x7f2f94004810 2024-08-31T04:44:43.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fa7e00640 1 -- 172.21.15.89:0/2013335005 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0011c70 con 0x7f2f94004810 2024-08-31T04:44:43.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.374+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb01f22f0 con 0x7f2f94004810 2024-08-31T04:44:43.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.378+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb00c82f0 con 0x7f2f94004810 2024-08-31T04:44:43.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.378+0000 7f2fa7e00640 1 -- 172.21.15.89:0/2013335005 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f2fa0018070 con 0x7f2f94004810 2024-08-31T04:44:43.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.378+0000 7f2fa7e00640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f8c0720c0 0x7f2f8c0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:43.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.378+0000 7f2fa7e00640 1 -- 172.21.15.89:0/2013335005 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f2fa0093ca0 con 0x7f2f94004810 2024-08-31T04:44:43.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.378+0000 7f2fa6a00640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f8c0720c0 0x7f2f8c0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:43.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.382+0000 7f2fa6a00640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f8c0720c0 0x7f2f8c0745d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2f980af000 tx=0x7f2f94005840 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:43.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.382+0000 7f2fa7e00640 1 -- 172.21.15.89:0/2013335005 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2fa005f210 con 0x7f2f94004810 2024-08-31T04:44:43.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.546+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 --> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fb0073ab0 con 0x7f2f8c0720c0 2024-08-31T04:44:43.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.562+0000 7f2fa7e00640 1 -- 172.21.15.89:0/2013335005 <== mgr.4103 v2:172.21.15.170:6800/2607723370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339563 (secure 0 0 0) 0x7f2fb0073ab0 con 0x7f2f8c0720c0 2024-08-31T04:44:43.569 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:44:43.571 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-08-31T04:44:43.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f8c0720c0 msgr2=0x7f2f8c0745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f8c0720c0 0x7f2f8c0745d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2f980af000 tx=0x7f2f94005840 comp rx=0 tx=0).stop 2024-08-31T04:44:43.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f94004810 msgr2=0x7f2fb01f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f94004810 0x7f2fb01f5530 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0001410 tx=0x7f2fa00039d0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 shutdown_connections 2024-08-31T04:44:43.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f2f8c0720c0 0x7f2f8c0745d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb014ff90 0x7f2fb0157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb014fb80 0x7f2fb00b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 --2- 172.21.15.89:0/2013335005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f94004810 0x7f2fb01f5530 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 >> 172.21.15.89:0/2013335005 conn(0x7f2fb00ccf20 msgr2=0x7f2fb00b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:43.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 shutdown_connections 2024-08-31T04:44:43.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.566+0000 7f2fb6000640 1 -- 172.21.15.89:0/2013335005 wait complete. 2024-08-31T04:44:43.589 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1269,"stamp":"2024-08-31T04:44:43.314265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2002433759,"num_objects":43771,"num_object_clones":18986,"num_object_copies":166070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43771,"num_whiteouts":18810,"num_read":8428,"num_read_kb":6783984,"num_write":113777,"num_write_kb":3919729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19620823,"num_omap_keys":33909,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168175,"ondisk_log_size":168175,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6334400,"kb_used_data":4116800,"kb_used_omap":12,"kb_used_meta":2217459,"kb_avail":748640320,"statfs":{"total":773094113280,"available":766607687680,"internally_reserved":0,"allocated":4215603200,"data_stored":4214765690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":2270678576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006015"},"pg_stats":[{"pgid":"2.1f","version":"48'842","reported_seq":938,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.173613+0000","last_change":"2024-08-31T04:44:02.173613+0000","last_active":"2024-08-31T04:44:02.173613+0000","last_peered":"2024-08-31T04:44:02.173613+0000","last_clean":"2024-08-31T04:44:02.173613+0000","last_became_active":"2024-08-31T04:03:59.846892+0000","last_became_peered":"2024-08-31T04:03:59.846892+0000","last_unstale":"2024-08-31T04:44:02.173613+0000","last_undegraded":"2024-08-31T04:44:02.173613+0000","last_fullsized":"2024-08-31T04:44:02.173613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'842","last_scrub_stamp":"2024-08-31T04:44:02.173452+0000","last_deep_scrub":"48'842","last_deep_scrub_stamp":"2024-08-31T04:44:02.173452+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.173452+0000","objects_scrubbed":51,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:27:18.893618+0000","scrub_duration":171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37419797,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":826,"num_write_kb":58141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":557462,"num_omap_keys":1075,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"48'626","reported_seq":2740,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.296121+0000","last_change":"2024-08-31T04:44:10.296121+0000","last_active":"2024-08-31T04:44:10.296121+0000","last_peered":"2024-08-31T04:44:10.296121+0000","last_clean":"2024-08-31T04:44:10.296121+0000","last_became_active":"2024-08-31T04:04:00.860973+0000","last_became_peered":"2024-08-31T04:04:00.860973+0000","last_unstale":"2024-08-31T04:44:10.296121+0000","last_undegraded":"2024-08-31T04:44:10.296121+0000","last_fullsized":"2024-08-31T04:44:10.296121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'626","last_scrub_stamp":"2024-08-31T04:44:10.295890+0000","last_deep_scrub":"48'626","last_deep_scrub_stamp":"2024-08-31T04:44:10.295890+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.295890+0000","objects_scrubbed":34,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:22.348391+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.012836803000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":8,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"48'2838","reported_seq":4659,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.196562+0000","last_change":"2024-08-31T04:44:11.196562+0000","last_active":"2024-08-31T04:44:11.196562+0000","last_peered":"2024-08-31T04:44:11.196562+0000","last_clean":"2024-08-31T04:44:11.196562+0000","last_became_active":"2024-08-31T04:04:04.955267+0000","last_became_peered":"2024-08-31T04:04:04.955267+0000","last_unstale":"2024-08-31T04:44:11.196562+0000","last_undegraded":"2024-08-31T04:44:11.196562+0000","last_fullsized":"2024-08-31T04:44:11.196562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2838","last_scrub_stamp":"2024-08-31T04:44:11.196410+0000","last_deep_scrub":"48'2838","last_deep_scrub_stamp":"2024-08-31T04:44:11.196410+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.196410+0000","objects_scrubbed":1198,"log_size":2838,"log_dups_size":0,"ondisk_log_size":2838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:06:57.619952+0000","scrub_duration":703,"objects_trimmed":0,"snaptrim_duration":0.0058952350000000004,"stat_sum":{"num_bytes":50597461,"num_objects":1198,"num_object_clones":550,"num_object_copies":4792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1198,"num_whiteouts":550,"num_read":212,"num_read_kb":376919,"num_write":2332,"num_write_kb":57543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"48'714","reported_seq":810,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.349815+0000","last_change":"2024-08-31T04:44:04.349613+0000","last_active":"2024-08-31T04:44:04.349815+0000","last_peered":"2024-08-31T04:44:04.349815+0000","last_clean":"2024-08-31T04:44:04.349815+0000","last_became_active":"2024-08-31T04:03:59.871146+0000","last_became_peered":"2024-08-31T04:03:59.871146+0000","last_unstale":"2024-08-31T04:44:04.349815+0000","last_undegraded":"2024-08-31T04:44:04.349815+0000","last_fullsized":"2024-08-31T04:44:04.349815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'714","last_scrub_stamp":"2024-08-31T04:44:04.349423+0000","last_deep_scrub":"48'714","last_deep_scrub_stamp":"2024-08-31T04:44:04.349423+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.349423+0000","objects_scrubbed":42,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:45:53.557729+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":697,"num_write_kb":66604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":420359,"num_omap_keys":770,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"48'613","reported_seq":2727,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.294810+0000","last_change":"2024-08-31T04:44:09.294810+0000","last_active":"2024-08-31T04:44:09.294810+0000","last_peered":"2024-08-31T04:44:09.294810+0000","last_clean":"2024-08-31T04:44:09.294810+0000","last_became_active":"2024-08-31T04:04:00.879640+0000","last_became_peered":"2024-08-31T04:04:00.879640+0000","last_unstale":"2024-08-31T04:44:09.294810+0000","last_undegraded":"2024-08-31T04:44:09.294810+0000","last_fullsized":"2024-08-31T04:44:09.294810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'613","last_scrub_stamp":"2024-08-31T04:44:09.294657+0000","last_deep_scrub":"48'613","last_deep_scrub_stamp":"2024-08-31T04:44:09.294657+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.294657+0000","objects_scrubbed":34,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:30:34.068982+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.012881510000000001,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"48'3007","reported_seq":4831,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.297593+0000","last_change":"2024-08-31T04:44:11.297593+0000","last_active":"2024-08-31T04:44:11.297593+0000","last_peered":"2024-08-31T04:44:11.297593+0000","last_clean":"2024-08-31T04:44:11.297593+0000","last_became_active":"2024-08-31T04:04:04.950958+0000","last_became_peered":"2024-08-31T04:04:04.950958+0000","last_unstale":"2024-08-31T04:44:11.297593+0000","last_undegraded":"2024-08-31T04:44:11.297593+0000","last_fullsized":"2024-08-31T04:44:11.297593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3007","last_scrub_stamp":"2024-08-31T04:44:11.297442+0000","last_deep_scrub":"48'3007","last_deep_scrub_stamp":"2024-08-31T04:44:11.297442+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.297442+0000","objects_scrubbed":1258,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:01.718442+0000","scrub_duration":599,"objects_trimmed":0,"snaptrim_duration":0.0059980260000000001,"stat_sum":{"num_bytes":71770879,"num_objects":1258,"num_object_clones":586,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":586,"num_read":247,"num_read_kb":407586,"num_write":2470,"num_write_kb":85232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"48'1302","reported_seq":1395,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.966567+0000","last_change":"2024-08-31T04:44:02.966567+0000","last_active":"2024-08-31T04:44:02.966567+0000","last_peered":"2024-08-31T04:44:02.966567+0000","last_clean":"2024-08-31T04:44:02.966567+0000","last_became_active":"2024-08-31T04:03:59.847796+0000","last_became_peered":"2024-08-31T04:03:59.847796+0000","last_unstale":"2024-08-31T04:44:02.966567+0000","last_undegraded":"2024-08-31T04:44:02.966567+0000","last_fullsized":"2024-08-31T04:44:02.966567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1302","last_scrub_stamp":"2024-08-31T04:44:02.966503+0000","last_deep_scrub":"48'1302","last_deep_scrub_stamp":"2024-08-31T04:44:02.966503+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.966503+0000","objects_scrubbed":51,"log_size":1302,"log_dups_size":0,"ondisk_log_size":1302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:30.935679+0000","scrub_duration":175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1281,"num_write_kb":120075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508856,"num_omap_keys":955,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"48'667","reported_seq":2776,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.049948+0000","last_change":"2024-08-31T04:44:04.049948+0000","last_active":"2024-08-31T04:44:04.049948+0000","last_peered":"2024-08-31T04:44:04.049948+0000","last_clean":"2024-08-31T04:44:04.049948+0000","last_became_active":"2024-08-31T04:04:00.873122+0000","last_became_peered":"2024-08-31T04:04:00.873122+0000","last_unstale":"2024-08-31T04:44:04.049948+0000","last_undegraded":"2024-08-31T04:44:04.049948+0000","last_fullsized":"2024-08-31T04:44:04.049948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'667","last_scrub_stamp":"2024-08-31T04:44:04.049855+0000","last_deep_scrub":"48'667","last_deep_scrub_stamp":"2024-08-31T04:44:04.049855+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.049855+0000","objects_scrubbed":42,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:03:32.135720+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0032840360000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"48'3005","reported_seq":4757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.423952+0000","last_change":"2024-08-31T04:44:14.423952+0000","last_active":"2024-08-31T04:44:14.423952+0000","last_peered":"2024-08-31T04:44:14.423952+0000","last_clean":"2024-08-31T04:44:14.423952+0000","last_became_active":"2024-08-31T04:04:04.971852+0000","last_became_peered":"2024-08-31T04:04:04.971852+0000","last_unstale":"2024-08-31T04:44:14.423952+0000","last_undegraded":"2024-08-31T04:44:14.423952+0000","last_fullsized":"2024-08-31T04:44:14.423952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3005","last_scrub_stamp":"2024-08-31T04:44:14.423799+0000","last_deep_scrub":"48'3005","last_deep_scrub_stamp":"2024-08-31T04:44:14.423799+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.423799+0000","objects_scrubbed":1292,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:21:25.106649+0000","scrub_duration":647,"objects_trimmed":0,"snaptrim_duration":0.0058445240000000002,"stat_sum":{"num_bytes":38693415,"num_objects":1292,"num_object_clones":602,"num_object_copies":5168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":602,"num_read":191,"num_read_kb":293900,"num_write":2458,"num_write_kb":41612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"48'455","reported_seq":548,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.842853+0000","last_change":"2024-08-31T04:44:00.842796+0000","last_active":"2024-08-31T04:44:00.842853+0000","last_peered":"2024-08-31T04:44:00.842853+0000","last_clean":"2024-08-31T04:44:00.842853+0000","last_became_active":"2024-08-31T04:03:59.849953+0000","last_became_peered":"2024-08-31T04:03:59.849953+0000","last_unstale":"2024-08-31T04:44:00.842853+0000","last_undegraded":"2024-08-31T04:44:00.842853+0000","last_fullsized":"2024-08-31T04:44:00.842853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'455","last_scrub_stamp":"2024-08-31T04:44:00.842723+0000","last_deep_scrub":"48'455","last_deep_scrub_stamp":"2024-08-31T04:44:00.842723+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.842723+0000","objects_scrubbed":55,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:37.463986+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":451,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684010,"num_omap_keys":1149,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"48'630","reported_seq":2742,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.399192+0000","last_change":"2024-08-31T04:44:15.399192+0000","last_active":"2024-08-31T04:44:15.399192+0000","last_peered":"2024-08-31T04:44:15.399192+0000","last_clean":"2024-08-31T04:44:15.399192+0000","last_became_active":"2024-08-31T04:04:00.868759+0000","last_became_peered":"2024-08-31T04:04:00.868759+0000","last_unstale":"2024-08-31T04:44:15.399192+0000","last_undegraded":"2024-08-31T04:44:15.399192+0000","last_fullsized":"2024-08-31T04:44:15.399192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'630","last_scrub_stamp":"2024-08-31T04:44:15.399109+0000","last_deep_scrub":"48'630","last_deep_scrub_stamp":"2024-08-31T04:44:15.399109+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.399109+0000","objects_scrubbed":30,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:11:37.670608+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0070378919999999996,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"48'2845","reported_seq":4669,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.307393+0000","last_change":"2024-08-31T04:44:13.307393+0000","last_active":"2024-08-31T04:44:13.307393+0000","last_peered":"2024-08-31T04:44:13.307393+0000","last_clean":"2024-08-31T04:44:13.307393+0000","last_became_active":"2024-08-31T04:04:41.418200+0000","last_became_peered":"2024-08-31T04:04:41.418200+0000","last_unstale":"2024-08-31T04:44:13.307393+0000","last_undegraded":"2024-08-31T04:44:13.307393+0000","last_fullsized":"2024-08-31T04:44:13.307393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2845","last_scrub_stamp":"2024-08-31T04:44:13.307278+0000","last_deep_scrub":"48'2845","last_deep_scrub_stamp":"2024-08-31T04:44:13.307278+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.307278+0000","objects_scrubbed":1209,"log_size":2845,"log_dups_size":0,"ondisk_log_size":2845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:48:57.517465+0000","scrub_duration":579,"objects_trimmed":0,"snaptrim_duration":0.0059467970000000002,"stat_sum":{"num_bytes":46428419,"num_objects":1209,"num_object_clones":554,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":554,"num_read":210,"num_read_kb":267629,"num_write":2344,"num_write_kb":53603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,4],"acting":[2,6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"48'659","reported_seq":2768,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.434620+0000","last_change":"2024-08-31T04:44:09.434620+0000","last_active":"2024-08-31T04:44:09.434620+0000","last_peered":"2024-08-31T04:44:09.434620+0000","last_clean":"2024-08-31T04:44:09.434620+0000","last_became_active":"2024-08-31T04:04:00.867298+0000","last_became_peered":"2024-08-31T04:04:00.867298+0000","last_unstale":"2024-08-31T04:44:09.434620+0000","last_undegraded":"2024-08-31T04:44:09.434620+0000","last_fullsized":"2024-08-31T04:44:09.434620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'659","last_scrub_stamp":"2024-08-31T04:44:09.434497+0000","last_deep_scrub":"48'659","last_deep_scrub_stamp":"2024-08-31T04:44:09.434497+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.434497+0000","objects_scrubbed":43,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:08:40.671438+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0068528089999999996,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"48'1243","reported_seq":1338,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.445246+0000","last_change":"2024-08-31T04:44:13.445184+0000","last_active":"2024-08-31T04:44:13.445246+0000","last_peered":"2024-08-31T04:44:13.445246+0000","last_clean":"2024-08-31T04:44:13.445246+0000","last_became_active":"2024-08-31T04:03:59.837634+0000","last_became_peered":"2024-08-31T04:03:59.837634+0000","last_unstale":"2024-08-31T04:44:13.445246+0000","last_undegraded":"2024-08-31T04:44:13.445246+0000","last_fullsized":"2024-08-31T04:44:13.445246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1243","last_scrub_stamp":"2024-08-31T04:44:13.445085+0000","last_deep_scrub":"48'1243","last_deep_scrub_stamp":"2024-08-31T04:44:13.445085+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.445085+0000","objects_scrubbed":61,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:50:52.548850+0000","scrub_duration":127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1278,"num_write_kb":83819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":672938,"num_omap_keys":1256,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"48'2943","reported_seq":4801,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:24.106177+0000","last_change":"2024-08-31T04:44:24.106099+0000","last_active":"2024-08-31T04:44:24.106177+0000","last_peered":"2024-08-31T04:44:24.106177+0000","last_clean":"2024-08-31T04:44:24.106177+0000","last_became_active":"2024-08-31T04:04:04.966398+0000","last_became_peered":"2024-08-31T04:04:04.966398+0000","last_unstale":"2024-08-31T04:44:24.106177+0000","last_undegraded":"2024-08-31T04:44:24.106177+0000","last_fullsized":"2024-08-31T04:44:24.106177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2943","last_scrub_stamp":"2024-08-31T04:44:24.105979+0000","last_deep_scrub":"48'2943","last_deep_scrub_stamp":"2024-08-31T04:44:24.105979+0000","last_clean_scrub_stamp":"2024-08-31T04:44:24.105979+0000","objects_scrubbed":1275,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:18:02.009398+0000","scrub_duration":703,"objects_trimmed":0,"snaptrim_duration":0.0066428290000000003,"stat_sum":{"num_bytes":56765051,"num_objects":1275,"num_object_clones":585,"num_object_copies":5100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1275,"num_whiteouts":585,"num_read":279,"num_read_kb":424140,"num_write":2416,"num_write_kb":67833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"48'673","reported_seq":2783,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.663803+0000","last_change":"2024-08-31T04:44:03.663648+0000","last_active":"2024-08-31T04:44:03.663803+0000","last_peered":"2024-08-31T04:44:03.663803+0000","last_clean":"2024-08-31T04:44:03.663803+0000","last_became_active":"2024-08-31T04:04:00.887087+0000","last_became_peered":"2024-08-31T04:04:00.887087+0000","last_unstale":"2024-08-31T04:44:03.663803+0000","last_undegraded":"2024-08-31T04:44:03.663803+0000","last_fullsized":"2024-08-31T04:44:03.663803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'673","last_scrub_stamp":"2024-08-31T04:44:03.663436+0000","last_deep_scrub":"48'673","last_deep_scrub_stamp":"2024-08-31T04:44:03.663436+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.663436+0000","objects_scrubbed":45,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:02:59.160345+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0.0066355329999999999,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"48'747","reported_seq":842,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.975457+0000","last_change":"2024-08-31T04:44:01.975457+0000","last_active":"2024-08-31T04:44:01.975457+0000","last_peered":"2024-08-31T04:44:01.975457+0000","last_clean":"2024-08-31T04:44:01.975457+0000","last_became_active":"2024-08-31T04:03:59.848601+0000","last_became_peered":"2024-08-31T04:03:59.848601+0000","last_unstale":"2024-08-31T04:44:01.975457+0000","last_undegraded":"2024-08-31T04:44:01.975457+0000","last_fullsized":"2024-08-31T04:44:01.975457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'747","last_scrub_stamp":"2024-08-31T04:44:01.975299+0000","last_deep_scrub":"48'747","last_deep_scrub_stamp":"2024-08-31T04:44:01.975299+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.975299+0000","objects_scrubbed":61,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:16:12.813818+0000","scrub_duration":179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":738,"num_write_kb":87340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":845775,"num_omap_keys":1615,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"48'2909","reported_seq":4599,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.317804+0000","last_change":"2024-08-31T04:44:16.317804+0000","last_active":"2024-08-31T04:44:16.317804+0000","last_peered":"2024-08-31T04:44:16.317804+0000","last_clean":"2024-08-31T04:44:16.317804+0000","last_became_active":"2024-08-31T04:04:04.954173+0000","last_became_peered":"2024-08-31T04:04:04.954173+0000","last_unstale":"2024-08-31T04:44:16.317804+0000","last_undegraded":"2024-08-31T04:44:16.317804+0000","last_fullsized":"2024-08-31T04:44:16.317804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2909","last_scrub_stamp":"2024-08-31T04:44:16.317708+0000","last_deep_scrub":"48'2909","last_deep_scrub_stamp":"2024-08-31T04:44:16.317708+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.317708+0000","objects_scrubbed":1190,"log_size":2909,"log_dups_size":0,"ondisk_log_size":2909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:04:18.188141+0000","scrub_duration":507,"objects_trimmed":0,"snaptrim_duration":0.0043859299999999997,"stat_sum":{"num_bytes":16936662,"num_objects":1190,"num_object_clones":558,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":558,"num_read":87,"num_read_kb":9431,"num_write":2392,"num_write_kb":37720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"48'707","reported_seq":2813,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.992950+0000","last_change":"2024-08-31T04:44:08.992950+0000","last_active":"2024-08-31T04:44:08.992950+0000","last_peered":"2024-08-31T04:44:08.992950+0000","last_clean":"2024-08-31T04:44:08.992950+0000","last_became_active":"2024-08-31T04:04:00.891555+0000","last_became_peered":"2024-08-31T04:04:00.891555+0000","last_unstale":"2024-08-31T04:44:08.992950+0000","last_undegraded":"2024-08-31T04:44:08.992950+0000","last_fullsized":"2024-08-31T04:44:08.992950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'707","last_scrub_stamp":"2024-08-31T04:44:08.992828+0000","last_deep_scrub":"48'707","last_deep_scrub_stamp":"2024-08-31T04:44:08.992828+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.992828+0000","objects_scrubbed":48,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:37:08.223324+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.018377836000000002,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":14,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"48'614","reported_seq":709,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.182102+0000","last_change":"2024-08-31T04:44:01.182102+0000","last_active":"2024-08-31T04:44:01.182102+0000","last_peered":"2024-08-31T04:44:01.182102+0000","last_clean":"2024-08-31T04:44:01.182102+0000","last_became_active":"2024-08-31T04:03:59.845241+0000","last_became_peered":"2024-08-31T04:03:59.845241+0000","last_unstale":"2024-08-31T04:44:01.182102+0000","last_undegraded":"2024-08-31T04:44:01.182102+0000","last_fullsized":"2024-08-31T04:44:01.182102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'614","last_scrub_stamp":"2024-08-31T04:44:01.181946+0000","last_deep_scrub":"48'614","last_deep_scrub_stamp":"2024-08-31T04:44:01.181946+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.181946+0000","objects_scrubbed":52,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:07.441762+0000","scrub_duration":163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":615,"num_write_kb":58408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":536630,"num_omap_keys":960,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"48'2896","reported_seq":4633,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.247065+0000","last_change":"2024-08-31T04:44:09.247065+0000","last_active":"2024-08-31T04:44:09.247065+0000","last_peered":"2024-08-31T04:44:09.247065+0000","last_clean":"2024-08-31T04:44:09.247065+0000","last_became_active":"2024-08-31T04:04:04.945734+0000","last_became_peered":"2024-08-31T04:04:04.945734+0000","last_unstale":"2024-08-31T04:44:09.247065+0000","last_undegraded":"2024-08-31T04:44:09.247065+0000","last_fullsized":"2024-08-31T04:44:09.247065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2896","last_scrub_stamp":"2024-08-31T04:44:09.246791+0000","last_deep_scrub":"48'2896","last_deep_scrub_stamp":"2024-08-31T04:44:09.246791+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.246791+0000","objects_scrubbed":1227,"log_size":2896,"log_dups_size":0,"ondisk_log_size":2896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:46:59.862038+0000","scrub_duration":787,"objects_trimmed":0,"snaptrim_duration":0.0070696559999999997,"stat_sum":{"num_bytes":20275415,"num_objects":1227,"num_object_clones":567,"num_object_copies":4908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1227,"num_whiteouts":567,"num_read":143,"num_read_kb":118630,"num_write":2381,"num_write_kb":31494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"48'672","reported_seq":2782,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.441802+0000","last_change":"2024-08-31T04:44:05.441802+0000","last_active":"2024-08-31T04:44:05.441802+0000","last_peered":"2024-08-31T04:44:05.441802+0000","last_clean":"2024-08-31T04:44:05.441802+0000","last_became_active":"2024-08-31T04:04:00.892390+0000","last_became_peered":"2024-08-31T04:04:00.892390+0000","last_unstale":"2024-08-31T04:44:05.441802+0000","last_undegraded":"2024-08-31T04:44:05.441802+0000","last_fullsized":"2024-08-31T04:44:05.441802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'672","last_scrub_stamp":"2024-08-31T04:44:05.441710+0000","last_deep_scrub":"48'672","last_deep_scrub_stamp":"2024-08-31T04:44:05.441710+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.441710+0000","objects_scrubbed":43,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:35:51.700384+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.0060537480000000003,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"48'423","reported_seq":518,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.842112+0000","last_change":"2024-08-31T04:44:03.842112+0000","last_active":"2024-08-31T04:44:03.842112+0000","last_peered":"2024-08-31T04:44:03.842112+0000","last_clean":"2024-08-31T04:44:03.842112+0000","last_became_active":"2024-08-31T04:03:59.839841+0000","last_became_peered":"2024-08-31T04:03:59.839841+0000","last_unstale":"2024-08-31T04:44:03.842112+0000","last_undegraded":"2024-08-31T04:44:03.842112+0000","last_fullsized":"2024-08-31T04:44:03.842112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'423","last_scrub_stamp":"2024-08-31T04:44:03.842040+0000","last_deep_scrub":"48'423","last_deep_scrub_stamp":"2024-08-31T04:44:03.842040+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.842040+0000","objects_scrubbed":52,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:54:09.328590+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":417,"num_write_kb":42100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":614061,"num_omap_keys":1061,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"48'2828","reported_seq":4561,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.329128+0000","last_change":"2024-08-31T04:44:12.329023+0000","last_active":"2024-08-31T04:44:12.329128+0000","last_peered":"2024-08-31T04:44:12.329128+0000","last_clean":"2024-08-31T04:44:12.329128+0000","last_became_active":"2024-08-31T04:04:04.936348+0000","last_became_peered":"2024-08-31T04:04:04.936348+0000","last_unstale":"2024-08-31T04:44:12.329128+0000","last_undegraded":"2024-08-31T04:44:12.329128+0000","last_fullsized":"2024-08-31T04:44:12.329128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2828","last_scrub_stamp":"2024-08-31T04:44:12.328917+0000","last_deep_scrub":"48'2828","last_deep_scrub_stamp":"2024-08-31T04:44:12.328917+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.328917+0000","objects_scrubbed":1243,"log_size":2828,"log_dups_size":0,"ondisk_log_size":2828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:20:12.706346+0000","scrub_duration":595,"objects_trimmed":0,"snaptrim_duration":0.0062106380000000001,"stat_sum":{"num_bytes":38082532,"num_objects":1243,"num_object_clones":581,"num_object_copies":4972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1243,"num_whiteouts":581,"num_read":151,"num_read_kb":116541,"num_write":2283,"num_write_kb":45420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"48'651","reported_seq":2760,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.011068+0000","last_change":"2024-08-31T04:44:10.011068+0000","last_active":"2024-08-31T04:44:10.011068+0000","last_peered":"2024-08-31T04:44:10.011068+0000","last_clean":"2024-08-31T04:44:10.011068+0000","last_became_active":"2024-08-31T04:04:00.890817+0000","last_became_peered":"2024-08-31T04:04:00.890817+0000","last_unstale":"2024-08-31T04:44:10.011068+0000","last_undegraded":"2024-08-31T04:44:10.011068+0000","last_fullsized":"2024-08-31T04:44:10.011068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'651","last_scrub_stamp":"2024-08-31T04:44:10.010948+0000","last_deep_scrub":"48'651","last_deep_scrub_stamp":"2024-08-31T04:44:10.010948+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.010948+0000","objects_scrubbed":43,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:49:58.492267+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.018455160000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":11,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"48'596","reported_seq":691,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.450799+0000","last_change":"2024-08-31T04:44:08.450799+0000","last_active":"2024-08-31T04:44:08.450799+0000","last_peered":"2024-08-31T04:44:08.450799+0000","last_clean":"2024-08-31T04:44:08.450799+0000","last_became_active":"2024-08-31T04:03:59.845317+0000","last_became_peered":"2024-08-31T04:03:59.845317+0000","last_unstale":"2024-08-31T04:44:08.450799+0000","last_undegraded":"2024-08-31T04:44:08.450799+0000","last_fullsized":"2024-08-31T04:44:08.450799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'596","last_scrub_stamp":"2024-08-31T04:44:08.450715+0000","last_deep_scrub":"48'596","last_deep_scrub_stamp":"2024-08-31T04:44:08.450715+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.450715+0000","objects_scrubbed":54,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:12:49.593796+0000","scrub_duration":107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":604,"num_write_kb":70753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504741,"num_omap_keys":921,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"48'2858","reported_seq":4677,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.271693+0000","last_change":"2024-08-31T04:44:05.271693+0000","last_active":"2024-08-31T04:44:05.271693+0000","last_peered":"2024-08-31T04:44:05.271693+0000","last_clean":"2024-08-31T04:44:05.271693+0000","last_became_active":"2024-08-31T04:04:04.946981+0000","last_became_peered":"2024-08-31T04:04:04.946981+0000","last_unstale":"2024-08-31T04:44:05.271693+0000","last_undegraded":"2024-08-31T04:44:05.271693+0000","last_fullsized":"2024-08-31T04:44:05.271693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2858","last_scrub_stamp":"2024-08-31T04:44:05.271593+0000","last_deep_scrub":"48'2858","last_deep_scrub_stamp":"2024-08-31T04:44:05.271593+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.271593+0000","objects_scrubbed":1175,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:49:07.263280+0000","scrub_duration":615,"objects_trimmed":0,"snaptrim_duration":0.0076718680000000001,"stat_sum":{"num_bytes":46058979,"num_objects":1175,"num_object_clones":539,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":539,"num_read":197,"num_read_kb":336982,"num_write":2367,"num_write_kb":53816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"48'629","reported_seq":2737,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.976476+0000","last_change":"2024-08-31T04:44:06.976476+0000","last_active":"2024-08-31T04:44:06.976476+0000","last_peered":"2024-08-31T04:44:06.976476+0000","last_clean":"2024-08-31T04:44:06.976476+0000","last_became_active":"2024-08-31T04:04:00.890511+0000","last_became_peered":"2024-08-31T04:04:00.890511+0000","last_unstale":"2024-08-31T04:44:06.976476+0000","last_undegraded":"2024-08-31T04:44:06.976476+0000","last_fullsized":"2024-08-31T04:44:06.976476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'629","last_scrub_stamp":"2024-08-31T04:44:06.976399+0000","last_deep_scrub":"48'629","last_deep_scrub_stamp":"2024-08-31T04:44:06.976399+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.976399+0000","objects_scrubbed":53,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:07:21.574286+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0.019117552999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":13,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"48'2025","reported_seq":2120,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.197842+0000","last_change":"2024-08-31T04:44:03.197842+0000","last_active":"2024-08-31T04:44:03.197842+0000","last_peered":"2024-08-31T04:44:03.197842+0000","last_clean":"2024-08-31T04:44:03.197842+0000","last_became_active":"2024-08-31T04:03:59.849588+0000","last_became_peered":"2024-08-31T04:03:59.849588+0000","last_unstale":"2024-08-31T04:44:03.197842+0000","last_undegraded":"2024-08-31T04:44:03.197842+0000","last_fullsized":"2024-08-31T04:44:03.197842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2025","last_scrub_stamp":"2024-08-31T04:44:03.197619+0000","last_deep_scrub":"48'2025","last_deep_scrub_stamp":"2024-08-31T04:44:03.197619+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.197619+0000","objects_scrubbed":66,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:32:16.149643+0000","scrub_duration":231,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":4155,"num_write_kb":64616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":776230,"num_omap_keys":1395,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"48'2942","reported_seq":4765,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.558179+0000","last_change":"2024-08-31T04:44:14.558179+0000","last_active":"2024-08-31T04:44:14.558179+0000","last_peered":"2024-08-31T04:44:14.558179+0000","last_clean":"2024-08-31T04:44:14.558179+0000","last_became_active":"2024-08-31T04:04:04.949944+0000","last_became_peered":"2024-08-31T04:04:04.949944+0000","last_unstale":"2024-08-31T04:44:14.558179+0000","last_undegraded":"2024-08-31T04:44:14.558179+0000","last_fullsized":"2024-08-31T04:44:14.558179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2942","last_scrub_stamp":"2024-08-31T04:44:14.557886+0000","last_deep_scrub":"48'2942","last_deep_scrub_stamp":"2024-08-31T04:44:14.557886+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.557886+0000","objects_scrubbed":1223,"log_size":2942,"log_dups_size":0,"ondisk_log_size":2942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:37:06.396566+0000","scrub_duration":655,"objects_trimmed":0,"snaptrim_duration":0.018717636999999999,"stat_sum":{"num_bytes":43745379,"num_objects":1223,"num_object_clones":566,"num_object_copies":4892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1223,"num_whiteouts":566,"num_read":225,"num_read_kb":330819,"num_write":2430,"num_write_kb":52706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"48'696","reported_seq":2798,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.901888+0000","last_change":"2024-08-31T04:44:05.901888+0000","last_active":"2024-08-31T04:44:05.901888+0000","last_peered":"2024-08-31T04:44:05.901888+0000","last_clean":"2024-08-31T04:44:05.901888+0000","last_became_active":"2024-08-31T04:04:00.886475+0000","last_became_peered":"2024-08-31T04:04:00.886475+0000","last_unstale":"2024-08-31T04:44:05.901888+0000","last_undegraded":"2024-08-31T04:44:05.901888+0000","last_fullsized":"2024-08-31T04:44:05.901888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'696","last_scrub_stamp":"2024-08-31T04:44:05.901756+0000","last_deep_scrub":"48'696","last_deep_scrub_stamp":"2024-08-31T04:44:05.901756+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.901756+0000","objects_scrubbed":60,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:52.526394+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.024325223999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":20,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"48'1199","reported_seq":1294,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.530439+0000","last_change":"2024-08-31T04:44:01.530439+0000","last_active":"2024-08-31T04:44:01.530439+0000","last_peered":"2024-08-31T04:44:01.530439+0000","last_clean":"2024-08-31T04:44:01.530439+0000","last_became_active":"2024-08-31T04:03:59.849842+0000","last_became_peered":"2024-08-31T04:03:59.849842+0000","last_unstale":"2024-08-31T04:44:01.530439+0000","last_undegraded":"2024-08-31T04:44:01.530439+0000","last_fullsized":"2024-08-31T04:44:01.530439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1199","last_scrub_stamp":"2024-08-31T04:44:01.530315+0000","last_deep_scrub":"48'1199","last_deep_scrub_stamp":"2024-08-31T04:44:01.530315+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.530315+0000","objects_scrubbed":49,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:38.099017+0000","scrub_duration":135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":1214,"num_write_kb":79665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":624485,"num_omap_keys":1076,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"48'3005","reported_seq":4779,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.547062+0000","last_change":"2024-08-31T04:44:13.547062+0000","last_active":"2024-08-31T04:44:13.547062+0000","last_peered":"2024-08-31T04:44:13.547062+0000","last_clean":"2024-08-31T04:44:13.547062+0000","last_became_active":"2024-08-31T04:04:04.947234+0000","last_became_peered":"2024-08-31T04:04:04.947234+0000","last_unstale":"2024-08-31T04:44:13.547062+0000","last_undegraded":"2024-08-31T04:44:13.547062+0000","last_fullsized":"2024-08-31T04:44:13.547062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3005","last_scrub_stamp":"2024-08-31T04:44:13.546839+0000","last_deep_scrub":"48'3005","last_deep_scrub_stamp":"2024-08-31T04:44:13.546839+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.546839+0000","objects_scrubbed":1282,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:13:43.677541+0000","scrub_duration":715,"objects_trimmed":0,"snaptrim_duration":0.025625698999999998,"stat_sum":{"num_bytes":43095232,"num_objects":1282,"num_object_clones":604,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":604,"num_read":212,"num_read_kb":287774,"num_write":2444,"num_write_kb":46619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"48'678","reported_seq":2787,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:59.708191+0000","last_change":"2024-08-31T04:43:59.708191+0000","last_active":"2024-08-31T04:43:59.708191+0000","last_peered":"2024-08-31T04:43:59.708191+0000","last_clean":"2024-08-31T04:43:59.708191+0000","last_became_active":"2024-08-31T04:04:00.887248+0000","last_became_peered":"2024-08-31T04:04:00.887248+0000","last_unstale":"2024-08-31T04:43:59.708191+0000","last_undegraded":"2024-08-31T04:43:59.708191+0000","last_fullsized":"2024-08-31T04:43:59.708191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'678","last_scrub_stamp":"2024-08-31T04:43:59.708058+0000","last_deep_scrub":"48'678","last_deep_scrub_stamp":"2024-08-31T04:43:59.708058+0000","last_clean_scrub_stamp":"2024-08-31T04:43:59.708058+0000","objects_scrubbed":45,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:21:25.302149+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0058084670000000003,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"48'857","reported_seq":953,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.258097+0000","last_change":"2024-08-31T04:44:02.258097+0000","last_active":"2024-08-31T04:44:02.258097+0000","last_peered":"2024-08-31T04:44:02.258097+0000","last_clean":"2024-08-31T04:44:02.258097+0000","last_became_active":"2024-08-31T04:03:59.862917+0000","last_became_peered":"2024-08-31T04:03:59.862917+0000","last_unstale":"2024-08-31T04:44:02.258097+0000","last_undegraded":"2024-08-31T04:44:02.258097+0000","last_fullsized":"2024-08-31T04:44:02.258097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'857","last_scrub_stamp":"2024-08-31T04:44:02.257973+0000","last_deep_scrub":"48'857","last_deep_scrub_stamp":"2024-08-31T04:44:02.257973+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.257973+0000","objects_scrubbed":53,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:23:21.114892+0000","scrub_duration":111,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":843,"num_write_kb":95373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":452599,"num_omap_keys":744,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"48'2913","reported_seq":4609,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.422430+0000","last_change":"2024-08-31T04:44:12.422430+0000","last_active":"2024-08-31T04:44:12.422430+0000","last_peered":"2024-08-31T04:44:12.422430+0000","last_clean":"2024-08-31T04:44:12.422430+0000","last_became_active":"2024-08-31T04:04:04.974303+0000","last_became_peered":"2024-08-31T04:04:04.974303+0000","last_unstale":"2024-08-31T04:44:12.422430+0000","last_undegraded":"2024-08-31T04:44:12.422430+0000","last_fullsized":"2024-08-31T04:44:12.422430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2913","last_scrub_stamp":"2024-08-31T04:44:12.422307+0000","last_deep_scrub":"48'2913","last_deep_scrub_stamp":"2024-08-31T04:44:12.422307+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.422307+0000","objects_scrubbed":1252,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:38:44.034564+0000","scrub_duration":563,"objects_trimmed":0,"snaptrim_duration":0.024539147000000001,"stat_sum":{"num_bytes":16912754,"num_objects":1252,"num_object_clones":571,"num_object_copies":5008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1252,"num_whiteouts":571,"num_read":103,"num_read_kb":5348,"num_write":2409,"num_write_kb":25816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"48'646","reported_seq":2761,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.811069+0000","last_change":"2024-08-31T04:44:04.811069+0000","last_active":"2024-08-31T04:44:04.811069+0000","last_peered":"2024-08-31T04:44:04.811069+0000","last_clean":"2024-08-31T04:44:04.811069+0000","last_became_active":"2024-08-31T04:04:00.880993+0000","last_became_peered":"2024-08-31T04:04:00.880993+0000","last_unstale":"2024-08-31T04:44:04.811069+0000","last_undegraded":"2024-08-31T04:44:04.811069+0000","last_fullsized":"2024-08-31T04:44:04.811069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'646","last_scrub_stamp":"2024-08-31T04:44:04.810943+0000","last_deep_scrub":"48'646","last_deep_scrub_stamp":"2024-08-31T04:44:04.810943+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.810943+0000","objects_scrubbed":27,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:21:45.272602+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.00335798,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"48'401","reported_seq":497,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.538210+0000","last_change":"2024-08-31T04:44:03.538210+0000","last_active":"2024-08-31T04:44:03.538210+0000","last_peered":"2024-08-31T04:44:03.538210+0000","last_clean":"2024-08-31T04:44:03.538210+0000","last_became_active":"2024-08-31T04:03:59.847664+0000","last_became_peered":"2024-08-31T04:03:59.847664+0000","last_unstale":"2024-08-31T04:44:03.538210+0000","last_undegraded":"2024-08-31T04:44:03.538210+0000","last_fullsized":"2024-08-31T04:44:03.538210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'401","last_scrub_stamp":"2024-08-31T04:44:03.538140+0000","last_deep_scrub":"48'401","last_deep_scrub_stamp":"2024-08-31T04:44:03.538140+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.538140+0000","objects_scrubbed":53,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:00.019696+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":379,"num_write_kb":74722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":617910,"num_omap_keys":1037,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"48'2860","reported_seq":4579,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.477806+0000","last_change":"2024-08-31T04:44:14.477806+0000","last_active":"2024-08-31T04:44:14.477806+0000","last_peered":"2024-08-31T04:44:14.477806+0000","last_clean":"2024-08-31T04:44:14.477806+0000","last_became_active":"2024-08-31T04:04:04.951205+0000","last_became_peered":"2024-08-31T04:04:04.951205+0000","last_unstale":"2024-08-31T04:44:14.477806+0000","last_undegraded":"2024-08-31T04:44:14.477806+0000","last_fullsized":"2024-08-31T04:44:14.477806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2860","last_scrub_stamp":"2024-08-31T04:44:14.477672+0000","last_deep_scrub":"48'2860","last_deep_scrub_stamp":"2024-08-31T04:44:14.477672+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.477672+0000","objects_scrubbed":1202,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:33:58.283689+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0.024774918,"stat_sum":{"num_bytes":28766340,"num_objects":1202,"num_object_clones":562,"num_object_copies":4808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":562,"num_read":118,"num_read_kb":82244,"num_write":2340,"num_write_kb":38944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"48'697","reported_seq":2806,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.388560+0000","last_change":"2024-08-31T04:44:05.388424+0000","last_active":"2024-08-31T04:44:05.388560+0000","last_peered":"2024-08-31T04:44:05.388560+0000","last_clean":"2024-08-31T04:44:05.388560+0000","last_became_active":"2024-08-31T04:04:00.882881+0000","last_became_peered":"2024-08-31T04:04:00.882881+0000","last_unstale":"2024-08-31T04:44:05.388560+0000","last_undegraded":"2024-08-31T04:44:05.388560+0000","last_fullsized":"2024-08-31T04:44:05.388560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'697","last_scrub_stamp":"2024-08-31T04:44:05.388257+0000","last_deep_scrub":"48'697","last_deep_scrub_stamp":"2024-08-31T04:44:05.388257+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.388257+0000","objects_scrubbed":51,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:52.276604+0000","scrub_duration":127,"objects_trimmed":0,"snaptrim_duration":0.011184838000000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"48'1790","reported_seq":2926,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.725631+0000","last_change":"2024-08-31T04:44:04.725631+0000","last_active":"2024-08-31T04:44:04.725631+0000","last_peered":"2024-08-31T04:44:04.725631+0000","last_clean":"2024-08-31T04:44:04.725631+0000","last_became_active":"2024-08-31T04:03:59.874301+0000","last_became_peered":"2024-08-31T04:03:59.874301+0000","last_unstale":"2024-08-31T04:44:04.725631+0000","last_undegraded":"2024-08-31T04:44:04.725631+0000","last_fullsized":"2024-08-31T04:44:04.725631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1790","last_scrub_stamp":"2024-08-31T04:44:04.725449+0000","last_deep_scrub":"48'1790","last_deep_scrub_stamp":"2024-08-31T04:44:04.725449+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.725449+0000","objects_scrubbed":72,"log_size":1790,"log_dups_size":0,"ondisk_log_size":1790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:10.542571+0000","scrub_duration":195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":1088,"num_read_kb":4789,"num_write":1771,"num_write_kb":92200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":738098,"num_omap_keys":1268,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"48'2769","reported_seq":4575,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.440552+0000","last_change":"2024-08-31T04:44:15.440552+0000","last_active":"2024-08-31T04:44:15.440552+0000","last_peered":"2024-08-31T04:44:15.440552+0000","last_clean":"2024-08-31T04:44:15.440552+0000","last_became_active":"2024-08-31T04:04:04.947384+0000","last_became_peered":"2024-08-31T04:04:04.947384+0000","last_unstale":"2024-08-31T04:44:15.440552+0000","last_undegraded":"2024-08-31T04:44:15.440552+0000","last_fullsized":"2024-08-31T04:44:15.440552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2769","last_scrub_stamp":"2024-08-31T04:44:15.440430+0000","last_deep_scrub":"48'2769","last_deep_scrub_stamp":"2024-08-31T04:44:15.440430+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.440430+0000","objects_scrubbed":1190,"log_size":2769,"log_dups_size":0,"ondisk_log_size":2769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:36:09.691893+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0.024776765999999999,"stat_sum":{"num_bytes":32718964,"num_objects":1190,"num_object_clones":545,"num_object_copies":4760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":545,"num_read":189,"num_read_kb":237912,"num_write":2280,"num_write_kb":50056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"48'633","reported_seq":2744,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.819213+0000","last_change":"2024-08-31T04:44:04.819213+0000","last_active":"2024-08-31T04:44:04.819213+0000","last_peered":"2024-08-31T04:44:04.819213+0000","last_clean":"2024-08-31T04:44:04.819213+0000","last_became_active":"2024-08-31T04:04:00.885528+0000","last_became_peered":"2024-08-31T04:04:00.885528+0000","last_unstale":"2024-08-31T04:44:04.819213+0000","last_undegraded":"2024-08-31T04:44:04.819213+0000","last_fullsized":"2024-08-31T04:44:04.819213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'633","last_scrub_stamp":"2024-08-31T04:44:04.819079+0000","last_deep_scrub":"48'633","last_deep_scrub_stamp":"2024-08-31T04:44:04.819079+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.819079+0000","objects_scrubbed":45,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:00:46.550617+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.023142859000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"48'790","reported_seq":887,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.511224+0000","last_change":"2024-08-31T04:44:00.511159+0000","last_active":"2024-08-31T04:44:00.511224+0000","last_peered":"2024-08-31T04:44:00.511224+0000","last_clean":"2024-08-31T04:44:00.511224+0000","last_became_active":"2024-08-31T04:03:59.848497+0000","last_became_peered":"2024-08-31T04:03:59.848497+0000","last_unstale":"2024-08-31T04:44:00.511224+0000","last_undegraded":"2024-08-31T04:44:00.511224+0000","last_fullsized":"2024-08-31T04:44:00.511224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'790","last_scrub_stamp":"2024-08-31T04:44:00.511065+0000","last_deep_scrub":"48'790","last_deep_scrub_stamp":"2024-08-31T04:44:00.511065+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.511065+0000","objects_scrubbed":55,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:14:06.757563+0000","scrub_duration":135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":805,"num_write_kb":79377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":727793,"num_omap_keys":1211,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"48'2886","reported_seq":4612,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:21.008112+0000","last_change":"2024-08-31T04:44:21.008112+0000","last_active":"2024-08-31T04:44:21.008112+0000","last_peered":"2024-08-31T04:44:21.008112+0000","last_clean":"2024-08-31T04:44:21.008112+0000","last_became_active":"2024-08-31T04:04:04.972406+0000","last_became_peered":"2024-08-31T04:04:04.972406+0000","last_unstale":"2024-08-31T04:44:21.008112+0000","last_undegraded":"2024-08-31T04:44:21.008112+0000","last_fullsized":"2024-08-31T04:44:21.008112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2886","last_scrub_stamp":"2024-08-31T04:44:21.007994+0000","last_deep_scrub":"48'2886","last_deep_scrub_stamp":"2024-08-31T04:44:21.007994+0000","last_clean_scrub_stamp":"2024-08-31T04:44:21.007994+0000","objects_scrubbed":1183,"log_size":2886,"log_dups_size":0,"ondisk_log_size":2886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:34:49.615160+0000","scrub_duration":675,"objects_trimmed":0,"snaptrim_duration":0.014346418999999999,"stat_sum":{"num_bytes":16814987,"num_objects":1183,"num_object_clones":546,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":546,"num_read":112,"num_read_kb":15010,"num_write":2390,"num_write_kb":22596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"48'688","reported_seq":2793,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.094347+0000","last_change":"2024-08-31T04:44:04.094347+0000","last_active":"2024-08-31T04:44:04.094347+0000","last_peered":"2024-08-31T04:44:04.094347+0000","last_clean":"2024-08-31T04:44:04.094347+0000","last_became_active":"2024-08-31T04:04:00.891270+0000","last_became_peered":"2024-08-31T04:04:00.891270+0000","last_unstale":"2024-08-31T04:44:04.094347+0000","last_undegraded":"2024-08-31T04:44:04.094347+0000","last_fullsized":"2024-08-31T04:44:04.094347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'688","last_scrub_stamp":"2024-08-31T04:44:04.094101+0000","last_deep_scrub":"48'688","last_deep_scrub_stamp":"2024-08-31T04:44:04.094101+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.094101+0000","objects_scrubbed":62,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:43:31.936830+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0.013467437000000001,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"48'831","reported_seq":927,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.546478+0000","last_change":"2024-08-31T04:44:02.546478+0000","last_active":"2024-08-31T04:44:02.546478+0000","last_peered":"2024-08-31T04:44:02.546478+0000","last_clean":"2024-08-31T04:44:02.546478+0000","last_became_active":"2024-08-31T04:03:59.834519+0000","last_became_peered":"2024-08-31T04:03:59.834519+0000","last_unstale":"2024-08-31T04:44:02.546478+0000","last_undegraded":"2024-08-31T04:44:02.546478+0000","last_fullsized":"2024-08-31T04:44:02.546478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'831","last_scrub_stamp":"2024-08-31T04:44:02.546371+0000","last_deep_scrub":"48'831","last_deep_scrub_stamp":"2024-08-31T04:44:02.546371+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.546371+0000","objects_scrubbed":56,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:35:04.179853+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":842,"num_write_kb":66986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":697185,"num_omap_keys":1278,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"48'74","reported_seq":193,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.004740+0000","last_change":"2024-08-31T04:44:00.004619+0000","last_active":"2024-08-31T04:44:00.004740+0000","last_peered":"2024-08-31T04:44:00.004740+0000","last_clean":"2024-08-31T04:44:00.004740+0000","last_became_active":"2024-08-31T04:03:52.136597+0000","last_became_peered":"2024-08-31T04:03:52.136597+0000","last_unstale":"2024-08-31T04:44:00.004740+0000","last_undegraded":"2024-08-31T04:44:00.004740+0000","last_fullsized":"2024-08-31T04:44:00.004740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'74","last_scrub_stamp":"2024-08-31T04:44:00.004510+0000","last_deep_scrub":"48'74","last_deep_scrub_stamp":"2024-08-31T04:44:00.004510+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.004510+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:48.929118+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"48'2855","reported_seq":4739,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:21.909499+0000","last_change":"2024-08-31T04:44:21.909499+0000","last_active":"2024-08-31T04:44:21.909499+0000","last_peered":"2024-08-31T04:44:21.909499+0000","last_clean":"2024-08-31T04:44:21.909499+0000","last_became_active":"2024-08-31T04:04:04.921904+0000","last_became_peered":"2024-08-31T04:04:04.921904+0000","last_unstale":"2024-08-31T04:44:21.909499+0000","last_undegraded":"2024-08-31T04:44:21.909499+0000","last_fullsized":"2024-08-31T04:44:21.909499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2855","last_scrub_stamp":"2024-08-31T04:44:21.909368+0000","last_deep_scrub":"48'2855","last_deep_scrub_stamp":"2024-08-31T04:44:21.909368+0000","last_clean_scrub_stamp":"2024-08-31T04:44:21.909368+0000","objects_scrubbed":1195,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:59:41.257879+0000","scrub_duration":523,"objects_trimmed":0,"snaptrim_duration":0.0069147610000000002,"stat_sum":{"num_bytes":57940200,"num_objects":1195,"num_object_clones":554,"num_object_copies":4780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":554,"num_read":276,"num_read_kb":364684,"num_write":2343,"num_write_kb":69963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"48'674","reported_seq":2781,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.433766+0000","last_change":"2024-08-31T04:44:11.433704+0000","last_active":"2024-08-31T04:44:11.433766+0000","last_peered":"2024-08-31T04:44:11.433766+0000","last_clean":"2024-08-31T04:44:11.433766+0000","last_became_active":"2024-08-31T04:04:00.866729+0000","last_became_peered":"2024-08-31T04:04:00.866729+0000","last_unstale":"2024-08-31T04:44:11.433766+0000","last_undegraded":"2024-08-31T04:44:11.433766+0000","last_fullsized":"2024-08-31T04:44:11.433766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'674","last_scrub_stamp":"2024-08-31T04:44:11.433597+0000","last_deep_scrub":"48'674","last_deep_scrub_stamp":"2024-08-31T04:44:11.433597+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.433597+0000","objects_scrubbed":54,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:58:14.172176+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.0067171050000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"48'1668","reported_seq":1762,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.891177+0000","last_change":"2024-08-31T04:44:03.891004+0000","last_active":"2024-08-31T04:44:03.891177+0000","last_peered":"2024-08-31T04:44:03.891177+0000","last_clean":"2024-08-31T04:44:03.891177+0000","last_became_active":"2024-08-31T04:03:59.844777+0000","last_became_peered":"2024-08-31T04:03:59.844777+0000","last_unstale":"2024-08-31T04:44:03.891177+0000","last_undegraded":"2024-08-31T04:44:03.891177+0000","last_fullsized":"2024-08-31T04:44:03.891177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1668","last_scrub_stamp":"2024-08-31T04:44:03.890781+0000","last_deep_scrub":"48'1668","last_deep_scrub_stamp":"2024-08-31T04:44:03.890781+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.890781+0000","objects_scrubbed":48,"log_size":1668,"log_dups_size":0,"ondisk_log_size":1668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:50.294577+0000","scrub_duration":131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":1668,"num_write_kb":75070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":594210,"num_omap_keys":959,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"48'2903","reported_seq":4616,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.254216+0000","last_change":"2024-08-31T04:44:07.254216+0000","last_active":"2024-08-31T04:44:07.254216+0000","last_peered":"2024-08-31T04:44:07.254216+0000","last_clean":"2024-08-31T04:44:07.254216+0000","last_became_active":"2024-08-31T04:04:04.937474+0000","last_became_peered":"2024-08-31T04:04:04.937474+0000","last_unstale":"2024-08-31T04:44:07.254216+0000","last_undegraded":"2024-08-31T04:44:07.254216+0000","last_fullsized":"2024-08-31T04:44:07.254216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2903","last_scrub_stamp":"2024-08-31T04:44:07.254090+0000","last_deep_scrub":"48'2903","last_deep_scrub_stamp":"2024-08-31T04:44:07.254090+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.254090+0000","objects_scrubbed":1237,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:36.475214+0000","scrub_duration":595,"objects_trimmed":0,"snaptrim_duration":0.0059273310000000001,"stat_sum":{"num_bytes":26554957,"num_objects":1237,"num_object_clones":582,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":582,"num_read":132,"num_read_kb":127199,"num_write":2367,"num_write_kb":33368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"48'687","reported_seq":2796,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.882019+0000","last_change":"2024-08-31T04:44:05.881920+0000","last_active":"2024-08-31T04:44:05.882019+0000","last_peered":"2024-08-31T04:44:05.882019+0000","last_clean":"2024-08-31T04:44:05.882019+0000","last_became_active":"2024-08-31T04:04:00.883152+0000","last_became_peered":"2024-08-31T04:04:00.883152+0000","last_unstale":"2024-08-31T04:44:05.882019+0000","last_undegraded":"2024-08-31T04:44:05.882019+0000","last_fullsized":"2024-08-31T04:44:05.882019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'687","last_scrub_stamp":"2024-08-31T04:44:05.881817+0000","last_deep_scrub":"48'687","last_deep_scrub_stamp":"2024-08-31T04:44:05.881817+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.881817+0000","objects_scrubbed":50,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:24:48.612658+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0.0055968709999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"48'1211","reported_seq":1305,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.363204+0000","last_change":"2024-08-31T04:44:03.363043+0000","last_active":"2024-08-31T04:44:03.363204+0000","last_peered":"2024-08-31T04:44:03.363204+0000","last_clean":"2024-08-31T04:44:03.363204+0000","last_became_active":"2024-08-31T04:03:59.844539+0000","last_became_peered":"2024-08-31T04:03:59.844539+0000","last_unstale":"2024-08-31T04:44:03.363204+0000","last_undegraded":"2024-08-31T04:44:03.363204+0000","last_fullsized":"2024-08-31T04:44:03.363204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1211","last_scrub_stamp":"2024-08-31T04:44:03.362774+0000","last_deep_scrub":"48'1211","last_deep_scrub_stamp":"2024-08-31T04:44:03.362774+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.362774+0000","objects_scrubbed":47,"log_size":1211,"log_dups_size":0,"ondisk_log_size":1211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:24:16.404021+0000","scrub_duration":171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37753176,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":1208,"num_write_kb":91501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449875,"num_omap_keys":723,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"48'2868","reported_seq":4618,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:19.308384+0000","last_change":"2024-08-31T04:44:19.308156+0000","last_active":"2024-08-31T04:44:19.308384+0000","last_peered":"2024-08-31T04:44:19.308384+0000","last_clean":"2024-08-31T04:44:19.308384+0000","last_became_active":"2024-08-31T04:04:04.978510+0000","last_became_peered":"2024-08-31T04:04:04.978510+0000","last_unstale":"2024-08-31T04:44:19.308384+0000","last_undegraded":"2024-08-31T04:44:19.308384+0000","last_fullsized":"2024-08-31T04:44:19.308384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2868","last_scrub_stamp":"2024-08-31T04:44:19.307866+0000","last_deep_scrub":"48'2868","last_deep_scrub_stamp":"2024-08-31T04:44:19.307866+0000","last_clean_scrub_stamp":"2024-08-31T04:44:19.307866+0000","objects_scrubbed":1215,"log_size":2868,"log_dups_size":0,"ondisk_log_size":2868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:52.257464+0000","scrub_duration":975,"objects_trimmed":0,"snaptrim_duration":0.013964779,"stat_sum":{"num_bytes":24232544,"num_objects":1215,"num_object_clones":563,"num_object_copies":4860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":563,"num_read":151,"num_read_kb":172254,"num_write":2354,"num_write_kb":29314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"48'650","reported_seq":2762,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.836414+0000","last_change":"2024-08-31T04:44:07.836347+0000","last_active":"2024-08-31T04:44:07.836414+0000","last_peered":"2024-08-31T04:44:07.836414+0000","last_clean":"2024-08-31T04:44:07.836414+0000","last_became_active":"2024-08-31T04:04:00.872692+0000","last_became_peered":"2024-08-31T04:04:00.872692+0000","last_unstale":"2024-08-31T04:44:07.836414+0000","last_undegraded":"2024-08-31T04:44:07.836414+0000","last_fullsized":"2024-08-31T04:44:07.836414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'650","last_scrub_stamp":"2024-08-31T04:44:07.836266+0000","last_deep_scrub":"48'650","last_deep_scrub_stamp":"2024-08-31T04:44:07.836266+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.836266+0000","objects_scrubbed":41,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:40:20.977393+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0052273500000000004,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"48'599","reported_seq":694,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.009960+0000","last_change":"2024-08-31T04:44:08.009846+0000","last_active":"2024-08-31T04:44:08.009960+0000","last_peered":"2024-08-31T04:44:08.009960+0000","last_clean":"2024-08-31T04:44:08.009960+0000","last_became_active":"2024-08-31T04:03:59.853270+0000","last_became_peered":"2024-08-31T04:03:59.853270+0000","last_unstale":"2024-08-31T04:44:08.009960+0000","last_undegraded":"2024-08-31T04:44:08.009960+0000","last_fullsized":"2024-08-31T04:44:08.009960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'599","last_scrub_stamp":"2024-08-31T04:44:08.009712+0000","last_deep_scrub":"48'599","last_deep_scrub_stamp":"2024-08-31T04:44:08.009712+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.009712+0000","objects_scrubbed":52,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:12:25.518006+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":607,"num_write_kb":87317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":699385,"num_omap_keys":1095,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"48'2923","reported_seq":4683,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:22.997780+0000","last_change":"2024-08-31T04:44:22.997780+0000","last_active":"2024-08-31T04:44:22.997780+0000","last_peered":"2024-08-31T04:44:22.997780+0000","last_clean":"2024-08-31T04:44:22.997780+0000","last_became_active":"2024-08-31T04:04:04.918249+0000","last_became_peered":"2024-08-31T04:04:04.918249+0000","last_unstale":"2024-08-31T04:44:22.997780+0000","last_undegraded":"2024-08-31T04:44:22.997780+0000","last_fullsized":"2024-08-31T04:44:22.997780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2923","last_scrub_stamp":"2024-08-31T04:44:22.997683+0000","last_deep_scrub":"48'2923","last_deep_scrub_stamp":"2024-08-31T04:44:22.997683+0000","last_clean_scrub_stamp":"2024-08-31T04:44:22.997683+0000","objects_scrubbed":1235,"log_size":2923,"log_dups_size":0,"ondisk_log_size":2923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:27:05.291853+0000","scrub_duration":563,"objects_trimmed":0,"snaptrim_duration":0.0065855360000000003,"stat_sum":{"num_bytes":30081699,"num_objects":1235,"num_object_clones":576,"num_object_copies":4940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1235,"num_whiteouts":576,"num_read":173,"num_read_kb":193208,"num_write":2389,"num_write_kb":43568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"48'656","reported_seq":2766,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.743489+0000","last_change":"2024-08-31T04:44:07.743436+0000","last_active":"2024-08-31T04:44:07.743489+0000","last_peered":"2024-08-31T04:44:07.743489+0000","last_clean":"2024-08-31T04:44:07.743489+0000","last_became_active":"2024-08-31T04:04:00.875066+0000","last_became_peered":"2024-08-31T04:04:00.875066+0000","last_unstale":"2024-08-31T04:44:07.743489+0000","last_undegraded":"2024-08-31T04:44:07.743489+0000","last_fullsized":"2024-08-31T04:44:07.743489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'656","last_scrub_stamp":"2024-08-31T04:44:07.743351+0000","last_deep_scrub":"48'656","last_deep_scrub_stamp":"2024-08-31T04:44:07.743351+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.743351+0000","objects_scrubbed":39,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:49:25.522336+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0057184189999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"48'587","reported_seq":682,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:59.813290+0000","last_change":"2024-08-31T04:43:59.813232+0000","last_active":"2024-08-31T04:43:59.813290+0000","last_peered":"2024-08-31T04:43:59.813290+0000","last_clean":"2024-08-31T04:43:59.813290+0000","last_became_active":"2024-08-31T04:03:59.862997+0000","last_became_peered":"2024-08-31T04:03:59.862997+0000","last_unstale":"2024-08-31T04:43:59.813290+0000","last_undegraded":"2024-08-31T04:43:59.813290+0000","last_fullsized":"2024-08-31T04:43:59.813290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'587","last_scrub_stamp":"2024-08-31T04:43:59.813158+0000","last_deep_scrub":"48'587","last_deep_scrub_stamp":"2024-08-31T04:43:59.813158+0000","last_clean_scrub_stamp":"2024-08-31T04:43:59.813158+0000","objects_scrubbed":52,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:11:17.188105+0000","scrub_duration":119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971542,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":585,"num_write_kb":62565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":413993,"num_omap_keys":698,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"48'2832","reported_seq":4659,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.568084+0000","last_change":"2024-08-31T04:44:06.568084+0000","last_active":"2024-08-31T04:44:06.568084+0000","last_peered":"2024-08-31T04:44:06.568084+0000","last_clean":"2024-08-31T04:44:06.568084+0000","last_became_active":"2024-08-31T04:04:04.958438+0000","last_became_peered":"2024-08-31T04:04:04.958438+0000","last_unstale":"2024-08-31T04:44:06.568084+0000","last_undegraded":"2024-08-31T04:44:06.568084+0000","last_fullsized":"2024-08-31T04:44:06.568084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2832","last_scrub_stamp":"2024-08-31T04:44:06.567992+0000","last_deep_scrub":"48'2832","last_deep_scrub_stamp":"2024-08-31T04:44:06.567992+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.567992+0000","objects_scrubbed":1209,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:58:56.872310+0000","scrub_duration":575,"objects_trimmed":0,"snaptrim_duration":0.001644726,"stat_sum":{"num_bytes":45550886,"num_objects":1209,"num_object_clones":562,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1209,"num_whiteouts":562,"num_read":227,"num_read_kb":373101,"num_write":2312,"num_write_kb":56902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"48'663","reported_seq":2775,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.378734+0000","last_change":"2024-08-31T04:44:10.378734+0000","last_active":"2024-08-31T04:44:10.378734+0000","last_peered":"2024-08-31T04:44:10.378734+0000","last_clean":"2024-08-31T04:44:10.378734+0000","last_became_active":"2024-08-31T04:04:00.864250+0000","last_became_peered":"2024-08-31T04:04:00.864250+0000","last_unstale":"2024-08-31T04:44:10.378734+0000","last_undegraded":"2024-08-31T04:44:10.378734+0000","last_fullsized":"2024-08-31T04:44:10.378734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'663","last_scrub_stamp":"2024-08-31T04:44:10.378648+0000","last_deep_scrub":"48'663","last_deep_scrub_stamp":"2024-08-31T04:44:10.378648+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.378648+0000","objects_scrubbed":33,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:46.222260+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0051653649999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":7,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"48'739","reported_seq":833,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.054463+0000","last_change":"2024-08-31T04:44:13.054463+0000","last_active":"2024-08-31T04:44:13.054463+0000","last_peered":"2024-08-31T04:44:13.054463+0000","last_clean":"2024-08-31T04:44:13.054463+0000","last_became_active":"2024-08-31T04:03:59.855010+0000","last_became_peered":"2024-08-31T04:03:59.855010+0000","last_unstale":"2024-08-31T04:44:13.054463+0000","last_undegraded":"2024-08-31T04:44:13.054463+0000","last_fullsized":"2024-08-31T04:44:13.054463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'739","last_scrub_stamp":"2024-08-31T04:44:13.054216+0000","last_deep_scrub":"48'739","last_deep_scrub_stamp":"2024-08-31T04:44:13.054216+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.054216+0000","objects_scrubbed":58,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:53:11.077347+0000","scrub_duration":107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":760,"num_write_kb":71301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":785587,"num_omap_keys":1122,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"48'2735","reported_seq":4448,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:22.002072+0000","last_change":"2024-08-31T04:44:22.002072+0000","last_active":"2024-08-31T04:44:22.002072+0000","last_peered":"2024-08-31T04:44:22.002072+0000","last_clean":"2024-08-31T04:44:22.002072+0000","last_became_active":"2024-08-31T04:04:04.964306+0000","last_became_peered":"2024-08-31T04:04:04.964306+0000","last_unstale":"2024-08-31T04:44:22.002072+0000","last_undegraded":"2024-08-31T04:44:22.002072+0000","last_fullsized":"2024-08-31T04:44:22.002072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2735","last_scrub_stamp":"2024-08-31T04:44:22.001910+0000","last_deep_scrub":"48'2735","last_deep_scrub_stamp":"2024-08-31T04:44:22.001910+0000","last_clean_scrub_stamp":"2024-08-31T04:44:22.001910+0000","objects_scrubbed":1152,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:16:02.490650+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0.012604237000000001,"stat_sum":{"num_bytes":16809799,"num_objects":1152,"num_object_clones":538,"num_object_copies":4608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":538,"num_read":93,"num_read_kb":855,"num_write":2242,"num_write_kb":21215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"48'652","reported_seq":2759,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.076481+0000","last_change":"2024-08-31T04:44:01.076481+0000","last_active":"2024-08-31T04:44:01.076481+0000","last_peered":"2024-08-31T04:44:01.076481+0000","last_clean":"2024-08-31T04:44:01.076481+0000","last_became_active":"2024-08-31T04:04:00.879847+0000","last_became_peered":"2024-08-31T04:04:00.879847+0000","last_unstale":"2024-08-31T04:44:01.076481+0000","last_undegraded":"2024-08-31T04:44:01.076481+0000","last_fullsized":"2024-08-31T04:44:01.076481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'652","last_scrub_stamp":"2024-08-31T04:44:01.076372+0000","last_deep_scrub":"48'652","last_deep_scrub_stamp":"2024-08-31T04:44:01.076372+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.076372+0000","objects_scrubbed":40,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:37:37.836214+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0036328670000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":12,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"48'397","reported_seq":490,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:58.788531+0000","last_change":"2024-08-31T04:43:58.788531+0000","last_active":"2024-08-31T04:43:58.788531+0000","last_peered":"2024-08-31T04:43:58.788531+0000","last_clean":"2024-08-31T04:43:58.788531+0000","last_became_active":"2024-08-31T04:03:59.839261+0000","last_became_peered":"2024-08-31T04:03:59.839261+0000","last_unstale":"2024-08-31T04:43:58.788531+0000","last_undegraded":"2024-08-31T04:43:58.788531+0000","last_fullsized":"2024-08-31T04:43:58.788531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'397","last_scrub_stamp":"2024-08-31T04:43:58.788449+0000","last_deep_scrub":"48'397","last_deep_scrub_stamp":"2024-08-31T04:43:58.788449+0000","last_clean_scrub_stamp":"2024-08-31T04:43:58.788449+0000","objects_scrubbed":39,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:15.834647+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":374,"num_write_kb":62134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":425438,"num_omap_keys":783,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"48'3078","reported_seq":4763,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:20.011489+0000","last_change":"2024-08-31T04:44:20.011489+0000","last_active":"2024-08-31T04:44:20.011489+0000","last_peered":"2024-08-31T04:44:20.011489+0000","last_clean":"2024-08-31T04:44:20.011489+0000","last_became_active":"2024-08-31T04:04:04.966272+0000","last_became_peered":"2024-08-31T04:04:04.966272+0000","last_unstale":"2024-08-31T04:44:20.011489+0000","last_undegraded":"2024-08-31T04:44:20.011489+0000","last_fullsized":"2024-08-31T04:44:20.011489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3078","last_scrub_stamp":"2024-08-31T04:44:20.011370+0000","last_deep_scrub":"48'3078","last_deep_scrub_stamp":"2024-08-31T04:44:20.011370+0000","last_clean_scrub_stamp":"2024-08-31T04:44:20.011370+0000","objects_scrubbed":1354,"log_size":3078,"log_dups_size":0,"ondisk_log_size":3078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:29.393007+0000","scrub_duration":715,"objects_trimmed":0,"snaptrim_duration":0.012777844,"stat_sum":{"num_bytes":35172120,"num_objects":1354,"num_object_clones":682,"num_object_copies":5416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1354,"num_whiteouts":594,"num_read":201,"num_read_kb":245482,"num_write":2432,"num_write_kb":44882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"48'658","reported_seq":2771,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.367050+0000","last_change":"2024-08-31T04:44:12.367050+0000","last_active":"2024-08-31T04:44:12.367050+0000","last_peered":"2024-08-31T04:44:12.367050+0000","last_clean":"2024-08-31T04:44:12.367050+0000","last_became_active":"2024-08-31T04:04:41.425024+0000","last_became_peered":"2024-08-31T04:04:41.425024+0000","last_unstale":"2024-08-31T04:44:12.367050+0000","last_undegraded":"2024-08-31T04:44:12.367050+0000","last_fullsized":"2024-08-31T04:44:12.367050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'658","last_scrub_stamp":"2024-08-31T04:44:12.366949+0000","last_deep_scrub":"48'658","last_deep_scrub_stamp":"2024-08-31T04:44:12.366949+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.366949+0000","objects_scrubbed":38,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:30:28.944548+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.006804175,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"48'560","reported_seq":653,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:04.517252+0000","last_change":"2024-08-31T04:44:04.517252+0000","last_active":"2024-08-31T04:44:04.517252+0000","last_peered":"2024-08-31T04:44:04.517252+0000","last_clean":"2024-08-31T04:44:04.517252+0000","last_became_active":"2024-08-31T04:03:59.854859+0000","last_became_peered":"2024-08-31T04:03:59.854859+0000","last_unstale":"2024-08-31T04:44:04.517252+0000","last_undegraded":"2024-08-31T04:44:04.517252+0000","last_fullsized":"2024-08-31T04:44:04.517252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'560","last_scrub_stamp":"2024-08-31T04:44:04.517141+0000","last_deep_scrub":"48'560","last_deep_scrub_stamp":"2024-08-31T04:44:04.517141+0000","last_clean_scrub_stamp":"2024-08-31T04:44:04.517141+0000","objects_scrubbed":46,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:05:32.497794+0000","scrub_duration":107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":556,"num_write_kb":54279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":460677,"num_omap_keys":837,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"48'2880","reported_seq":4659,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.674306+0000","last_change":"2024-08-31T04:44:16.674306+0000","last_active":"2024-08-31T04:44:16.674306+0000","last_peered":"2024-08-31T04:44:16.674306+0000","last_clean":"2024-08-31T04:44:16.674306+0000","last_became_active":"2024-08-31T04:04:04.960412+0000","last_became_peered":"2024-08-31T04:04:04.960412+0000","last_unstale":"2024-08-31T04:44:16.674306+0000","last_undegraded":"2024-08-31T04:44:16.674306+0000","last_fullsized":"2024-08-31T04:44:16.674306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2880","last_scrub_stamp":"2024-08-31T04:44:16.674065+0000","last_deep_scrub":"48'2880","last_deep_scrub_stamp":"2024-08-31T04:44:16.674065+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.674065+0000","objects_scrubbed":1251,"log_size":2880,"log_dups_size":0,"ondisk_log_size":2880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:14:13.795497+0000","scrub_duration":871,"objects_trimmed":0,"snaptrim_duration":0.025415436,"stat_sum":{"num_bytes":43622224,"num_objects":1251,"num_object_clones":583,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1251,"num_whiteouts":583,"num_read":199,"num_read_kb":207126,"num_write":2328,"num_write_kb":56286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"48'617","reported_seq":2727,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.862896+0000","last_change":"2024-08-31T04:44:06.862896+0000","last_active":"2024-08-31T04:44:06.862896+0000","last_peered":"2024-08-31T04:44:06.862896+0000","last_clean":"2024-08-31T04:44:06.862896+0000","last_became_active":"2024-08-31T04:04:00.885890+0000","last_became_peered":"2024-08-31T04:04:00.885890+0000","last_unstale":"2024-08-31T04:44:06.862896+0000","last_undegraded":"2024-08-31T04:44:06.862896+0000","last_fullsized":"2024-08-31T04:44:06.862896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'617","last_scrub_stamp":"2024-08-31T04:44:06.862802+0000","last_deep_scrub":"48'617","last_deep_scrub_stamp":"2024-08-31T04:44:06.862802+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.862802+0000","objects_scrubbed":32,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:08.440446+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.023919682000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"48'1314","reported_seq":1408,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.597343+0000","last_change":"2024-08-31T04:44:07.597343+0000","last_active":"2024-08-31T04:44:07.597343+0000","last_peered":"2024-08-31T04:44:07.597343+0000","last_clean":"2024-08-31T04:44:07.597343+0000","last_became_active":"2024-08-31T04:03:59.868447+0000","last_became_peered":"2024-08-31T04:03:59.868447+0000","last_unstale":"2024-08-31T04:44:07.597343+0000","last_undegraded":"2024-08-31T04:44:07.597343+0000","last_fullsized":"2024-08-31T04:44:07.597343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1314","last_scrub_stamp":"2024-08-31T04:44:07.597116+0000","last_deep_scrub":"48'1314","last_deep_scrub_stamp":"2024-08-31T04:44:07.597116+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.597116+0000","objects_scrubbed":57,"log_size":1314,"log_dups_size":0,"ondisk_log_size":1314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:12:22.894549+0000","scrub_duration":131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1306,"num_write_kb":67222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":571475,"num_omap_keys":1097,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"48'2891","reported_seq":4642,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:25.100321+0000","last_change":"2024-08-31T04:44:25.100321+0000","last_active":"2024-08-31T04:44:25.100321+0000","last_peered":"2024-08-31T04:44:25.100321+0000","last_clean":"2024-08-31T04:44:25.100321+0000","last_became_active":"2024-08-31T04:04:04.966382+0000","last_became_peered":"2024-08-31T04:04:04.966382+0000","last_unstale":"2024-08-31T04:44:25.100321+0000","last_undegraded":"2024-08-31T04:44:25.100321+0000","last_fullsized":"2024-08-31T04:44:25.100321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2891","last_scrub_stamp":"2024-08-31T04:44:25.100230+0000","last_deep_scrub":"48'2891","last_deep_scrub_stamp":"2024-08-31T04:44:25.100230+0000","last_clean_scrub_stamp":"2024-08-31T04:44:25.100230+0000","objects_scrubbed":1260,"log_size":2891,"log_dups_size":0,"ondisk_log_size":2891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:33:36.547885+0000","scrub_duration":667,"objects_trimmed":0,"snaptrim_duration":0.0069575569999999996,"stat_sum":{"num_bytes":34789039,"num_objects":1260,"num_object_clones":583,"num_object_copies":5040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1260,"num_whiteouts":583,"num_read":172,"num_read_kb":170440,"num_write":2360,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"48'659","reported_seq":2768,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.878191+0000","last_change":"2024-08-31T04:44:06.878191+0000","last_active":"2024-08-31T04:44:06.878191+0000","last_peered":"2024-08-31T04:44:06.878191+0000","last_clean":"2024-08-31T04:44:06.878191+0000","last_became_active":"2024-08-31T04:04:00.886455+0000","last_became_peered":"2024-08-31T04:04:00.886455+0000","last_unstale":"2024-08-31T04:44:06.878191+0000","last_undegraded":"2024-08-31T04:44:06.878191+0000","last_fullsized":"2024-08-31T04:44:06.878191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'659","last_scrub_stamp":"2024-08-31T04:44:06.878102+0000","last_deep_scrub":"48'659","last_deep_scrub_stamp":"2024-08-31T04:44:06.878102+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.878102+0000","objects_scrubbed":50,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:16:14.900927+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0047916210000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"48'1203","reported_seq":1296,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:00.839328+0000","last_change":"2024-08-31T04:44:00.839328+0000","last_active":"2024-08-31T04:44:00.839328+0000","last_peered":"2024-08-31T04:44:00.839328+0000","last_clean":"2024-08-31T04:44:00.839328+0000","last_became_active":"2024-08-31T04:03:59.845070+0000","last_became_peered":"2024-08-31T04:03:59.845070+0000","last_unstale":"2024-08-31T04:44:00.839328+0000","last_undegraded":"2024-08-31T04:44:00.839328+0000","last_fullsized":"2024-08-31T04:44:00.839328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1203","last_scrub_stamp":"2024-08-31T04:44:00.839183+0000","last_deep_scrub":"48'1203","last_deep_scrub_stamp":"2024-08-31T04:44:00.839183+0000","last_clean_scrub_stamp":"2024-08-31T04:44:00.839183+0000","objects_scrubbed":48,"log_size":1203,"log_dups_size":0,"ondisk_log_size":1203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:05:01.631410+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555104,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":1203,"num_write_kb":103869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":503248,"num_omap_keys":844,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"48'2948","reported_seq":4675,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.562805+0000","last_change":"2024-08-31T04:44:15.562805+0000","last_active":"2024-08-31T04:44:15.562805+0000","last_peered":"2024-08-31T04:44:15.562805+0000","last_clean":"2024-08-31T04:44:15.562805+0000","last_became_active":"2024-08-31T04:04:04.959958+0000","last_became_peered":"2024-08-31T04:04:04.959958+0000","last_unstale":"2024-08-31T04:44:15.562805+0000","last_undegraded":"2024-08-31T04:44:15.562805+0000","last_fullsized":"2024-08-31T04:44:15.562805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2948","last_scrub_stamp":"2024-08-31T04:44:15.562648+0000","last_deep_scrub":"48'2948","last_deep_scrub_stamp":"2024-08-31T04:44:15.562648+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.562648+0000","objects_scrubbed":1250,"log_size":2948,"log_dups_size":0,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:20:17.506846+0000","scrub_duration":615,"objects_trimmed":0,"snaptrim_duration":0.0046964119999999996,"stat_sum":{"num_bytes":37035283,"num_objects":1250,"num_object_clones":626,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":538,"num_read":190,"num_read_kb":163631,"num_write":2363,"num_write_kb":48541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"48'664","reported_seq":2773,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.362551+0000","last_change":"2024-08-31T04:44:14.362551+0000","last_active":"2024-08-31T04:44:14.362551+0000","last_peered":"2024-08-31T04:44:14.362551+0000","last_clean":"2024-08-31T04:44:14.362551+0000","last_became_active":"2024-08-31T04:04:00.869035+0000","last_became_peered":"2024-08-31T04:04:00.869035+0000","last_unstale":"2024-08-31T04:44:14.362551+0000","last_undegraded":"2024-08-31T04:44:14.362551+0000","last_fullsized":"2024-08-31T04:44:14.362551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'664","last_scrub_stamp":"2024-08-31T04:44:14.362422+0000","last_deep_scrub":"48'664","last_deep_scrub_stamp":"2024-08-31T04:44:14.362422+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.362422+0000","objects_scrubbed":36,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:35:48.129891+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.006690306,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"48'1433","reported_seq":1526,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.722424+0000","last_change":"2024-08-31T04:44:02.722424+0000","last_active":"2024-08-31T04:44:02.722424+0000","last_peered":"2024-08-31T04:44:02.722424+0000","last_clean":"2024-08-31T04:44:02.722424+0000","last_became_active":"2024-08-31T04:03:59.868333+0000","last_became_peered":"2024-08-31T04:03:59.868333+0000","last_unstale":"2024-08-31T04:44:02.722424+0000","last_undegraded":"2024-08-31T04:44:02.722424+0000","last_fullsized":"2024-08-31T04:44:02.722424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1433","last_scrub_stamp":"2024-08-31T04:44:02.722333+0000","last_deep_scrub":"48'1433","last_deep_scrub_stamp":"2024-08-31T04:44:02.722333+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.722333+0000","objects_scrubbed":53,"log_size":1433,"log_dups_size":0,"ondisk_log_size":1433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:35:37.297915+0000","scrub_duration":195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554522,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1433,"num_write_kb":71604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":698912,"num_omap_keys":1223,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"48'2822","reported_seq":4562,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.257782+0000","last_change":"2024-08-31T04:44:06.257782+0000","last_active":"2024-08-31T04:44:06.257782+0000","last_peered":"2024-08-31T04:44:06.257782+0000","last_clean":"2024-08-31T04:44:06.257782+0000","last_became_active":"2024-08-31T04:04:04.940204+0000","last_became_peered":"2024-08-31T04:04:04.940204+0000","last_unstale":"2024-08-31T04:44:06.257782+0000","last_undegraded":"2024-08-31T04:44:06.257782+0000","last_fullsized":"2024-08-31T04:44:06.257782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2822","last_scrub_stamp":"2024-08-31T04:44:06.257645+0000","last_deep_scrub":"48'2822","last_deep_scrub_stamp":"2024-08-31T04:44:06.257645+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.257645+0000","objects_scrubbed":1254,"log_size":2822,"log_dups_size":0,"ondisk_log_size":2822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:49:51.366948+0000","scrub_duration":587,"objects_trimmed":0,"snaptrim_duration":0.0060660929999999998,"stat_sum":{"num_bytes":30139631,"num_objects":1254,"num_object_clones":586,"num_object_copies":5016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1254,"num_whiteouts":586,"num_read":163,"num_read_kb":134524,"num_write":2263,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"48'639","reported_seq":2748,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.315033+0000","last_change":"2024-08-31T04:44:07.315033+0000","last_active":"2024-08-31T04:44:07.315033+0000","last_peered":"2024-08-31T04:44:07.315033+0000","last_clean":"2024-08-31T04:44:07.315033+0000","last_became_active":"2024-08-31T04:04:00.881124+0000","last_became_peered":"2024-08-31T04:04:00.881124+0000","last_unstale":"2024-08-31T04:44:07.315033+0000","last_undegraded":"2024-08-31T04:44:07.315033+0000","last_fullsized":"2024-08-31T04:44:07.315033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'639","last_scrub_stamp":"2024-08-31T04:44:07.314825+0000","last_deep_scrub":"48'639","last_deep_scrub_stamp":"2024-08-31T04:44:07.314825+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.314825+0000","objects_scrubbed":37,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:27:10.387198+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0.012319801999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"48'1677","reported_seq":1770,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.918816+0000","last_change":"2024-08-31T04:44:01.918816+0000","last_active":"2024-08-31T04:44:01.918816+0000","last_peered":"2024-08-31T04:44:01.918816+0000","last_clean":"2024-08-31T04:44:01.918816+0000","last_became_active":"2024-08-31T04:03:59.851155+0000","last_became_peered":"2024-08-31T04:03:59.851155+0000","last_unstale":"2024-08-31T04:44:01.918816+0000","last_undegraded":"2024-08-31T04:44:01.918816+0000","last_fullsized":"2024-08-31T04:44:01.918816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1677","last_scrub_stamp":"2024-08-31T04:44:01.918707+0000","last_deep_scrub":"48'1677","last_deep_scrub_stamp":"2024-08-31T04:44:01.918707+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.918707+0000","objects_scrubbed":65,"log_size":1677,"log_dups_size":0,"ondisk_log_size":1677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:25:16.053642+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1665,"num_write_kb":95716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":642113,"num_omap_keys":1090,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"48'2860","reported_seq":4705,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.251878+0000","last_change":"2024-08-31T04:44:10.251878+0000","last_active":"2024-08-31T04:44:10.251878+0000","last_peered":"2024-08-31T04:44:10.251878+0000","last_clean":"2024-08-31T04:44:10.251878+0000","last_became_active":"2024-08-31T04:04:04.947363+0000","last_became_peered":"2024-08-31T04:04:04.947363+0000","last_unstale":"2024-08-31T04:44:10.251878+0000","last_undegraded":"2024-08-31T04:44:10.251878+0000","last_fullsized":"2024-08-31T04:44:10.251878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2860","last_scrub_stamp":"2024-08-31T04:44:10.251666+0000","last_deep_scrub":"48'2860","last_deep_scrub_stamp":"2024-08-31T04:44:10.251666+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.251666+0000","objects_scrubbed":1208,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:00:33.958640+0000","scrub_duration":775,"objects_trimmed":0,"snaptrim_duration":0.006760248,"stat_sum":{"num_bytes":54090295,"num_objects":1208,"num_object_clones":563,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":563,"num_read":248,"num_read_kb":382949,"num_write":2323,"num_write_kb":60670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"48'656","reported_seq":2764,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.738065+0000","last_change":"2024-08-31T04:44:08.738065+0000","last_active":"2024-08-31T04:44:08.738065+0000","last_peered":"2024-08-31T04:44:08.738065+0000","last_clean":"2024-08-31T04:44:08.738065+0000","last_became_active":"2024-08-31T04:04:00.862912+0000","last_became_peered":"2024-08-31T04:04:00.862912+0000","last_unstale":"2024-08-31T04:44:08.738065+0000","last_undegraded":"2024-08-31T04:44:08.738065+0000","last_fullsized":"2024-08-31T04:44:08.738065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'656","last_scrub_stamp":"2024-08-31T04:44:08.737953+0000","last_deep_scrub":"48'656","last_deep_scrub_stamp":"2024-08-31T04:44:08.737953+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.737953+0000","objects_scrubbed":40,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:56:38.308269+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0058567369999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":10,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"48'1010","reported_seq":1274,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:43:59.126332+0000","last_change":"2024-08-31T04:43:59.126332+0000","last_active":"2024-08-31T04:43:59.126332+0000","last_peered":"2024-08-31T04:43:59.126332+0000","last_clean":"2024-08-31T04:43:59.126332+0000","last_became_active":"2024-08-31T04:03:59.857814+0000","last_became_peered":"2024-08-31T04:03:59.857814+0000","last_unstale":"2024-08-31T04:43:59.126332+0000","last_undegraded":"2024-08-31T04:43:59.126332+0000","last_fullsized":"2024-08-31T04:43:59.126332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1010","last_scrub_stamp":"2024-08-31T04:43:59.126230+0000","last_deep_scrub":"48'1010","last_deep_scrub_stamp":"2024-08-31T04:43:59.126230+0000","last_clean_scrub_stamp":"2024-08-31T04:43:59.126230+0000","objects_scrubbed":56,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:24:05.247379+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21620066,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":215,"num_read_kb":746,"num_write":1006,"num_write_kb":67606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":629659,"num_omap_keys":1052,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"48'2946","reported_seq":4724,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.579621+0000","last_change":"2024-08-31T04:44:11.579621+0000","last_active":"2024-08-31T04:44:11.579621+0000","last_peered":"2024-08-31T04:44:11.579621+0000","last_clean":"2024-08-31T04:44:11.579621+0000","last_became_active":"2024-08-31T04:04:04.937854+0000","last_became_peered":"2024-08-31T04:04:04.937854+0000","last_unstale":"2024-08-31T04:44:11.579621+0000","last_undegraded":"2024-08-31T04:44:11.579621+0000","last_fullsized":"2024-08-31T04:44:11.579621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2946","last_scrub_stamp":"2024-08-31T04:44:11.579447+0000","last_deep_scrub":"48'2946","last_deep_scrub_stamp":"2024-08-31T04:44:11.579447+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.579447+0000","objects_scrubbed":1219,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:04.492693+0000","scrub_duration":671,"objects_trimmed":0,"snaptrim_duration":0.017565338,"stat_sum":{"num_bytes":42002217,"num_objects":1219,"num_object_clones":563,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1219,"num_whiteouts":563,"num_read":180,"num_read_kb":308227,"num_write":2428,"num_write_kb":54614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"48'2738","reported_seq":4530,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.565459+0000","last_change":"2024-08-31T04:44:16.565459+0000","last_active":"2024-08-31T04:44:16.565459+0000","last_peered":"2024-08-31T04:44:16.565459+0000","last_clean":"2024-08-31T04:44:16.565459+0000","last_became_active":"2024-08-31T04:04:04.969311+0000","last_became_peered":"2024-08-31T04:04:04.969311+0000","last_unstale":"2024-08-31T04:44:16.565459+0000","last_undegraded":"2024-08-31T04:44:16.565459+0000","last_fullsized":"2024-08-31T04:44:16.565459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2738","last_scrub_stamp":"2024-08-31T04:44:16.565292+0000","last_deep_scrub":"48'2738","last_deep_scrub_stamp":"2024-08-31T04:44:16.565292+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.565292+0000","objects_scrubbed":1162,"log_size":2738,"log_dups_size":0,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:18:32.865249+0000","scrub_duration":611,"objects_trimmed":0,"snaptrim_duration":0.017721323000000001,"stat_sum":{"num_bytes":29550305,"num_objects":1162,"num_object_clones":544,"num_object_copies":4648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":544,"num_read":174,"num_read_kb":171691,"num_write":2228,"num_write_kb":37428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"48'634","reported_seq":2746,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.029410+0000","last_change":"2024-08-31T04:44:05.029410+0000","last_active":"2024-08-31T04:44:05.029410+0000","last_peered":"2024-08-31T04:44:05.029410+0000","last_clean":"2024-08-31T04:44:05.029410+0000","last_became_active":"2024-08-31T04:04:00.896687+0000","last_became_peered":"2024-08-31T04:04:00.896687+0000","last_unstale":"2024-08-31T04:44:05.029410+0000","last_undegraded":"2024-08-31T04:44:05.029410+0000","last_fullsized":"2024-08-31T04:44:05.029410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'634","last_scrub_stamp":"2024-08-31T04:44:05.029200+0000","last_deep_scrub":"48'634","last_deep_scrub_stamp":"2024-08-31T04:44:05.029200+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.029200+0000","objects_scrubbed":33,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:05:31.669864+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.018675580000000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"48'1921","reported_seq":2014,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.448873+0000","last_change":"2024-08-31T04:44:07.448873+0000","last_active":"2024-08-31T04:44:07.448873+0000","last_peered":"2024-08-31T04:44:07.448873+0000","last_clean":"2024-08-31T04:44:07.448873+0000","last_became_active":"2024-08-31T04:03:59.833174+0000","last_became_peered":"2024-08-31T04:03:59.833174+0000","last_unstale":"2024-08-31T04:44:07.448873+0000","last_undegraded":"2024-08-31T04:44:07.448873+0000","last_fullsized":"2024-08-31T04:44:07.448873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1921","last_scrub_stamp":"2024-08-31T04:44:07.448796+0000","last_deep_scrub":"48'1921","last_deep_scrub_stamp":"2024-08-31T04:44:07.448796+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.448796+0000","objects_scrubbed":53,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:41:15.969625+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":1929,"num_write_kb":92217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":951852,"num_omap_keys":1509,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"48'2766","reported_seq":4539,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.371780+0000","last_change":"2024-08-31T04:44:15.371671+0000","last_active":"2024-08-31T04:44:15.371780+0000","last_peered":"2024-08-31T04:44:15.371780+0000","last_clean":"2024-08-31T04:44:15.371780+0000","last_became_active":"2024-08-31T04:04:41.417946+0000","last_became_peered":"2024-08-31T04:04:41.417946+0000","last_unstale":"2024-08-31T04:44:15.371780+0000","last_undegraded":"2024-08-31T04:44:15.371780+0000","last_fullsized":"2024-08-31T04:44:15.371780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2766","last_scrub_stamp":"2024-08-31T04:44:15.371575+0000","last_deep_scrub":"48'2766","last_deep_scrub_stamp":"2024-08-31T04:44:15.371575+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.371575+0000","objects_scrubbed":1177,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:51:27.408515+0000","scrub_duration":571,"objects_trimmed":0,"snaptrim_duration":0.00503113,"stat_sum":{"num_bytes":35643591,"num_objects":1177,"num_object_clones":542,"num_object_copies":4708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1177,"num_whiteouts":542,"num_read":159,"num_read_kb":132474,"num_write":2281,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5,1],"acting":[0,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'745","reported_seq":2851,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.287109+0000","last_change":"2024-08-31T04:44:12.287109+0000","last_active":"2024-08-31T04:44:12.287109+0000","last_peered":"2024-08-31T04:44:12.287109+0000","last_clean":"2024-08-31T04:44:12.287109+0000","last_became_active":"2024-08-31T04:04:00.887378+0000","last_became_peered":"2024-08-31T04:04:00.887378+0000","last_unstale":"2024-08-31T04:44:12.287109+0000","last_undegraded":"2024-08-31T04:44:12.287109+0000","last_fullsized":"2024-08-31T04:44:12.287109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'745","last_scrub_stamp":"2024-08-31T04:44:12.286949+0000","last_deep_scrub":"48'745","last_deep_scrub_stamp":"2024-08-31T04:44:12.286949+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.286949+0000","objects_scrubbed":41,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:49:09.153249+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.014046813,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"48'704","reported_seq":797,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.933849+0000","last_change":"2024-08-31T04:44:02.933849+0000","last_active":"2024-08-31T04:44:02.933849+0000","last_peered":"2024-08-31T04:44:02.933849+0000","last_clean":"2024-08-31T04:44:02.933849+0000","last_became_active":"2024-08-31T04:03:59.851711+0000","last_became_peered":"2024-08-31T04:03:59.851711+0000","last_unstale":"2024-08-31T04:44:02.933849+0000","last_undegraded":"2024-08-31T04:44:02.933849+0000","last_fullsized":"2024-08-31T04:44:02.933849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'704","last_scrub_stamp":"2024-08-31T04:44:02.933628+0000","last_deep_scrub":"48'704","last_deep_scrub_stamp":"2024-08-31T04:44:02.933628+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.933628+0000","objects_scrubbed":59,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:43:25.369219+0000","scrub_duration":147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":715,"num_write_kb":62992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":875547,"num_omap_keys":1531,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"48'2303","reported_seq":2396,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.457237+0000","last_change":"2024-08-31T04:44:06.457237+0000","last_active":"2024-08-31T04:44:06.457237+0000","last_peered":"2024-08-31T04:44:06.457237+0000","last_clean":"2024-08-31T04:44:06.457237+0000","last_became_active":"2024-08-31T04:03:59.839622+0000","last_became_peered":"2024-08-31T04:03:59.839622+0000","last_unstale":"2024-08-31T04:44:06.457237+0000","last_undegraded":"2024-08-31T04:44:06.457237+0000","last_fullsized":"2024-08-31T04:44:06.457237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2303","last_scrub_stamp":"2024-08-31T04:44:06.457084+0000","last_deep_scrub":"48'2303","last_deep_scrub_stamp":"2024-08-31T04:44:06.457084+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.457084+0000","objects_scrubbed":51,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:48:49.770580+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2298,"num_write_kb":79805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":581696,"num_omap_keys":975,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"48'652","reported_seq":2759,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.005654+0000","last_change":"2024-08-31T04:44:06.005654+0000","last_active":"2024-08-31T04:44:06.005654+0000","last_peered":"2024-08-31T04:44:06.005654+0000","last_clean":"2024-08-31T04:44:06.005654+0000","last_became_active":"2024-08-31T04:04:00.896773+0000","last_became_peered":"2024-08-31T04:04:00.896773+0000","last_unstale":"2024-08-31T04:44:06.005654+0000","last_undegraded":"2024-08-31T04:44:06.005654+0000","last_fullsized":"2024-08-31T04:44:06.005654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'652","last_scrub_stamp":"2024-08-31T04:44:06.005491+0000","last_deep_scrub":"48'652","last_deep_scrub_stamp":"2024-08-31T04:44:06.005491+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.005491+0000","objects_scrubbed":40,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:09.157917+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.013275207000000001,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":11,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"48'2940","reported_seq":4687,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:17.459626+0000","last_change":"2024-08-31T04:44:17.459626+0000","last_active":"2024-08-31T04:44:17.459626+0000","last_peered":"2024-08-31T04:44:17.459626+0000","last_clean":"2024-08-31T04:44:17.459626+0000","last_became_active":"2024-08-31T04:04:04.960035+0000","last_became_peered":"2024-08-31T04:04:04.960035+0000","last_unstale":"2024-08-31T04:44:17.459626+0000","last_undegraded":"2024-08-31T04:44:17.459626+0000","last_fullsized":"2024-08-31T04:44:17.459626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2940","last_scrub_stamp":"2024-08-31T04:44:17.459517+0000","last_deep_scrub":"48'2940","last_deep_scrub_stamp":"2024-08-31T04:44:17.459517+0000","last_clean_scrub_stamp":"2024-08-31T04:44:17.459517+0000","objects_scrubbed":1259,"log_size":2940,"log_dups_size":0,"ondisk_log_size":2940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:49.023301+0000","scrub_duration":555,"objects_trimmed":0,"snaptrim_duration":0.016882483,"stat_sum":{"num_bytes":22283462,"num_objects":1259,"num_object_clones":585,"num_object_copies":5036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1259,"num_whiteouts":585,"num_read":170,"num_read_kb":61710,"num_write":2408,"num_write_kb":31485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"48'1176","reported_seq":1268,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.349149+0000","last_change":"2024-08-31T04:44:06.349149+0000","last_active":"2024-08-31T04:44:06.349149+0000","last_peered":"2024-08-31T04:44:06.349149+0000","last_clean":"2024-08-31T04:44:06.349149+0000","last_became_active":"2024-08-31T04:03:59.861021+0000","last_became_peered":"2024-08-31T04:03:59.861021+0000","last_unstale":"2024-08-31T04:44:06.349149+0000","last_undegraded":"2024-08-31T04:44:06.349149+0000","last_fullsized":"2024-08-31T04:44:06.349149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1176","last_scrub_stamp":"2024-08-31T04:44:06.349029+0000","last_deep_scrub":"48'1176","last_deep_scrub_stamp":"2024-08-31T04:44:06.349029+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.349029+0000","objects_scrubbed":46,"log_size":1176,"log_dups_size":0,"ondisk_log_size":1176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:20:27.884469+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1166,"num_write_kb":91251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":358024,"num_omap_keys":600,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"48'684","reported_seq":2792,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.047048+0000","last_change":"2024-08-31T04:44:02.047048+0000","last_active":"2024-08-31T04:44:02.047048+0000","last_peered":"2024-08-31T04:44:02.047048+0000","last_clean":"2024-08-31T04:44:02.047048+0000","last_became_active":"2024-08-31T04:04:00.878223+0000","last_became_peered":"2024-08-31T04:04:00.878223+0000","last_unstale":"2024-08-31T04:44:02.047048+0000","last_undegraded":"2024-08-31T04:44:02.047048+0000","last_fullsized":"2024-08-31T04:44:02.047048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'684","last_scrub_stamp":"2024-08-31T04:44:02.046977+0000","last_deep_scrub":"48'684","last_deep_scrub_stamp":"2024-08-31T04:44:02.046977+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.046977+0000","objects_scrubbed":50,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:02.397018+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0038995560000000002,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"48'2848","reported_seq":4629,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.222550+0000","last_change":"2024-08-31T04:44:12.222550+0000","last_active":"2024-08-31T04:44:12.222550+0000","last_peered":"2024-08-31T04:44:12.222550+0000","last_clean":"2024-08-31T04:44:12.222550+0000","last_became_active":"2024-08-31T04:04:04.974664+0000","last_became_peered":"2024-08-31T04:04:04.974664+0000","last_unstale":"2024-08-31T04:44:12.222550+0000","last_undegraded":"2024-08-31T04:44:12.222550+0000","last_fullsized":"2024-08-31T04:44:12.222550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'2848","last_scrub_stamp":"2024-08-31T04:44:12.222418+0000","last_deep_scrub":"48'2848","last_deep_scrub_stamp":"2024-08-31T04:44:12.222418+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.222418+0000","objects_scrubbed":1228,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:11:03.580339+0000","scrub_duration":699,"objects_trimmed":0,"snaptrim_duration":0.0065935439999999998,"stat_sum":{"num_bytes":37885613,"num_objects":1228,"num_object_clones":569,"num_object_copies":4912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1228,"num_whiteouts":569,"num_read":190,"num_read_kb":257974,"num_write":2324,"num_write_kb":54067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"48'687","reported_seq":2794,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:01.725904+0000","last_change":"2024-08-31T04:44:01.725904+0000","last_active":"2024-08-31T04:44:01.725904+0000","last_peered":"2024-08-31T04:44:01.725904+0000","last_clean":"2024-08-31T04:44:01.725904+0000","last_became_active":"2024-08-31T04:04:00.886795+0000","last_became_peered":"2024-08-31T04:04:00.886795+0000","last_unstale":"2024-08-31T04:44:01.725904+0000","last_undegraded":"2024-08-31T04:44:01.725904+0000","last_fullsized":"2024-08-31T04:44:01.725904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'687","last_scrub_stamp":"2024-08-31T04:44:01.725836+0000","last_deep_scrub":"48'687","last_deep_scrub_stamp":"2024-08-31T04:44:01.725836+0000","last_clean_scrub_stamp":"2024-08-31T04:44:01.725836+0000","objects_scrubbed":50,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:43:03.505141+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0.0078040410000000003,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":15,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"48'705","reported_seq":2817,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.624556+0000","last_change":"2024-08-31T04:44:05.624556+0000","last_active":"2024-08-31T04:44:05.624556+0000","last_peered":"2024-08-31T04:44:05.624556+0000","last_clean":"2024-08-31T04:44:05.624556+0000","last_became_active":"2024-08-31T04:04:00.880553+0000","last_became_peered":"2024-08-31T04:04:00.880553+0000","last_unstale":"2024-08-31T04:44:05.624556+0000","last_undegraded":"2024-08-31T04:44:05.624556+0000","last_fullsized":"2024-08-31T04:44:05.624556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'705","last_scrub_stamp":"2024-08-31T04:44:05.624284+0000","last_deep_scrub":"48'705","last_deep_scrub_stamp":"2024-08-31T04:44:05.624284+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.624284+0000","objects_scrubbed":47,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:09:18.409305+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0.0060576730000000004,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":9,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"48'669","reported_seq":2782,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.410804+0000","last_change":"2024-08-31T04:44:16.410804+0000","last_active":"2024-08-31T04:44:16.410804+0000","last_peered":"2024-08-31T04:44:16.410804+0000","last_clean":"2024-08-31T04:44:16.410804+0000","last_became_active":"2024-08-31T04:04:00.879465+0000","last_became_peered":"2024-08-31T04:04:00.879465+0000","last_unstale":"2024-08-31T04:44:16.410804+0000","last_undegraded":"2024-08-31T04:44:16.410804+0000","last_fullsized":"2024-08-31T04:44:16.410804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'669","last_scrub_stamp":"2024-08-31T04:44:16.410685+0000","last_deep_scrub":"48'669","last_deep_scrub_stamp":"2024-08-31T04:44:16.410685+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.410685+0000","objects_scrubbed":43,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:52:49.699642+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0067294099999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":8,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"48'712","reported_seq":2820,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.363283+0000","last_change":"2024-08-31T04:44:08.363283+0000","last_active":"2024-08-31T04:44:08.363283+0000","last_peered":"2024-08-31T04:44:08.363283+0000","last_clean":"2024-08-31T04:44:08.363283+0000","last_became_active":"2024-08-31T04:04:00.876187+0000","last_became_peered":"2024-08-31T04:04:00.876187+0000","last_unstale":"2024-08-31T04:44:08.363283+0000","last_undegraded":"2024-08-31T04:44:08.363283+0000","last_fullsized":"2024-08-31T04:44:08.363283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'712","last_scrub_stamp":"2024-08-31T04:44:08.363144+0000","last_deep_scrub":"48'712","last_deep_scrub_stamp":"2024-08-31T04:44:08.363144+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.363144+0000","objects_scrubbed":50,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:16.974434+0000","scrub_duration":131,"objects_trimmed":0,"snaptrim_duration":0.01443145,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"48'660","reported_seq":2768,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:07.933735+0000","last_change":"2024-08-31T04:44:07.933735+0000","last_active":"2024-08-31T04:44:07.933735+0000","last_peered":"2024-08-31T04:44:07.933735+0000","last_clean":"2024-08-31T04:44:07.933735+0000","last_became_active":"2024-08-31T04:04:00.887690+0000","last_became_peered":"2024-08-31T04:04:00.887690+0000","last_unstale":"2024-08-31T04:44:07.933735+0000","last_undegraded":"2024-08-31T04:44:07.933735+0000","last_fullsized":"2024-08-31T04:44:07.933735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'660","last_scrub_stamp":"2024-08-31T04:44:07.933459+0000","last_deep_scrub":"48'660","last_deep_scrub_stamp":"2024-08-31T04:44:07.933459+0000","last_clean_scrub_stamp":"2024-08-31T04:44:07.933459+0000","objects_scrubbed":46,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:37.450965+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.024833572000000002,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"48'632","reported_seq":2745,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.871118+0000","last_change":"2024-08-31T04:44:08.871118+0000","last_active":"2024-08-31T04:44:08.871118+0000","last_peered":"2024-08-31T04:44:08.871118+0000","last_clean":"2024-08-31T04:44:08.871118+0000","last_became_active":"2024-08-31T04:04:00.885347+0000","last_became_peered":"2024-08-31T04:04:00.885347+0000","last_unstale":"2024-08-31T04:44:08.871118+0000","last_undegraded":"2024-08-31T04:44:08.871118+0000","last_fullsized":"2024-08-31T04:44:08.871118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'632","last_scrub_stamp":"2024-08-31T04:44:08.870999+0000","last_deep_scrub":"48'632","last_deep_scrub_stamp":"2024-08-31T04:44:08.870999+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.870999+0000","objects_scrubbed":37,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:32:05.076239+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0.024839776000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"48'697","reported_seq":2809,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.754758+0000","last_change":"2024-08-31T04:44:09.754758+0000","last_active":"2024-08-31T04:44:09.754758+0000","last_peered":"2024-08-31T04:44:09.754758+0000","last_clean":"2024-08-31T04:44:09.754758+0000","last_became_active":"2024-08-31T04:04:00.869539+0000","last_became_peered":"2024-08-31T04:04:00.869539+0000","last_unstale":"2024-08-31T04:44:09.754758+0000","last_undegraded":"2024-08-31T04:44:09.754758+0000","last_fullsized":"2024-08-31T04:44:09.754758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'697","last_scrub_stamp":"2024-08-31T04:44:09.754616+0000","last_deep_scrub":"48'697","last_deep_scrub_stamp":"2024-08-31T04:44:09.754616+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.754616+0000","objects_scrubbed":46,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:23.112793+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0060308059999999997,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":8,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"48'634","reported_seq":2748,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.262101+0000","last_change":"2024-08-31T04:44:11.262101+0000","last_active":"2024-08-31T04:44:11.262101+0000","last_peered":"2024-08-31T04:44:11.262101+0000","last_clean":"2024-08-31T04:44:11.262101+0000","last_became_active":"2024-08-31T04:04:00.880826+0000","last_became_peered":"2024-08-31T04:04:00.880826+0000","last_unstale":"2024-08-31T04:44:11.262101+0000","last_undegraded":"2024-08-31T04:44:11.262101+0000","last_fullsized":"2024-08-31T04:44:11.262101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'634","last_scrub_stamp":"2024-08-31T04:44:11.261975+0000","last_deep_scrub":"48'634","last_deep_scrub_stamp":"2024-08-31T04:44:11.261975+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.261975+0000","objects_scrubbed":41,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:33:19.363836+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.012931465,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":6,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"48'665","reported_seq":2774,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:17.438996+0000","last_change":"2024-08-31T04:44:17.438996+0000","last_active":"2024-08-31T04:44:17.438996+0000","last_peered":"2024-08-31T04:44:17.438996+0000","last_clean":"2024-08-31T04:44:17.438996+0000","last_became_active":"2024-08-31T04:04:00.879746+0000","last_became_peered":"2024-08-31T04:04:00.879746+0000","last_unstale":"2024-08-31T04:44:17.438996+0000","last_undegraded":"2024-08-31T04:44:17.438996+0000","last_fullsized":"2024-08-31T04:44:17.438996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'665","last_scrub_stamp":"2024-08-31T04:44:17.438904+0000","last_deep_scrub":"48'665","last_deep_scrub_stamp":"2024-08-31T04:44:17.438904+0000","last_clean_scrub_stamp":"2024-08-31T04:44:17.438904+0000","objects_scrubbed":42,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:09:00.418951+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0062469689999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"48'623","reported_seq":2737,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:17.340092+0000","last_change":"2024-08-31T04:44:17.339994+0000","last_active":"2024-08-31T04:44:17.340092+0000","last_peered":"2024-08-31T04:44:17.340092+0000","last_clean":"2024-08-31T04:44:17.340092+0000","last_became_active":"2024-08-31T04:04:00.860517+0000","last_became_peered":"2024-08-31T04:04:00.860517+0000","last_unstale":"2024-08-31T04:44:17.340092+0000","last_undegraded":"2024-08-31T04:44:17.340092+0000","last_fullsized":"2024-08-31T04:44:17.340092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'623","last_scrub_stamp":"2024-08-31T04:44:17.339868+0000","last_deep_scrub":"48'623","last_deep_scrub_stamp":"2024-08-31T04:44:17.339868+0000","last_clean_scrub_stamp":"2024-08-31T04:44:17.339868+0000","objects_scrubbed":31,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:51.959756+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.011311599,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"48'696","reported_seq":2804,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:05.033032+0000","last_change":"2024-08-31T04:44:05.032967+0000","last_active":"2024-08-31T04:44:05.033032+0000","last_peered":"2024-08-31T04:44:05.033032+0000","last_clean":"2024-08-31T04:44:05.033032+0000","last_became_active":"2024-08-31T04:04:00.884121+0000","last_became_peered":"2024-08-31T04:04:00.884121+0000","last_unstale":"2024-08-31T04:44:05.033032+0000","last_undegraded":"2024-08-31T04:44:05.033032+0000","last_fullsized":"2024-08-31T04:44:05.033032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'696","last_scrub_stamp":"2024-08-31T04:44:05.032875+0000","last_deep_scrub":"48'696","last_deep_scrub_stamp":"2024-08-31T04:44:05.032875+0000","last_clean_scrub_stamp":"2024-08-31T04:44:05.032875+0000","objects_scrubbed":45,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:25.676913+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0035095819999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"48'655","reported_seq":2767,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.008107+0000","last_change":"2024-08-31T04:44:12.007998+0000","last_active":"2024-08-31T04:44:12.008107+0000","last_peered":"2024-08-31T04:44:12.008107+0000","last_clean":"2024-08-31T04:44:12.008107+0000","last_became_active":"2024-08-31T04:04:00.897445+0000","last_became_peered":"2024-08-31T04:04:00.897445+0000","last_unstale":"2024-08-31T04:44:12.008107+0000","last_undegraded":"2024-08-31T04:44:12.008107+0000","last_fullsized":"2024-08-31T04:44:12.008107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'655","last_scrub_stamp":"2024-08-31T04:44:12.007886+0000","last_deep_scrub":"48'655","last_deep_scrub_stamp":"2024-08-31T04:44:12.007886+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.007886+0000","objects_scrubbed":42,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:22.376497+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0055677180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"48'685","reported_seq":2793,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.850846+0000","last_change":"2024-08-31T04:44:09.850785+0000","last_active":"2024-08-31T04:44:09.850846+0000","last_peered":"2024-08-31T04:44:09.850846+0000","last_clean":"2024-08-31T04:44:09.850846+0000","last_became_active":"2024-08-31T04:04:00.872680+0000","last_became_peered":"2024-08-31T04:04:00.872680+0000","last_unstale":"2024-08-31T04:44:09.850846+0000","last_undegraded":"2024-08-31T04:44:09.850846+0000","last_fullsized":"2024-08-31T04:44:09.850846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'685","last_scrub_stamp":"2024-08-31T04:44:09.850685+0000","last_deep_scrub":"48'685","last_deep_scrub_stamp":"2024-08-31T04:44:09.850685+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.850685+0000","objects_scrubbed":42,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:15.355476+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0047976060000000003,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"48'694","reported_seq":2805,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:18.432983+0000","last_change":"2024-08-31T04:44:18.432919+0000","last_active":"2024-08-31T04:44:18.432983+0000","last_peered":"2024-08-31T04:44:18.432983+0000","last_clean":"2024-08-31T04:44:18.432983+0000","last_became_active":"2024-08-31T04:04:00.896561+0000","last_became_peered":"2024-08-31T04:04:00.896561+0000","last_unstale":"2024-08-31T04:44:18.432983+0000","last_undegraded":"2024-08-31T04:44:18.432983+0000","last_fullsized":"2024-08-31T04:44:18.432983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'694","last_scrub_stamp":"2024-08-31T04:44:18.432853+0000","last_deep_scrub":"48'694","last_deep_scrub_stamp":"2024-08-31T04:44:18.432853+0000","last_clean_scrub_stamp":"2024-08-31T04:44:18.432853+0000","objects_scrubbed":50,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:48.770758+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0.0066178469999999996,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"48'635","reported_seq":2743,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:06.558741+0000","last_change":"2024-08-31T04:44:06.558741+0000","last_active":"2024-08-31T04:44:06.558741+0000","last_peered":"2024-08-31T04:44:06.558741+0000","last_clean":"2024-08-31T04:44:06.558741+0000","last_became_active":"2024-08-31T04:04:00.879259+0000","last_became_peered":"2024-08-31T04:04:00.879259+0000","last_unstale":"2024-08-31T04:44:06.558741+0000","last_undegraded":"2024-08-31T04:44:06.558741+0000","last_fullsized":"2024-08-31T04:44:06.558741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'635","last_scrub_stamp":"2024-08-31T04:44:06.558583+0000","last_deep_scrub":"48'635","last_deep_scrub_stamp":"2024-08-31T04:44:06.558583+0000","last_clean_scrub_stamp":"2024-08-31T04:44:06.558583+0000","objects_scrubbed":41,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:47.605266+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.0050893520000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"48'682","reported_seq":2795,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:19.426287+0000","last_change":"2024-08-31T04:44:19.426287+0000","last_active":"2024-08-31T04:44:19.426287+0000","last_peered":"2024-08-31T04:44:19.426287+0000","last_clean":"2024-08-31T04:44:19.426287+0000","last_became_active":"2024-08-31T04:04:00.873276+0000","last_became_peered":"2024-08-31T04:04:00.873276+0000","last_unstale":"2024-08-31T04:44:19.426287+0000","last_undegraded":"2024-08-31T04:44:19.426287+0000","last_fullsized":"2024-08-31T04:44:19.426287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'682","last_scrub_stamp":"2024-08-31T04:44:19.426165+0000","last_deep_scrub":"48'682","last_deep_scrub_stamp":"2024-08-31T04:44:19.426165+0000","last_clean_scrub_stamp":"2024-08-31T04:44:19.426165+0000","objects_scrubbed":45,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:19:39.438129+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0068720639999999998,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":6,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"48'645","reported_seq":2757,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:20.392557+0000","last_change":"2024-08-31T04:44:20.392557+0000","last_active":"2024-08-31T04:44:20.392557+0000","last_peered":"2024-08-31T04:44:20.392557+0000","last_clean":"2024-08-31T04:44:20.392557+0000","last_became_active":"2024-08-31T04:04:00.861596+0000","last_became_peered":"2024-08-31T04:04:00.861596+0000","last_unstale":"2024-08-31T04:44:20.392557+0000","last_undegraded":"2024-08-31T04:44:20.392557+0000","last_fullsized":"2024-08-31T04:44:20.392557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'645","last_scrub_stamp":"2024-08-31T04:44:20.392462+0000","last_deep_scrub":"48'645","last_deep_scrub_stamp":"2024-08-31T04:44:20.392462+0000","last_clean_scrub_stamp":"2024-08-31T04:44:20.392462+0000","objects_scrubbed":32,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:24:21.149306+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0059141749999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":7,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"48'703","reported_seq":2811,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.306586+0000","last_change":"2024-08-31T04:44:13.306586+0000","last_active":"2024-08-31T04:44:13.306586+0000","last_peered":"2024-08-31T04:44:13.306586+0000","last_clean":"2024-08-31T04:44:13.306586+0000","last_became_active":"2024-08-31T04:04:00.873084+0000","last_became_peered":"2024-08-31T04:04:00.873084+0000","last_unstale":"2024-08-31T04:44:13.306586+0000","last_undegraded":"2024-08-31T04:44:13.306586+0000","last_fullsized":"2024-08-31T04:44:13.306586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'703","last_scrub_stamp":"2024-08-31T04:44:13.306485+0000","last_deep_scrub":"48'703","last_deep_scrub_stamp":"2024-08-31T04:44:13.306485+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.306485+0000","objects_scrubbed":52,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:53:38.445717+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0098583990000000003,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":12,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"48'675","reported_seq":2783,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:09.934441+0000","last_change":"2024-08-31T04:44:09.934441+0000","last_active":"2024-08-31T04:44:09.934441+0000","last_peered":"2024-08-31T04:44:09.934441+0000","last_clean":"2024-08-31T04:44:09.934441+0000","last_became_active":"2024-08-31T04:04:00.887106+0000","last_became_peered":"2024-08-31T04:04:00.887106+0000","last_unstale":"2024-08-31T04:44:09.934441+0000","last_undegraded":"2024-08-31T04:44:09.934441+0000","last_fullsized":"2024-08-31T04:44:09.934441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'675","last_scrub_stamp":"2024-08-31T04:44:09.934271+0000","last_deep_scrub":"48'675","last_deep_scrub_stamp":"2024-08-31T04:44:09.934271+0000","last_clean_scrub_stamp":"2024-08-31T04:44:09.934271+0000","objects_scrubbed":53,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:05.286963+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0.023950035000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":12,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"48'639","reported_seq":2748,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.909998+0000","last_change":"2024-08-31T04:44:10.909998+0000","last_active":"2024-08-31T04:44:10.909998+0000","last_peered":"2024-08-31T04:44:10.909998+0000","last_clean":"2024-08-31T04:44:10.909998+0000","last_became_active":"2024-08-31T04:04:00.885722+0000","last_became_peered":"2024-08-31T04:04:00.885722+0000","last_unstale":"2024-08-31T04:44:10.909998+0000","last_undegraded":"2024-08-31T04:44:10.909998+0000","last_fullsized":"2024-08-31T04:44:10.909998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'639","last_scrub_stamp":"2024-08-31T04:44:10.909854+0000","last_deep_scrub":"48'639","last_deep_scrub_stamp":"2024-08-31T04:44:10.909854+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.909854+0000","objects_scrubbed":40,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:55:03.007424+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.025118893999999999,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":9,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"48'639","reported_seq":2749,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:13.853881+0000","last_change":"2024-08-31T04:44:13.853881+0000","last_active":"2024-08-31T04:44:13.853881+0000","last_peered":"2024-08-31T04:44:13.853881+0000","last_clean":"2024-08-31T04:44:13.853881+0000","last_became_active":"2024-08-31T04:04:00.885144+0000","last_became_peered":"2024-08-31T04:04:00.885144+0000","last_unstale":"2024-08-31T04:44:13.853881+0000","last_undegraded":"2024-08-31T04:44:13.853881+0000","last_fullsized":"2024-08-31T04:44:13.853881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'639","last_scrub_stamp":"2024-08-31T04:44:13.853741+0000","last_deep_scrub":"48'639","last_deep_scrub_stamp":"2024-08-31T04:44:13.853741+0000","last_clean_scrub_stamp":"2024-08-31T04:44:13.853741+0000","objects_scrubbed":40,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:26.326387+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0051269660000000002,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"48'674","reported_seq":2779,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:08.902115+0000","last_change":"2024-08-31T04:44:08.902115+0000","last_active":"2024-08-31T04:44:08.902115+0000","last_peered":"2024-08-31T04:44:08.902115+0000","last_clean":"2024-08-31T04:44:08.902115+0000","last_became_active":"2024-08-31T04:04:00.876508+0000","last_became_peered":"2024-08-31T04:04:00.876508+0000","last_unstale":"2024-08-31T04:44:08.902115+0000","last_undegraded":"2024-08-31T04:44:08.902115+0000","last_fullsized":"2024-08-31T04:44:08.902115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'674","last_scrub_stamp":"2024-08-31T04:44:08.902014+0000","last_deep_scrub":"48'674","last_deep_scrub_stamp":"2024-08-31T04:44:08.902014+0000","last_clean_scrub_stamp":"2024-08-31T04:44:08.902014+0000","objects_scrubbed":47,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:12:21.876412+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.0045307300000000002,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"48'630","reported_seq":2737,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:10.840078+0000","last_change":"2024-08-31T04:44:10.840078+0000","last_active":"2024-08-31T04:44:10.840078+0000","last_peered":"2024-08-31T04:44:10.840078+0000","last_clean":"2024-08-31T04:44:10.840078+0000","last_became_active":"2024-08-31T04:04:00.878379+0000","last_became_peered":"2024-08-31T04:04:00.878379+0000","last_unstale":"2024-08-31T04:44:10.840078+0000","last_undegraded":"2024-08-31T04:44:10.840078+0000","last_fullsized":"2024-08-31T04:44:10.840078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'630","last_scrub_stamp":"2024-08-31T04:44:10.839976+0000","last_deep_scrub":"48'630","last_deep_scrub_stamp":"2024-08-31T04:44:10.839976+0000","last_clean_scrub_stamp":"2024-08-31T04:44:10.839976+0000","objects_scrubbed":45,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:42:29.058949+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0053663419999999996,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":11,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"48'675","reported_seq":2783,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.026083+0000","last_change":"2024-08-31T04:44:03.026083+0000","last_active":"2024-08-31T04:44:03.026083+0000","last_peered":"2024-08-31T04:44:03.026083+0000","last_clean":"2024-08-31T04:44:03.026083+0000","last_became_active":"2024-08-31T04:04:00.865105+0000","last_became_peered":"2024-08-31T04:04:00.865105+0000","last_unstale":"2024-08-31T04:44:03.026083+0000","last_undegraded":"2024-08-31T04:44:03.026083+0000","last_fullsized":"2024-08-31T04:44:03.026083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'675","last_scrub_stamp":"2024-08-31T04:44:03.025958+0000","last_deep_scrub":"48'675","last_deep_scrub_stamp":"2024-08-31T04:44:03.025958+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.025958+0000","objects_scrubbed":44,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:46:43.460581+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.003298704,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"48'621","reported_seq":2731,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:14.291553+0000","last_change":"2024-08-31T04:44:14.291553+0000","last_active":"2024-08-31T04:44:14.291553+0000","last_peered":"2024-08-31T04:44:14.291553+0000","last_clean":"2024-08-31T04:44:14.291553+0000","last_became_active":"2024-08-31T04:04:00.881840+0000","last_became_peered":"2024-08-31T04:04:00.881840+0000","last_unstale":"2024-08-31T04:44:14.291553+0000","last_undegraded":"2024-08-31T04:44:14.291553+0000","last_fullsized":"2024-08-31T04:44:14.291553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'621","last_scrub_stamp":"2024-08-31T04:44:14.291447+0000","last_deep_scrub":"48'621","last_deep_scrub_stamp":"2024-08-31T04:44:14.291447+0000","last_clean_scrub_stamp":"2024-08-31T04:44:14.291447+0000","objects_scrubbed":40,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:23.904155+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.0091212849999999998,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":8,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"48'662","reported_seq":2769,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.846368+0000","last_change":"2024-08-31T04:44:16.846368+0000","last_active":"2024-08-31T04:44:16.846368+0000","last_peered":"2024-08-31T04:44:16.846368+0000","last_clean":"2024-08-31T04:44:16.846368+0000","last_became_active":"2024-08-31T04:04:00.896427+0000","last_became_peered":"2024-08-31T04:04:00.896427+0000","last_unstale":"2024-08-31T04:44:16.846368+0000","last_undegraded":"2024-08-31T04:44:16.846368+0000","last_fullsized":"2024-08-31T04:44:16.846368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'662","last_scrub_stamp":"2024-08-31T04:44:16.846296+0000","last_deep_scrub":"48'662","last_deep_scrub_stamp":"2024-08-31T04:44:16.846296+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.846296+0000","objects_scrubbed":50,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:48.980036+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0.0020846939999999998,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"48'638","reported_seq":2743,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:02.718446+0000","last_change":"2024-08-31T04:44:02.718446+0000","last_active":"2024-08-31T04:44:02.718446+0000","last_peered":"2024-08-31T04:44:02.718446+0000","last_clean":"2024-08-31T04:44:02.718446+0000","last_became_active":"2024-08-31T04:04:00.897631+0000","last_became_peered":"2024-08-31T04:04:00.897631+0000","last_unstale":"2024-08-31T04:44:02.718446+0000","last_undegraded":"2024-08-31T04:44:02.718446+0000","last_fullsized":"2024-08-31T04:44:02.718446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'638","last_scrub_stamp":"2024-08-31T04:44:02.718335+0000","last_deep_scrub":"48'638","last_deep_scrub_stamp":"2024-08-31T04:44:02.718335+0000","last_clean_scrub_stamp":"2024-08-31T04:44:02.718335+0000","objects_scrubbed":45,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:09:02.390529+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.0079797440000000004,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":13,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"48'729","reported_seq":2829,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:11.862359+0000","last_change":"2024-08-31T04:44:11.862359+0000","last_active":"2024-08-31T04:44:11.862359+0000","last_peered":"2024-08-31T04:44:11.862359+0000","last_clean":"2024-08-31T04:44:11.862359+0000","last_became_active":"2024-08-31T04:04:00.882985+0000","last_became_peered":"2024-08-31T04:04:00.882985+0000","last_unstale":"2024-08-31T04:44:11.862359+0000","last_undegraded":"2024-08-31T04:44:11.862359+0000","last_fullsized":"2024-08-31T04:44:11.862359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'729","last_scrub_stamp":"2024-08-31T04:44:11.862271+0000","last_deep_scrub":"48'729","last_deep_scrub_stamp":"2024-08-31T04:44:11.862271+0000","last_clean_scrub_stamp":"2024-08-31T04:44:11.862271+0000","objects_scrubbed":63,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:24:16.766331+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0.0047669089999999997,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":19,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":19,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"48'662","reported_seq":2779,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:03.734665+0000","last_change":"2024-08-31T04:44:03.734605+0000","last_active":"2024-08-31T04:44:03.734665+0000","last_peered":"2024-08-31T04:44:03.734665+0000","last_clean":"2024-08-31T04:44:03.734665+0000","last_became_active":"2024-08-31T04:04:00.892189+0000","last_became_peered":"2024-08-31T04:04:00.892189+0000","last_unstale":"2024-08-31T04:44:03.734665+0000","last_undegraded":"2024-08-31T04:44:03.734665+0000","last_fullsized":"2024-08-31T04:44:03.734665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'662","last_scrub_stamp":"2024-08-31T04:44:03.734529+0000","last_deep_scrub":"48'662","last_deep_scrub_stamp":"2024-08-31T04:44:03.734529+0000","last_clean_scrub_stamp":"2024-08-31T04:44:03.734529+0000","objects_scrubbed":38,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:41:38.888910+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0063128230000000004,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":5,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":5,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"48'674","reported_seq":2786,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:15.305191+0000","last_change":"2024-08-31T04:44:15.305191+0000","last_active":"2024-08-31T04:44:15.305191+0000","last_peered":"2024-08-31T04:44:15.305191+0000","last_clean":"2024-08-31T04:44:15.305191+0000","last_became_active":"2024-08-31T04:04:00.892581+0000","last_became_peered":"2024-08-31T04:04:00.892581+0000","last_unstale":"2024-08-31T04:44:15.305191+0000","last_undegraded":"2024-08-31T04:44:15.305191+0000","last_fullsized":"2024-08-31T04:44:15.305191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'674","last_scrub_stamp":"2024-08-31T04:44:15.305078+0000","last_deep_scrub":"48'674","last_deep_scrub_stamp":"2024-08-31T04:44:15.305078+0000","last_clean_scrub_stamp":"2024-08-31T04:44:15.305078+0000","objects_scrubbed":50,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:06:27.562700+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.013845079999999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"48'622","reported_seq":2734,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:16.316665+0000","last_change":"2024-08-31T04:44:16.316665+0000","last_active":"2024-08-31T04:44:16.316665+0000","last_peered":"2024-08-31T04:44:16.316665+0000","last_clean":"2024-08-31T04:44:16.316665+0000","last_became_active":"2024-08-31T04:04:00.886934+0000","last_became_peered":"2024-08-31T04:04:00.886934+0000","last_unstale":"2024-08-31T04:44:16.316665+0000","last_undegraded":"2024-08-31T04:44:16.316665+0000","last_fullsized":"2024-08-31T04:44:16.316665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'622","last_scrub_stamp":"2024-08-31T04:44:16.316513+0000","last_deep_scrub":"48'622","last_deep_scrub_stamp":"2024-08-31T04:44:16.316513+0000","last_clean_scrub_stamp":"2024-08-31T04:44:16.316513+0000","objects_scrubbed":38,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:46:10.952487+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.012861716,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"48'659","reported_seq":2766,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-31T04:44:12.887396+0000","last_change":"2024-08-31T04:44:12.887396+0000","last_active":"2024-08-31T04:44:12.887396+0000","last_peered":"2024-08-31T04:44:12.887396+0000","last_clean":"2024-08-31T04:44:12.887396+0000","last_became_active":"2024-08-31T04:04:00.880761+0000","last_became_peered":"2024-08-31T04:04:00.880761+0000","last_unstale":"2024-08-31T04:44:12.887396+0000","last_undegraded":"2024-08-31T04:44:12.887396+0000","last_fullsized":"2024-08-31T04:44:12.887396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'659","last_scrub_stamp":"2024-08-31T04:44:12.887281+0000","last_deep_scrub":"48'659","last_deep_scrub_stamp":"2024-08-31T04:44:12.887281+0000","last_clean_scrub_stamp":"2024-08-31T04:44:12.887281+0000","objects_scrubbed":58,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:59.457891+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0048876299999999996,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":15,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1171046334,"num_objects":39264,"num_object_clones":18317,"num_object_copies":157056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39264,"num_whiteouts":18141,"num_read":5774,"num_read_kb":6778394,"num_write":75481,"num_write_kb":1474785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2548367360,"data_stored":2549710848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92337,"ondisk_log_size":92337,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":2792,"num_object_clones":669,"num_object_copies":5584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2792,"num_whiteouts":669,"num_read":0,"num_read_kb":0,"num_write":2800,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42433,"ondisk_log_size":42433,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":830797057,"num_objects":1713,"num_object_clones":0,"num_object_copies":3426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1713,"num_whiteouts":0,"num_read":2588,"num_read_kb":5535,"num_write":35395,"num_write_kb":2443316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1452,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19620823,"num_omap_keys":33909,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1661657088,"data_stored":1661594114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33331,"ondisk_log_size":33331,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477230,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1001140,"kb_used_data":627236,"kb_used_omap":1,"kb_used_meta":373886,"kb_avail":93370700,"statfs":{"total":96636764160,"available":95611596800,"internally_reserved":0,"allocated":642289664,"data_stored":642188380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":382859719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477230,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":638272,"kb_used_data":418288,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93733568,"statfs":{"total":96636764160,"available":95983173632,"internally_reserved":0,"allocated":428326912,"data_stored":428055527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477231,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":861352,"kb_used_data":569176,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93510488,"statfs":{"total":96636764160,"available":95754739712,"internally_reserved":0,"allocated":582836224,"data_stored":582730273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299170245},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477231,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":817520,"kb_used_data":525408,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93554320,"statfs":{"total":96636764160,"available":95799623680,"internally_reserved":0,"allocated":538017792,"data_stored":537913727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509933,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":696196,"kb_used_data":458228,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":93675644,"statfs":{"total":96636764160,"available":95923859456,"internally_reserved":0,"allocated":469225472,"data_stored":469129543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243661254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509934,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":761836,"kb_used_data":487772,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93610004,"statfs":{"total":96636764160,"available":95856644096,"internally_reserved":0,"allocated":499478528,"data_stored":499539157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509933,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":815596,"kb_used_data":549852,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":93556244,"statfs":{"total":96636764160,"available":95801593856,"internally_reserved":0,"allocated":563048448,"data_stored":563100856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272103877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575342,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":742488,"kb_used_data":480840,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93629352,"statfs":{"total":96636764160,"available":95876456448,"internally_reserved":0,"allocated":492380160,"data_stored":492108227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":314580992,"data_stored":314572856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":201986048,"data_stored":201979578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":113254400,"data_stored":113246880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":284889088,"data_stored":284883733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":243609600,"data_stored":243590001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":226504704,"data_stored":226496878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":138412032,"data_stored":138412032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":138420224,"data_stored":138412156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":222887936,"data_stored":223055872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":379707392,"data_stored":379875328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":314523648,"data_stored":314523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":356851712,"data_stored":357019648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":318889984,"data_stored":319225856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":271831040,"data_stored":272166912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":330264576,"data_stored":330432512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":353411072,"data_stored":353411072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:44:43.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-31T04:44:43.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.778+0000 7f86b9800640 1 -- 172.21.15.89:0/2767735582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2d20 msgr2=0x7f86b40c1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.778+0000 7f86b9800640 1 --2- 172.21.15.89:0/2767735582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2d20 0x7f86b40c1ed0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009840 tx=0x7f86a001c790 comp rx=0 tx=0).stop 2024-08-31T04:44:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.778+0000 7f86b9800640 1 -- 172.21.15.89:0/2767735582 shutdown_connections 2024-08-31T04:44:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.778+0000 7f86b9800640 1 --2- 172.21.15.89:0/2767735582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2d20 0x7f86b40c1ed0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.778+0000 7f86b9800640 1 -- 172.21.15.89:0/2767735582 >> 172.21.15.89:0/2767735582 conn(0x7f86b40c99b0 msgr2=0x7f86b40c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.778+0000 7f86b9800640 1 -- 172.21.15.89:0/2767735582 shutdown_connections 2024-08-31T04:44:43.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.778+0000 7f86b9800640 1 -- 172.21.15.89:0/2767735582 wait complete. 2024-08-31T04:44:43.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b9800640 1 Processor -- start 2024-08-31T04:44:43.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b9800640 1 -- start start 2024-08-31T04:44:43.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b9800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2860 0x7f86b41f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:43.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b9800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86b40b2d20 0x7f86b414f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:43.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b9800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86b40c90e0 0x7f86b40715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:43.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b9800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f86b40c2670 con 0x7f86b40b2860 2024-08-31T04:44:43.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b9800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f86b40c8c50 con 0x7f86b40b2d20 2024-08-31T04:44:43.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b9800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f86b4166780 con 0x7f86b40c90e0 2024-08-31T04:44:43.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2860 0x7f86b41f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:43.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2860 0x7f86b41f90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40562/0 (socket says 172.21.15.89:40562) 2024-08-31T04:44:43.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2a00640 1 -- 172.21.15.89:0/3504080393 learned_addr learned my addr 172.21.15.89:0/3504080393 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:43.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2000640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86b40b2d20 0x7f86b414f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:43.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b3400640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86b40c90e0 0x7f86b40715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:43.788 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2a00640 1 -- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86b40c90e0 msgr2=0x7f86b40715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2a00640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86b40c90e0 0x7f86b40715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2a00640 1 -- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86b40b2d20 msgr2=0x7f86b414f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2a00640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86b40b2d20 0x7f86b414f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2a00640 1 -- 172.21.15.89:0/3504080393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b4156f50 con 0x7f86b40b2860 2024-08-31T04:44:43.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b3400640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86b40c90e0 0x7f86b40715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:44:43.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.782+0000 7f86b2a00640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2860 0x7f86b41f90e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f86a400c420 tx=0x7f86a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:43.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86aaa00640 1 -- 172.21.15.89:0/3504080393 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4017070 con 0x7f86b40b2860 2024-08-31T04:44:43.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86aaa00640 1 -- 172.21.15.89:0/3504080393 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86a40053c0 con 0x7f86b40b2860 2024-08-31T04:44:43.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86aaa00640 1 -- 172.21.15.89:0/3504080393 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4003860 con 0x7f86b40b2860 2024-08-31T04:44:43.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b40c6bc0 con 0x7f86b40b2860 2024-08-31T04:44:43.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b4152b00 con 0x7f86b40b2860 2024-08-31T04:44:43.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b40c1ed0 con 0x7f86b40b2860 2024-08-31T04:44:43.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86aaa00640 1 -- 172.21.15.89:0/3504080393 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f86a401a070 con 0x7f86b40b2860 2024-08-31T04:44:43.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86aaa00640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f86940720f0 0x7f8694074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:43.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86aaa00640 1 -- 172.21.15.89:0/3504080393 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f86a4092330 con 0x7f86b40b2860 2024-08-31T04:44:43.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.786+0000 7f86b2000640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f86940720f0 0x7f8694074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:43.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.790+0000 7f86b2000640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f86940720f0 0x7f8694074600 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86a00af000 tx=0x7f86a00b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:43.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.790+0000 7f86aaa00640 1 -- 172.21.15.89:0/3504080393 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f86a405d130 con 0x7f86b40b2860 2024-08-31T04:44:43.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.958+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f86b4156aa0 con 0x7f86b40b2860 2024-08-31T04:44:43.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.962+0000 7f86aaa00640 1 -- 172.21.15.89:0/3504080393 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v33)=0 v33) ==== 123+0+0 (secure 0 0 0) 0x7f86a40618f0 con 0x7f86b40b2860 2024-08-31T04:44:43.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86aaa00640 1 -- 172.21.15.89:0/3504080393 <== mon.0 v2:172.21.15.89:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f86a405cc40 con 0x7f86b40b2860 2024-08-31T04:44:43.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f86940720f0 msgr2=0x7f8694074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f86940720f0 0x7f8694074600 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86a00af000 tx=0x7f86a00b2040 comp rx=0 tx=0).stop 2024-08-31T04:44:43.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2860 msgr2=0x7f86b41f90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:43.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2860 0x7f86b41f90e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f86a400c420 tx=0x7f86a400c8e0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 shutdown_connections 2024-08-31T04:44:43.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f86940720f0 0x7f8694074600 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86b40c90e0 0x7f86b40715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86b40b2d20 0x7f86b414f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 --2- 172.21.15.89:0/3504080393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86b40b2860 0x7f86b41f90e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:43.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 >> 172.21.15.89:0/3504080393 conn(0x7f86b40c99b0 msgr2=0x7f86b4151780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:43.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 shutdown_connections 2024-08-31T04:44:43.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:43.966+0000 7f86b9800640 1 -- 172.21.15.89:0/3504080393 wait complete. 2024-08-31T04:44:43.988 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-31T04:44:43.988 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:44:44.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 -- 172.21.15.89:0/1006012530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 msgr2=0x7fbe940c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 --2- 172.21.15.89:0/1006012530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 0x7fbe940c9330 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fbe94072540 tx=0x7fbe8001f0b0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 -- 172.21.15.89:0/1006012530 shutdown_connections 2024-08-31T04:44:44.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 --2- 172.21.15.89:0/1006012530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 0x7fbe940c9330 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 --2- 172.21.15.89:0/1006012530 >> v2:172.21.15.170:3300/0 conn(0x7fbe9415bc70 0x7fbe94152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 -- 172.21.15.89:0/1006012530 >> 172.21.15.89:0/1006012530 conn(0x7fbe940ccf20 msgr2=0x7fbe940cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:44.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 -- 172.21.15.89:0/1006012530 shutdown_connections 2024-08-31T04:44:44.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 -- 172.21.15.89:0/1006012530 wait complete. 2024-08-31T04:44:44.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 Processor -- start 2024-08-31T04:44:44.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.142+0000 7fbe9b400640 1 -- start start 2024-08-31T04:44:44.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe9b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 0x7fbe941e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe9b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe940c7920 0x7fbe9414ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe9b400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe9415bc70 0x7fbe9414bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe9b400640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94074fb0 con 0x7fbe940c1f40 2024-08-31T04:44:44.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe9b400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94074e30 con 0x7fbe940c7920 2024-08-31T04:44:44.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe9b400640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbe940c7d30 con 0x7fbe9415bc70 2024-08-31T04:44:44.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe98a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 0x7fbe941e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe98a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 0x7fbe941e6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40574/0 (socket says 172.21.15.89:40574) 2024-08-31T04:44:44.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe98a00640 1 -- 172.21.15.89:0/1280060384 learned_addr learned my addr 172.21.15.89:0/1280060384 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:44.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe93e00640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe940c7920 0x7fbe9414ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe99400640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe9415bc70 0x7fbe9414bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe98a00640 1 -- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe9415bc70 msgr2=0x7fbe9414bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe98a00640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe9415bc70 0x7fbe9414bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe98a00640 1 -- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe940c7920 msgr2=0x7fbe9414ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.150 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe98a00640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe940c7920 0x7fbe9414ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe98a00640 1 -- 172.21.15.89:0/1280060384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9415b9e0 con 0x7fbe940c1f40 2024-08-31T04:44:44.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe98a00640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 0x7fbe941e6940 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400d750 tx=0x7fbe8400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:44.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe90c00640 1 -- 172.21.15.89:0/1280060384 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84017070 con 0x7fbe940c1f40 2024-08-31T04:44:44.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe90c00640 1 -- 172.21.15.89:0/1280060384 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fbe84009d40 con 0x7fbe940c1f40 2024-08-31T04:44:44.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe94154fc0 con 0x7fbe940c1f40 2024-08-31T04:44:44.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe90c00640 1 -- 172.21.15.89:0/1280060384 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84005280 con 0x7fbe940c1f40 2024-08-31T04:44:44.151 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9415af00 con 0x7fbe940c1f40 2024-08-31T04:44:44.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe940c9330 con 0x7fbe940c1f40 2024-08-31T04:44:44.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.146+0000 7fbe90c00640 1 -- 172.21.15.89:0/1280060384 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7fbe84005420 con 0x7fbe940c1f40 2024-08-31T04:44:44.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.150+0000 7fbe90c00640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe740720f0 0x7fbe74074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.152 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.150+0000 7fbe90c00640 1 -- 172.21.15.89:0/1280060384 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7fbe84092fe0 con 0x7fbe940c1f40 2024-08-31T04:44:44.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.150+0000 7fbe93e00640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe740720f0 0x7fbe74074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.153 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.150+0000 7fbe93e00640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe740720f0 0x7fbe74074600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbe800b2000 tx=0x7fbe800ab040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:44.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.154+0000 7fbe90c00640 1 -- 172.21.15.89:0/1280060384 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbe8400de60 con 0x7fbe940c1f40 2024-08-31T04:44:44.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.346+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe940c82f0 con 0x7fbe940c1f40 2024-08-31T04:44:44.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe90c00640 1 -- 172.21.15.89:0/1280060384 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7fbe8405de90 con 0x7fbe940c1f40 2024-08-31T04:44:44.352 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:44:44.352 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:44:44.352 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:44:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe740720f0 msgr2=0x7fbe74074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe740720f0 0x7fbe74074600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbe800b2000 tx=0x7fbe800ab040 comp rx=0 tx=0).stop 2024-08-31T04:44:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 msgr2=0x7fbe941e6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 0x7fbe941e6940 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400d750 tx=0x7fbe8400dc10 comp rx=0 tx=0).stop 2024-08-31T04:44:44.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 shutdown_connections 2024-08-31T04:44:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7fbe740720f0 0x7fbe74074600 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe9415bc70 0x7fbe9414bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe940c7920 0x7fbe9414ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 --2- 172.21.15.89:0/1280060384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe940c1f40 0x7fbe941e6940 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 >> 172.21.15.89:0/1280060384 conn(0x7fbe940ccf20 msgr2=0x7fbe94150fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 shutdown_connections 2024-08-31T04:44:44.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.350+0000 7fbe9b400640 1 -- 172.21.15.89:0/1280060384 wait complete. 2024-08-31T04:44:44.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-31T04:44:44.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.522+0000 7f6dca200640 1 -- 172.21.15.89:0/3810436071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6da8004810 msgr2=0x7f6da8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.522+0000 7f6dca200640 1 --2- 172.21.15.89:0/3810436071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6da8004810 0x7f6da8004c20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40c25b0 tx=0x7f6dac01d1b0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.522+0000 7f6dc3e00640 1 -- 172.21.15.89:0/3810436071 reap_dead start 2024-08-31T04:44:44.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.522+0000 7f6dca200640 1 -- 172.21.15.89:0/3810436071 shutdown_connections 2024-08-31T04:44:44.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.522+0000 7f6dca200640 1 -- 172.21.15.89:0/3810436071 >> 172.21.15.89:0/3810436071 conn(0x7f6dc40ccf20 msgr2=0x7f6dc40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:44.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.522+0000 7f6dca200640 1 -- 172.21.15.89:0/3810436071 shutdown_connections 2024-08-31T04:44:44.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.522+0000 7f6dca200640 1 -- 172.21.15.89:0/3810436071 wait complete. 2024-08-31T04:44:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dca200640 1 Processor -- start 2024-08-31T04:44:44.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dca200640 1 -- start start 2024-08-31T04:44:44.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dca200640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6da8004810 0x7f6dc40c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dca200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dc40c69f0 0x7f6dc40b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dca200640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dc414e930 0x7f6dc414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dca200640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc40c8030 con 0x7f6da8004810 2024-08-31T04:44:44.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dca200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc40c3150 con 0x7f6dc40c69f0 2024-08-31T04:44:44.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dca200640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc4074e30 con 0x7f6dc414e930 2024-08-31T04:44:44.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dc3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6da8004810 0x7f6dc40c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dc3400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6da8004810 0x7f6dc40c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40584/0 (socket says 172.21.15.89:40584) 2024-08-31T04:44:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dc3400640 1 -- 172.21.15.89:0/3859998078 learned_addr learned my addr 172.21.15.89:0/3859998078 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dc3e00640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dc414e930 0x7f6dc414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.526+0000 7f6dbaa00640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dc40c69f0 0x7f6dc40b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dc3400640 1 -- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dc414e930 msgr2=0x7f6dc414ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dc3400640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dc414e930 0x7f6dc414ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dc3400640 1 -- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dc40c69f0 msgr2=0x7f6dc40b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dc3400640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dc40c69f0 0x7f6dc40b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dc3400640 1 -- 172.21.15.89:0/3859998078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc40c59c0 con 0x7f6da8004810 2024-08-31T04:44:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dc3400640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6da8004810 0x7f6dc40c5330 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6db4001340 tx=0x7f6db400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dbbe00640 1 -- 172.21.15.89:0/3859998078 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4015070 con 0x7f6da8004810 2024-08-31T04:44:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dbbe00640 1 -- 172.21.15.89:0/3859998078 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f6db400ce40 con 0x7f6da8004810 2024-08-31T04:44:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc40c5ca0 con 0x7f6da8004810 2024-08-31T04:44:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dbbe00640 1 -- 172.21.15.89:0/3859998078 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db40116a0 con 0x7f6da8004810 2024-08-31T04:44:44.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc415b900 con 0x7f6da8004810 2024-08-31T04:44:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc40c5ee0 con 0x7f6da8004810 2024-08-31T04:44:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dbbe00640 1 -- 172.21.15.89:0/3859998078 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6db4018070 con 0x7f6da8004810 2024-08-31T04:44:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dbbe00640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6da00720c0 0x7f6da00745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.530+0000 7f6dbbe00640 1 -- 172.21.15.89:0/3859998078 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f6db4093780 con 0x7f6da8004810 2024-08-31T04:44:44.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.534+0000 7f6dbaa00640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6da00720c0 0x7f6da00745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.534+0000 7f6dbaa00640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6da00720c0 0x7f6da00745d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0ad000 tx=0x7f6da8005840 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:44.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.534+0000 7f6dbbe00640 1 -- 172.21.15.89:0/3859998078 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6dc40c5ee0 con 0x7f6da8004810 2024-08-31T04:44:44.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dc4152a10 con 0x7f6da8004810 2024-08-31T04:44:44.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dbbe00640 1 -- 172.21.15.89:0/3859998078 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6868 (secure 0 0 0) 0x7f6db405ec60 con 0x7f6da8004810 2024-08-31T04:44:44.741 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:44:44.741 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":9,"btime":"2024-08-31T04:04:25:199378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4340,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/905146015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":905146015},{"type":"v1","addr":"172.21.15.170:6837","nonce":905146015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4346,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3916288397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3916288397},{"type":"v1","addr":"172.21.15.170:6839","nonce":3916288397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3282147035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3282147035},{"type":"v1","addr":"172.21.15.89:6833","nonce":3282147035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1093578029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1093578029},{"type":"v1","addr":"172.21.15.89:6837","nonce":1093578029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/579113977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":579113977},{"type":"v1","addr":"172.21.15.89:6836","nonce":579113977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T04:04:00.242319+0000","modified":"2024-08-31T04:04:24.589391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4420":{"gid":4420,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6835/890662790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":890662790},{"type":"v1","addr":"172.21.15.170:6835","nonce":890662790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4420,"qdb_cluster":[4420]},"id":1}]} 2024-08-31T04:44:44.741 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 9 2024-08-31T04:44:44.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6da00720c0 msgr2=0x7f6da00745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6da00720c0 0x7f6da00745d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0ad000 tx=0x7f6da8005840 comp rx=0 tx=0).stop 2024-08-31T04:44:44.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6da8004810 msgr2=0x7f6dc40c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6da8004810 0x7f6dc40c5330 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6db4001340 tx=0x7f6db400ee00 comp rx=0 tx=0).stop 2024-08-31T04:44:44.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 shutdown_connections 2024-08-31T04:44:44.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f6da00720c0 0x7f6da00745d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dc414e930 0x7f6dc414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dc40c69f0 0x7f6dc40b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 --2- 172.21.15.89:0/3859998078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6da8004810 0x7f6dc40c5330 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 >> 172.21.15.89:0/3859998078 conn(0x7f6dc40ccf20 msgr2=0x7f6dc415c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:44.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 shutdown_connections 2024-08-31T04:44:44.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.738+0000 7f6dca200640 1 -- 172.21.15.89:0/3859998078 wait complete. 2024-08-31T04:44:44.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:44:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 -- 172.21.15.89:0/2954345824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d0c0c9330 msgr2=0x7f4d0c074720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 --2- 172.21.15.89:0/2954345824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d0c0c9330 0x7f4d0c074720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009bc0 tx=0x7f4d0401f3b0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 -- 172.21.15.89:0/2954345824 shutdown_connections 2024-08-31T04:44:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 --2- 172.21.15.89:0/2954345824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d0c0c9330 0x7f4d0c074720 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 --2- 172.21.15.89:0/2954345824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d0c15bc70 0x7f4d0c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 -- 172.21.15.89:0/2954345824 >> 172.21.15.89:0/2954345824 conn(0x7f4d0c0ccf20 msgr2=0x7f4d0c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 -- 172.21.15.89:0/2954345824 shutdown_connections 2024-08-31T04:44:44.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 -- 172.21.15.89:0/2954345824 wait complete. 2024-08-31T04:44:44.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 Processor -- start 2024-08-31T04:44:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.914+0000 7f4d12000640 1 -- start start 2024-08-31T04:44:44.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d12000640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d0c0c1f40 0x7f4d0c1f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d12000640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d0c0c9330 0x7f4d0c0c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d12000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d0c15bc70 0x7f4d0c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d12000640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0c8030 con 0x7f4d0c0c9330 2024-08-31T04:44:44.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d12000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0c3150 con 0x7f4d0c15bc70 2024-08-31T04:44:44.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d12000640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c074c60 con 0x7f4d0c0c1f40 2024-08-31T04:44:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d02a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d0c0c9330 0x7f4d0c0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d02a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d0c0c9330 0x7f4d0c0c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40600/0 (socket says 172.21.15.89:40600) 2024-08-31T04:44:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d02a00640 1 -- 172.21.15.89:0/3667602038 learned_addr learned my addr 172.21.15.89:0/3667602038 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d0b400640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d0c0c1f40 0x7f4d0c1f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d0be00640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d0c15bc70 0x7f4d0c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d02a00640 1 -- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d0c0c1f40 msgr2=0x7f4d0c1f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d02a00640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d0c0c1f40 0x7f4d0c1f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d02a00640 1 -- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d0c15bc70 msgr2=0x7f4d0c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d02a00640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d0c15bc70 0x7f4d0c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d02a00640 1 -- 172.21.15.89:0/3667602038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c1f3a50 con 0x7f4d0c0c9330 2024-08-31T04:44:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d0be00640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d0c15bc70 0x7f4d0c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:44:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d02a00640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d0c0c9330 0x7f4d0c0c4c70 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c390 tx=0x7f4cf400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:44.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d03e00640 1 -- 172.21.15.89:0/3667602038 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4017070 con 0x7f4d0c0c9330 2024-08-31T04:44:44.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d03e00640 1 -- 172.21.15.89:0/3667602038 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f4cf40052d0 con 0x7f4d0c0c9330 2024-08-31T04:44:44.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c0c57d0 con 0x7f4d0c0c9330 2024-08-31T04:44:44.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d03e00640 1 -- 172.21.15.89:0/3667602038 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4003860 con 0x7f4d0c0c9330 2024-08-31T04:44:44.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c1532f0 con 0x7f4d0c0c9330 2024-08-31T04:44:44.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.918+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c0c5570 con 0x7f4d0c0c9330 2024-08-31T04:44:44.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.922+0000 7f4d03e00640 1 -- 172.21.15.89:0/3667602038 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f4cf401a070 con 0x7f4d0c0c9330 2024-08-31T04:44:44.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.922+0000 7f4d03e00640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ce80720f0 0x7f4ce8074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:44.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.922+0000 7f4d03e00640 1 -- 172.21.15.89:0/3667602038 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f4cf40921e0 con 0x7f4d0c0c9330 2024-08-31T04:44:44.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.922+0000 7f4d0b400640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ce80720f0 0x7f4ce8074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:44.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.922+0000 7f4d0b400640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ce80720f0 0x7f4ce8074600 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0096c0 tx=0x7f4cfc009260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:44.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:44.926+0000 7f4d03e00640 1 -- 172.21.15.89:0/3667602038 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4cf4005480 con 0x7f4d0c0c9330 2024-08-31T04:44:45.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.098+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d0c0c8ab0 con 0x7f4d0c0c9330 2024-08-31T04:44:45.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.098+0000 7f4d03e00640 1 -- 172.21.15.89:0/3667602038 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+18886 (secure 0 0 0) 0x7f4cf405d070 con 0x7f4d0c0c9330 2024-08-31T04:44:45.102 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-08-31T04:44:45.102 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":48,"fsid":"4a16b848-e6b2-47d6-97cd-edff59841cb1","created":"2024-08-31T04:03:35.144065+0000","modified":"2024-08-31T04:10:34.915666+0000","last_up_change":"2024-08-31T04:03:50.309883+0000","last_in_change":"2024-08-31T04:03:39.145119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:03:50.162083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:03:58.472421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:03:59.233836+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":46,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T04:04:02.892404+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":46,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83de31e6-3473-49e1-9021-523c19766651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6801","nonce":1617233830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6803","nonce":1617233830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6807","nonce":1617233830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1617233830},{"type":"v1","addr":"172.21.15.89:6805","nonce":1617233830}]},"public_addr":"172.21.15.89:6801/1617233830","cluster_addr":"172.21.15.89:6803/1617233830","heartbeat_back_addr":"172.21.15.89:6807/1617233830","heartbeat_front_addr":"172.21.15.89:6805/1617233830","state":["exists","up"]},{"osd":1,"uuid":"a6a088f0-9e59-4acc-af24-4288aefaf5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6809","nonce":2972667834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6811","nonce":2972667834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6815","nonce":2972667834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2972667834},{"type":"v1","addr":"172.21.15.89:6813","nonce":2972667834}]},"public_addr":"172.21.15.89:6809/2972667834","cluster_addr":"172.21.15.89:6811/2972667834","heartbeat_back_addr":"172.21.15.89:6815/2972667834","heartbeat_front_addr":"172.21.15.89:6813/2972667834","state":["exists","up"]},{"osd":2,"uuid":"2273a43e-d9d4-4082-9bc3-726a8c1fd221","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6825","nonce":208143917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6827","nonce":208143917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6831","nonce":208143917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":208143917},{"type":"v1","addr":"172.21.15.89:6829","nonce":208143917}]},"public_addr":"172.21.15.89:6825/208143917","cluster_addr":"172.21.15.89:6827/208143917","heartbeat_back_addr":"172.21.15.89:6831/208143917","heartbeat_front_addr":"172.21.15.89:6829/208143917","state":["exists","up"]},{"osd":3,"uuid":"ec64da71-436b-4bf8-9055-1a2fc9b67a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6817","nonce":208411581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6819","nonce":208411581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6823","nonce":208411581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":208411581},{"type":"v1","addr":"172.21.15.89:6821","nonce":208411581}]},"public_addr":"172.21.15.89:6817/208411581","cluster_addr":"172.21.15.89:6819/208411581","heartbeat_back_addr":"172.21.15.89:6823/208411581","heartbeat_front_addr":"172.21.15.89:6821/208411581","state":["exists","up"]},{"osd":4,"uuid":"e11caf26-99a3-4be9-87b1-451dcfd4fa98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6827","nonce":3130076970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6829","nonce":3130076970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6833","nonce":3130076970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3130076970},{"type":"v1","addr":"172.21.15.170:6831","nonce":3130076970}]},"public_addr":"172.21.15.170:6827/3130076970","cluster_addr":"172.21.15.170:6829/3130076970","heartbeat_back_addr":"172.21.15.170:6833/3130076970","heartbeat_front_addr":"172.21.15.170:6831/3130076970","state":["exists","up"]},{"osd":5,"uuid":"e4b27fbc-5880-4587-aacc-235758f442ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6811","nonce":3687562268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6813","nonce":3687562268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6817","nonce":3687562268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3687562268},{"type":"v1","addr":"172.21.15.170:6815","nonce":3687562268}]},"public_addr":"172.21.15.170:6811/3687562268","cluster_addr":"172.21.15.170:6813/3687562268","heartbeat_back_addr":"172.21.15.170:6817/3687562268","heartbeat_front_addr":"172.21.15.170:6815/3687562268","state":["exists","up"]},{"osd":6,"uuid":"8bba872c-eb21-4429-9c99-8a46290e3716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6819","nonce":4213050289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6821","nonce":4213050289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6825","nonce":4213050289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":4213050289},{"type":"v1","addr":"172.21.15.170:6823","nonce":4213050289}]},"public_addr":"172.21.15.170:6819/4213050289","cluster_addr":"172.21.15.170:6821/4213050289","heartbeat_back_addr":"172.21.15.170:6825/4213050289","heartbeat_front_addr":"172.21.15.170:6823/4213050289","state":["exists","up"]},{"osd":7,"uuid":"fdbaa8c0-f525-4cb5-a588-e5f9fb89bfd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6803","nonce":2770203152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6805","nonce":2770203152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6809","nonce":2770203152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2770203152},{"type":"v1","addr":"172.21.15.170:6807","nonce":2770203152}]},"public_addr":"172.21.15.170:6803/2770203152","cluster_addr":"172.21.15.170:6805/2770203152","heartbeat_back_addr":"172.21.15.170:6809/2770203152","heartbeat_front_addr":"172.21.15.170:6807/2770203152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.069729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.065399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.267660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.254823+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.981096+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.250152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:46.435769+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:03:45.779385+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.1a","mappings":[{"from":7,"to":4}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":492,"length":14}]},{"pool":4,"snaps":[{"begin":492,"length":14}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:44:45.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ce80720f0 msgr2=0x7f4ce8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ce80720f0 0x7f4ce8074600 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0096c0 tx=0x7f4cfc009260 comp rx=0 tx=0).stop 2024-08-31T04:44:45.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d0c0c9330 msgr2=0x7f4d0c0c4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d0c0c9330 0x7f4d0c0c4c70 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400c390 tx=0x7f4cf400c850 comp rx=0 tx=0).stop 2024-08-31T04:44:45.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 shutdown_connections 2024-08-31T04:44:45.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f4ce80720f0 0x7f4ce8074600 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d0c0c9330 0x7f4d0c0c4c70 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d0c15bc70 0x7f4d0c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 --2- 172.21.15.89:0/3667602038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d0c0c1f40 0x7f4d0c1f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 >> 172.21.15.89:0/3667602038 conn(0x7f4d0c0ccf20 msgr2=0x7f4d0c1e2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:45.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 shutdown_connections 2024-08-31T04:44:45.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.102+0000 7f4d12000640 1 -- 172.21.15.89:0/3667602038 wait complete. 2024-08-31T04:44:45.125 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-31T04:44:45.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 -- 172.21.15.89:0/2473746598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c15bc70 msgr2=0x7f935c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 --2- 172.21.15.89:0/2473746598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c15bc70 0x7f935c152a10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f935c0c9020 tx=0x7f934c01f0d0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 -- 172.21.15.89:0/2473746598 shutdown_connections 2024-08-31T04:44:45.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 --2- 172.21.15.89:0/2473746598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f935c0c1f40 0x7f935c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 --2- 172.21.15.89:0/2473746598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c15bc70 0x7f935c152a10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 -- 172.21.15.89:0/2473746598 >> 172.21.15.89:0/2473746598 conn(0x7f935c0ccf20 msgr2=0x7f935c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 -- 172.21.15.89:0/2473746598 shutdown_connections 2024-08-31T04:44:45.281 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 -- 172.21.15.89:0/2473746598 wait complete. 2024-08-31T04:44:45.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 Processor -- start 2024-08-31T04:44:45.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.278+0000 7f9362a00640 1 -- start start 2024-08-31T04:44:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9362a00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f935c0c1f40 0x7f935c1f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9362a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c0c7920 0x7f935c14dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9362a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f935c15bc70 0x7f935c0c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9362a00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f935c074fb0 con 0x7f935c0c7920 2024-08-31T04:44:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9362a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f935c074e30 con 0x7f935c15bc70 2024-08-31T04:44:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9362a00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f935c0c7d30 con 0x7f935c0c1f40 2024-08-31T04:44:45.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c0c7920 0x7f935c14dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935b400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c0c7920 0x7f935c14dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40612/0 (socket says 172.21.15.89:40612) 2024-08-31T04:44:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935b400640 1 -- 172.21.15.89:0/4032133582 learned_addr learned my addr 172.21.15.89:0/4032133582 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935be00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f935c0c1f40 0x7f935c1f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9360a00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f935c15bc70 0x7f935c0c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935b400640 1 -- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f935c0c1f40 msgr2=0x7f935c1f02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935b400640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f935c0c1f40 0x7f935c1f02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935b400640 1 -- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f935c15bc70 msgr2=0x7f935c0c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935b400640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f935c15bc70 0x7f935c0c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935b400640 1 -- 172.21.15.89:0/4032133582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c1f0800 con 0x7f935c0c7920 2024-08-31T04:44:45.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9360a00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f935c15bc70 0x7f935c0c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:44:45.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f935b400640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c0c7920 0x7f935c14dbd0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f934800d6e0 tx=0x7f934800dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:45.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9353e00640 1 -- 172.21.15.89:0/4032133582 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348017030 con 0x7f935c0c7920 2024-08-31T04:44:45.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9353e00640 1 -- 172.21.15.89:0/4032133582 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f9348004160 con 0x7f935c0c7920 2024-08-31T04:44:45.287 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c14e110 con 0x7f935c0c7920 2024-08-31T04:44:45.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9353e00640 1 -- 172.21.15.89:0/4032133582 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348005020 con 0x7f935c0c7920 2024-08-31T04:44:45.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c1e3da0 con 0x7f935c0c7920 2024-08-31T04:44:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.282+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935c0c9330 con 0x7f935c0c7920 2024-08-31T04:44:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.286+0000 7f9353e00640 1 -- 172.21.15.89:0/4032133582 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f934801a070 con 0x7f935c0c7920 2024-08-31T04:44:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.286+0000 7f9353e00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f933c0720f0 0x7f933c074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.286+0000 7f9353e00640 1 -- 172.21.15.89:0/4032133582 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6675+0+0 (secure 0 0 0) 0x7f9348092dc0 con 0x7f935c0c7920 2024-08-31T04:44:45.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.286+0000 7f935be00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f933c0720f0 0x7f933c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:45.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.286+0000 7f935be00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f933c0720f0 0x7f933c074600 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f934c0b2000 tx=0x7f934c0ab040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:45.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.290+0000 7f9353e00640 1 -- 172.21.15.89:0/4032133582 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f934805e330 con 0x7f935c0c7920 2024-08-31T04:44:45.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.490+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f935c1560a0 con 0x7f935c0c7920 2024-08-31T04:44:45.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9353e00640 1 -- 172.21.15.89:0/4032133582 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f934805dc30 con 0x7f935c0c7920 2024-08-31T04:44:45.496 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-31T04:44:45.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f933c0720f0 msgr2=0x7f933c074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f933c0720f0 0x7f933c074600 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f934c0b2000 tx=0x7f934c0ab040 comp rx=0 tx=0).stop 2024-08-31T04:44:45.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c0c7920 msgr2=0x7f935c14dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c0c7920 0x7f935c14dbd0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f934800d6e0 tx=0x7f934800dba0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 shutdown_connections 2024-08-31T04:44:45.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f933c0720f0 0x7f933c074600 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f935c0c7920 0x7f935c14dbd0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f935c15bc70 0x7f935c0c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 --2- 172.21.15.89:0/4032133582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f935c0c1f40 0x7f935c1f02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.494+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 >> 172.21.15.89:0/4032133582 conn(0x7f935c0ccf20 msgr2=0x7f935c14fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:45.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.498+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 shutdown_connections 2024-08-31T04:44:45.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.498+0000 7f9362a00640 1 -- 172.21.15.89:0/4032133582 wait complete. 2024-08-31T04:44:45.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-31T04:44:45.615 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-08-31T04:44:45.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.678+0000 7f6389800640 1 -- 172.21.15.89:0/311793456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c87a0 msgr2=0x7f63840c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.678+0000 7f6389800640 1 --2- 172.21.15.89:0/311793456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c87a0 0x7f63840c8bb0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f637c009840 tx=0x7f637c01c820 comp rx=0 tx=0).stop 2024-08-31T04:44:45.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.678+0000 7f6389800640 1 -- 172.21.15.89:0/311793456 shutdown_connections 2024-08-31T04:44:45.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.678+0000 7f6389800640 1 --2- 172.21.15.89:0/311793456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c87a0 0x7f63840c8bb0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.678+0000 7f6389800640 1 -- 172.21.15.89:0/311793456 >> 172.21.15.89:0/311793456 conn(0x7f63840cd1e0 msgr2=0x7f63840c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:45.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.678+0000 7f6389800640 1 -- 172.21.15.89:0/311793456 shutdown_connections 2024-08-31T04:44:45.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.678+0000 7f6389800640 1 -- 172.21.15.89:0/311793456 wait complete. 2024-08-31T04:44:45.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.678+0000 7f6389800640 1 Processor -- start 2024-08-31T04:44:45.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.678+0000 7f6389800640 1 -- start start 2024-08-31T04:44:45.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6389800640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c75e0 0x7f638414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:45.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6389800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840c87a0 0x7f63841f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:45.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6389800640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63841589e0 0x7f63840cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:45.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6389800640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6384166830 con 0x7f63840c75e0 2024-08-31T04:44:45.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6389800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f63840ca600 con 0x7f63840c87a0 2024-08-31T04:44:45.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6389800640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f63841669b0 con 0x7f63841589e0 2024-08-31T04:44:45.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c75e0 0x7f638414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:45.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383e00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c75e0 0x7f638414ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40624/0 (socket says 172.21.15.89:40624) 2024-08-31T04:44:45.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383e00640 1 -- 172.21.15.89:0/527316731 learned_addr learned my addr 172.21.15.89:0/527316731 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:45.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6388e00640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63841589e0 0x7f63840cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:45.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383400640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840c87a0 0x7f63841f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:45.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383e00640 1 -- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63841589e0 msgr2=0x7f63840cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383e00640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63841589e0 0x7f63840cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383e00640 1 -- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840c87a0 msgr2=0x7f63841f65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:45.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383e00640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840c87a0 0x7f63841f65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:45.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383e00640 1 -- 172.21.15.89:0/527316731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63841f6b10 con 0x7f63840c75e0 2024-08-31T04:44:45.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6383e00640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c75e0 0x7f638414ee60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f637400cbe0 tx=0x7f637400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:45.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f637be00640 1 -- 172.21.15.89:0/527316731 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374016020 con 0x7f63840c75e0 2024-08-31T04:44:45.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f637be00640 1 -- 172.21.15.89:0/527316731 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f637400aa50 con 0x7f63840c75e0 2024-08-31T04:44:45.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6384156370 con 0x7f63840c75e0 2024-08-31T04:44:45.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f637be00640 1 -- 172.21.15.89:0/527316731 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637400ce60 con 0x7f63840c75e0 2024-08-31T04:44:45.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6384157fd0 con 0x7f63840c75e0 2024-08-31T04:44:45.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.682+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63841f6210 con 0x7f63840c75e0 2024-08-31T04:44:45.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.686+0000 7f637be00640 1 -- 172.21.15.89:0/527316731 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f6374019020 con 0x7f63840c75e0 2024-08-31T04:44:45.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.686+0000 7f637be00640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f63640720c0 0x7f63640745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:45.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.686+0000 7f637be00640 1 -- 172.21.15.89:0/527316731 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6705+0+0 (secure 0 0 0) 0x7f6374093300 con 0x7f63840c75e0 2024-08-31T04:44:45.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.686+0000 7f6383400640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f63640720c0 0x7f63640745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:45.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.686+0000 7f6383400640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f63640720c0 0x7f63640745d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f63840cca40 tx=0x7f6370009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:45.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.690+0000 7f637be00640 1 -- 172.21.15.89:0/527316731 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6374020020 con 0x7f63840c75e0 2024-08-31T04:44:45.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:45.886+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f63840c8bb0 con 0x7f63840c75e0 2024-08-31T04:44:46.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.558+0000 7f637be00640 1 -- 172.21.15.89:0/527316731 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f637405e730 con 0x7f63840c75e0 2024-08-31T04:44:46.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f63640720c0 msgr2=0x7f63640745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:46.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f63640720c0 0x7f63640745d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f63840cca40 tx=0x7f6370009040 comp rx=0 tx=0).stop 2024-08-31T04:44:46.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c75e0 msgr2=0x7f638414ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:46.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c75e0 0x7f638414ee60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f637400cbe0 tx=0x7f637400cc10 comp rx=0 tx=0).stop 2024-08-31T04:44:46.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 shutdown_connections 2024-08-31T04:44:46.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f63640720c0 0x7f63640745d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:46.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63841589e0 0x7f63840cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:46.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840c87a0 0x7f63841f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:46.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 --2- 172.21.15.89:0/527316731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63840c75e0 0x7f638414ee60 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:46.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 >> 172.21.15.89:0/527316731 conn(0x7f63840cd1e0 msgr2=0x7f638414c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:46.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 shutdown_connections 2024-08-31T04:44:46.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.562+0000 7f6389800640 1 -- 172.21.15.89:0/527316731 wait complete. 2024-08-31T04:44:46.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-31T04:44:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.746+0000 7f3a8ca00640 1 -- 172.21.15.89:0/4192724001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c94a0 msgr2=0x7f3a881527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.746+0000 7f3a8ca00640 1 --2- 172.21.15.89:0/4192724001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c94a0 0x7f3a881527d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f3a88071930 tx=0x7f3a7401c8a0 comp rx=0 tx=0).stop 2024-08-31T04:44:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.746+0000 7f3a8ca00640 1 -- 172.21.15.89:0/4192724001 shutdown_connections 2024-08-31T04:44:46.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.746+0000 7f3a8ca00640 1 --2- 172.21.15.89:0/4192724001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c94a0 0x7f3a881527d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:46.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.746+0000 7f3a8ca00640 1 --2- 172.21.15.89:0/4192724001 >> v2:172.21.15.170:3300/0 conn(0x7f3a88074fb0 0x7f3a880c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:46.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.746+0000 7f3a8ca00640 1 -- 172.21.15.89:0/4192724001 >> 172.21.15.89:0/4192724001 conn(0x7f3a880ccf20 msgr2=0x7f3a880cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:46.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.746+0000 7f3a8ca00640 1 -- 172.21.15.89:0/4192724001 shutdown_connections 2024-08-31T04:44:46.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.746+0000 7f3a8ca00640 1 -- 172.21.15.89:0/4192724001 wait complete. 2024-08-31T04:44:46.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.746+0000 7f3a8ca00640 1 Processor -- start 2024-08-31T04:44:46.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 -- start start 2024-08-31T04:44:46.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a88074fb0 0x7f3a881f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:46.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c8560 0x7f3a881512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:46.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a880c94a0 0x7f3a881553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:46.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880c81b0 con 0x7f3a880c8560 2024-08-31T04:44:46.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880c8030 con 0x7f3a880c94a0 2024-08-31T04:44:46.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a881657a0 con 0x7f3a88074fb0 2024-08-31T04:44:46.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c8560 0x7f3a881512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:46.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c8560 0x7f3a881512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40634/0 (socket says 172.21.15.89:40634) 2024-08-31T04:44:46.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85400640 1 -- 172.21.15.89:0/1546598883 learned_addr learned my addr 172.21.15.89:0/1546598883 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:46.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85e00640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a88074fb0 0x7f3a881f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:46.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a86800640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a880c94a0 0x7f3a881553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:46.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85400640 1 -- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a88074fb0 msgr2=0x7f3a881f8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:46.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85400640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a88074fb0 0x7f3a881f8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:46.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85400640 1 -- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a880c94a0 msgr2=0x7f3a881553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:46.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85400640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a880c94a0 0x7f3a881553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:46.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85400640 1 -- 172.21.15.89:0/1546598883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a881f8980 con 0x7f3a880c8560 2024-08-31T04:44:46.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a85400640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c8560 0x7f3a881512b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009850 tx=0x7f3a74005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:46.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a7e000640 1 -- 172.21.15.89:0/1546598883 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a740b2040 con 0x7f3a880c8560 2024-08-31T04:44:46.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a7e000640 1 -- 172.21.15.89:0/1546598883 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f3a74004210 con 0x7f3a880c8560 2024-08-31T04:44:46.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a881f4f40 con 0x7f3a880c8560 2024-08-31T04:44:46.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a7e000640 1 -- 172.21.15.89:0/1546598883 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74003600 con 0x7f3a880c8560 2024-08-31T04:44:46.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a881f5500 con 0x7f3a880c8560 2024-08-31T04:44:46.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.750+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a880c3d80 con 0x7f3a880c8560 2024-08-31T04:44:46.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.754+0000 7f3a7e000640 1 -- 172.21.15.89:0/1546598883 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f3a740bf020 con 0x7f3a880c8560 2024-08-31T04:44:46.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.754+0000 7f3a7e000640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a680720c0 0x7f3a680745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:46.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.754+0000 7f3a7e000640 1 -- 172.21.15.89:0/1546598883 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6705+0+0 (secure 0 0 0) 0x7f3a7412cf30 con 0x7f3a880c8560 2024-08-31T04:44:46.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.754+0000 7f3a85e00640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a680720c0 0x7f3a680745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:46.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.754+0000 7f3a85e00640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a680720c0 0x7f3a680745d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a78005c50 tx=0x7f3a78005be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:46.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.758+0000 7f3a7e000640 1 -- 172.21.15.89:0/1546598883 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3a74016490 con 0x7f3a880c8560 2024-08-31T04:44:46.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:46.926+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3a88155fd0 con 0x7f3a880c8560 2024-08-31T04:44:47.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.574+0000 7f3a7e000640 1 -- 172.21.15.89:0/1546598883 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) ==== 181+0+0 (secure 0 0 0) 0x7f3a740f8490 con 0x7f3a880c8560 2024-08-31T04:44:47.578 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' removed 2024-08-31T04:44:47.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a680720c0 msgr2=0x7f3a680745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:47.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a680720c0 0x7f3a680745d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a78005c50 tx=0x7f3a78005be0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c8560 msgr2=0x7f3a881512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:47.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c8560 0x7f3a881512b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009850 tx=0x7f3a74005e70 comp rx=0 tx=0).stop 2024-08-31T04:44:47.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 shutdown_connections 2024-08-31T04:44:47.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f3a680720c0 0x7f3a680745d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a880c8560 0x7f3a881512b0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a880c94a0 0x7f3a881553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 --2- 172.21.15.89:0/1546598883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a88074fb0 0x7f3a881f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 >> 172.21.15.89:0/1546598883 conn(0x7f3a880ccf20 msgr2=0x7f3a8814f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:47.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.578+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 shutdown_connections 2024-08-31T04:44:47.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.582+0000 7f3a8ca00640 1 -- 172.21.15.89:0/1546598883 wait complete. 2024-08-31T04:44:47.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-31T04:44:47.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 -- 172.21.15.89:0/1062834809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 msgr2=0x7f89e40c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:47.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 --2- 172.21.15.89:0/1062834809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 0x7f89e40c3d80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f89e40c6b60 tx=0x7f89d801c8c0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 -- 172.21.15.89:0/1062834809 shutdown_connections 2024-08-31T04:44:47.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 --2- 172.21.15.89:0/1062834809 >> v2:172.21.15.170:3300/0 conn(0x7f89e40c8560 0x7f89e40c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 --2- 172.21.15.89:0/1062834809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 0x7f89e40c3d80 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 -- 172.21.15.89:0/1062834809 >> 172.21.15.89:0/1062834809 conn(0x7f89e40ccf20 msgr2=0x7f89e40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:47.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 -- 172.21.15.89:0/1062834809 shutdown_connections 2024-08-31T04:44:47.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 -- 172.21.15.89:0/1062834809 wait complete. 2024-08-31T04:44:47.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 Processor -- start 2024-08-31T04:44:47.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.782+0000 7f89ebe00640 1 -- start start 2024-08-31T04:44:47.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89ebe00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 0x7f89e40c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:47.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89ebe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89e40c8560 0x7f89e414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:47.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89ebe00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89e40c94a0 0x7f89e413d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:47.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89ebe00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4165b30 con 0x7f89e4074fb0 2024-08-31T04:44:47.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89ebe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41659b0 con 0x7f89e40c8560 2024-08-31T04:44:47.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89ebe00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89e4165cb0 con 0x7f89e40c94a0 2024-08-31T04:44:47.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 0x7f89e40c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:47.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9400640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 0x7f89e40c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40650/0 (socket says 172.21.15.89:40650) 2024-08-31T04:44:47.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9400640 1 -- 172.21.15.89:0/3345090625 learned_addr learned my addr 172.21.15.89:0/3345090625 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:47.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e8a00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89e40c8560 0x7f89e414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:47.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9e00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89e40c94a0 0x7f89e413d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:47.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9400640 1 -- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89e40c94a0 msgr2=0x7f89e413d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:47.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9400640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89e40c94a0 0x7f89e413d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9400640 1 -- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89e40c8560 msgr2=0x7f89e414f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:47.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9400640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89e40c8560 0x7f89e414f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:47.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9400640 1 -- 172.21.15.89:0/3345090625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e4157f40 con 0x7f89e4074fb0 2024-08-31T04:44:47.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e9400640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 0x7f89e40c51d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f89d801af70 tx=0x7f89d80a56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:47.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e1600640 1 -- 172.21.15.89:0/3345090625 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d80b2040 con 0x7f89e4074fb0 2024-08-31T04:44:47.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e1600640 1 -- 172.21.15.89:0/3345090625 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f89d80043d0 con 0x7f89e4074fb0 2024-08-31T04:44:47.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e4158220 con 0x7f89e4074fb0 2024-08-31T04:44:47.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89e1600640 1 -- 172.21.15.89:0/3345090625 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8005280 con 0x7f89e4074fb0 2024-08-31T04:44:47.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e4150330 con 0x7f89e4074fb0 2024-08-31T04:44:47.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.786+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e40c3d80 con 0x7f89e4074fb0 2024-08-31T04:44:47.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.790+0000 7f89e1600640 1 -- 172.21.15.89:0/3345090625 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f89d8005420 con 0x7f89e4074fb0 2024-08-31T04:44:47.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.790+0000 7f89e1600640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f89c40720c0 0x7f89c40745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:47.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.790+0000 7f89e1600640 1 -- 172.21.15.89:0/3345090625 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6267+0+0 (secure 0 0 0) 0x7f89d80bb070 con 0x7f89e4074fb0 2024-08-31T04:44:47.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.790+0000 7f89e8a00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f89c40720c0 0x7f89c40745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:47.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.790+0000 7f89e8a00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f89c40720c0 0x7f89c40745d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f89e4162ec0 tx=0x7f89d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:47.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.794+0000 7f89e1600640 1 -- 172.21.15.89:0/3345090625 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f89d80164b0 con 0x7f89e4074fb0 2024-08-31T04:44:47.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:47.962+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f89e4149370 con 0x7f89e4074fb0 2024-08-31T04:44:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.586+0000 7f89e1600640 1 -- 172.21.15.89:0/3345090625 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) ==== 169+0+0 (secure 0 0 0) 0x7f89d80f7750 con 0x7f89e4074fb0 2024-08-31T04:44:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' removed 2024-08-31T04:44:48.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.586+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f89c40720c0 msgr2=0x7f89c40745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:48.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.586+0000 7f89ebe00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f89c40720c0 0x7f89c40745d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f89e4162ec0 tx=0x7f89d0008040 comp rx=0 tx=0).stop 2024-08-31T04:44:48.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.586+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 msgr2=0x7f89e40c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:48.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.586+0000 7f89ebe00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 0x7f89e40c51d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f89d801af70 tx=0x7f89d80a56d0 comp rx=0 tx=0).stop 2024-08-31T04:44:48.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.590+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 shutdown_connections 2024-08-31T04:44:48.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.590+0000 7f89ebe00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f89c40720c0 0x7f89c40745d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:48.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.590+0000 7f89ebe00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89e40c94a0 0x7f89e413d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:48.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.590+0000 7f89ebe00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89e40c8560 0x7f89e414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:48.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.590+0000 7f89ebe00640 1 --2- 172.21.15.89:0/3345090625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4074fb0 0x7f89e40c51d0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:48.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.590+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 >> 172.21.15.89:0/3345090625 conn(0x7f89e40ccf20 msgr2=0x7f89e40c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:48.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.594+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 shutdown_connections 2024-08-31T04:44:48.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.594+0000 7f89ebe00640 1 -- 172.21.15.89:0/3345090625 wait complete. 2024-08-31T04:44:48.631 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-31T04:44:48.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.806+0000 7f031da00640 1 -- 172.21.15.89:0/810697219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02fc003a10 msgr2=0x7f02fc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:48.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.806+0000 7f031da00640 1 --2- 172.21.15.89:0/810697219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02fc003a10 0x7f02fc003e80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f030800c290 tx=0x7f030801cfa0 comp rx=0 tx=0).stop 2024-08-31T04:44:48.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.806+0000 7f0317400640 1 -- 172.21.15.89:0/810697219 reap_dead start 2024-08-31T04:44:48.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.806+0000 7f031da00640 1 -- 172.21.15.89:0/810697219 shutdown_connections 2024-08-31T04:44:48.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.806+0000 7f031da00640 1 -- 172.21.15.89:0/810697219 >> 172.21.15.89:0/810697219 conn(0x7f03180ccf20 msgr2=0x7f03180cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:48.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.806+0000 7f031da00640 1 -- 172.21.15.89:0/810697219 shutdown_connections 2024-08-31T04:44:48.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.806+0000 7f031da00640 1 -- 172.21.15.89:0/810697219 wait complete. 2024-08-31T04:44:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.806+0000 7f031da00640 1 Processor -- start 2024-08-31T04:44:48.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.806+0000 7f031da00640 1 -- start start 2024-08-31T04:44:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f031da00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02fc003a10 0x7f031814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f031da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03181512b0 0x7f031813d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f031da00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03181516c0 0x7f031813dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f031da00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0318163310 con 0x7f02fc003a10 2024-08-31T04:44:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f031da00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0318163190 con 0x7f03181512b0 2024-08-31T04:44:48.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f031da00640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0318163490 con 0x7f03181516c0 2024-08-31T04:44:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0316a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02fc003a10 0x7f031814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0316a00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02fc003a10 0x7f031814d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40670/0 (socket says 172.21.15.89:40670) 2024-08-31T04:44:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0316a00640 1 -- 172.21.15.89:0/1785590740 learned_addr learned my addr 172.21.15.89:0/1785590740 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-08-31T04:44:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0317400640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03181516c0 0x7f031813dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:48.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f030fe00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03181512b0 0x7f031813d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:48.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0316a00640 1 -- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03181516c0 msgr2=0x7f031813dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:48.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0316a00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03181516c0 0x7f031813dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:48.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0316a00640 1 -- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03181512b0 msgr2=0x7f031813d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:48.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0316a00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03181512b0 0x7f031813d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:48.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0316a00640 1 -- 172.21.15.89:0/1785590740 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031814d6f0 con 0x7f02fc003a10 2024-08-31T04:44:48.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f0316a00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02fc003a10 0x7f031814d1b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f030801ca60 tx=0x7f0308001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:48.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f030ea00640 1 -- 172.21.15.89:0/1785590740 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03080060c0 con 0x7f02fc003a10 2024-08-31T04:44:48.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f030ea00640 1 -- 172.21.15.89:0/1785590740 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f0308003710 con 0x7f02fc003a10 2024-08-31T04:44:48.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031813e280 con 0x7f02fc003a10 2024-08-31T04:44:48.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f030ea00640 1 -- 172.21.15.89:0/1785590740 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308003b60 con 0x7f02fc003a10 2024-08-31T04:44:48.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03181f7080 con 0x7f02fc003a10 2024-08-31T04:44:48.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.810+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031814cb10 con 0x7f02fc003a10 2024-08-31T04:44:48.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.814+0000 7f030ea00640 1 -- 172.21.15.89:0/1785590740 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 95944+0+0 (secure 0 0 0) 0x7f03080bf060 con 0x7f02fc003a10 2024-08-31T04:44:48.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.814+0000 7f030ea00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f02f4072260 0x7f02f4074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:44:48.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.814+0000 7f030ea00640 1 -- 172.21.15.89:0/1785590740 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5824+0+0 (secure 0 0 0) 0x7f030812d080 con 0x7f02fc003a10 2024-08-31T04:44:48.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.814+0000 7f030fe00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f02f4072260 0x7f02f4074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:44:48.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.814+0000 7f030fe00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f02f4072260 0x7f02f4074770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f031814c790 tx=0x7f03000091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:44:48.821 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.818+0000 7f030ea00640 1 -- 172.21.15.89:0/1785590740 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0308016d50 con 0x7f02fc003a10 2024-08-31T04:44:48.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:48.986+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f03180c3d80 con 0x7f02fc003a10 2024-08-31T04:44:49.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.594+0000 7f030ea00640 1 -- 172.21.15.89:0/1785590740 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v52) ==== 178+0+0 (secure 0 0 0) 0x7f03080f8910 con 0x7f02fc003a10 2024-08-31T04:44:49.597 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data_ec' removed 2024-08-31T04:44:49.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f02f4072260 msgr2=0x7f02f4074770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:49.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f02f4072260 0x7f02f4074770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f031814c790 tx=0x7f03000091e0 comp rx=0 tx=0).stop 2024-08-31T04:44:49.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02fc003a10 msgr2=0x7f031814d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:44:49.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02fc003a10 0x7f031814d1b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f030801ca60 tx=0x7f0308001cc0 comp rx=0 tx=0).stop 2024-08-31T04:44:49.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 shutdown_connections 2024-08-31T04:44:49.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:6800/2607723370,v1:172.21.15.170:6801/2607723370] conn(0x7f02f4072260 0x7f02f4074770 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:49.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03181516c0 0x7f031813dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:49.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03181512b0 0x7f031813d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:49.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 --2- 172.21.15.89:0/1785590740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02fc003a10 0x7f031814d1b0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:44:49.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 >> 172.21.15.89:0/1785590740 conn(0x7f03180ccf20 msgr2=0x7f03181527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:44:49.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 shutdown_connections 2024-08-31T04:44:49.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-08-31T04:44:49.598+0000 7f031da00640 1 -- 172.21.15.89:0/1785590740 wait complete. 2024-08-31T04:44:49.626 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-31T04:44:49.626 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-31T04:44:49.626 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:44:49.644 INFO:tasks.ceph.mds.a:Stopped 2024-08-31T04:44:49.644 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-31T04:44:49.644 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:44:49.709 INFO:tasks.ceph.mds.c:Stopped 2024-08-31T04:44:49.709 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-08-31T04:44:49.709 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:44:49.771 INFO:tasks.ceph.mds.e:Stopped 2024-08-31T04:44:49.772 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-31T04:44:49.772 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:44:49.791 INFO:tasks.ceph.mds.b:Stopped 2024-08-31T04:44:49.792 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-31T04:44:49.792 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:44:49.848 INFO:tasks.ceph.mds.d:Stopped 2024-08-31T04:44:49.848 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-08-31T04:44:49.849 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:44:49.905 INFO:tasks.ceph.mds.f:Stopped 2024-08-31T04:44:49.905 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-31T04:44:49.906 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-31T04:44:49.906 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:44:55.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:44:55.020 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:44:55.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-08-31T04:44:56.008 INFO:tasks.ceph.osd.0:Stopped 2024-08-31T04:44:56.008 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-31T04:44:56.008 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:01.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-08-31T04:45:01.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-08-31T04:45:02.109 INFO:tasks.ceph.osd.1:Stopped 2024-08-31T04:45:02.110 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-31T04:45:02.110 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:07.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-08-31T04:45:07.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-08-31T04:45:08.212 INFO:tasks.ceph.osd.2:Stopped 2024-08-31T04:45:08.212 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-31T04:45:08.212 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:13.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-08-31T04:45:13.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-08-31T04:45:14.314 INFO:tasks.ceph.osd.3:Stopped 2024-08-31T04:45:14.315 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-31T04:45:14.315 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:19.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-08-31T04:45:19.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-08-31T04:45:20.417 INFO:tasks.ceph.osd.4:Stopped 2024-08-31T04:45:20.418 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-31T04:45:20.418 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:24.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-08-31T04:45:24.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-08-31T04:45:25.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:45:25.076 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:45:26.520 INFO:tasks.ceph.osd.5:Stopped 2024-08-31T04:45:26.520 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-31T04:45:26.520 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:26.606 INFO:tasks.ceph.osd.6:Stopped 2024-08-31T04:45:26.607 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-31T04:45:26.607 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:26.707 INFO:tasks.ceph.osd.7:Stopped 2024-08-31T04:45:26.708 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-31T04:45:26.708 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-31T04:45:26.708 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:26.769 INFO:tasks.ceph.mgr.y:Stopped 2024-08-31T04:45:26.769 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-31T04:45:26.770 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:26.801 INFO:tasks.ceph.mgr.x:Stopped 2024-08-31T04:45:26.801 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-31T04:45:26.801 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-31T04:45:26.802 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:26.823 INFO:tasks.ceph.mon.a:Stopped 2024-08-31T04:45:26.824 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-31T04:45:26.824 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:26.861 INFO:tasks.ceph.mon.b:Stopped 2024-08-31T04:45:26.861 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-31T04:45:26.861 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T04:45:26.920 INFO:tasks.ceph.mon.c:Stopped 2024-08-31T04:45:26.920 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-31T04:45:26.920 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-08-31T04:45:26.972 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:45:26.972 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-31T04:45:27.279 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:45:27.279 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-31T04:45:27.532 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:45:27.533 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-31T04:45:27.764 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:45:27.765 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-31T04:45:28.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:45:28.029 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-31T04:45:28.369 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:45:28.369 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-31T04:45:28.631 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:45:28.632 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-31T04:45:28.798 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:45:28.798 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-31T04:45:28.956 INFO:tasks.ceph:Archiving mon data... 2024-08-31T04:45:28.958 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260/data/mon.a.tgz 2024-08-31T04:45:28.958 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-08-31T04:45:28.967 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.SQEdFrb25k 2024-08-31T04:45:28.968 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SQEdFrb25k 2024-08-31T04:45:29.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.SQEdFrb25k 2024-08-31T04:45:29.191 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.SQEdFrb25k is 417KB 2024-08-31T04:45:29.253 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.SQEdFrb25k 2024-08-31T04:45:29.261 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260/data/mon.b.tgz 2024-08-31T04:45:29.261 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-08-31T04:45:29.267 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.7bR7Gh1hpD 2024-08-31T04:45:29.268 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7bR7Gh1hpD 2024-08-31T04:45:29.410 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.7bR7Gh1hpD 2024-08-31T04:45:29.477 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.7bR7Gh1hpD is 434KB 2024-08-31T04:45:29.539 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.7bR7Gh1hpD 2024-08-31T04:45:29.545 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260/data/mon.c.tgz 2024-08-31T04:45:29.545 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-08-31T04:45:29.593 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.ziDbBCrZAG 2024-08-31T04:45:29.594 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ziDbBCrZAG 2024-08-31T04:45:29.746 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.ziDbBCrZAG 2024-08-31T04:45:29.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-08-31T04:45:29.809 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.ziDbBCrZAG is 433KB 2024-08-31T04:45:29.867 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.ziDbBCrZAG 2024-08-31T04:45:29.872 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-31T04:45:29.872 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-31T04:45:29.875 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-31T04:45:29.944 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-31T04:45:29.973 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-31T04:45:29.974 INFO:tasks.ceph:Archiving crash dumps... 2024-08-31T04:45:29.975 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260/remote/smithi089/crash 2024-08-31T04:45:29.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-31T04:45:30.007 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260/remote/smithi170/crash 2024-08-31T04:45:30.008 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-31T04:45:30.029 INFO:tasks.ceph:Shutting down logrotate 2024-08-31T04:45:30.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:45:30.053 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-31T04:45:30.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-31T04:45:30.141 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-31T04:45:30.153 INFO:tasks.ceph:Compressing logs... 2024-08-31T04:45:30.153 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T04:45:30.185 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T04:45:30.202 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42880.log 2024-08-31T04:45:30.203 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45876.log 2024-08-31T04:45:30.204 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35466.log 2024-08-31T04:45:30.204 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42880.log.gz 2024-08-31T04:45:30.205 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41582.log 2024-08-31T04:45:30.205 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45876.log.gz 2024-08-31T04:45:30.206 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37333.log 2024-08-31T04:45:30.206 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35466.log.gz 2024-08-31T04:45:30.207 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44688.log 2024-08-31T04:45:30.207 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41582.log.gz 2024-08-31T04:45:30.208 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44953.log 2024-08-31T04:45:30.208 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37333.log.gz 2024-08-31T04:45:30.208 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42543.log 2024-08-31T04:45:30.208 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44688.log.gz 2024-08-31T04:45:30.209 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44765.log 2024-08-31T04:45:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42543.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44953.log.gz 2024-08-31T04:45:30.210 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42063.log 2024-08-31T04:45:30.211 INFO:teuthology.orchestra.run.smithi089.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42543.log.gz 2024-08-31T04:45:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44792.log 2024-08-31T04:45:30.212 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44765.log.gz 2024-08-31T04:45:30.212 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45394.log 2024-08-31T04:45:30.212 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42063.log.gz 2024-08-31T04:45:30.213 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43805.log 2024-08-31T04:45:30.213 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44792.log.gz 2024-08-31T04:45:30.213 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45394.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-31T04:45:30.215 INFO:teuthology.orchestra.run.smithi089.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45394.log.gz 2024-08-31T04:45:30.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43748.log 2024-08-31T04:45:30.215 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43805.log.gz 2024-08-31T04:45:30.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42623.log 2024-08-31T04:45:30.216 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46283.log 2024-08-31T04:45:30.216 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43748.log.gz 2024-08-31T04:45:30.217 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41319.log 2024-08-31T04:45:30.218 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42623.log.gz 2024-08-31T04:45:30.218 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45795.log 2024-08-31T04:45:30.218 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46283.log.gz 2024-08-31T04:45:30.219 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36124.log 2024-08-31T04:45:30.219 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41319.log.gz 2024-08-31T04:45:30.219 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35334.log 2024-08-31T04:45:30.219 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45795.log.gz 2024-08-31T04:45:30.220 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42249.log 2024-08-31T04:45:30.220 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36124.log.gz 2024-08-31T04:45:30.221 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43285.log 2024-08-31T04:45:30.221 INFO:teuthology.orchestra.run.smithi089.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35334.log.gz 2024-08-31T04:45:30.222 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39739.log 2024-08-31T04:45:30.222 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42249.log.gz 2024-08-31T04:45:30.222 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29346.log 2024-08-31T04:45:30.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41666.log 2024-08-31T04:45:30.223 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43285.log.gz 2024-08-31T04:45:30.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40814.log 2024-08-31T04:45:30.224 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39739.log.gz 2024-08-31T04:45:30.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45030.log 2024-08-31T04:45:30.227 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41666.log.gz 2024-08-31T04:45:30.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40814.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-31T04:45:30.227 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40814.log.gz 2024-08-31T04:45:30.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36046.log 2024-08-31T04:45:30.228 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45030.log.gz 2024-08-31T04:45:30.228 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40984.log 2024-08-31T04:45:30.229 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29370.log 2024-08-31T04:45:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-31T04:45:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29346.log: /var/log/ceph/ceph-client.admin.29370.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-31T04:45:30.230 INFO:teuthology.orchestra.run.smithi170.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29370.log.gz 2024-08-31T04:45:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29449.log 2024-08-31T04:45:30.230 INFO:teuthology.orchestra.run.smithi170.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29346.log.gz 2024-08-31T04:45:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29394.log 2024-08-31T04:45:30.230 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29449.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-31T04:45:30.231 INFO:teuthology.orchestra.run.smithi170.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29449.log.gz 2024-08-31T04:45:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29425.log 2024-08-31T04:45:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.5.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29394.log.gz 2024-08-31T04:45:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-31T04:45:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-08-31T04:45:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29425.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29521.log 2024-08-31T04:45:30.231 INFO:teuthology.orchestra.run.smithi170.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29425.log.gz 2024-08-31T04:45:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-31T04:45:30.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29497.log 2024-08-31T04:45:30.232 INFO:teuthology.orchestra.run.smithi170.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29521.log.gz 2024-08-31T04:45:30.232 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5/var/log/ceph/ceph.log: --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-31T04:45:30.232 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29497.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-31T04:45:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28717.log 2024-08-31T04:45:30.235 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36046.log.gz 2024-08-31T04:45:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40984.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40984.log.gz 2024-08-31T04:45:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46647.log 2024-08-31T04:45:30.235 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40927.log 2024-08-31T04:45:30.235 INFO:teuthology.orchestra.run.smithi089.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.28717.log.gz 2024-08-31T04:45:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46647.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46647.log.gz 2024-08-31T04:45:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35198.log 2024-08-31T04:45:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36203.log 2024-08-31T04:45:30.236 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40927.log.gz 2024-08-31T04:45:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39524.log 87.6% 2024-08-31T04:45:30.236 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35198.log.gz 2024-08-31T04:45:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42276.log 2024-08-31T04:45:30.236 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36203.log.gz 2024-08-31T04:45:30.236 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46621.log 2024-08-31T04:45:30.237 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42276.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.39524.log.gz 2024-08-31T04:45:30.238 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44551.log 2024-08-31T04:45:30.238 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42276.log.gz 2024-08-31T04:45:30.238 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39687.log 95.2% 2024-08-31T04:45:30.239 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-31T04:45:30.239 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44551.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46621.log.gz 2024-08-31T04:45:30.239 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43066.log 2024-08-31T04:45:30.239 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44551.log.gz 2024-08-31T04:45:30.239 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42700.log 2024-08-31T04:45:30.240 INFO:teuthology.orchestra.run.smithi089.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.39687.log.gz 2024-08-31T04:45:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41822.log 2024-08-31T04:45:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42700.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43066.log.gz 2024-08-31T04:45:30.240 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36189.log 2024-08-31T04:45:30.241 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mon.c.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29497.log.gz 2024-08-31T04:45:30.241 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-31T04:45:30.241 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.audit.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-31T04:45:30.242 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-31T04:45:30.242 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.d.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-31T04:45:30.242 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-31T04:45:30.243 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42700.log.gz 2024-08-31T04:45:30.244 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36193.log 2024-08-31T04:45:30.244 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41822.log.gz 2024-08-31T04:45:30.244 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36150.log 2024-08-31T04:45:30.244 INFO:teuthology.orchestra.run.smithi089.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36189.log.gz 2024-08-31T04:45:30.244 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41979.log 2024-08-31T04:45:30.244 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36193.log.gz 2024-08-31T04:45:30.244 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45367.log 2024-08-31T04:45:30.245 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36150.log.gz 2024-08-31T04:45:30.246 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.b.log: 94.9% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-08-31T04:45:30.246 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29473.log 2024-08-31T04:45:30.247 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28919.log 2024-08-31T04:45:30.248 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41979.log.gz 2024-08-31T04:45:30.248 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42453.log 2024-08-31T04:45:30.248 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45367.log.gz 2024-08-31T04:45:30.248 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36020.log 2024-08-31T04:45:30.248 INFO:teuthology.orchestra.run.smithi089.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28919.log.gz 2024-08-31T04:45:30.248 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28822.log 2024-08-31T04:45:30.251 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mon.b.log: 94.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-31T04:45:30.251 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-31T04:45:30.251 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29473.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29473.log.gz 2024-08-31T04:45:30.253 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36020.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42453.log.gz 2024-08-31T04:45:30.253 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37399.log 2024-08-31T04:45:30.253 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36020.log.gz 2024-08-31T04:45:30.253 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35942.log 2024-08-31T04:45:30.253 INFO:teuthology.orchestra.run.smithi089.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.28822.log.gz 2024-08-31T04:45:30.253 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45802.log 2024-08-31T04:45:30.253 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37399.log.gz 2024-08-31T04:45:30.254 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40842.log 2024-08-31T04:45:30.254 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35942.log.gz 2024-08-31T04:45:30.254 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35172.log 2024-08-31T04:45:30.254 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40842.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45802.log.gz 2024-08-31T04:45:30.254 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36411.log 2024-08-31T04:45:30.254 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40842.log.gz 2024-08-31T04:45:30.256 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45599.log 2024-08-31T04:45:30.256 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35172.log.gz 2024-08-31T04:45:30.256 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36411.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-31T04:45:30.256 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36411.log.gz 2024-08-31T04:45:30.256 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45599.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45599.log.gz 2024-08-31T04:45:30.256 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40900.log 2024-08-31T04:45:30.256 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29385.log 2024-08-31T04:45:30.258 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39932.log 2024-08-31T04:45:30.258 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40900.log.gz 2024-08-31T04:45:30.258 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45003.log 2024-08-31T04:45:30.258 INFO:teuthology.orchestra.run.smithi089.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29385.log.gz 2024-08-31T04:45:30.259 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28937.log 2024-08-31T04:45:30.259 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39932.log.gz 2024-08-31T04:45:30.259 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37538.log 2024-08-31T04:45:30.260 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45003.log.gz 2024-08-31T04:45:30.260 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44421.log 2024-08-31T04:45:30.261 INFO:teuthology.orchestra.run.smithi089.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28937.log.gz 2024-08-31T04:45:30.261 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42195.log 2024-08-31T04:45:30.262 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37538.log.gz 2024-08-31T04:45:30.262 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45290.log 2024-08-31T04:45:30.263 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42195.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44421.log.gz 2024-08-31T04:45:30.263 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39660.log 2024-08-31T04:45:30.263 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42195.log.gz 2024-08-31T04:45:30.264 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35864.log 2024-08-31T04:45:30.265 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45290.log.gz 2024-08-31T04:45:30.265 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28772.log 2024-08-31T04:45:30.265 INFO:teuthology.orchestra.run.smithi089.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.39660.log.gz 2024-08-31T04:45:30.266 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35864.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.35864.log.gz 2024-08-31T04:45:30.266 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35388.log 2024-08-31T04:45:30.267 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28772.log.gz 2024-08-31T04:45:30.267 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35994.log 2024-08-31T04:45:30.268 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45945.log 2024-08-31T04:45:30.268 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35388.log.gz 2024-08-31T04:45:30.268 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35994.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-31T04:45:30.269 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35994.log.gz 2024-08-31T04:45:30.269 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41555.log 2024-08-31T04:45:30.270 INFO:teuthology.orchestra.run.smithi089.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45945.log.gz 2024-08-31T04:45:30.270 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42006.log 2024-08-31T04:45:30.271 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36199.log 2024-08-31T04:45:30.272 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41555.log.gz 2024-08-31T04:45:30.272 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45189.log 2024-08-31T04:45:30.273 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42006.log.gz 2024-08-31T04:45:30.273 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42376.log 2024-08-31T04:45:30.274 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36199.log.gz 2024-08-31T04:45:30.275 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45189.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45189.log.gz 2024-08-31T04:45:30.275 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43832.log 2024-08-31T04:45:30.275 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46595.log 2024-08-31T04:45:30.277 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43832.log: gzip -5 --verbose -- 90.8% /var/log/ceph/ceph-client.admin.37764.log -- replaced with /var/log/ceph/ceph-client.admin.42376.log.gz 2024-08-31T04:45:30.277 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-08-31T04:45:30.277 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43832.log.gz 2024-08-31T04:45:30.278 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29006.log 2024-08-31T04:45:30.278 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46595.log.gz 2024-08-31T04:45:30.279 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37764.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37764.log.gz 2024-08-31T04:45:30.279 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28803.log 2024-08-31T04:45:30.280 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46049.log 2024-08-31T04:45:30.280 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29006.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29006.log.gz 2024-08-31T04:45:30.281 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43937.log 2024-08-31T04:45:30.281 INFO:teuthology.orchestra.run.smithi089.stderr: 75.3% -- replaced with /var/log/ceph/ceph-client.admin.28803.log.gz 2024-08-31T04:45:30.282 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46049.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46049.log.gz 2024-08-31T04:45:30.282 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36196.log 2024-08-31T04:45:30.282 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41177.log 2024-08-31T04:45:30.284 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43937.log: /var/log/ceph/ceph-client.admin.36196.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.43937.log.gz 2024-08-31T04:45:30.284 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39766.log 2024-08-31T04:45:30.284 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36196.log.gz 2024-08-31T04:45:30.285 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35414.log 2024-08-31T04:45:30.285 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41177.log.gz 2024-08-31T04:45:30.286 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40646.log 2024-08-31T04:45:30.287 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35414.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39766.log.gz 2024-08-31T04:45:30.287 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2024-08-31T04:45:30.287 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35414.log.gz 2024-08-31T04:45:30.288 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37307.log 2024-08-31T04:45:30.288 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40646.log.gz 2024-08-31T04:45:30.289 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44926.log 2024-08-31T04:45:30.289 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37307.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2024-08-31T04:45:30.290 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37307.log.gz 2024-08-31T04:45:30.290 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40500.log 2024-08-31T04:45:30.291 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29007.log 2024-08-31T04:45:30.291 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44926.log: /var/log/ceph/ceph-client.admin.40500.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44926.log.gz 2024-08-31T04:45:30.292 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39851.log 2024-08-31T04:45:30.292 INFO:teuthology.orchestra.run.smithi089.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.40500.log.gz 2024-08-31T04:45:30.293 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34380.log 2024-08-31T04:45:30.293 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29007.log.gz 2024-08-31T04:45:30.294 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37045.log 2024-08-31T04:45:30.294 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.39851.log.gz 2024-08-31T04:45:30.295 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35086.log 2024-08-31T04:45:30.295 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34380.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34380.log.gz 2024-08-31T04:45:30.296 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28760.log 2024-08-31T04:45:30.296 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37045.log.gz 2024-08-31T04:45:30.297 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.35086.log: -- /var/log/ceph/ceph-client.admin.37364.log 2024-08-31T04:45:30.297 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28760.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.35086.log.gz 2024-08-31T04:45:30.297 INFO:teuthology.orchestra.run.smithi089.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.28760.log.gz 2024-08-31T04:45:30.298 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46179.log 2024-08-31T04:45:30.299 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45626.log 2024-08-31T04:45:30.299 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37364.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37364.log.gz 2024-08-31T04:45:30.300 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41346.log 2024-08-31T04:45:30.300 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46179.log.gz 2024-08-31T04:45:30.301 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43476.log 2024-08-31T04:45:30.301 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45626.log.gz 2024-08-31T04:45:30.302 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39824.log 2024-08-31T04:45:30.303 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35050.log 2024-08-31T04:45:30.303 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41346.log.gz 2024-08-31T04:45:30.304 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43476.log: /var/log/ceph/ceph-client.admin.39824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46699.log 2024-08-31T04:45:30.304 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43476.log.gz 2024-08-31T04:45:30.305 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39824.log.gz 2024-08-31T04:45:30.305 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35544.log 2024-08-31T04:45:30.305 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35050.log.gz 2024-08-31T04:45:30.306 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-31T04:45:30.306 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46699.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46699.log.gz 2024-08-31T04:45:30.307 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43910.log 2024-08-31T04:45:30.308 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35544.log.gz 2024-08-31T04:45:30.308 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36396.log 2024-08-31T04:45:30.309 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35492.log 2024-08-31T04:45:30.310 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43910.log.gz 2024-08-31T04:45:30.310 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46023.log 2024-08-31T04:45:30.311 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36396.log.gz 2024-08-31T04:45:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2024-08-31T04:45:30.312 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35492.log.gz 2024-08-31T04:45:30.312 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41011.log 2024-08-31T04:45:30.313 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46023.log.gz 2024-08-31T04:45:30.314 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44317.log 2024-08-31T04:45:30.314 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2024-08-31T04:45:30.315 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36622.log 2024-08-31T04:45:30.315 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41011.log.gz 2024-08-31T04:45:30.316 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42596.log 2024-08-31T04:45:30.316 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44317.log.gz 2024-08-31T04:45:30.317 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35308.log 2024-08-31T04:45:30.317 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36622.log.gz 2024-08-31T04:45:30.318 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36201.log 2024-08-31T04:45:30.318 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42596.log.gz 2024-08-31T04:45:30.319 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36408.log 2024-08-31T04:45:30.320 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-08-31T04:45:30.320 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36854.log 2024-08-31T04:45:30.321 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36201.log.gz 2024-08-31T04:45:30.321 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36594.log 2024-08-31T04:45:30.322 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36408.log.gz 2024-08-31T04:45:30.323 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42780.log 2024-08-31T04:45:30.323 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36854.log.gz 2024-08-31T04:45:30.323 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28747.log 2024-08-31T04:45:30.324 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36594.log.gz 2024-08-31T04:45:30.324 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46127.log 2024-08-31T04:45:30.326 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28747.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42780.log.gz 2024-08-31T04:45:30.326 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42958.log 2024-08-31T04:45:30.326 INFO:teuthology.orchestra.run.smithi089.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.28747.log.gz 2024-08-31T04:45:30.327 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41475.log 2024-08-31T04:45:30.327 INFO:teuthology.orchestra.run.smithi089.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46127.log.gz 2024-08-31T04:45:30.328 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45708.log 2024-08-31T04:45:30.328 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz 2024-08-31T04:45:30.329 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44344.log 2024-08-31T04:45:30.329 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41475.log.gz 2024-08-31T04:45:30.330 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41150.log 2024-08-31T04:45:30.333 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44344.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45708.log.gz 2024-08-31T04:45:30.333 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46153.log 2024-08-31T04:45:30.333 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41150.log: gzip 91.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.44344.log.gz --verbose 2024-08-31T04:45:30.333 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.36397.log 2024-08-31T04:45:30.333 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41150.log.gz 2024-08-31T04:45:30.334 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37451.log 2024-08-31T04:45:30.334 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46153.log.gz 2024-08-31T04:45:30.335 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36397.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-31T04:45:30.335 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36397.log.gz 2024-08-31T04:45:30.335 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36984.log 2024-08-31T04:45:30.336 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37451.log.gz 2024-08-31T04:45:30.337 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36615.log 2024-08-31T04:45:30.338 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36072.log 2024-08-31T04:45:30.339 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0%/var/log/ceph/ceph-client.admin.36615.log: -- replaced with /var/log/ceph/ceph-client.admin.36984.log.gz 2024-08-31T04:45:30.339 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28832.log 2024-08-31T04:45:30.339 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36615.log.gz 2024-08-31T04:45:30.340 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44095.log 2024-08-31T04:45:30.340 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36072.log.gz 2024-08-31T04:45:30.341 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36932.log 2024-08-31T04:45:30.344 INFO:teuthology.orchestra.run.smithi089.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28832.log.gz 2024-08-31T04:45:30.345 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36608.log 2024-08-31T04:45:30.345 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44095.log.gz/var/log/ceph/ceph-client.admin.36932.log: 2024-08-31T04:45:30.346 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36932.log.gz 2024-08-31T04:45:30.346 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36608.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36608.log.gz 2024-08-31T04:45:30.346 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28985.log 2024-08-31T04:45:30.346 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41795.log 2024-08-31T04:45:30.348 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46493.log 2024-08-31T04:45:30.348 INFO:teuthology.orchestra.run.smithi089.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28985.log.gz 2024-08-31T04:45:30.349 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41795.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41795.log.gz 2024-08-31T04:45:30.350 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46493.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46493.log.gz 2024-08-31T04:45:30.350 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43721.log 2024-08-31T04:45:30.351 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45216.log 2024-08-31T04:45:30.353 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42907.log 2024-08-31T04:45:30.353 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43721.log.gz 2024-08-31T04:45:30.354 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45216.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45216.log.gz 2024-08-31T04:45:30.355 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42907.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42907.log.gz 2024-08-31T04:45:30.356 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44847.log 2024-08-31T04:45:30.357 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37792.log 2024-08-31T04:45:30.358 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29332.log 2024-08-31T04:45:30.358 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44847.log.gz 2024-08-31T04:45:30.359 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44018.log 2024-08-31T04:45:30.361 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29332.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.37792.log.gz 2024-08-31T04:45:30.361 INFO:teuthology.orchestra.run.smithi089.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29332.log.gz 2024-08-31T04:45:30.361 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36098.log 2024-08-31T04:45:30.362 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36618.log 2024-08-31T04:45:30.362 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44018.log.gz 2024-08-31T04:45:30.363 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46101.log 2024-08-31T04:45:30.363 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36098.log.gz 2024-08-31T04:45:30.364 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36618.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36618.log.gz 2024-08-31T04:45:30.365 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46231.log 2024-08-31T04:45:30.365 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46101.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46101.log.gz 2024-08-31T04:45:30.366 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40569.log 2024-08-31T04:45:30.367 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46205.log 2024-08-31T04:45:30.367 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46231.log.gz 2024-08-31T04:45:30.368 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41254.log 2024-08-31T04:45:30.369 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40569.log.gz 2024-08-31T04:45:30.370 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2024-08-31T04:45:30.370 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46205.log.gz 2024-08-31T04:45:30.370 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36610.log 2024-08-31T04:45:30.371 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41254.log.gz 2024-08-31T04:45:30.372 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43312.log 2024-08-31T04:45:30.372 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2024-08-31T04:45:30.373 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41903.log 2024-08-31T04:45:30.373 INFO:teuthology.orchestra.run.smithi089.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36610.log.gz 2024-08-31T04:45:30.374 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40596.log 2024-08-31T04:45:30.375 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41903.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43312.log.gz 2024-08-31T04:45:30.376 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43559.log 2024-08-31T04:45:30.376 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41903.log.gz 2024-08-31T04:45:30.377 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40596.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-31T04:45:30.377 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43559.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.40596.log.gz 2024-08-31T04:45:30.378 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43396.log 2024-08-31T04:45:30.378 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43559.log.gz 2024-08-31T04:45:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.43396.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43396.log.gz 2024-08-31T04:45:30.382 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44874.log 2024-08-31T04:45:30.383 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41396.log 2024-08-31T04:45:30.385 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44874.log: 91.0%/var/log/ceph/ceph-client.admin.41396.log: -- replaced with /var/log/ceph/ceph-client.admin.44874.log.gz 2024-08-31T04:45:30.385 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-31T04:45:30.385 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35838.log 2024-08-31T04:45:30.385 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41396.log.gz 2024-08-31T04:45:30.386 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46413.log 2024-08-31T04:45:30.387 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41502.log 2024-08-31T04:45:30.388 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35838.log.gz 2024-08-31T04:45:30.389 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42090.log 2024-08-31T04:45:30.389 INFO:teuthology.orchestra.run.smithi089.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46413.log.gz 2024-08-31T04:45:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41502.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41502.log.gz 2024-08-31T04:45:30.390 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43449.log 2024-08-31T04:45:30.392 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45919.log 2024-08-31T04:45:30.392 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42090.log.gz 2024-08-31T04:45:30.393 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36204.log 2024-08-31T04:45:30.393 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43449.log.gz 2024-08-31T04:45:30.394 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45919.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45919.log.gz 2024-08-31T04:45:30.395 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37229.log 2024-08-31T04:45:30.395 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36204.log.gz 2024-08-31T04:45:30.396 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46517.log 2024-08-31T04:45:30.397 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36958.log 2024-08-31T04:45:30.397 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37229.log.gz 2024-08-31T04:45:30.398 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46517.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46517.log.gz 2024-08-31T04:45:30.399 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44175.log 2024-08-31T04:45:30.400 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36958.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36958.log.gz 2024-08-31T04:45:30.400 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28989.log 2024-08-31T04:45:30.402 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46673.log 2024-08-31T04:45:30.402 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44175.log.gz 2024-08-31T04:45:30.402 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28989.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28989.log.gz 2024-08-31T04:45:30.403 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45455.log 2024-08-31T04:45:30.404 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46673.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46673.log.gz 2024-08-31T04:45:30.404 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45997.log 2024-08-31T04:45:30.406 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36403.log 2024-08-31T04:45:30.406 INFO:teuthology.orchestra.run.smithi089.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45455.log.gz 2024-08-31T04:45:30.406 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45997.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45997.log.gz 2024-08-31T04:45:30.407 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36403.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36403.log.gz 2024-08-31T04:45:30.408 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36617.log 2024-08-31T04:45:30.409 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35890.log 2024-08-31T04:45:30.410 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45080.log 2024-08-31T04:45:30.411 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36617.log.gz 2024-08-31T04:45:30.412 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35722.log 2024-08-31T04:45:30.412 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35890.log.gz 2024-08-31T04:45:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45080.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45080.log.gz 2024-08-31T04:45:30.413 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42426.log 2024-08-31T04:45:30.414 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36409.log 2024-08-31T04:45:30.415 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42426.log: 87.4% 92.2% -- replaced with /var/log/ceph/ceph-client.admin.35722.log.gz 2024-08-31T04:45:30.416 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42426.log.gz 2024-08-31T04:45:30.416 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43039.log 2024-08-31T04:45:30.417 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36409.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36409.log.gz 2024-08-31T04:45:30.417 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37615.log 2024-08-31T04:45:30.418 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39610.log 2024-08-31T04:45:30.418 INFO:teuthology.orchestra.run.smithi089.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43039.log.gz 2024-08-31T04:45:30.420 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37615.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37615.log.gz 2024-08-31T04:45:30.421 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39610.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.39610.log.gz 2024-08-31T04:45:30.421 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41745.log 2024-08-31T04:45:30.422 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35594.log 2024-08-31T04:45:30.424 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37281.log 2024-08-31T04:45:30.425 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41745.log.gz 2024-08-31T04:45:30.425 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35594.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35594.log.gz 2024-08-31T04:45:30.426 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37281.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37281.log.gz 2024-08-31T04:45:30.426 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2024-08-31T04:45:30.428 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45971.log 2024-08-31T04:45:30.429 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46075.log 2024-08-31T04:45:30.429 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz 2024-08-31T04:45:30.430 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45971.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45971.log.gz 2024-08-31T04:45:30.431 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46075.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46075.log.gz 2024-08-31T04:45:30.432 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46439.log 2024-08-31T04:45:30.433 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28945.log 2024-08-31T04:45:30.434 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37642.log 2024-08-31T04:45:30.434 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46439.log.gz 2024-08-31T04:45:30.435 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28945.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28945.log.gz 2024-08-31T04:45:30.436 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37642.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.37642.log.gz 2024-08-31T04:45:30.437 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46361.log 2024-08-31T04:45:30.438 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46465.log 2024-08-31T04:45:30.440 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37179.log 2024-08-31T04:45:30.440 INFO:teuthology.orchestra.run.smithi089.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.46361.log.gz 2024-08-31T04:45:30.440 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46465.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46465.log.gz 2024-08-31T04:45:30.441 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.0.37179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37179.log.gz 2024-08-31T04:45:30.442 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46569.log 2024-08-31T04:45:30.443 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-31T04:45:30.444 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39495.log 2024-08-31T04:45:30.444 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46569.log.gz 2024-08-31T04:45:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.39495.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39495.log.gz 2024-08-31T04:45:30.447 INFO:teuthology.orchestra.run.smithi089.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-31T04:45:30.447 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46257.log 2024-08-31T04:45:30.448 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-31T04:45:30.450 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36906.log 2024-08-31T04:45:30.450 INFO:teuthology.orchestra.run.smithi089.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46257.log.gz 2024-08-31T04:45:30.451 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.36906.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36906.log.gz 2024-08-31T04:45:30.452 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36802.log 2024-08-31T04:45:30.453 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-31T04:45:30.455 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36802.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36802.log.gz 2024-08-31T04:45:30.459 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37478.log 2024-08-31T04:45:30.462 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43116.log 2024-08-31T04:45:30.462 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40755.log 2024-08-31T04:45:30.463 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37478.log.gz 2024-08-31T04:45:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43116.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43116.log.gz 2024-08-31T04:45:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46335.log 2024-08-31T04:45:30.465 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40755.log: 94.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-31T04:45:30.465 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40755.log.gz 2024-08-31T04:45:30.467 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35518.log 2024-08-31T04:45:30.470 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23894.log 2024-08-31T04:45:30.470 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28816.log 2024-08-31T04:45:30.470 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35518.log.gz 2024-08-31T04:45:30.470 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35362.log 2024-08-31T04:45:30.473 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46335.log.gz 2024-08-31T04:45:30.473 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28816.log: /var/log/ceph/ceph.tmp-client.admin.23894.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23894.log.gz 2024-08-31T04:45:30.473 INFO:teuthology.orchestra.run.smithi089.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.28816.log.gz 2024-08-31T04:45:30.473 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45107.log 2024-08-31T04:45:30.474 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35362.log: 94.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-31T04:45:30.475 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28998.log 2024-08-31T04:45:30.475 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35362.log.gz 2024-08-31T04:45:30.476 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45107.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45107.log.gz 2024-08-31T04:45:30.477 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28998.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28998.log.gz 2024-08-31T04:45:30.478 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-08-31T04:45:30.479 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41876.log 2024-08-31T04:45:30.480 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37565.log 2024-08-31T04:45:30.481 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz/var/log/ceph/ceph-client.admin.41876.log: 2024-08-31T04:45:30.481 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41876.log.gz 2024-08-31T04:45:30.483 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37565.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37565.log.gz 2024-08-31T04:45:30.483 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35808.log 2024-08-31T04:45:30.484 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46725.log 2024-08-31T04:45:30.486 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28784.log 2024-08-31T04:45:30.486 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35808.log.gz 2024-08-31T04:45:30.486 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35224.log 2024-08-31T04:45:30.487 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46725.log.gz 2024-08-31T04:45:30.488 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28784.log.gz 2024-08-31T04:45:30.488 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28981.log 2024-08-31T04:45:30.489 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35224.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35224.log.gz 2024-08-31T04:45:30.489 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36185.log 2024-08-31T04:45:30.490 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40473.log 2024-08-31T04:45:30.490 INFO:teuthology.orchestra.run.smithi089.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28981.log.gz 2024-08-31T04:45:30.492 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36185.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36185.log.gz 2024-08-31T04:45:30.493 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40473.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40473.log.gz 2024-08-31T04:45:30.493 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42168.log 2024-08-31T04:45:30.494 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2024-08-31T04:45:30.496 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44148.log 2024-08-31T04:45:30.496 INFO:teuthology.orchestra.run.smithi089.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42168.log.gz 2024-08-31T04:45:30.497 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43369.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2024-08-31T04:45:30.498 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44148.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44148.log.gz 2024-08-31T04:45:30.498 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35282.log 2024-08-31T04:45:30.500 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36880.log 2024-08-31T04:45:30.501 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42985.log 2024-08-31T04:45:30.501 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35282.log.gz 2024-08-31T04:45:30.502 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43586.log 2024-08-31T04:45:30.502 INFO:teuthology.orchestra.run.smithi089.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36880.log.gz 2024-08-31T04:45:30.504 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42985.log: /var/log/ceph/ceph-client.admin.43586.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42985.log.gz 2024-08-31T04:45:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37255.log 2024-08-31T04:45:30.505 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43586.log.gz 2024-08-31T04:45:30.505 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35916.log 2024-08-31T04:45:30.506 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42753.log 2024-08-31T04:45:30.507 INFO:teuthology.orchestra.run.smithi089.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37255.log.gz 2024-08-31T04:45:30.508 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35916.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35916.log.gz 2024-08-31T04:45:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42753.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42753.log.gz 2024-08-31T04:45:30.509 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2024-08-31T04:45:30.511 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43235.log 2024-08-31T04:45:30.512 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43208.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2024-08-31T04:45:30.513 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43235.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43235.log.gz 2024-08-31T04:45:30.514 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2024-08-31T04:45:30.515 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46309.log 2024-08-31T04:45:30.517 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40673.log 2024-08-31T04:45:30.517 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2024-08-31T04:45:30.517 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46309.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46309.log.gz 2024-08-31T04:45:30.519 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35254.log 2024-08-31T04:45:30.519 INFO:teuthology.orchestra.run.smithi089.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40673.log.gz 2024-08-31T04:45:30.520 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35781.log 2024-08-31T04:45:30.522 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29004.log 2024-08-31T04:45:30.522 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35254.log.gz 2024-08-31T04:45:30.522 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2024-08-31T04:45:30.523 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35781.log.gz 2024-08-31T04:45:30.524 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29004.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29004.log.gz 2024-08-31T04:45:30.524 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37161.log 2024-08-31T04:45:30.525 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29008.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2024-08-31T04:45:30.525 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2024-08-31T04:45:30.527 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.0.37161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36394.log 2024-08-31T04:45:30.527 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37161.log.gz 2024-08-31T04:45:30.529 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45317.log: 91.0%/var/log/ceph/ceph-client.admin.36394.log: -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2024-08-31T04:45:30.529 INFO:teuthology.orchestra.run.smithi089.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36394.log.gz 2024-08-31T04:45:30.529 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45483.log 2024-08-31T04:45:30.531 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44500.log 2024-08-31T04:45:30.533 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42516.log 2024-08-31T04:45:30.533 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45483.log.gz 2024-08-31T04:45:30.534 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44500.log: 90.9%/var/log/ceph/ceph-client.admin.42516.log: -- replaced with /var/log/ceph/ceph-client.admin.44500.log.gz 2024-08-31T04:45:30.535 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42516.log.gz 2024-08-31T04:45:30.535 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29473.log 2024-08-31T04:45:30.536 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40728.log 2024-08-31T04:45:30.538 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39583.log 2024-08-31T04:45:30.538 INFO:teuthology.orchestra.run.smithi089.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29473.log.gz 2024-08-31T04:45:30.539 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41071.log 2024-08-31T04:45:30.539 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40728.log.gz 2024-08-31T04:45:30.540 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39583.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.39583.log.gz 2024-08-31T04:45:30.540 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41423.log 2024-08-31T04:45:30.541 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41071.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41071.log.gz 2024-08-31T04:45:30.541 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46543.log 2024-08-31T04:45:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35440.log 2024-08-31T04:45:30.543 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46543.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41423.log.gz 2024-08-31T04:45:30.544 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46543.log.gz 2024-08-31T04:45:30.545 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35440.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35440.log.gz 2024-08-31T04:45:30.545 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35968.log 2024-08-31T04:45:30.547 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43991.log 2024-08-31T04:45:30.548 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35968.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35968.log.gz 2024-08-31T04:45:30.550 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29005.log 2024-08-31T04:45:30.550 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43991.log.gz 2024-08-31T04:45:30.550 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41227.log 2024-08-31T04:45:30.551 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41100.log 2024-08-31T04:45:30.552 INFO:teuthology.orchestra.run.smithi089.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29005.log.gz 2024-08-31T04:45:30.552 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41227.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41227.log.gz 2024-08-31T04:45:30.553 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44068.log 2024-08-31T04:45:30.554 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44715.log 2024-08-31T04:45:30.554 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41100.log.gz 2024-08-31T04:45:30.555 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36414.log 2024-08-31T04:45:30.555 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44068.log.gz 2024-08-31T04:45:30.557 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44715.log: /var/log/ceph/ceph-client.admin.36414.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44715.log.gz 2024-08-31T04:45:30.557 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28999.log 2024-08-31T04:45:30.558 INFO:teuthology.orchestra.run.smithi089.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36414.log.gz 2024-08-31T04:45:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-08-31T04:45:30.561 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2024-08-31T04:45:30.562 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.28999.log.gz 2024-08-31T04:45:30.562 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.36828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41639.log 2024-08-31T04:45:30.563 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2024-08-31T04:45:30.563 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28960.log 2024-08-31T04:45:30.565 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41639.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41639.log.gz 2024-08-31T04:45:30.565 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45771.log 2024-08-31T04:45:30.566 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28960.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28960.log.gz 2024-08-31T04:45:30.567 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44578.log 2024-08-31T04:45:30.569 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45771.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45771.log.gz 2024-08-31T04:45:30.569 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-08-31T04:45:30.570 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.44578.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44578.log.gz 2024-08-31T04:45:30.571 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36611.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2024-08-31T04:45:30.572 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43663.log 2024-08-31T04:45:30.573 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42349.log 2024-08-31T04:45:30.575 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2024-08-31T04:45:30.575 INFO:teuthology.orchestra.run.smithi089.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43663.log.gz 2024-08-31T04:45:30.576 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42349.log: 94.9% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-08-31T04:45:30.576 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose 87.3% -- /var/log/ceph/ceph-client.admin.41718.log -- replaced with /var/log/ceph/ceph-client.admin.42349.log.gz 2024-08-31T04:45:30.576 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-08-31T04:45:30.578 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39905.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2024-08-31T04:45:30.578 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.41718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42673.log 2024-08-31T04:45:30.579 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41718.log.gz 2024-08-31T04:45:30.579 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46387.log 2024-08-31T04:45:30.580 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42673.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42673.log.gz 2024-08-31T04:45:30.582 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46387.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46387.log.gz 2024-08-31T04:45:30.625 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.4.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-31T04:45:30.838 INFO:teuthology.orchestra.run.smithi170.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-31T04:45:30.875 INFO:teuthology.orchestra.run.smithi170.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-31T04:45:31.606 INFO:teuthology.orchestra.run.smithi089.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-31T04:45:49.737 INFO:teuthology.orchestra.run.smithi170.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-31T04:45:52.659 INFO:teuthology.orchestra.run.smithi089.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-31T04:45:54.369 INFO:teuthology.orchestra.run.smithi089.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-31T04:45:56.110 INFO:teuthology.orchestra.run.smithi170.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-31T04:45:56.447 INFO:teuthology.orchestra.run.smithi170.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-31T04:45:57.445 INFO:teuthology.orchestra.run.smithi089.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-31T04:46:01.926 INFO:teuthology.orchestra.run.smithi170.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-31T04:46:02.020 INFO:teuthology.orchestra.run.smithi089.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-31T04:46:02.022 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-08-31T04:46:02.022 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m31.833s 2024-08-31T04:46:02.022 INFO:teuthology.orchestra.run.smithi089.stderr:user 1m38.250s 2024-08-31T04:46:02.023 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m8.480s 2024-08-31T04:46:03.384 INFO:teuthology.orchestra.run.smithi170.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-31T04:46:03.385 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-08-31T04:46:03.386 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m33.186s 2024-08-31T04:46:03.386 INFO:teuthology.orchestra.run.smithi170.stderr:user 2m13.623s 2024-08-31T04:46:03.386 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m4.301s 2024-08-31T04:46:03.387 INFO:tasks.ceph:Archiving logs... 2024-08-31T04:46:03.387 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260/remote/smithi089/log 2024-08-31T04:46:03.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T04:46:17.786 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260/remote/smithi170/log 2024-08-31T04:46:17.787 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T04:46:56.136 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-31T04:46:56.147 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-31T04:46:56.148 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T04:46:56.151 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T04:46:56.218 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-31T04:46:56.227 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-31T04:46:56.227 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:46:56.230 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:46:56.242 INFO:teuthology.orchestra.run.smithi170.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T04:46:56.242 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================== 2024-08-31T04:46:56.242 INFO:teuthology.orchestra.run.smithi170.stdout:*hv01.front.sepi 67.205.162.81 3 u 57 64 377 0.085 -3.193 0.758 2024-08-31T04:46:56.242 INFO:teuthology.orchestra.run.smithi170.stdout:+hv02.front.sepi 96.245.170.99 3 u 1 64 377 0.099 -2.660 0.537 2024-08-31T04:46:56.242 INFO:teuthology.orchestra.run.smithi170.stdout:+hv03.front.sepi 74.6.168.72 3 u 67 64 377 0.081 -1.661 0.538 2024-08-31T04:46:56.242 INFO:teuthology.orchestra.run.smithi170.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-08-31T04:46:56.243 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T04:46:56.243 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2024-08-31T04:46:56.243 INFO:teuthology.orchestra.run.smithi089.stdout:+hv01.front.sepi 67.205.162.81 3 u 49 64 377 0.071 -2.847 0.319 2024-08-31T04:46:56.243 INFO:teuthology.orchestra.run.smithi089.stdout:*hv02.front.sepi 96.245.170.99 3 u 49 64 377 0.098 -2.929 0.360 2024-08-31T04:46:56.244 INFO:teuthology.orchestra.run.smithi089.stdout:+hv03.front.sepi 74.6.168.72 3 u 56 64 377 0.111 -2.171 0.380 2024-08-31T04:46:56.244 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-08-31T04:46:56.245 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-31T04:46:56.254 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-31T04:46:56.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-31T04:46:56.266 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-31T04:46:56.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-31T04:46:56.287 INFO:teuthology.task.internal:Duration was 3297.968175 seconds 2024-08-31T04:46:56.288 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-31T04:46:56.298 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-31T04:46:56.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T04:46:56.301 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T04:46:56.413 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-31T04:46:56.413 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-08-31T04:46:56.413 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T04:46:56.434 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-08-31T04:46:56.435 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T04:46:56.445 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-31T04:46:56.445 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T04:46:56.486 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T04:46:56.534 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-31T04:46:56.534 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T04:46:56.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T04:46:56.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-31T04:46:56.694 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-31T04:46:56.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T04:46:56.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T04:46:56.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-31T04:46:56.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:46:56.762 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:46:56.776 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-08-31T04:46:56.783 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-08-31T04:46:56.806 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:46:56.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:46:56.841 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:46:56.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:46:56.853 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-31T04:46:56.862 INFO:teuthology.task.internal:Transferring archived files... 2024-08-31T04:46:56.863 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260/remote/smithi089 2024-08-31T04:46:56.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T04:46:56.910 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881260/remote/smithi170 2024-08-31T04:46:56.910 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T04:46:56.931 INFO:teuthology.task.internal:Removing archive directory... 2024-08-31T04:46:56.931 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T04:46:56.949 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T04:46:56.977 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-31T04:46:56.989 INFO:teuthology.task.internal:Not uploading archives. 2024-08-31T04:46:56.989 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-31T04:46:57.000 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-31T04:46:57.000 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T04:46:57.003 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T04:46:57.008 INFO:teuthology.orchestra.run.smithi089.stdout: 658134 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 04:46 /home/ubuntu/cephtest 2024-08-31T04:46:57.025 INFO:teuthology.orchestra.run.smithi170.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 04:46 /home/ubuntu/cephtest 2024-08-31T04:46:57.027 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-31T04:46:57.037 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-31T04:46:57.063 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} duration: 3297.9681754112244 failure_reason: 'Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi089 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh''' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8e5bbcbbce664084ac03fac8486600fd status: fail success: false 2024-08-31T04:46:57.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T04:46:57.150 INFO:teuthology.run:FAIL